Content presentation method and system, electronic equipment and computer program product

Abstract

The invention belongs to the technical field of computers, and aims to provide a content presentation method and system, electronic equipment and a computer program product. According to the method, the user is positioned, and high-quality rendering is only carried out on the specified image picture information of the user view area, so that the requirement on high-performance graphic processing hardware can be remarkably reduced, the performance bottleneck in processing high-resolution full-screen rendering in the prior art is effectively dealt with, and the user experience is improved. Unnecessary image processing and energy consumption are greatly reduced, so that the overall energy consumption is reduced; meanwhile, partition rendering is carried out on the specified image picture information, so that the response speed can be reduced, the phenomena of picture jamming, delay and the like can be effectively avoided, and the watching experience of a user is improved.

Description

Technical Field

[0001] This invention belongs to the field of computer technology, specifically relating to a content presentation method, system, electronic device, and computer program product. Background Technology

[0002] With the development of film and television technology and immersive experience technology, especially in the field of 360-degree immersive experience cabins, the demand for more efficient and better experiences is constantly growing. However, in using existing technologies, the inventors have discovered that existing technologies have at least the following problems in immersive high-resolution display environments:

[0003] In existing technologies, real-time rendering of full-frame high-resolution images on giant screens is commonly used for image display. This requires extremely high computing power and energy consumption. Furthermore, to improve image quality and smoothness, multiple display hardware components are typically used in combination, resulting in significant cost and energy consumption, which will seriously affect industry development. In addition, because more computing power is needed to coordinate system operation, and high network bandwidth resources are required when transmitting high-resolution images, the load on distribution servers is increased. This leads to image stuttering and latency when displaying images using full-frame high-resolution images, severely impacting the user's viewing experience. Summary of the Invention

[0004] The present invention aims to at least partially solve the above-mentioned technical problems, and provides a content presentation method, system, electronic device and computer program product.

[0005] To achieve the above objectives, the present invention adopts the following technical solution:

[0006] In a first aspect, the present invention provides a content presentation method, comprising:

[0007] The real-time location information of a specified part of the user's head is collected;

[0008] Spatial calculations are performed based on the real-time position information of the specified part of the user's head and the specified screen position information to obtain the screen's visible area information;

[0009] Receive specified image information, and perform real-time image segmentation on the specified image information according to the screen visible area information to obtain first image information corresponding to the screen visible area information and second image information other than the first image information in the specified image information.

[0010] The first image information is rendered in high quality to obtain the first rendered image information, and the second image information is rendered in low quality to obtain the second rendered image information.

[0011] The first rendered image information and the second rendered image information are combined to obtain the rendered image information.

[0012] The rendered image information is displayed on a designated screen that matches the designated screen position information.

[0013] This invention reduces the energy consumption of image rendering while enhancing the user experience in the immersive experience cabin. Specifically, in the implementation process, this invention collects real-time position information of a specified part of the user's head, and performs spatial calculations based on the real-time position information of the specified part of the user's head and the specified screen position information to obtain the screen's visible area information; then, it receives specified image information, and performs real-time image segmentation on the specified image information based on the screen's visible area information to obtain a first image information corresponding to the screen's visible area information and a second image information other than the first image information in the specified image information; then, it performs high-quality rendering on the first image information to obtain a first rendered image information, and performs low-quality rendering on the first image information to obtain a second rendered image information; the first and second rendered image information are then combined to obtain the rendered image information; finally, the rendered image information is displayed on a specified screen that matches the specified screen position information. In this process, the present invention locates the user and renders high-quality image information only in the specified area of ​​the user's field of view. This significantly reduces the need for high-performance graphics processing hardware, effectively addresses the performance bottleneck of existing technologies when processing high-resolution full-screen rendering, greatly reduces unnecessary image processing and energy consumption, and thus lowers overall energy consumption. At the same time, because the specified image information is rendered in partitions, the response speed can be reduced, which can effectively avoid screen stuttering and delay, and improve the user's viewing experience.

[0014] In one possible design, after acquiring the real-time location information of a specified part of the user's head, the method further includes:

[0015] The user's ear position information is obtained based on the real-time position information of the specified part of the user's head;

[0016] Based on the user's ear position information and the position information of multiple audio playback devices corresponding to the designated screen, the volume of multiple audio playback devices that match the position information of the multiple audio playback devices is adjusted.

[0017] The specified audio information is received and sent to multiple audio playback devices so that the multiple audio playback devices can play the specified audio information at an adjusted volume.

[0018] In one possible design, the specified audio information can be set in multiple ways so that multiple audio playback devices can play different types of specified audio information.

[0019] In one possible design, the designated area on the user's head consists of four points positioned around the user's eyes. These four points are coplanar, and no three of them are collinear. Correspondingly, spatial calculations are performed based on the real-time position information of the designated area on the user's head and the designated screen position information to obtain the screen's visible area information, including:

[0020] Based on the real-time position information of the specified part of the user's head, the position information of the plane where the four points are located is obtained;

[0021] Based on the position information of the four points on the plane, the position information of the center point of the user's head is obtained;

[0022] Based on the position information of the four points on the plane and the position information of the center point of the user's head, the user's field of vision information is obtained;

[0023] Based on the user's field of view information and the specified screen position information, the screen's visible area information is obtained.

[0024] In one possible design, the specified image information comes from a panoramic shooting terminal equipped with a dynamic transmission module and a shooting module; correspondingly, before receiving the specified image information, the method further includes:

[0025] The screen visible area information is sent to the dynamic transmission module of the panoramic shooting terminal;

[0026] The camera module collects user field of view information and sends the user field of view information to the dynamic transmission module.

[0027] The dynamic transmission module obtains specified image information that matches the user's field of view information based on the user's field of view information and the screen's visible area information.

[0028] The dynamic transmission module performs real-time image segmentation and rendering on the specified image information to obtain rendered image information, which is then displayed on a specified screen that matches the specified screen position information.

[0029] In one possible design, the first image information is rendered in high quality to obtain first rendered image information, and the second image information is rendered in low quality to obtain second rendered image information, including:

[0030] Computational resources are allocated based on the first image information and the second image information to obtain a first computing resource corresponding to the first image information and a second computing resource corresponding to the second image information; wherein, the number of the first computing resources is greater than the number of the second computing resources.

[0031] Based on the first computing resources, the first image information is rendered in high quality to obtain the first rendered image information, and based on the second computing resources, the second image information is rendered in low quality to obtain the second rendered image information.

[0032] In one possible design, spatial calculations are performed based on the real-time position information of the specified part of the user's head and the specified screen position information to obtain real-time distance information of the user's head from the screen within the visible area and the user's focal area information within the visible area; correspondingly, after real-time image segmentation is performed on the specified image information to obtain first image information and second image information, the method further includes:

[0033] The real-time distance information is compared with the historical distance information obtained at the previous moment. If the real-time distance information is less than the historical distance information, it is determined that the user is close to the screen, and the resolution of the first image information is increased. If the real-time distance information is greater than the historical distance information, it is determined that the user is far away from the screen, and the resolution of the first image information is decreased.

[0034] After performing real-time image segmentation on the specified image information to obtain first image information and second image information, the method further includes:

[0035] Based on the focal area information, the first image screen information is segmented in real time to obtain the focal image screen information corresponding to the focal area information and the non-focal image screen information other than the focal area information in the visible area information of the screen.

[0036] When the first image information is rendered in high quality, the resulting first rendered image information includes rendered image information of the focal area corresponding to the focal image information and rendered image information of the non-focal area corresponding to the non-focal image information; wherein, the resolution of the rendered image information of the focal area is greater than the resolution of the rendered image information of the non-focal area.

[0037] Secondly, the present invention provides a content presentation system for implementing the content presentation method as described in any of the preceding claims; the content presentation system includes a central processing module, a location information acquisition module, and a screen rendering module, wherein the location information acquisition module and the screen rendering module are both communicatively connected to the central processing module; wherein...

[0038] The location information acquisition module is used to acquire real-time location information of a specified part of the user's head and send it to the central processing module.

[0039] The central processing module is used to perform spatial calculations based on the real-time position information of the specified part of the user's head and the specified screen position information to obtain the screen visible area information; it is also used to receive specified image information and, based on the screen visible area information, perform real-time image segmentation on the specified image information to obtain first image information corresponding to the screen visible area information and second image information other than the first image information in the specified image information, and send the first image information and the second image information to the image rendering module;

[0040] The image rendering module is used to perform high-quality rendering on the first image information to obtain first rendered image information, and to perform low-quality rendering on the second image information to obtain second rendered image information; it is also used to combine the first rendered image information and the second rendered image information to obtain rendered image information, and to display the rendered image information through a designated screen that matches the designated screen position information.

[0041] Thirdly, the present invention provides an electronic device, comprising:

[0042] Memory, used to store computer program instructions; and,

[0043] A processor for executing the computer program instructions to perform the operations of the content presentation method as described in any of the preceding descriptions.

[0044] Fourthly, the present invention provides a computer program product, including a computer program or instructions, wherein the computer program or instructions, when executed by a computer, implement the content presentation method as described in any of the preceding claims. Attached Figure Description

[0045] Figure 1 This is a flowchart of the content presentation method in Example 1;

[0046] Figure 2 This is a schematic diagram of the application scenario of Example 1;

[0047] Figure 3 This is a block diagram of the content presentation system in Example 2. Detailed Implementation

[0048] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the present invention will be briefly introduced below in conjunction with the accompanying drawings and descriptions of the embodiments or the prior art. Obviously, the following description of the structure of the accompanying drawings is only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort. It should be noted that the description of these embodiments is for the purpose of helping to understand the present invention, but does not constitute a limitation of the present invention.

[0049] Example 1:

[0050] This embodiment discloses a content presentation method, which can be executed by, but is not limited to, a computer device or virtual machine with certain computing resources, such as a personal computer, smartphone, personal digital assistant or wearable device, or by a virtual machine.

[0051] like Figure 1 As shown, a content presentation method may include, but is not limited to, the following steps:

[0052] S1. Collect real-time position information of a specified part of the user's head; specifically, in this embodiment, UWB (Ultra Wide Band) high-precision positioning technology can be used to collect real-time position information of a specified part of the user's head to determine the position and direction of the user's head, and at the same time facilitate further determination of the user's field of vision; among which, UWB high-precision positioning technology has advantages such as high accuracy, low power consumption, high security and low cost.

[0053] In this embodiment, the designated part of the user's head consists of four points located around the user's eyes. These four points are coplanar, and no three of them are collinear. In this case, the real-time position information of the designated part of the user's head includes the position information of the four points.

[0054] S2. Spatial calculations are performed based on the real-time position information of the specified part of the user's head and the specified screen position information to obtain the screen's visible area information. It should be noted that the screen's visible area information refers to the position information of the screen area that the user can see when currently viewing the specified screen, and it includes multiple position information within a certain area of ​​the specified screen. Furthermore, it should be understood that the specified screen in this embodiment is a giant screen, such as a 360° surround giant curved screen; this is not a limitation.

[0055] In step S2, spatial calculations are performed based on the real-time position information of the specified part of the user's head and the specified screen position information to obtain the screen's visible area information, including:

[0056] S201. Based on the real-time position information of the specified part of the user's head, obtain the position information of the plane where the four points are located; wherein, the position information of the plane where the four points are located includes the size, position and flip angle of the plane where the four points are located;

[0057] S202. Based on the position information of the plane where the four points are located, obtain the position information of the center point of the user's head;

[0058] S203. Based on the position information of the plane where the four points are located and the position information of the center point of the user's head, obtain the user's field of vision information;

[0059] S204. Based on the user's field of view information and the specified screen position information, obtain the screen's visible area information. It should be understood that the user's visible space range can be obtained based on the user's field of view information, and the specified screen position information includes the position information of multiple areas of the specified screen. The position information of the screen area that overlaps with the user's visible space range is the screen's visible area information.

[0060] Specifically, in this embodiment, obtaining screen visible area information based on the user's field of vision information and the designated screen position information includes: obtaining the relative distance between the user and the designated screen based on the user's head center point position information and the designated screen position information; and obtaining screen visible area information based on the relative distance and the user's field of vision information.

[0061] S3. Receive the specified image screen information, and perform real-time image segmentation on the specified image screen information according to the screen visible area information to obtain the first image screen information corresponding to the screen visible area information and the second image screen information other than the first image screen information in the specified image screen information.

[0062] Specifically, in this embodiment, the specified image information comes from a panoramic shooting terminal equipped with a dynamic transmission module and a shooting module. For example, in this embodiment, the panoramic shooting terminal is a 360° panoramic high-resolution shooting terminal device. Correspondingly, the method further includes:

[0063] The screen visible area information, real-time distance information, and the user's focus area information within the visible area are sent to the dynamic transmission module of the panoramic shooting terminal.

[0064] The camera module collects user field of view information and sends the user field of view information to the dynamic transmission module.

[0065] The dynamic transmission module obtains specified image information that matches the user's field of view information based on the user's field of view information and the screen's visible area information.

[0066] The dynamic transmission module performs real-time image segmentation and rendering on the specified image information to obtain rendered image information, which is then displayed on a specified screen that matches the specified screen position information.

[0067] It should be understood that the dynamic transmission module can also receive real-time distance information between the user's head and the screen within the visible area, as well as the user's focus area information within the visible area. It transmits the image within the user's field of vision in high quality and the image outside the field of vision in low quality. Simultaneously, the high-quality image within the field of vision must be adjusted in real-time based on the user's distance from the screen. When the user moves away from the screen, the resolution is reduced; when the user moves closer to the screen, the resolution is increased.

[0068] Correspondingly, the specified audio information is obtained through the panoramic shooting terminal, or it can be audio information pre-stored in the system; there is no restriction here.

[0069] It should be noted that, in this embodiment, the use of a panoramic shooting terminal can achieve the technical advantages of reducing transmission bandwidth resource consumption and improving performance.

[0070] In this embodiment, the panoramic shooting terminal acquires designated image information that matches the user's field of view information. That is, the panoramic shooting terminal rotates to a direction consistent with the user's field of view information and performs image acquisition. The range of the acquired image is equal to or larger than the range of the image that the user can view on the designated screen. This embodiment can be applied to entertainment fields such as virtual reality games, film and television entertainment and virtual tourism, education fields such as interactive learning, distance education and special education, and professional training fields such as medical training, military training and aviation simulation. It can provide users with an immersive user experience and has the value of promotion and application.

[0071] Specifically, in virtual reality gaming scenarios, this embodiment can provide users with a more realistic and immersive gaming experience, especially suitable for large-scale multiplayer online interactive games; in film and television entertainment scenarios, it can create immersive movie and television experiences, allowing viewers to feel the scenes and environments in movies or TV series; in virtual tourism scenarios, it allows users to virtually visit attractions around the world, providing a realistic travel experience without geographical limitations; in interactive learning scenarios, it can create interactive and immersive learning environments, such as historical scene recreation and scientific experiment simulation; in distance education scenarios, it can facilitate a more vivid remote teaching experience, helping students better understand and absorb knowledge; in special education scenarios, it can support special education needs, such as simulating social situations, helping special groups better adapt to society; in medical training scenarios, medical students can improve their skills through virtual surgery and diagnostic exercises without the risk of using real patients; in military training scenarios, it can simulate battlefield environments and tactical training, thereby improving the combat capabilities of military personnel; in aviation simulation scenarios, pilots and astronauts can conduct flight training in a highly realistic simulated environment, thus enabling this embodiment to play a significant role in many important fields.

[0072] As another implementation, in this embodiment, the specified image information comes from a preset cloud signal distribution center. Correspondingly, in this embodiment, the cloud signal distribution center can also receive the screen visible area information, real-time distance information, and the user's focus area information within the visible area, and perform real-time image segmentation and rendering on the specified image information to obtain rendered image information. The rendered image information is then displayed through a specified screen that matches the specified screen position information. That is, based on the different real-time field of view information of different users, targeted image segmentation is performed, and high-quality images matching each user's field of view information and low-quality images outside the field of view area are distributed.

[0073] It should be noted that the cloud signal distribution center is deployed on a cloud server and can be used in one-to-many scenarios for high-resolution live streaming, that is, the cloud signal distribution center can distribute a specified image to multiple users for simultaneous viewing.

[0074] Correspondingly, the specified audio information is obtained by sending it through the cloud signal distribution center, or it can be audio information pre-stored in the system, and there is no restriction here.

[0075] Based on this embodiment, whether it is one-to-many live streaming or one-to-one live streaming, it can greatly reduce the network bandwidth usage and reduce the load on the cloud server, which will greatly improve the audio-visual smoothness and image presentation effect of the live streaming process.

[0076] S4. Perform high-quality rendering on the first image information to obtain first rendered image information, and perform low-quality rendering on the second image information to obtain second rendered image information. It should be understood that in this embodiment, high-quality rendering can also be called high-quality rendering, first-quality rendering, etc., and low-quality rendering can also be called low-quality rendering, second-quality rendering, etc. The rendering effect of high-quality rendering is relatively higher than that of low-quality rendering, that is, the image clarity of the first rendered image information is higher than that of the second rendered image information. For example, high-quality rendering is performed through high-resolution textures, complex lighting models, and detailed scenes. In order to achieve a smooth visual experience, it can be applied to advanced image technologies such as fast anti-aliasing and dynamic shadows. Low-quality rendering is performed by reducing texture details and simplifying lighting calculations. Furthermore, blurring effects or progressive detail reduction techniques can be applied to the second image information to further reduce computational requirements.

[0077] In step S4, the first image information is rendered in high quality to obtain the first rendered image information, and the second image information is rendered in low quality to obtain the second rendered image information, including:

[0078] S401. Based on the first image information and the second image information, allocate computing resources to obtain a first computing resource corresponding to the first image information and a second computing resource corresponding to the second image information; wherein, the number of the first computing resources is greater than the number of the second computing resources;

[0079] S402. Based on the first computing resources, the first image information is rendered in high quality to obtain the first rendered image information, and based on the second computing resources, the second image information is rendered in low quality to obtain the second rendered image information.

[0080] It should be noted that in this embodiment, computing resources can be dynamically allocated by using the first image information and the second image information at different times, thereby ensuring that the image information within the user's field of view receives sufficient processing resources to maintain high-quality image output.

[0081] This embodiment can achieve the goal of high-quality rendering of the image information within the user's field of view, i.e., the first image image information, by allocating computing resources, while rendering the image information outside the user's field of view with low quality, such as blurring or using low-resolution rendering.

[0082] Furthermore, in this embodiment, spatial calculations are performed based on the real-time position information of the specified part of the user's head and the specified screen position information to obtain real-time distance information between the user's head and the screen within the visible area, as well as the user's focal area information within the visible area; correspondingly, after real-time image segmentation is performed on the specified image information to obtain first image information and second image information, the method further includes:

[0083] The real-time distance information is compared with the historical distance information obtained at the previous moment. If the real-time distance information is less than the historical distance information, it is determined that the user is close to the screen, and the resolution of the first image information is increased. If the real-time distance information is greater than the historical distance information, it is determined that the user is far away from the screen, and the resolution of the first image information is decreased.

[0084] After performing real-time image segmentation on the specified image information to obtain first image information and second image information, the method further includes:

[0085] Based on the focal area information, the first image screen information is segmented in real time to obtain the focal image screen information corresponding to the focal area information and the non-focal image screen information other than the focal area information in the visible area information of the screen.

[0086] When the first image information is rendered in high quality, the resulting first rendered image information includes rendered image information of the focal area corresponding to the focal image information and rendered image information of the non-focal area corresponding to the non-focal image information; wherein, the resolution of the rendered image information of the focal area is greater than the resolution of the rendered image information of the non-focal area.

[0087] Specifically, in this embodiment, when it is determined that the user is close to the screen, i.e., the field of view is smaller relative to the screen, the resolution and quality of the image within the field of view are appropriately increased; when the user is far from the screen, i.e., the field of view is larger relative to the screen, the resolution and quality of the image are appropriately decreased. In other words, in addition to dynamically segmenting the visible area of ​​the screen in real time, this embodiment can also dynamically adjust the resolution and quality of the image within the visible area based on the user's distance from the screen. Furthermore, in this embodiment, the user's focal area is calculated simultaneously based on the spatial relationship between the user's eye position and the screen position. The image within the user's focal area is rendered at the highest resolution and quality, while the image outside the focal area has its resolution and quality appropriately reduced.

[0088] S5. Combine the first rendered image information and the second rendered image information to obtain the rendered image information;

[0089] S6. Display the rendered image information through a designated screen that matches the designated screen position information.

[0090] Current immersive experience cabins typically use surround sound, and the audio is passively received by the user, unable to adjust the audio in real time according to the user's ear position. This results in poor audio realism and negatively impacts the user's immersive experience. To address this technical problem, this embodiment further improves upon the following: After obtaining the real-time position information of a specified part of the user's head in step S1, the method further includes:

[0091] S7. Obtain the user's ear position information based on the real-time position information of the specified part of the user's head;

[0092] S8. Based on the user's ear position information and the position information of multiple audio playback devices corresponding to the designated screen, adjust the volume of multiple audio playback devices that match the position information of the multiple audio playback devices; it should be noted that in this embodiment, multiple audio playback devices are arranged around the user, such as being arranged on the top, bottom and all around the user, and each audio playback device can independently receive and output audio signals.

[0093] S9. Receive specified audio information and send the specified audio information to multiple audio playback devices so that the multiple audio playback devices can play the specified audio information at an adjusted volume.

[0094] It should be understood that, in order to further achieve a diversified and hierarchical presentation of audio effects, this embodiment makes the following improvements: the specified audio information is set in multiple ways so that multiple audio playback devices can play different types of specified audio information.

[0095] It should be noted that, in the application of this embodiment, surround sound technology can be used to create a stereo effect to enhance the sense of immersion, and by adjusting the volume and audio content, the distance, direction and dynamic changes in the real world can be simulated to make the sound source closer to the real environment.

[0096] By displaying the rendered image information on a designated screen that matches the designated screen position information, and sending the designated audio information to multiple audio playback devices so that the multiple audio playback devices can play the designated audio information with adjusted volume, the technical effect of integrating audio and video information is achieved. This ensures that the audio content is synchronized with the visual content, thus enabling this embodiment to not only provide a personalized immersive audiovisual experience visually, but also further enhance the user's sense of immersion through precise sound positioning and surround sound effects. This will greatly improve the content presentation effect of the immersive experience cabin and its appeal to users.

[0097] In this embodiment, a pair of eyeglasses can be used in conjunction with the glasses. Positioning sensors are installed around the four sides of the eyeglasses. The position information collected by these sensors determines the user's field of view on a designated screen, i.e., the visible area of ​​the screen, and further, the user's ear position information. This enables dynamic rendering of designated image information and dynamic adjustment of designated audio information. Specifically, the eyeglasses can be made of high-grade transparent plastic, and only the frame is used, which helps reduce the overall weight of the glasses and allows nearsighted users to easily change lenses as needed. Furthermore, for convenient long-term use, the power supply for the eyeglasses can be designed with both quick-removal and wired direct charging options.

[0098] As an example Figure 2 The application scenario of this embodiment is illustrated, where the frame surrounding the user represents the designated screen, the red frame on the user's face represents the eyeglasses, point P is the center point of the user's head, points A1, A2, A3, and A4 are positioning sensors deployed on the user's eyeglasses frame, and the position information of point P, i.e., the position information of the center point of the user's head, can be deduced based on the positioning information of points A1, A2, A3, and A4; points B1, B2, B3, B4, B5, B6, B7, and B8 are audio playback devices deployed around the designated screen in the user's experience; through the position information of the plane where points A1, A2, A3, and A4 are located and the position information of the center point P of the user's head, the user's field of vision information can be obtained, and further, the screen visible area information including the position information of points C1, C2, C3, and C4 can be obtained.

[0099] It should be noted that, during the simulation test, the dynamic rendering speed of this embodiment is about 30-40% faster than the traditional full-resolution rendering, greatly improving rendering efficiency. At the same time, energy consumption tests show that the dynamic field-of-view rendering technology of this embodiment saves about 25% of power consumption compared to traditional methods, resulting in lower energy consumption. In addition, during the initial user testing, the immersive experience cabin based on the method of this embodiment achieved a user satisfaction rate that was about 50% higher than that of traditional technologies. It can be seen that this embodiment demonstrates significant advantages in solving device performance limitations in content presentation, reducing energy consumption, and improving user experience.

[0100] This embodiment reduces the energy consumption of image rendering and enhances the user experience in the immersive experience cabin. Specifically, in the implementation process, this embodiment collects real-time position information of a specified part of the user's head, and performs spatial calculations based on the real-time position information of the specified part of the user's head and the specified screen position information to obtain the screen's visible area information; then, it receives specified image information, and performs real-time image segmentation on the specified image information based on the screen's visible area information to obtain first image information corresponding to the screen's visible area information and second image information other than the first image information in the specified image information; then, it performs high-quality rendering on the first image information to obtain first rendered image information, and performs low-quality rendering on the first image information to obtain second rendered image information; the first rendered image information and the second rendered image information are then combined to obtain rendered image information; finally, the rendered image information is displayed on a specified screen that matches the specified screen position information. In this process, this embodiment locates the user and renders high-quality image information only in the user's field of view. This significantly reduces the need for high-performance graphics processing hardware, effectively addresses the performance bottleneck of existing technologies when processing high-resolution full-screen rendering, greatly reduces unnecessary image processing and energy consumption, and thus lowers overall energy consumption. At the same time, because the image information is rendered in partitions, the response speed can be reduced, which can effectively avoid screen stuttering and delays, thus improving the user's viewing experience.

[0101] Example 2:

[0102] This embodiment discloses a content presentation system for implementing the content presentation method in Embodiment 1; such as Figure 3 As shown, the content presentation system includes a central processing module, a location information acquisition module, a screen rendering module, and an audio processing module. The location information acquisition module, screen rendering module, and audio processing module are all communicatively connected to the central processing module.

[0103] The location information acquisition module is used to acquire real-time location information of a specified part of the user's head and send it to the central processing module.

[0104] The central processing module is used to perform spatial calculations based on the real-time position information of the specified part of the user's head and the specified screen position information to obtain the screen visible area information; it is also used to receive specified image information and, based on the screen visible area information, perform real-time image segmentation on the specified image information to obtain first image information corresponding to the screen visible area information and second image information other than the first image information in the specified image information, and send the first image information and the second image information to the image rendering module;

[0105] The image rendering module is used to perform high-quality rendering on the first image information to obtain first rendered image information, and to perform low-quality rendering on the second image information to obtain second rendered image information; it is also used to combine the first rendered image information and the second rendered image information to obtain rendered image information, and to display the rendered image information through a designated screen that matches the designated screen position information.

[0106] The central processing module is also used to obtain the user's ear position information based on the real-time position information of the specified part of the user's head; it is also used to receive specified audio information and send the specified audio information to the audio processing module.

[0107] The audio processing module is used to adjust the volume of multiple audio playback devices that match the position information of the multiple audio playback devices according to the user's ear position information and the position information of multiple audio playback devices set corresponding to the designated screen; it is also used to receive designated audio information and send the designated audio information to the multiple audio playback devices so that the multiple audio playback devices play the designated audio information at the adjusted volume.

[0108] In addition, to improve the rendering quality of the images, this embodiment may also include an AI (Artificial Intelligence) assisted computing and rendering module that is connected to the central processing module. This module can access AI computing power to assist the central processing module in its calculations, assist the image rendering module in image rendering and repair, and assist the cloud signal distribution center in signal distribution, etc. There are no restrictions on this.

[0109] It should be noted that the working process, working details and technical effects of the content presentation system provided in this embodiment 2 can be found in embodiment 1, and will not be repeated here.

[0110] Example 3:

[0111] Based on Embodiment 1 or 2, this embodiment discloses an electronic device, which may be a smartphone, tablet computer, laptop computer, or desktop computer, etc. The electronic device may be referred to as a user terminal, portable terminal, desktop terminal, etc., and includes:

[0112] Memory, used to store computer program instructions; and,

[0113] A processor is configured to execute the computer program instructions to perform the operation of the content presentation method as described in any of Embodiment 1.

[0114] Example 4:

[0115] Based on any one of the embodiments 1 to 3, this embodiment discloses a computer program product, including a computer program or instructions, which, when executed by a computer, implements the content presentation method as described in any one of embodiments 1.

[0116] Obviously, those skilled in the art will understand that the modules or steps of the present invention described above can be implemented using general-purpose computing devices. They can be centralized on a single computing device or distributed across a network of multiple computing devices. Optionally, they can be implemented using computer-executable program code, thereby storing them in a storage device for execution by a computing device, or fabricating them separately as individual integrated circuit modules, or fabricating multiple modules or steps as a single integrated circuit module. Thus, the present invention is not limited to any particular hardware and software combination.

[0117] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. These modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A content presentation method, characterized in that: include: The real-time location information of a specified part of the user's head is collected; Spatial calculations are performed based on the real-time position information of the specified part of the user's head and the specified screen position information to obtain the screen's visible area information; Receive specified image information, and perform real-time image segmentation on the specified image information according to the screen visible area information to obtain first image information corresponding to the screen visible area information and second image information other than the first image information in the specified image information. The first image information is rendered in high quality to obtain the first rendered image information, and the second image information is rendered in low quality to obtain the second rendered image information. The first rendered image information and the second rendered image information are combined to obtain the rendered image information. The rendered image information is displayed on a designated screen that matches the designated screen position information.

2. The content presentation method according to claim 1, characterized in that: After acquiring the real-time location information of a specified part of the user's head, the method further includes: The user's ear position information is obtained based on the real-time position information of the specified part of the user's head; Based on the user's ear position information and the position information of multiple audio playback devices corresponding to the designated screen, the volume of multiple audio playback devices that match the position information of the multiple audio playback devices is adjusted. The specified audio information is received and sent to multiple audio playback devices so that the multiple audio playback devices can play the specified audio information at an adjusted volume.

3. The content presentation method according to claim 2, characterized in that: The specified audio information can be set in multiple ways so that multiple audio playback devices can play different types of specified audio information.

4. The content presentation method according to claim 1, characterized in that: The designated area on the user's head consists of four points positioned around the user's eyes. These four points are coplanar, and no three of them are collinear. Correspondingly, spatial calculations are performed based on the real-time position information of the designated area on the user's head and the designated screen position information to obtain the screen's visible area information, including: Based on the real-time position information of the specified part of the user's head, the position information of the plane where the four points are located is obtained; Based on the position information of the four points on the plane, the position information of the center point of the user's head is obtained; Based on the position information of the four points on the plane and the position information of the center point of the user's head, the user's field of vision information is obtained; Based on the user's field of view information and the specified screen position information, the screen's visible area information is obtained.

5. The content presentation method according to claim 4, characterized in that: The specified image information comes from a panoramic shooting terminal equipped with a dynamic transmission module and a shooting module; correspondingly, the method further includes: The screen visible area information is sent to the dynamic transmission module of the panoramic shooting terminal; The camera module collects user field of view information and sends the user field of view information to the dynamic transmission module. The dynamic transmission module obtains specified image information that matches the user's field of view information based on the user's field of view information and the screen's visible area information. The dynamic transmission module performs real-time image segmentation and rendering on the specified image information to obtain rendered image information, which is then displayed on a specified screen that matches the specified screen position information.

6. The content presentation method according to claim 1, characterized in that: The first image information is rendered in high quality to obtain the first rendered image information, and the second image information is rendered in low quality to obtain the second rendered image information, including: Computational resources are allocated based on the first image information and the second image information to obtain a first computing resource corresponding to the first image information and a second computing resource corresponding to the second image information; wherein, the number of the first computing resources is greater than the number of the second computing resources. Based on the first computing resources, the first image information is rendered in high quality to obtain the first rendered image information, and based on the second computing resources, the second image information is rendered in low quality to obtain the second rendered image information.

7. The content presentation method according to claim 1, characterized in that: Based on the real-time position information of the specified part of the user's head and the specified screen position information, spatial calculations are performed to obtain the real-time distance information of the user's head from the screen within the visible area and the focus area information of the user within the visible area. Correspondingly, after performing real-time image segmentation on the specified image information to obtain first image information and second image information, the method further includes: The real-time distance information is compared with the historical distance information obtained at the previous moment. If the real-time distance information is less than the historical distance information, it is determined that the user is close to the screen, and the resolution of the first image information is increased. If the real-time distance information is greater than the historical distance information, it is determined that the user is far away from the screen, and the resolution of the first image information is decreased. After performing real-time image segmentation on the specified image information to obtain first image information and second image information, the method further includes: Based on the focal area information, the first image screen information is segmented in real time to obtain the focal image screen information corresponding to the focal area information and the non-focal image screen information other than the focal area information in the visible area information of the screen. When the first image information is rendered in high quality, the resulting first rendered image information includes rendered image information of the focal area corresponding to the focal image information and rendered image information of the non-focal area corresponding to the non-focal image information; wherein, the resolution of the rendered image information of the focal area is greater than the resolution of the rendered image information of the non-focal area.

8. A content presentation system, characterized in that: This system is used to implement the content presentation method as described in any one of claims 1 to 7; the content presentation system includes a central processing module, a location information acquisition module, and a screen rendering module, wherein the location information acquisition module and the screen rendering module are both communicatively connected to the central processing module; wherein... The location information acquisition module is used to acquire real-time location information of a specified part of the user's head and send it to the central processing module. The central processing module is used to perform spatial calculations based on the real-time position information of the specified part of the user's head and the specified screen position information to obtain the screen visible area information; it is also used to receive specified image information and, based on the screen visible area information, perform real-time image segmentation on the specified image information to obtain first image information corresponding to the screen visible area information and second image information other than the first image information in the specified image information, and send the first image information and the second image information to the image rendering module; The image rendering module is used to perform high-quality rendering on the first image information to obtain first rendered image information, and to perform low-quality rendering on the second image information to obtain second rendered image information; it is also used to combine the first rendered image information and the second rendered image information to obtain rendered image information, and to display the rendered image information through a designated screen that matches the designated screen position information.

9. An electronic device, characterized in that: include: Memory is used to store computer program instructions; as well as, A processor for executing the computer program instructions to perform the operation of the content presentation method as described in any one of claims 1 to 7.

10. A computer program product, comprising a computer program or instructions, characterized in that: When the computer program or the instructions are executed by a computer, they implement the content presentation method as described in any one of claims 1 to 7.

Images