Method, device, smart terminal and medium for creating panoramic images based on large displays

By integrating large displays with VR technology and employing resolution adjustment and seamless splicing, smart large displays can create 360° panoramic images, improving user experience and advertising potential.

JP7580605B2Active Publication Date: 2024-11-11シェンツェン·ティシーエル·ニュー·テクノロジー·カンパニー·リミテッド
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2023530651
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-11-18
Filing Date
2021-11-01
Publication Date
2024-11-11
Estimated Expiration
2041-11-01

AI Technical Summary

Technical Problem

Traditional smart large displays lack the capability to create 360° panoramic images and cannot be integrated with VR technology to provide immersive 3D panoramic views.

Method used

A method and apparatus that combine large displays with VR technology to create panoramic images by adjusting image resolution, using floating window layers with different layer transparencies and expansion areas, and employing seamless splicing technology to convert images into 3D panoramic views.

Benefits of technology

Enables smart large displays to provide 360° panoramic images, enhancing user experience, expanding advertising capabilities, and providing convenience through immersive visual content.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007580605000002
    Figure 0007580605000002
  • Figure 0007580605000003
    Figure 0007580605000003
  • Figure 0007580605000004
    Figure 0007580605000004
Patent Text Reader

Abstract

This application discloses a method, device, smart device, and medium for creating a panoramic image based on a large display, which includes calculating the resolution difference between the image resolution and the screen resolution (S10), obtaining an image of the large display that matches the screen resolution based on the resolution difference (S20), and creating a floating window layer located on the image of the large display (S30).The above method aims to enable smart large displays to provide 360° panoramic images by using different layer transparency of the floating window layer, a translation extension area algorithm, a visually impaired direct viewing algorithm, and seamless splicing techniques.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] This application claims priority to a Chinese patent application filed with the China Patent Office on November 18, 2020, with application number 202011291487.5, and entitled "Method, apparatus, smart terminal and medium for creating panoramic images based on large displays," the entire contents of which are incorporated herein by reference.

[0002] The present invention belongs to the technical field of smart large display technology, and particularly relates to a method, device, smart terminal and medium for creating a panoramic image based on a large display. [Background technology]

[0003] Emerging imaging technologies such as VR technology have brought unprecedented imaging experiences to users. As the display center of smart devices in the home, smart large displays have become a challenge to address: how to meet the increasing demands of users for display effects. Traditionally, most smart large displays do not have the ability to create 360° panoramic images, and cannot be combined with VR technology to create 360° panoramic images, also known as 3D panoramic images or surround panoramic view images. 360° panoramic technology is a 3D virtual display technology that uses a digital camera to shoot an existing scene from multiple angles, stitches them together using a computer, and then loads a playback program to complete the process.

[0004] Therefore, improvements and developments in the prior art are needed. Summary of the Invention [Problem to be solved by the invention]

[0005] In response to the technical problem that the conventional smart large display cannot provide 360° panoramic images, it is necessary to provide a method, device, smart terminal and medium for creating a panoramic image based on a large display by combining the large display with VR technology to display a 360° panoramic image for the user. [Means for solving the problem]

[0006] In a first aspect, the present application provides a method for creating a panoramic image based on a large display, the method including: Obtaining an image resolution of a target image and a screen resolution of a large display; Calculate a resolution difference between the image resolution and the screen resolution, and adjust the target image according to the resolution difference to obtain an image of the large display that matches the screen resolution; Creating a floating window layer located on the image of the large display, and arranging and filling a translation extension area and a viewing area corresponding to a category of the screen resolution in the floating window layer according to a predetermined algorithm, in which the translation extension area is used to convert the target image into the image of the large display through translation processing and extension processing, and the viewing area is used to convert the image of the large display into a panoramic image by parallax; Setting layer transparency of floating window layers corresponding to the translation extension region and the viewing region, respectively; Compositing the floating window layers with different layer transparency with the large display to obtain a panoramic image of the target image.

[0007] In a second aspect, the present application provides an apparatus for creating a panoramic image based on a large display, the apparatus comprising: an acquisition module used for acquiring an image resolution of a target image and a screen resolution of a large display; A resolution adjustment module is used for calculating a resolution difference between the image resolution and the screen resolution, and adjusting the target image according to the resolution difference to obtain an image of the large display that matches the screen resolution; Create a floating window layer located on the image of the large display, and arrange and fill a translation extension area corresponding to a category to which the screen resolution belongs in the floating window layer according to a predetermined algorithm, and set a layer transparency of the floating window layer corresponding to the translation extension area, where the translation extension area is a translation extension area module used for transforming the target image into the image of the large display through translation processing and extension processing; A direct-view module is used to arrange and fill a direct-view area according to a direct-view algorithm based on a translation extension area module, and set a layer transparency of a floating window layer corresponding to the direct-view area, in which the direct-view area is used to convert the image of the large display into a panoramic image according to parallax; a panoramic synthesis module, which is used to synthesize the floating window layers with different layer transparencies with the large display to obtain a panoramic image of the target image.

[0008] In a third aspect, the present application further provides a smart terminal, which includes a display panel of a large display, a storage device, a processing device, and a program for creating a panoramic image based on the large display stored in the storage device and executable by the processing device, and when the processing device executes the program for creating a panoramic image based on the large display, implements a method for creating a panoramic image based on the large display.

[0009] In a fourth aspect, the present application further provides a computer storage medium, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processing device, a method for creating a panoramic image based on a large display is implemented. Effect of the Invention

[0010] Compared with the prior art, the present application provides a method, device, smart terminal and medium for creating a panoramic image based on a large display, and uses the resolution difference to create an image of the large display that matches the screen resolution (i.e., a flat panoramic image), and then converts the image of the large display into a 3D panoramic image through different layer transparency of the floating window layer, a translation extension area algorithm, an exciting direct viewing algorithm and seamless splicing technology, so that the smart large display can be combined with VR, and the smart large display can also provide 360° panoramic images, which can improve the user's visual experience, expand promotion and bring convenience to users. [Brief description of the drawings]

[0011] [Figure 1] FIG. 2 is a flow diagram illustrating a method for creating a panoramic image based on a large display according to the present application. [Diagram 2] FIG. 1 is a structural block diagram of an apparatus for creating a panoramic image based on a large display according to the present application; [Diagram 3] FIG. 1 is a structural block diagram of a smart terminal according to the present application; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] 1. A method for creating a panoramic image based on a large display, the method comprising: Obtaining an image resolution of a target image and a screen resolution of a large display; Calculating a resolution difference between the image resolution and the screen resolution, and adjusting the target image according to the resolution difference to obtain an image of a large display that matches the screen resolution; Creating a floating window layer located on the image of the large display, and arranging and filling a translation extension area and a viewing area corresponding to a category to which the screen resolution belongs in the floating window layer according to a predetermined algorithm, in which the translation extension area is used to transform the target image into the image of the large display through translation processing and extension processing, and the viewing area is used to transform the image of the large display into a panoramic image by parallax; setting layer transparency of the floating window layer corresponding to the translation extension region and the viewing region, respectively; and compositing the floating window layers with different layer transparencies with the large display to obtain a panoramic image of the target image.

[0013] Among them, obtaining the image resolution of the target image and the screen resolution of the large display is When detecting a command to transmit a target image of the smart terminal, receive the target image and obtain an image resolution of the target image, the image resolution being expressed as a horizontal pixel number*vertical pixel number of the target image; Obtaining a screen resolution of the large display, the screen resolution being expressed as a number of horizontal pixels*a number of vertical pixels of the large display.

[0014] Among them, calculating the resolution difference between the image resolution and the screen resolution includes: This includes calculating a resolution difference between the number of horizontal pixels in the image resolution and the number of horizontal pixels in the screen resolution, and calculating a resolution difference between the number of vertical pixels in the image resolution and the number of vertical pixels in the screen resolution.

[0015] Calculating a resolution difference between the image resolution and the screen resolution, and adjusting the target image according to the resolution difference to obtain an image of a large display that matches the screen resolution; calculating a difference between a number of horizontal pixels at the image resolution and a number of horizontal pixels at the screen resolution to obtain a horizontal resolution difference; If the absolute value of the difference in horizontal resolution is equal to 0, the target image is an image of a large display that matches the screen resolution.

[0016] Calculating a resolution difference between the image resolution and the screen resolution, and adjusting the target image according to the resolution difference to obtain an image of a large display that matches the screen resolution; If the absolute value of the horizontal resolution difference is not equal to zero, setting the absolute value of the horizontal resolution difference as the number of pixels to be filled in the horizontal direction of the target image.

[0017] Wherein, if the absolute value of the difference in horizontal resolution is not equal to 0, the absolute value of the difference in horizontal resolution is set as the number of pixels to be filled in the horizontal direction of the target image; The method includes determining a color to be filled, obtaining a color value corresponding to the color to be filled, and filling the target image with the color value to obtain an image of a large display that matches the screen resolution.

[0018] Wherein, determining a color to be filled and obtaining a color value corresponding to the color to be filled is: Obtaining a color value of each color to be filled in the target image and a pixel number corresponding to each color to be filled, the color value of each color to be filled includes an R value, a G value and a B value; Calculating average values ​​of R, G and B values ​​based on the first color value of each color to be filled and the number of pixels corresponding to each color to be filled, respectively, to obtain an average value of R, an average value of G and an average value of B; determining a color corresponding to the average value of the R, the average value of the G, and the average value of the B, the color being the color to be filled, and the color value of the color to be filled is the average value of the R, the average value of the G, and the average value of the B.

[0019] Wherein, when the category to which the screen resolution belongs is high resolution, a floating window layer is created on the image of the large display, and a translation extension area and a viewing area corresponding to the category to which the screen resolution belongs are arranged and filled in the floating window layer according to a predetermined algorithm; matching a size of the floating window layer to the large display by creating a floating window layer based on the screen resolution; placing the floating window layer above an image on the large display; Placing a first translational expansion region in the floating window layer based on the target image by a predetermined translational expansion region algorithm; cropping the target image in a horizontal direction at a first horizontal ratio of first horizontal pixels; filling the first horizontal pixels into the first translation expansion region; After filling the first translation extension region, add a predetermined visual viewing algorithm to obtain a first visual viewing region, in which the first translation extension region includes the first visual viewing region; cropping a first vertical pixel in a vertical direction in the target image at a first vertical ratio; and filling the first vertical pixels into the first viewing area.

[0020] Wherein, respectively setting layer transparency of the floating window layer corresponding to the translation extension area and the viewing area includes: The layer transparency of the floating window layer corresponding to the first translation extension region is arranged to be semi-transparent; and configuring the layer transparency of the floating window layer corresponding to the first viewing area to be fully transparent.

[0021] Among them, compositing the floating window layers with different layer transparency with the large display to obtain a panoramic image of the target image; The method includes compositing the floating window layers with different layer transparencies with the large display using a seamless splicing technique to obtain a high-resolution panoramic image of the target image.

[0022] Wherein, when the category to which the screen resolution belongs is super high resolution, creating a floating window layer located on the image of the large display, and arranging and filling the translation extension area and the viewing area corresponding to the category to which the screen resolution belongs in the floating window layer according to a predetermined algorithm; matching a size of the floating window layer to the large display by creating a floating window layer based on the screen resolution; placing the floating window layer above an image on the large display; calculating a high-resolution image corresponding to a high resolution of the target image, wherein the image resolution of the high-resolution image is higher than the image resolution of the target image; placing a second translational expansion region in the floating window layer according to a predetermined translational expansion region algorithm; horizontally cropping the high resolution image at a second horizontal ratio of second horizontal pixels; filling the second horizontal pixels into the second translation expansion region; After filling the second translation extension region, add a predetermined viewing algorithm to obtain a second viewing region, in which the second translation extension region includes the second viewing region; obtaining second vertical pixels having a second vertical ratio in a vertical direction in the high resolution image; and filling the second vertical pixels into the second viewing area.

[0023] Wherein, respectively setting layer transparency of the floating window layer corresponding to the translation extension area and the viewing area includes: The layer transparency of the floating window layer corresponding to the second translation extension region is arranged to be semi-transparent; and configuring the layer transparency of the floating window layer corresponding to the second viewing area to be fully transparent.

[0024] Among them, compositing the floating window layers with different layer transparency with the large display to obtain a panoramic image of the target image; The method includes compositing the floating window layers with different layer transparency with the large display using seamless splicing technology to obtain a super high resolution panoramic image of the target image.

[0025] 1. An apparatus for creating a panoramic image based on a large display, the apparatus comprising: an acquisition module used for acquiring an image resolution of a target image and a screen resolution of a large display; a resolution adjustment module, which is used to calculate a resolution difference between the image resolution and the screen resolution, and adjust the target image according to the resolution difference to obtain an image of a large display that matches the screen resolution; A translation extension area module is used to create a floating window layer located on the image of the large display, and a translation extension area corresponding to a category of a screen resolution is arranged and filled in the floating window layer according to a predetermined algorithm, and a layer transparency of the floating window layer corresponding to the translation extension area is set, in which the translation extension area is used to transform the target image into the image of the large display through a translation process and an extension process; a viewing module that arranges and fills a viewing area according to a viewing algorithm based on the translation extension area module, and sets a layer transparency of a floating window layer corresponding to the viewing area, where the viewing area is used to convert the image of the large display into a panoramic image according to parallax; a panoramic synthesis module, which is used to composite the floating window layers with different layer transparencies with the large display to obtain a panoramic image of the target image.

[0026] Wherein, obtaining the image resolution of the target image and the screen resolution of the large display includes: When detecting a command to transmit a target image of the smart terminal, receive the target image and obtain an image resolution of the target image, the image resolution being expressed as a horizontal pixel number*vertical pixel number of the target image; Obtaining a screen resolution of the large display, the screen resolution being expressed as a number of horizontal pixels*a number of vertical pixels of the large display.

[0027] Calculating a resolution difference between the image resolution and the screen resolution, and adjusting the target image according to the resolution difference to obtain an image of a large display that matches the screen resolution; calculating a difference between a number of horizontal pixels at the image resolution and a number of horizontal pixels at the screen resolution to obtain a horizontal resolution difference; When the absolute value of the difference in horizontal resolution is equal to 0, the target image is an image of a large display that matches the screen resolution; If the absolute value of the horizontal resolution difference is not equal to 0, then the absolute value of the horizontal resolution difference is set as the number of pixels to be filled in the horizontal direction of the target image, a color to be filled is determined, and a color value corresponding to the color to be filled is obtained; and the target image is filled with the color value to obtain an image of a large display that matches the screen resolution.

[0028] Wherein, when the category to which the screen resolution belongs is high resolution, a floating window layer is created on the image of the large display, and a translation extension area and a viewing area corresponding to the category to which the screen resolution belongs are arranged and filled in the floating window layer according to a predetermined algorithm; matching a size of the floating window layer to the large display by creating a floating window layer based on the screen resolution; placing the floating window layer above an image on the large display; Placing a first translational expansion region in the floating window layer based on the target image by a predetermined translational expansion region algorithm; cropping the target image in a horizontal direction at a first horizontal ratio of first horizontal pixels; filling the first horizontal pixels into the first translation expansion region; After filling the first translation extension region, add a predetermined visual viewing algorithm to obtain a first visual viewing region, in which the first translation extension region includes the first visual viewing region; cropping a first vertical pixel in a vertical direction in the target image at a first vertical ratio; and filling the first vertical pixels into the first viewing area.

[0029] Wherein, when the category to which the screen resolution belongs is super high resolution, creating a floating window layer located on the image of the large display, and arranging and filling the translation extension area and the viewing area corresponding to the category to which the screen resolution belongs in the floating window layer according to a predetermined algorithm; matching a size of the floating window layer to the large display by creating a floating window layer based on the screen resolution; placing the floating window layer above an image on the large display; calculating a high-resolution image corresponding to a high resolution of the target image, wherein the image resolution of the high-resolution image is higher than the image resolution of the target image; placing a second translational expansion region in the floating window layer based on the target image by a predetermined translational expansion region algorithm; horizontally cropping the high resolution image at a second horizontal ratio of second horizontal pixels; filling the second horizontal pixels into the second translation expansion region; After filling the second translation extension region, add a predetermined viewing algorithm to obtain a second viewing region, in which the second translation extension region includes the second viewing region; cropping a second vertical pixel ratio in a vertical direction in the high resolution image; and filling the second vertical pixels into the second viewing area.

[0030] A smart terminal including a display panel of a large display, a memory device, a processing device, and a program for creating a panoramic image based on a large display stored in the memory device and executable by the processing device, and when the processing device executes the program for creating a panoramic image based on a large display, any of the above methods for creating a panoramic image based on a large display is implemented.

[0031] A computer-readable storage medium having a computer program stored therein, the computer program being executed by a processing device to implement any of the methods for creating a panoramic image based on a large display described above.

[0032] The present application provides a method, device, smart terminal and medium for creating a panoramic image based on a large display, and in order to make the objectives, technical solutions and effects of the present application clearer and more precise, the present application will be described in more detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described in the present application are only used to describe the present application and are not intended to limit the present application.

[0033] Those skilled in the art will appreciate that the singular forms "one," "one," and "the" as used herein can include the plural, unless otherwise stated. It should be further understood that the term "comprising" as used herein means the presence of features, integers, steps, processes, elements, and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, processes, elements, components, and / or combinations thereof. When an element is described as being "connected" or "coupled" to another element, it should be understood that it can be directly connected or coupled to the other element, or intermediate elements may be present. Furthermore, "connected" or "coupled" as used herein can include wireless connections or couplings. The term "and / or" as used herein includes all or any portion and all combinations of one or more associated examples.

[0034] Those skilled in the art should understand that unless otherwise defined, all terms (including technical and scientific terms) used in the present specification have the same meaning as commonly understood by a skilled artisan in the field to which the present application belongs. In addition, terms defined in general dictionaries and the like should be understood to have a meaning consistent with the meaning in the context of the prior art, and should not be interpreted in an idealized or overly formal sense unless otherwise defined herein.

[0035] The technical solution of the present application will be described below with reference to the drawings and specific examples.

[0036] Please refer to Fig. 1, which is a flow diagram showing a method for creating a panoramic image based on a large display. It should be noted that the method for creating a panoramic image based on a large display according to the embodiment of the present invention is not limited to the steps and procedures in the flow diagram shown in Fig. 1, and steps in the flow diagram may be added, deleted, or procedures may be changed as necessary. As shown in Fig. 1, the method for creating a panoramic image based on a large display includes the following:

[0037] S10: The system obtains the image resolution of the target image and the screen resolution of the large display.

[0038] Specifically, the target image is the object that needs to be combined with the panoramic image. In this embodiment, the target image is a standard definition image, that is, the image resolution of the target image is a standard definition resolution, and usually, the standard definition resolution is 480p (such as 720×480 pixel resolution) or 576p, and the standard resolution SD (Standard Definition) represents the standard definition resolution.

[0039] For example, the 480 in 480p refers to the vertical resolution, meaning that there are 480 horizontal scan lines in the vertical direction.

[0040] The target image can be obtained from the Internet or photography. Therefore, the target image may be pre-processed to improve the quality of the composite panoramic image. The pre-processing is a processing rule set according to the user's request, such as a process of enhancing the brightness of the target image or a process of cropping the target image. The processing rule is not limited and may be freely set according to different scenes.

[0041] Large display refers to a display panel with a screen diagonal size of more than 40 feet. For example: large display in direct view color television or rear projection television. Thus, the screen resolution of a large display may be high definition HD (High Definition), 720p (1280×720 pixel resolution), full high definition FHD (Full High Definition), 1080p (1080×720 pixel resolution), ultra high definition UHD (Ultra High Definition), 4k (4096×2160 pixel resolution), full ultra high definition FUHD (Full Ultra High Definition), 8k (7680×4320 pixel resolution, 16:9).

[0042] Specifically, the system can obtain the image resolution of the target image and the screen resolution of the large display. S11: When detecting a command to send a target image of the smart terminal, the system receives the target image and obtains an image resolution of the target image, and the image resolution is expressed as the number of horizontal pixels * the number of vertical pixels of the target image; S12: The system obtains a screen resolution of the large display, and the screen resolution is expressed as a horizontal pixel number*vertical pixel number of the large display.

[0043] In this embodiment, if the screen resolution of the large display is 1080p (1920*1080), 1920 is the number of horizontal pixels and 1080 is the number of vertical pixels, and the image resolution of the target image is 720*640, of which 720 is the number of horizontal pixels and 640 is the number of vertical pixels.

[0044] S20: The system calculates the resolution difference between the image resolution and the screen resolution, and adjusts the target image according to the resolution difference to obtain an image of the large display that matches the screen resolution.

[0045] Specifically, since both the image resolution and the screen resolution include the number of horizontal pixels and the number of vertical pixels, calculating the resolution difference between the image resolution and the screen resolution includes calculating the resolution difference between the number of horizontal pixels in the image resolution and the number of horizontal pixels in the screen resolution, and calculating the resolution difference between the number of vertical pixels in the image resolution and the number of vertical pixels in the screen resolution. In this embodiment, the resolution ratio is adjusted by calculating the resolution difference between the number of horizontal pixels in the image resolution and the number of horizontal pixels in the screen resolution.

[0046] Furthermore, the difference between the number of horizontal pixels in the image resolution and the number of horizontal pixels in the screen resolution is calculated to obtain the difference in horizontal resolution. Since the screen resolution is equal to or greater than the image resolution, the absolute value of the difference in horizontal resolution can be obtained.

[0047] When the absolute value of the difference in horizontal resolution is equal to 0, the target image is the image of the large display that matches the screen resolution, that is, the image resolution of the target image and the screen resolution of the large display are the same, and there is no need to perform the process of filling the target image.

[0048] If the absolute value of the horizontal resolution difference is not equal to 0, then the absolute value of the horizontal resolution difference is the number of pixels to be filled horizontally in the destination image.

[0049] for example: Target image Pic_X(x1)=640 / / 640 horizontal pixels, Large display_XDisplay(x1)=1080 / / Large display physical display resolution, Horizontal resolution difference Dis_ChaRu(x1)=|Large Display_XDisplay(x1)-Pic_X(x1)|=1080-640=440, that is, 440 is the horizontal resolution difference, and 440 is the number of pixels to be filled in the horizontal direction of the target image.

[0050] In the filling process, the color to be filled needs to be determined in advance, and after obtaining the color value of the color to be filled, the target image is filled using the color value, so that the image resolution of the image on the large display obtained after the target image is filled is the same as and matches the screen resolution of the large display.

[0051] Specifically, the flow of the system determining the color to be filled and obtaining the color value corresponding to the color to be filled is as follows: S211: obtaining a color value of each color to be filled in the target image and a pixel number corresponding to each color to be filled, and the color value of each color to be filled includes an R value, a G value, and a B value; S212: Calculating average values ​​of R, G and B values ​​based on the first color value of each color to be filled and the number of pixels corresponding to each color to be filled, respectively, to obtain an average value of R, an average value of G and an average value of B; S213: determining a color corresponding to the average value of R, the average value of G, and the average value of B, and the color is set as the color to be filled, and the color value of the color to be filled is the average value of R, the average value of G, and the average value of B.

[0052] In detail, the color values ​​of the colors to be filled in the target image all contain RGB values, so the average value pixel is used to select the most red, green, and blue color from the target image, and this color is the color to be filled, and its color value is the RGB average value.

[0053] for example: Ave_PixeRGB(r1,g1,b1)={“0”, “128”, “255”} / / The average value is the pixels filled with blue.

[0054] After the color to be filled is determined, the filling factor fills the target image until the number of pixels to be filled is, for example, 440, and obtains the corresponding image of the large display at the end of filling. Therefore, the image resolution of the large display obtained by filling is the same as the screen resolution.

[0055] S30: The system creates a floating window layer located on the image of the large display, and arranges and fills a translation extension area and a viewing angle area corresponding to a category to which the screen resolution belongs in the floating window layer according to a predetermined algorithm, in which the translation extension area is used to transform the target image into the image of the large display through translation processing and extension processing, and the viewing angle area is used to transform the image of the large display into a panoramic image by parallax.

[0056] S40: The system sets layer transparency of the floating window layer corresponding to the translation extension region and the viewing region respectively.

[0057] In this embodiment, the screen resolution is divided into two types: high resolution and super high resolution. Therefore, for each of these two types, a corresponding translation extension area and visually-sensing area are created. The translation extension area is regarded as the seamless connection of the target image projected onto the large display. The visually-sensing area is regarded as the parallax formed after the target image is projected.

[0058] (1): when the category to which the screen resolution belongs is high resolution, a floating window layer is created on the image of the large display, and a translation extension area and a viewing area corresponding to the category to which the screen resolution belongs are arranged and filled in the floating window layer according to a predetermined algorithm; S311: Matching the size of the floating window layer to a large display by creating the floating window layer based on the screen resolution; S312: Placing a floating window layer above the image on a large display; S313: locating a first translational extension region in a floating window layer based on the target image according to a predetermined translational extension region algorithm; S314: cropping a first horizontal pixel of a first horizontal ratio (e.g., 3 / 4) of the target image in a horizontal direction; S315: Filling a first horizontal pixel into a first translation expansion region; S316: after filling the first translation extension region, add a predetermined viewing algorithm to obtain a first viewing region, in which the first translation extension region includes the first viewing region; S317: cropping a first vertical pixel of a first vertical ratio (e.g., 1 / 2) in the vertical direction in the target image; S318: Filling a first vertical pixel into a first viewing area.

[0059] The system can set the layer transparency of the floating window layer corresponding to the translation extension area and the viewing area respectively. S411: Arranging the floating window layer corresponding to the first translation extension region so that the layer transparency of the floating window layer is semi-transparent; S412: Arranging the layer transparency of the floating window layer corresponding to the first viewing area to be fully transparent.

[0060] Specifically, as shown in the following Table 1, when the screen resolution is 1080p, the image resolution of the target image is, for example, 720*640, and the first horizontal ratio of, for example, 3 / 4 is selected to crop the horizontal pixels of the target image, to obtain 3*720 / 4=540, and then crop 540 pixels on each horizontal line, and obtain the length of the cropped pixels on each horizontal line to configure the first translation extension area FOV resolution, specifically, the length of the first translation extension area is 540. The translation extension algorithm crops 540 pixels on each horizontal line on the target image and fills them into the first translation extension area, and the layer transparency from left to right of the floating window layer corresponding to the first translation extension area is configured to be semi-transparent, i.e., 50%.

[0061] It should be noted that the first viewing area is arranged according to the first translation extension area of ​​the floating window layer. Therefore, after the filling and arrangement of the first translation extension area is completed, the viewing algorithm is added from left to right to the final first translation extension area to obtain the first viewing area. For example, select the first vertical ratio of 1 / 2 to crop the vertical pixels of the target image, and obtain 1*640 / 2=320. At that time, 320 pixels on each vertical line on the target image are cropped and filled into the first viewing area ROI resolution, and the layer transparency of the floating window layer corresponding to the first viewing area is arranged to be fully transparent, i.e. 100%.

[0062] (2): when the category to which the screen resolution belongs is ultra-high resolution, creating a floating window layer located on the image of the large display, and arranging and filling the translation extension area and the viewing area corresponding to the category to which the screen resolution belongs in the floating window layer according to a predetermined algorithm; S321: Matching the size of the floating window layer to a large display by creating the floating window layer based on the screen resolution; S322: Placing a floating window layer above the image on a large display; S323: Calculate a high-resolution image corresponding to a high resolution of the target image, in which the image resolution of the high-resolution image is higher than the image resolution of the target image; S324: Placing a second translational extension region in the floating window layer based on the target image according to a predetermined translational extension region algorithm; S325: horizontally cropping a second horizontal pixel of the high resolution image at a second horizontal ratio; S326: Filling a second horizontal pixel into a second translation expansion region; S327: after filling the second translation extension region, add a predetermined viewing algorithm to obtain a second viewing region, in which the second translation extension region includes the second viewing region; S328: cropping a second vertical pixel of a second vertical ratio in a vertical direction in the high resolution image; S329: Filling the second vertical pixels into the second viewing area.

[0063] Setting the layer transparency of the floating window layers corresponding to the translation extension area and the viewing area respectively S421: Arranging the floating window layer corresponding to the second translation extension region so that the layer transparency of the floating window layer is semi-transparent; S422: Arranging the layer transparency of the floating window layer corresponding to the second viewing area to be fully transparent.

[0064] Specifically, as shown in the following Table 1, when the screen resolution is 3840p, the image resolution of the target image is, for example, 720*640, and the target image needs to be converted into a high-resolution image, and the high-resolution image needs to be converted into a super high-resolution image (i.e., an image for a large display). Specifically, a high-resolution image corresponding to the high-definition resolution of the target image is calculated, and the image resolution of the high-resolution image is higher than the image resolution of the target image. That is, the high-resolution image may be the image of the large display in (1) above.

[0065] For example, the second horizontal ratio of 4 / 3 is selected to crop the horizontal pixels of the high-resolution image, and 4*1080 / 3=1440 is obtained. Then, 1440 pixels on each horizontal line are cropped, and the length of the cropped pixels on each horizontal line is obtained to configure the second translation extension area FOV resolution, specifically, the length of the second translation extension area is 1440. The translation extension algorithm crops 1440 pixels on each horizontal line on the high-resolution image and fills them into the second translation extension area, and the layer transparency from left to right of the floating window layer corresponding to the second translation extension area is configured to be semi-transparent, i.e., 50%.

[0066] Note that the second viewing area is arranged according to the second translation extension area of ​​the floating window layer. Therefore, after the filling and arrangement of the second translation extension area is completed, the viewing algorithm is added from left to right to the final second translation extension area to obtain the second viewing area. For example, the second vertical ratio of 3 / 4 is selected to cut the vertical pixels of the high-resolution image, and 3*720 / 4=540 is obtained, at which time 540 pixels on each vertical line on the high-resolution image are cut and filled into the second viewing area ROI resolution, and the layer transparency of the floating window layer corresponding to the second viewing area is arranged to be fully transparent, i.e. 100%.

[0067] [Table 1]

[0068] S50: The system composites the floating window layers with different layer transparencies with the large display to obtain a panoramic image of the target image.

[0069] Specifically, for different screen resolutions in steps S30 and S40, floating window layers with different layer transparencies are composited with the large display to obtain panoramic images with different resolutions of the target image. Specifically, when the category to which the screen resolution belongs is high resolution, seamless splicing technology is used to composite floating window layers with different layer transparencies with the large display to obtain panoramic images with high resolution of the target image. When the category to which the screen resolution belongs is super high resolution, seamless splicing technology is used to composite floating window layers with different layer transparencies with the large display to obtain panoramic images with super high resolution of the target image.

[0070] Therefore, based on steps S10 to S50, the present application uses the resolution difference to create an image of a large display (i.e., a flat panoramic image) that matches the screen resolution of the target image, and then converts the image of the large display into a 3D panoramic image through different layer transparency of the floating window layer, a parallel movement extension area algorithm, an exciting direct viewing algorithm and seamless splicing technology, thereby combining the smart large display with VR, so that the smart large display can also provide a 360° panoramic image, which can improve the user's visual experience, expand advertising, and bring convenience to users.

[0071] Based on the above method of creating a panoramic image based on a large display, the present application further provides an apparatus for creating a panoramic image based on a large display.Referring to FIG. 2, FIG. 2 shows a structural block diagram of the apparatus for creating a panoramic image based on a large display of the present application.The apparatus may include an acquisition module 100, a resolution adjustment module 200, a translation extension region module 300, a visual sensor module 400 and a panoramic synthesis module 500, and FIG. 2 shows only some parts of the apparatus, however, it is not necessary to implement all the components shown, and it should be understood that more or less components can be implemented instead.The apparatus may be any device such as a mobile phone, an ipad, a desktop computer, etc. that can connect to the Internet.

[0072] The acquisition module 100 is used to acquire the image resolution of the target image and the screen resolution of the large display. The resolution adjustment module 200 is used to calculate the resolution difference between the image resolution and the screen resolution, and adjust the target image according to the resolution difference to obtain an image for large-scale display that matches the screen resolution. The translation extension area module 300 creates a floating window layer located on the image of the large display, and arranges and fills a translation extension area corresponding to a category to which the screen resolution belongs in the floating window layer according to a predetermined algorithm, and sets a layer transparency of the floating window layer corresponding to the translation extension area, in which the translation extension area is used to transform the target image into the image of the large display through translation processing and extension processing. The visual direct viewing module 400 arranges and fills the visual direct viewing area according to a visual direct viewing algorithm based on the translation extension area module, and sets the layer transparency of the floating window layer corresponding to the visual direct viewing area, in which the visual direct viewing area is used to convert the image of the large display into a panoramic image by parallax. The panorama synthesis module 500 is used to synthesize floating window layers with different layer transparency with a large display to obtain a panoramic image of a target image.

[0073] The present application further provides a smart terminal, as shown in Fig. 3, the smart terminal 1 may be any device such as a mobile phone, an ipad, a desktop computer, etc. that can connect to the Internet. The smart terminal 1 includes a processing device 20 and a storage device 22 connected to the processing device 20, and Fig. 3 shows only some parts of the device, however, it is not necessary to implement all the components shown, and it should be understood that more or less components can be implemented instead.

[0074] In some embodiments, the storage device 22 may be an internal storage of the smart terminal 1, such as a memory of the smart terminal 1. In other embodiments, the storage device 22 may be an external storage device of the smart terminal 1, such as a plug-in USB, a Smart Media Card (SMC), a Secure Digital (SD) card, or a Flash Card disposed in the smart terminal 1. Furthermore, the storage device 22 may include both an internal storage device and an external storage device of the smart terminal 1. The storage device 22 is used to store application software and various data installed in the smart terminal 1, such as a display program code for a Web page. The storage device 22 may also be used to temporarily store output data or data to be output.

[0075] In some embodiments, the storage device 22 stores a program for displaying a web page, and the program for displaying a web page is executed by the processing device 20 as described above. The processing device 20 an acquisition module used for acquiring an image resolution of a target image and a screen resolution of a large display; A resolution adjustment module is used for calculating a resolution difference between the image resolution and the screen resolution, and adjusting the target image according to the resolution difference to obtain an image of the large display that matches the screen resolution; Create a floating window layer located on the image of the large display, and arrange and fill a translation extension area corresponding to a category to which the screen resolution belongs in the floating window layer according to a predetermined algorithm, and set a layer transparency of the floating window layer corresponding to the translation extension area, where the translation extension area is a translation extension area module used for transforming the target image into the image of the large display through translation processing and extension processing; A direct-view module is used to arrange and fill a direct-view area according to a direct-view algorithm based on a translation extension area module, and set a layer transparency of a floating window layer corresponding to the direct-view area, in which the direct-view area is used to convert the image of the large display into a panoramic image according to parallax; a panoramic synthesis module, which is used to synthesize the floating window layers with different layer transparencies with the large display to obtain a panoramic image of the target image.

[0076] The processing device 20 may be a central processing unit (CPU), a microprocessor, a baseband processor in a mobile phone or other data processing chip in some embodiments, and is used to execute program code stored in the memory device 22 or to process data, for example, to perform a method for creating a panoramic image based on a large display.

[0077] The present application further provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by the processing device 20, any of the methods for creating a panoramic image based on a large display is performed, in particular the methods described above.

[0078] Of course, it is understandable to those skilled in the art that all or part of the flow of the method of the above embodiment can be realized by a computer program that instructs related hardware (e.g., a processing device, a controller), and the program may be stored in a computer-readable storage medium, and when the program is executed, it may include the flow of the embodiment of the above method. Among them, the storage medium may be a storage device, a disk, a CD-ROM, etc.

[0079] The application of the present application is not limited to the above embodiments, and those skilled in the art may improve or modify it according to the above description, and it should be understood that all such improvements and modifications fall within the scope of protection of the claims attached to this application. [Explanation of symbols]

[0080] 1. Smart Devices 20 Processing equipment 22 Storage device 100 Acquisition Module 200 Resolution Adjustment Module 300 Translational Extension Area Module 400 Sensitive Direct Vision Module 500 Panorama Stitching Module 640 Horizontal

Claims

1. 1. A method for creating a panoramic image based on a large display, comprising: Obtaining an image resolution of a target image and a screen resolution of a large display; calculating a resolution difference between the image resolution and the screen resolution, and adjusting the target image based on the resolution difference to obtain an image for a large display that matches the screen resolution; Creating a floating window layer located on the image of the large display, and arranging and filling a translation extension area and a viewing area corresponding to the category to which the screen resolution belongs in the floating window layer according to a predetermined algorithm, wherein the translation extension area is used to transform the target image into the image of the large display through translation processing and extension processing, and the viewing area is used to transform the image of the large display into a panoramic image by parallax; setting layer transparency of the floating window layer corresponding to the translation extension area and the viewing area, respectively; and compositing the floating window layers with different layer transparencies with the large display to obtain a panoramic image of the target image.

2. Obtaining the image resolution of the target image and the screen resolution of the large display is When detecting a command to send a target image of the smart terminal, receive the target image and obtain an image resolution of the target image, and the image resolution is expressed as a horizontal pixel number * vertical pixel number of the target image; obtaining a screen resolution of the large display, the screen resolution being expressed as a number of horizontal pixels*a number of vertical pixels of the large display; The method of claim 1.

3. Calculating a resolution difference between the image resolution and the screen resolution includes: calculating a resolution difference between the number of horizontal pixels in the image resolution and the number of horizontal pixels in the screen resolution; and calculating a resolution difference between the number of vertical pixels in the image resolution and the number of vertical pixels in the screen resolution. The method of claim 2.

4. Calculating a resolution difference between the image resolution and the screen resolution, and adjusting the target image based on the resolution difference to obtain an image for a large display that matches the screen resolution, calculating a difference between the number of horizontal pixels in the image resolution and the number of horizontal pixels in the screen resolution to obtain a horizontal resolution difference; If the absolute value of the difference in horizontal resolution is equal to 0, setting the target image to an image of a large display that matches the screen resolution. The method of claim 3.

5. Calculating a resolution difference between the image resolution and the screen resolution, and adjusting the target image based on the resolution difference to obtain an image for a large display that matches the screen resolution, if the absolute value of the difference in horizontal resolution is not equal to 0, setting the absolute value of the difference in horizontal resolution as the number of pixels to be filled in the horizontal direction of the target image; The method of claim 4.

6. If the absolute value of the difference in horizontal resolution is not equal to 0, setting the absolute value of the difference in horizontal resolution as the number of pixels to be filled in the horizontal direction of the target image; determining a color to be filled and obtaining color values ​​corresponding to the color to be filled, and filling the target image with the color values ​​to obtain an image for a large display that matches the screen resolution; The method of claim 5.

7. Determining a to-be-filled color and obtaining a color value corresponding to the to-be-filled color includes: Obtaining a color value of each color to be filled in the target image and the number of pixels corresponding to each color to be filled, and the color value of each color to be filled includes an R value, a G value, and a B value; Calculating average values ​​of R, G and B values ​​based on the first color value of each color to be filled and the number of pixels corresponding to each color to be filled, respectively, to obtain an average value of R, an average value of G and an average value of B; determining a color corresponding to the average value of the R, the average value of the G, and the average value of the B, the color being a color to be filled, and the color value of the color to be filled being the average value of the R, the average value of the G, and the average value of the B; The method of claim 6.

8. If the category to which the screen resolution belongs is high resolution, creating a floating window layer located on the image of the large display, and arranging and filling a translation extension region and a viewing region corresponding to the category to which the screen resolution belongs in the floating window layer according to a predetermined algorithm; matching the size of the floating window layer to the large display by creating a floating window layer based on the screen resolution; placing the floating window layer above an image on the large display; placing a first translational expansion region in the floating window layer based on the target image according to a predetermined translational expansion region algorithm; horizontally cropping the target image at a first horizontal ratio of first horizontal pixels; filling the first horizontal pixels into the first translation expansion region; After filling the first translation extension region, add a predetermined visually sensed algorithm to obtain a first visually sensed region, wherein the first translation extension region includes the first visually sensed region; cropping first vertical pixels in the target image in a vertical direction at a first vertical ratio; and filling the first vertical pixels into the first viewing area. The method of claim 1.

9. Setting the layer transparency of the floating window layer corresponding to the translation extension area and the viewing area, respectively, includes: The layer transparency of the floating window layer corresponding to the first translation extension region is arranged to be semi-transparent; and arranging the floating window layer corresponding to the first viewing area so that the layer transparency of the floating window layer is fully transparent. The method of claim 8.

10. Compositing the floating window layers with different layer transparencies with the large display to obtain a panoramic image of the target image, and compositing the floating window layers with different layer transparencies with the large display using a seamless splicing technique to obtain a high-resolution panoramic image of the target image.

10. The method of claim 9.

11. If the category to which the screen resolution belongs is super high resolution, creating a floating window layer located on the image of the large display, and arranging and filling a translation extension region and a viewing region corresponding to the category to which the screen resolution belongs in the floating window layer according to a predetermined algorithm; matching the size of the floating window layer to the large display by creating a floating window layer based on the screen resolution; placing the floating window layer above an image on the large display; calculating a high-resolution image corresponding to a high resolution of the target image, wherein the image resolution of the high-resolution image is higher than the image resolution of the target image; placing a second translational expansion region in the floating window layer according to a predetermined translational expansion region algorithm; horizontally cropping the high resolution image at a second horizontal ratio of second horizontal pixels; filling the second horizontal pixels into the second translation expansion region; After filling the second translation extension region, adding a predetermined visually-oriented algorithm to obtain a second visually-oriented region, wherein the second translation extension region includes the second visually-oriented region; obtaining second vertical pixels in the high resolution image in a vertical direction at a second vertical ratio; and filling the second vertical pixels into the second viewing area. The method of claim 1.

12. Setting the layer transparency of the floating window layer corresponding to the translation extension area and the viewing area, respectively, includes: The layer transparency of the floating window layer corresponding to the second translation extension region is arranged to be semi-transparent; and arranging the layer transparency of the floating window layer corresponding to the second viewing area to be fully transparent. The method of claim 11.

13. Compositing the floating window layers with different layer transparencies with the large display to obtain a panoramic image of the target image, using seamless splicing technology to composite the floating window layers with different layer transparencies with the large display to obtain a super high-resolution panoramic image of the target image; The method of claim 12.

14. an acquisition module used to acquire the image resolution of the target image and the screen resolution of the large display; a resolution adjustment module used to calculate a resolution difference between the image resolution and the screen resolution, and adjust the target image according to the resolution difference to obtain an image for a large display that matches the screen resolution; a translation extension region module for creating a floating window layer located on the image of the large display, and arranging and filling a translation extension region in the floating window layer according to a predetermined algorithm, the translation extension region corresponding to a category to which the screen resolution belongs, and setting a layer transparency of the floating window layer corresponding to the translation extension region, wherein the translation extension region is used to transform the target image into the image of the large display through translation processing and extension processing; a viewing module that arranges and fills a viewing area according to a viewing algorithm based on the translation expansion area module, and sets a layer transparency of a floating window layer corresponding to the viewing area, wherein the viewing area is used to convert the image of the large display into a panoramic image according to parallax; a panoramic synthesis module used to synthesize the floating window layers with different layer transparencies with the large display to obtain a panoramic image of the target image; A device that creates panoramic images based on a large display.

15. Obtaining the image resolution of the target image and the screen resolution of the large display is When detecting a command to send a target image of the smart terminal, receive the target image and obtain an image resolution of the target image, and the image resolution is expressed as a horizontal pixel number * a vertical pixel number of the target image; obtaining a screen resolution of the large display, the screen resolution being expressed as a number of horizontal pixels*a number of vertical pixels of the large display; 15. An apparatus for creating panoramic images based on a large display according to claim 14.

16. Calculating a resolution difference between the image resolution and the screen resolution, and adjusting the target image based on the resolution difference to obtain an image for a large display that matches the screen resolution, calculating a difference between the number of horizontal pixels in the image resolution and the number of horizontal pixels in the screen resolution to obtain a horizontal resolution difference; If the absolute value of the difference in horizontal resolution is equal to 0, the target image is an image of a large display that matches the screen resolution; If the absolute value of the difference in horizontal resolution is not equal to 0, set the absolute value of the difference in horizontal resolution as the number of pixels to be filled in the horizontal direction of the target image, determine the color to be filled, and obtain a color value corresponding to the color to be filled, and fill the target image with the color value to obtain an image for a large display that matches the screen resolution.

16. An apparatus for creating panoramic images based on a large display according to claim 15.

17. If the category to which the screen resolution belongs is high resolution, creating a floating window layer located on the image of the large display, and arranging and filling a translation extension region and a viewing region corresponding to the category to which the screen resolution belongs in the floating window layer according to a predetermined algorithm; matching the size of the floating window layer to the large display by creating a floating window layer based on the screen resolution; placing the floating window layer above an image on the large display; placing a first translational expansion region in the floating window layer based on the target image according to a predetermined translational expansion region algorithm; horizontally cropping the target image at a first horizontal ratio of first horizontal pixels; filling the first horizontal pixels into the first translation expansion region; After filling the first translation extension region, add a predetermined visually sensed algorithm to obtain a first visually sensed region, wherein the first translation extension region includes the first visually sensed region; cropping first vertical pixels in the target image in a vertical direction at a first vertical ratio; and filling the first vertical pixels into the first viewing area.

15. An apparatus for creating panoramic images based on a large display according to claim 14.

18. If the category to which the screen resolution belongs is super high resolution, creating a floating window layer located on the image of the large display, and arranging and filling a translation extension region and a viewing region corresponding to the category to which the screen resolution belongs in the floating window layer according to a predetermined algorithm; matching the size of the floating window layer to the large display by creating a floating window layer based on the screen resolution; placing the floating window layer above an image on the large display; calculating a high-resolution image corresponding to a high resolution of the target image, wherein the image resolution of the high-resolution image is higher than the image resolution of the target image; placing a second translational expansion region in the floating window layer based on the high resolution image by a predetermined translational expansion region algorithm; horizontally cropping the high resolution image at a second horizontal ratio of second horizontal pixels; filling the second horizontal pixels into the second translation expansion region; After filling the second translation extension region, adding a predetermined visually-oriented algorithm to obtain a second visually-oriented region, wherein the second translation extension region includes the second visually-oriented region; cropping second vertical pixels in the high resolution image in a vertical direction at a second vertical ratio; and filling the second vertical pixels into the second viewing area.

15. An apparatus for creating panoramic images based on a large display according to claim 14.

19. A smart terminal including a display panel of a large display, a storage device, a processing device, and a program for creating a panoramic image based on a large display stored in the storage device and executable by the processing device, wherein when the processing device executes the program for creating a panoramic image based on a large display, the method for creating a panoramic image based on a large display according to any one of claims 1 to 13 is implemented. Smart device.

20. a computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processing device, the method for creating a panoramic image based on a large display according to any one of claims 1 to 13 is implemented; A computer-readable storage medium.

Citation Information

Patent Citations

  • Image content generation method and image content generation apparatus

    JP2010512086A

  • Image data encoding / decoding method and device

    JP2019536314A