Oversmoothing Progressive Images
Oversmoothing progressively encoded images as the first layer addresses the issue of disappearing features in JPEGs, enhancing user experience and reducing processing requirements.
Patent Information
- Application Number
- JP2022569240
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-07-29
- Filing Date
- 2021-04-27
- Publication Date
- 2024-12-04
- Estimated Expiration
- 2041-04-27
AI Technical Summary
Progressively encoded images, such as JPEGs, suffer from artifacts where image features disappear during rendering, disrupting the user experience and requiring increased processing resources.
Display an oversmoothed version of the image as the first layer, using a smoothing kernel like a Gaussian kernel, and subsequently render additional layers on top to maintain recognizable features throughout the loading process.
This approach provides a less disruptive loading experience by maintaining recognizable image features and reducing processing demands, allowing faster image loading without additional infrastructure.
Smart Images

Figure 0007594609000001 
Figure 0007594609000002 
Figure 0007594609000003
Abstract
Description
[Technical field]
[0001] REFERENCE TO RELATED APPLICATIONS This application claims priority to U.S. Provisional Patent Application No. 62 / 706,055, filed July 29, 2020, and entitled “Over-Smoothing Progressive Images,” the disclosure of which is incorporated herein by reference in its entirety.
[0002] This description relates to displaying progressively encoded images (eg, progressive JPEG) as the progressive images are received by a client computer. [Background technology]
[0003] background In non-progressive JPEG, the image data is organized so that the resulting image is rendered row-by-row from top to bottom on the display. In progressive JPEG, the image data is organized so that the resulting image is rendered in multiple scans, with each scan providing more and more information about the image. Summary of the Invention [Means for solving the problem]
[0004] An embodiment provides a scheme for displaying progressively encoded images using over-smoothing. Conventionally, progressively encoded images are displayed without smoothing. Nevertheless, rendering an over-smoothed image on a display and then rendering subsequent image layers on the over-smoothed image may be less confusing to a user than, for example, displaying the final image on a white background. The over-smoothed image may be smoothed according to a smoothing kernel, for example, a convolution kernel (Gaussian). The over-smoothed image is the first layer on which other image layers are displayed. Note that the over-smoothed image may present a recognizable version of the image to the user, including recognizable versions of various image features (e.g., people, objects). When other layers are rendered on the display, these image features remain visible to the user. That is, the image features are not artifacts that may disappear with the rendering of the final image layer. This may occur with conventional progressively encoded images, disrupting the user experience.
[0005] In one general aspect, a method may include transmitting a request from a client to access image data representing an image. The method may also include receiving a first portion of the image data representing a first image layer including a first set of features after transmitting the request. The method may include rendering an over-smoothed version of the image as the first layer on a display associated with the client, the over-smoothed version of the image including a plurality of colors. The method may include receiving a second portion of the image data representing a set of additional image layers after receiving the first portion of the image data on the client. The method may include rendering the set of additional image layers on the display while displaying the first set of features of the first layer on the display.
[0006] In another general aspect, a computer program product includes a non-transitory storage medium, the computer program product including code that, when executed by a processing circuit of a computing device, causes the processing circuit to perform a method. The method may also include transmitting a request from a client to access image data representing an image. The method may include receiving a first portion of the image data representing a first image layer including a first set of features after transmitting the request. The method may include rendering an over-smoothed version of the image as the first layer on a display associated with the client, the over-smoothed version of the image including a plurality of colors. The method may include receiving a second portion of the image data representing a set of additional image layers after receiving the first portion of the image data on the client. The method may include rendering the set of additional image layers on the display while displaying the first set of features of the first layer on the display.
[0007] In another general aspect, an electronic device configured to generate a recrawling policy includes a memory and a control circuit coupled to the memory. The control circuit may also be configured to transmit a request from a client to access image data representing an image. The control circuit may be configured to receive a first portion of the image data representing a first image layer including a first set of features after transmitting the request. The control circuit may be configured to render an over-smoothed version of the image as the first layer on a display associated with the client, the over-smoothed version of the image including a plurality of colors. The control circuit may be configured to receive a second portion of the image data representing a set of additional image layers after receiving the first portion of the image data on the client. The control circuit may be configured to render the set of additional image layers on the display while displaying the first set of features of the first layer on the display.
[0008] The details of one or more embodiments are set forth in the accompanying drawings and the description below. Other features will be apparent from the description and drawings, and from the claims. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 illustrates an exemplary electronic environment in which the improved techniques described herein may be implemented. [Diagram 2] 1 is a flowchart illustrating an example method of operating an augmented reality system in accordance with implementations of the present disclosure. [Diagram 3] FIG. 1 illustrates an example of a computing device and a mobile computing device that can be used to implement the described techniques. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Detailed Description A progressively encoded image (e.g., in the JPEG format) can be considered equivalent to the interlaced GIF graphics interchange format. For example, a progressively encoded JPEG may be an image created using the JPEG suite of compression algorithms that fades in successive waves of lines until the entire image is completely reached.
[0011] A technical problem with progressively coded JPEG is that some image features are only present in the preview when the previous version contains artifacts that will be corrected in future layers. This means that in conventional progressively coded JPEG, some new details appear while other features that may have caught the viewer's eye disappear. In particular, block structure is a feature that disappears in simple progression. Such disappearing artifacts can interfere with the user experience because the disappearing features do not match the user's expectations.
[0012] Furthermore, in the JPEG image format, progressive images tend to be about 10% smaller and otherwise load faster because progression allows different entropy coding to be used for different discrete cosine transform (DCT) coefficients. However, some progressively encoded JPEG images use increased processing unit and memory bandwidth.
[0013] According to embodiments described herein, a technical solution to the above-mentioned technical problem includes displaying an over-smoothed version of an image as image data is being received. For example, rendering an over-smoothed image on a display and then rendering subsequent image layers on the over-smoothed image may be less confusing to a user than, for example, displaying the final image on a white background. The over-smoothed image may be smoothed according to a smoothing kernel, for example, a convolution kernel (such as a Gaussian kernel). The over-smoothed image is the first layer on which other image layers are displayed. Note that the over-smoothed image may present a recognizable version of an image to a user, including recognizable versions of various image features (e.g., people, objects). When other layers are rendered on the display, these image features remain visible to the user. That is, the image features are not an artifact that may disappear with the rendering of the final image layer. This may occur with conventional progressively encoded images, disrupting the user experience.
[0014] A technical advantage of the disclosed embodiments is that the above-described progressively encoded images load very quickly, forming the basis for a less disruptive loading process, and may load faster than conventional progressively encoded images.
[0015] In some embodiments, the client running the browser has a control parameter that specifies the amount of smoothing to be applied to the progressive phase of the image. The value of this parameter may be defaulted to a high smoothing level to allow most websites to provide an over-smoothed rendering, while faster websites can be implemented using normal progression.
[0016] When an image has a progression configured for over-smoothing, e.g., when a DC group is sent in the first phase, the receiving client calculates the user's observed bandwidth versus the remaining memory left for that image. If the remaining download time exceeds a certain time interval (e.g., 1 second), the client renders an over-smoothed version of the DC image while the rest of the image is loading.
[0017] The client computer displays the oversmoothed version while the AC portion is loading. Loading the final image after we show the oversmoothed image is less confusing than showing the final image on a white background, and the oversmoothed image can be loaded more quickly.
[0018] When the client computer has enough data to render the first preview, it sends a signal through different layers of the browser content encoding layers, so that the client computer can render the first image sooner than it would be used, when a certain percentage of the data has loaded and a first analysis would be performed.
[0019] During loading, the client computer can either replace the oversmoothed version in a top-to-bottom order so that a normal sequential JPEG is painted over the background, or fade the AC into the oversmoothed version. This is advantageous when the client computer has high graphics capabilities but relatively low bandwidth compared to the image download size. The fade in the final image does not cause flash / flicker (relatively quickly), i.e. it is even less distracting to the viewer than a direct transition from oversmoothed to final image.
[0020] The maximum smoothing parameter value is equal to the background color used. Large smoothing results in a preview image of, for example, 200 bytes. However, alternative solutions with much less smoothing are still possible, giving a sense of more detail and more responsiveness. Often, for high quality images, about 6% of the image is needed to be able to show this first image. Given that a typical image is about 50 kB, the DC actually averages out to 3000 bytes, giving a much finer resolution than the 200 byte approach achieved with large smoothing parameter values. Furthermore, this extra data does not need to be transmitted at all, and no additional Javascript and / or server-side infrastructure is required to maintain the data. In addition to using existing data, savings in the total transmission size of JPEG can be achieved while adding this feature. Furthermore, this mode also corresponds to the progressive mode of the JPEG XL standard.
[0021] In the above technical solution embodiment, the DC image can be maintained at 1 pixel per 8x8 block. This solves a common problem with progression that nearly doubles memory bandwidth requirements. Furthermore, this allows less data to be transferred between the CPU and the GPU when the GPU is used for final oversmoothing.
[0022] 1 is a diagram showing an exemplary electronic environment 100 in which the above-mentioned technical solutions can be implemented. The electronic environment 100 includes a client computer 120 configured to perform image compression and decompression.
[0023] The computer 120 includes a network interface 122, one or more processing units 124, a memory 126, and a display interface 128. The network interface 122 includes, for example, an Ethernet adapter, a token ring adapter, etc., for converting electronic and / or optical signals received from the network 150 into an electronic format for use by the computer 120. The set of processing units 124 includes one or more processing chips and / or assemblies. The memory 126 includes both volatile memory (e.g., RAM) and non-volatile memory, such as one or more ROMs, disk drives, solid state drives, etc. The set of processing units 124 and the memory 126 together form control circuitry configured and arranged to perform various methods and functions as described herein.
[0024] In some embodiments, one or more of the components of computer 120 may be or include a processor (e.g., processing unit 124) configured to process instructions stored in memory 126. Examples of such instructions as shown in FIG. 1 include an image manager 130, an over-smoothing manager 140, and a rendering manager 150. Memory 126 also stores various data described for each manager that uses such data as shown in FIG. 1. Note that in some embodiments, the entity page corresponds to an offer page that includes offers to sell products.
[0025] Image manager 130 is configured to receive or obtain image data 132. In some embodiments, image manager 130 is configured to receive or obtain image data 132 via network interface 122, i.e., over a network (such as network 190) from display device 170. In some embodiments, image manager 130 is configured to receive or obtain image data 132 from local storage (e.g., a disk drive, flash drive, SSD, etc.).
[0026] Image data 132 represents a color image. Image data 132 includes a set of pixels, each of which includes a coordinate in the image and a set of numerical values, each of which represents a value in a color channel. In some embodiments, the color channels used in image data 132 are RBG, e.g., RGB data 133.
[0027] Image manager 130 is also configured to receive image data 132 in portions, i.e., first portion 134(1), second portion 134(2), up to Mth portion 134(M). When image data 132 is configured for over-smoothing, e.g., when a DC group is sent in first portion 134(1), image manager 130 is configured to calculate an observed bandwidth for the remaining memory left for that image. In some embodiments, if the remaining download time exceeds a certain time interval (e.g., 1 second), client computer 120 (e.g., rendering manager 150) renders an over-smoothed version of first portion 134(1) while the rest of the image is being loaded.
[0028] Over-smoothing manager 140 is configured to perform an over-smoothing operation on first portion 134(1) of image data 132 to generate over-smoothing image data 142. In some embodiments, the over-smoothing operation involves convolving first portion 134(1) with a blur kernel (e.g., blur kernel data 154). In some embodiments, the over-smoothing operation is controlled using over-smoothing parameter data 144, which takes the form of a real value indicating how much over-smoothing should occur. In some embodiments, when the convolution kernel is a Gaussian function, the over-smoothing parameter takes the form of a Gaussian width; in this case, a smaller value indicates less smoothing.
[0029] Over-smoothed image data 142 represents a DC image resulting from an over-smoothing operation performed on the first portion 134(1) of the image. Over-smoothed image data 142 is constructed, in some embodiments, using only a small amount (<10%) of the total image data 132. Despite the small amount of data, over-smoothed image data 142 is often a facsimile of an image that is recognizable to a user, including features of human features, objects, etc., depending on the value of over-smoothing parameter data 144.
[0030] The rendering manager 150 is configured to perform rendering operations on each image layer, e.g., representing portions 134(1), 134(2), ..., 134(M). The rendering manager 150 is configured to render the image layers in such a way as to preserve image features from the over-smoothed (first) image layer. That is, the first image layer does not include artifacts that can be removed upon further rendering. In this way, the image rendering process provides an improved user experience from a psychovisual point of view. As shown in FIG. 1, the rendering manager 150, in some embodiments, includes a cross-fading manager 152.
[0031] The cross-fade manager 152 is configured to perform a cross-fade operation on the subsequent image layer (i.e., the portion corresponding to the second portion 134(2) and the subsequent image portion). For example, the image may be divided into blocks of, for example, 8×8 pixels, as is done in computing the DCT coefficients. The cross-fade is applied to merge the high frequency image portion into the low frequency background or first layer. In some embodiments, the corner 2×2 sub-blocks of the 8×8 blocks are cross-faded into the background. In some embodiments, when the image is arranged in an array of tiles, for example 256×256 tiles, the cross-fade manager 152 is configured to perform a cross-fade operation on a single tile and merge that tile into the blurred background / layer. However, the cross-fade manager 152 is also configured not to perform a cross-fade operation on two tiles consecutively.
[0032] The cross-fading manager 152, in some embodiments, is configured to perform a linear interpolation between the blurred image and the final image. The weighting coefficients for the linear interpolation may depend on the temporal and spatial position. For example, when the finer resolution tile is ready for display, the boundary of the tile may remain cross-faded between the blurred version of the tile and the finer resolution version such that no sharp boundary appears in the image. The cross-fading manager 152 may gradually increase the weight of the finer resolution image in time so that it appears as a gradual effect rather than as a rapid flash.
[0033] In some embodiments, for example, corners of an 8x8 block (e.g., a 2x2 corner) may be filtered using an order-dependent filter such as a median filter. Another possibility for block corners is to calculate how far the value is from the average and give the furthest pixels the least weight, for example by weighting the pixels by their inverse distance to the average, or by adding a small epsilon to the distance before the inversion.
[0034] The cross-fade can work with any selected smoothing algorithm. The cross-fade operation, in some embodiments, is a convolution operation using a blur kernel 154, which may be Gaussian, but whose width may be smaller than that used for the over-smoothing operation.
[0035] The crossfading may be a spatially and temporally variable linear interpolation between sharp and smooth representations of the image, as described above. In some embodiments, when the crossfading is animated, different convolutions may be performed between keyframes of the animation, i.e., sharper interpolations before moving to the next layer of sharpening.
[0036] In some embodiments, the smoothing is performed in frequency space, i.e., on the DCT coefficients, while in other embodiments, the smoothing is performed across pixels.
[0037] In some embodiments, the smoothing is performed using the GPU and the animation is performed using the GPU. In other embodiments, the smoothing is performed by the CPU. When the smoothing is performed by DCT space, in some embodiments, when new coefficients are loaded, it keeps the smoother coefficients and replaces only those coefficients that were transmitted. In some embodiments, all smoothed coefficients are set to zero. In some embodiments, another smoothing operation is performed to obtain a better set of DCT values for the untransmitted coefficients.
[0038] The components of the user device 120 (e.g., modules, processing units 124) may be configured to operate based on one or more platforms (e.g., one or more similar or different platforms), which may include one or more types of hardware, software, firmware, operating systems, runtime libraries, etc. In some embodiments, the components of the computer 120 may be configured to operate within a cluster of devices (e.g., a server farm). In such embodiments, the functionality and processing of the components of the computer 120 may be distributed across several devices of the cluster of devices.
[0039] The components of computer 120 may be or include any type of hardware and / or software configured to process attributes. In some embodiments, one or more portions of the components shown in the components of computer 120 of FIG. 1 may be or include hardware-based modules (e.g., digital signal processor (DSP), field programmable gate array (FPGA), memory), firmware modules, and / or software-based modules (e.g., modules of computer code, sets of computer-readable instructions that can be executed by a computer). For example, in some embodiments, one or more portions of the components of computer 120 may be or include software modules configured for execution by at least one processor (not shown). In some embodiments, the functionality of a component may be included in different modules and / or different components than those shown in FIG. 1, including combining functionality shown as two components into a single component.
[0040] Although not shown, in some embodiments, components of computer 120 (or portions thereof) may be configured to operate within, for example, a data center (e.g., a cloud computing environment), a computer system, one or more server / host devices, etc. In some embodiments, components of computer 120 (or portions thereof) may be configured to operate within a network. Thus, components of computer 120 (or portions thereof) may be configured to function within various types of network environments, which may include one or more devices and / or one or more server devices. For example, the network may be or include a local area network (LAN), a wide area network (WAN), etc. The network may be or include a wireless network and / or a wireless network implemented using, for example, gateway devices, bridges, switches, etc. The network may include one or more segments and / or have portions based on various protocols, such as Internet Protocol (IP) and / or proprietary protocols. The network may include at least a portion of the Internet.
[0041] In some embodiments, one or more of the components of computer 120 may be or include a processor configured to process instructions stored in a memory. For example, image manager 130 (and / or portions thereof), over-smoothing manager 140 (and / or portions thereof), and rendering manager 150 (and / or portions thereof) may be a combination of a processor and memory configured to execute process-related instructions to implement one or more functions.
[0042] In some embodiments, memory 126 may be any type of memory, such as random access memory, disk drive memory, flash memory, etc. In some embodiments, memory 126 may be implemented as multiple memory components (e.g., multiple RAM components or disk drive memory) associated with components of VR server computer 120. In some embodiments, memory 126 may be database memory. In some embodiments, memory 126 may be or include non-local memory. For example, memory 126 may be or include memory shared by multiple devices (not shown). In some embodiments, memory 126 may be associated with a server device (not shown) in a network and configured to provide services to components of computer 120. As shown in FIG. 1, memory 126 is configured to store various data, including image data 132, over-smoothed image data 142, and blur kernel data 154.
[0043] 2 is a flow chart illustrating an exemplary method 200 in accordance with the improved technique described above. The method 200 is performed by the software configuration described in connection with FIG. 1, which resides in the memory 126 of the computer 120 and is executed by the set of processing units 124.
[0044] At 202, image manager 130 sends a request to access image data representing an image.
[0045] At 204, after sending the request, the image manager 130 receives a first portion of image data, the first portion of image data representing a first image layer, the first layer including a first set of features.
[0046] At 206, the over-smoothing manager 140 and the rendering manager 150 render an over-smoothed version of the image on a display associated with the client as a first layer, the over-smoothed version of the image including a plurality of colors.
[0047] At 208, the image manager 130 receives a second portion of the image data at the client after receiving the first portion of the image data, the second portion of the image data representing an additional set of image layers.
[0048] At 210, the rendering manager 150 renders a set of additional image layers onto the display while displaying the first set of features of the first layer on the display.
[0049] 3 shows an example of a general purpose computing device 300 and a general purpose mobile computing device 350 that may be used with the techniques described herein. The computing device 300 is one example configuration of the computer 120 of FIG.
[0050] As shown in Figure 3, computing device 300 is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. Computing device 350 is intended to represent various forms of mobile devices, such as personal digital assistants, cellular telephones, smart phones, and other similar computing devices. The components, their connections and relationships, and their functions depicted herein are merely exemplary and are not intended to limit the embodiments of the invention described and / or claimed herein.
[0051] Computing device 300 includes a processor 302, a memory 304, a storage device 306, a high-speed interface 308 that connects to memory 304 and a high-speed expansion port 310, and a low-speed interface 312 that connects to a low-speed bus 314 and storage device 306. Each of components 302, 304, 306, 308, 310, and 312 are interconnected using various buses and may be implemented on a common motherboard or in other manners as desired. Processor 302 may process instructions for execution within computing device 300, including instructions stored in memory 304 or storage device 306, to display graphical information for a GUI on an external input / output device such as a display 316 coupled to high-speed interface 308. In other embodiments, multiple processors and / or multiple buses may be used, along with multiple memories and types of memory, as desired. Multiple computing devices 300 may also be connected, with each device providing a portion of the required operations (e.g., as a bank of servers, a group of blade servers, or a multi-processor system).
[0052] The memory 304 stores information within the computing device 300. In one embodiment, the memory 304 is one or more volatile memory units. In another embodiment, the memory 304 is one or more non-volatile memory units. The memory 304 may also be another form of computer-readable medium, such as a magnetic disk or optical disk.
[0053] The storage device 306 can provide mass storage for the computing device 300. In one embodiment, the storage device 306 can be or include a computer-readable medium such as a floppy disk device, a hard disk device, an optical disk device, or a tape device, a flash memory or other similar solid-state memory device, or an array of devices including devices in a storage area network or other configuration. The computer program product can be tangibly embodied in an information carrier. The computer program product can also include instructions that, when executed, perform one or more methods, such as those described above. The information carrier is a computer-readable or machine-readable medium, such as the memory 304, the storage device 306, or a memory on the processor 302.
[0054] The high-speed controller 308 manages bandwidth-intensive operations for the computing device 300, and the low-speed controller 312 manages less bandwidth-intensive operations. Such an allocation of functions is merely exemplary. In one embodiment, the high-speed controller 308 is coupled to the memory 304, the display 316 (e.g., via a graphics processor or accelerator), and a high-speed expansion port 310 that can accept various expansion cards (not shown). In this embodiment, the low-speed controller 312 is coupled to the storage device 306 and a low-speed expansion port 914. The low-speed expansion ports, which may include various communication ports (e.g., USB, Bluetooth, Ethernet, wireless Ethernet), may be coupled, for example, via a network adapter, to one or more input / output devices, such as a keyboard, a pointing device, a scanner, or a networking device such as a switch or router.
[0055] The computing device 300 may be implemented in a number of different forms, as shown in the figure. For example, it may be implemented as a standard server 320, or multiple times in a group of such servers. It may also be implemented as part of a rack server system 324. In addition, it may be implemented in a personal computer, such as a laptop computer 322. Alternatively, components from the computing device 300 may be combined with other components in a mobile device (not shown), such as device 350. Each such device may include one or more of the computing devices 300, 350, and the entire system may be made up of multiple computing devices 300, 350 in communication with each other.
[0056] Various implementations of the systems and techniques described herein may be realized in digital electronic circuitry, integrated circuits, specially designed ASICs (application-specific integrated circuits), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include embodiments in one or more computer programs executable and / or interpretable on a programmable system including at least one programmable processor, which may be special purpose or general purpose, coupled to receive data and instructions from a storage system, at least one input device, and at least one output device, and to transmit data and instructions to the storage system, the at least one input device, and the at least one output device.
[0057] These computer programs (also known as programs, software, software applications or codes) contain machine instructions for a programmable processor and may be implemented in a high-level procedural and / or object-oriented programming language and / or in an assembly / machine language. As used herein, the term "machine-readable medium" or "computer-readable medium" refers to any computer program product, apparatus, and / or device used to provide machine instructions and / or data to a programmable processor (e.g., magnetic disks, optical disks, memory, programmable logic devices (PLDs)), including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and / or data to a programmable processor.
[0058] To provide for user interaction, the systems and techniques described herein can be implemented on a computer having a display device (e.g., a cathode ray tube (CRT) or liquid crystal display (LCD) monitor) for displaying information to the user, and a keyboard and pointing device (e.g., a mouse or trackball) by which the user can provide input to the computer. Other types of devices can also be used to provide for user interaction; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.
[0059] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or includes middleware components (e.g., an application server), or includes front-end components (e.g., a client computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described herein), or includes any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communications network). Examples of communications networks include a local area network ("LAN"), a wide area network ("WAN"), and the Internet.
[0060] A computing system may include clients and servers. Clients and servers are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
[0061] Although several embodiments have been described, it will be understood that various modifications may be made without departing from the spirit and scope of the present invention.
[0062] It will also be understood that when an element is referred to as being on, connected to, electrically connected to, coupled to, or electrically coupled to another element, the element may be directly on, connected to, or coupled to another element, or there may be one or more intervening elements. In contrast, when an element is referred to as being directly on, directly connected to, or directly coupled to another element, there are no intervening elements. Although the terms directly on, directly connected, or directly coupled may not be used throughout the detailed description, elements that are shown as being directly on, directly connected, or directly coupled may be referred to as such. The claims of this application may be amended to recite the exemplary relationships described herein or shown in the drawings.
[0063] Although some features of the described embodiments have been shown as described herein, many modifications, substitutions, changes, and equivalents will occur to those skilled in the art. It should therefore be understood that the appended claims are intended to cover all such modifications and changes that fall within the scope of the embodiments. It should be understood that these are presented only by way of example and not by way of limitation, and that various changes in form and details may be made. Any part of the apparatus and / or method described herein may be combined in any combination, except mutually exclusive combinations. The embodiments described herein may include various combinations and / or subcombinations of the functions, components and / or features of the different embodiments described.
[0064] Additionally, the logic flows depicted in the figures do not require the particular order shown, or sequential order, to achieve desired results. Additionally, other steps may be provided or steps may be eliminated from the described flows, and other components may be added to or removed from the described systems. Accordingly, other embodiments are within the scope of the following claims.
Claims
1. Sending a request from a client to access image data representing an image; receiving, after sending the request, a first portion of the image data representing a first layer including a first set of features; and rendering an over-smoothed version of the image as the first layer on a display associated with the client, the over-smoothed version of the image including a plurality of colors, the image being over-smoothed based on parameters specifying an amount of smoothing to be applied to a progressive phase of the image; receiving a second portion of the image data representing an additional set of image layers at the client after receiving the first portion of the image data; rendering the set of additional image layers on the display while displaying the first set of features of the first layer on the display.
2. the first layer is rendered onto a set of image pixels of the image; the set of additional image layers represented by the second portion of the image data includes a second layer and a third layer; The method further comprises: rendering a second set of image features as the second layer on a first subset of the set of image pixels; and rendering a third set of image features as the third layer on a second subset of the set of image pixels.
3. the first layer is rendered onto a set of image pixels of the image; the set of additional image layers represented by the second portion of the image data includes a second layer; The method of claim 1 , further comprising rendering a second set of image features on the first layer as the second layer.
4. The method of claim 3 , wherein rendering the second set of features comprises performing a cross-fade operation on a subset of the set of image pixels.
5. The method of claim 4 , wherein the cross-fade operation comprises a convolution operation with a particular blur kernel.
6. The cross-fade operation is applied to sub-blocks of a block of pixels; The method according to claim 4 or 5, wherein the sub-blocks are located at the corners of a block.
7. 7. The method of claim 1, wherein rendering the over-smoothed version of the image on the display comprises performing an over-smoothing operation to generate the over-smoothed version of the image according to user-specified values of over-smoothing parameters.
8. The method of claim 7, further comprising: rendering the set of additional image layers on the display while displaying the first set of features of the first layer on the display, the additional image layers being displayed on the display; 8. A method according to claim 1, further comprising: rendering the set of additional image layers on the display while displaying the first set of features of the first layer on the display when a download time of the second portion of the image data to the client exceeds a particular time interval.
9. A program causing a processing circuit of a computing device to carry out the method of any one of claims 1 to 8.
10. Memory, a control circuit coupled to the memory; 9. An electronic device, wherein the control circuitry implements the method according to any one of claims 1 to 8.
Citation Information
Patent Citations
Partial image search in compressed domains
JP2002528969A
Systems and methods for managing communication and / or storage of image data
JP2008517540A
Rendering an image on a display screen
US20150213632A1
Creating and displaying multi-layered augemented reality
US20200302664A1
Gathering data from a database for display
US7127453B1
