System and method for specular highlights on object photos
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2015-04-21
- Publication Date
- 2026-08-11
AI Technical Summary
[0008]对于某些商家或行业而言,转换到在线显示和陈列室可能因此是困难的
[0009] To address at least some of the aforementioned problems, embodiments of this application provide systems and methods for specular highlights on object photographs.
Smart Images

Figure CN116109722B_ABST
Abstract
Description
[0001] This application is a divisional application of the Chinese national phase application (201580032600.9) of PCT international application No. PCT / US2015 / 026908, filed on April 21, 2015.
[0002] Priority requirements
[0003] This international application claims the benefit of priority to U.S. Patent Application No. 14 / 260,091, filed April 23, 2014, the entire contents of which are incorporated herein by reference.
[0004] Copyright Notice
[0005] This patent document contains a portion of copyrighted material. The copyright holder does not object to any reproduction of the patent document or the patent disclosure as it appears in the Patent and Trademark Office's patent files or records, but all copyright rights are reserved regardless. The following statement applies to the software and data as described below and in the accompanying drawings that form part of this document: Copyright 2013, eBay Inc., All rights reserved. Technical Field
[0006] The subject matter disclosed herein generally relates to enhancing digital images. In some example embodiments, this disclosure relates to systems and methods for applying specular highlights to photographs of objects. Background Technology
[0007] As digital imaging becomes more prevalent, there is a desire to improve the representation of real-life objects through digital means. Generally, there is an expectation to depict real-life objects and environments as realistically as possible through digital means. However, some types of objects are more difficult to capture and display effectively than others. Specifically, as an example, objects with at least some reflective or specular properties (such as polished gemstones, crystal bottles, jewelry, glossy plastic objects, etc.) tend to be poorly captured in images because the reflectivity of these objects cannot be fully appreciated from a single still image. For example, a viewer may not fully understand a gemstone with many angles of reflection using only a single still image. Generally, when attempting to display objects with specular or reflective properties (where light reflects off the object in many different directions) in a single digital image, they tend to lose their luster or brightness.
[0008] For some businesses or industries, transitioning to online displays and showrooms can be challenging. For example, jewelry retailers and designers struggle to capture the best facets of their products when experimenting with online advertising. As more products and businesses rely on online shopping and sales, current methods for displaying goods online may be inadequate for certain items, potentially leading to lost customers and / or sales. Therefore, there is a need to improve the means of digitally recording and viewing objects (and particularly objects with reflective or mirror-like properties). Summary of the Invention
[0009] To address at least some of the aforementioned problems, embodiments of this application provide systems and methods for specular highlights on object photographs.
[0010] According to one aspect, a computer-implemented method is provided, comprising: accessing a first composite image of an object, the first composite image comprising an overlay of a first plurality of images. Each of the first plurality of images includes: an object recorded from a first location, and reflections of light from a light source located at a different location from each of the other images in the first plurality of images on the object. The method further comprises accessing a first input based on a tilt degree; and displaying the first composite image, wherein each image within the first composite image is displayed with transparency according to the first input based on the tilt degree.
[0011] According to one aspect, a computer-implemented system is provided, including a first memory coupled to a first processor, the first processor being configured to: access a first composite image of an object, the first composite image comprising a superposition of a first plurality of images. Each of the first plurality of images includes: an object recorded from a first location, and reflections of light from a light source located at a different location from each of the other images of the first plurality of images on the object. The first processor is further configured to: access a first input based on a tilt degree; and display the first composite image, wherein each image within the first composite image is displayed with transparency according to the first input based on the tilt degree.
[0012] According to one aspect, a computer-implemented method is provided, comprising: accessing a first plurality of images, each of the first plurality of images including: an object recorded from a first location, and reflections of light from a light source located at a different location from each of the other images in the first plurality of images on the object; generating a first composite image of the object, the first composite image including an overlay of the first plurality of images, and wherein each of the first plurality of images is configured to: change transparency within the first composite image and according to a first input based on tilt degree; and adjusting the transparency of each of the first plurality of images in response to user input for presenting an interactive perspective of light reflections from the object.
[0013] The above solution improves the means of digitally recording and viewing objects. Attached Figure Description
[0014] Some embodiments are shown by way of example and are not limited to the figures in the accompanying drawings.
[0015] Figure 1 It is a mobile device suitable for recording images of objects and for generating and / or viewing synthetic images based on the recorded images, according to some example embodiments.
[0016] Figure 2 It is a network architecture suitable for storing images of objects and for generating and / or sending synthetic images based on the recorded images, according to some example embodiments.
[0017] Figure 3 These are example images of objects with specular highlights used in some example embodiments.
[0018] Figure 4 These are example images of the first step in the process of recording an object with specular highlights, according to some example embodiments.
[0019] Figure 5 Example images are shown of other steps in the process of recording an object with specular highlights, according to some example embodiments.
[0020] Figure 6A and Figure 6B Example images are shown of other steps in the process of recording an object with specular highlights, according to some example embodiments.
[0021] Figure 7 Example images are shown of other steps in the process of recording an object with specular highlights, according to some example embodiments.
[0022] Figure 8A and 8BExample images of objects with specular highlights are shown according to some example embodiments.
[0023] Figure 9 This is a flowchart illustrating example operations for generating a composite image of an object, based on some example embodiments.
[0024] Figure 10 This is a flowchart illustrating example operations for viewing a composite image of an object, based on some example embodiments.
[0025] Figure 11 This is a block diagram illustrating components of a machine according to some example embodiments, the machine being able to read instructions from a machine-readable medium and execute any one or more of the methods discussed herein. Detailed Implementation
[0026] Example methods, apparatus, and systems for generating and viewing images of objects with specular highlights are presented. In some example embodiments, the image may display changing specular properties based on motion control of a display device displaying the image.
[0027] This disclosure discusses methods and systems for recording and viewing images of objects with specular highlights. In some example embodiments, a digital image of an object can be "tilted" from various angles, and the light reflected from the object can vary depending on the tilt of the image. In some example embodiments, while it may appear to a viewer that only a single image of an object exists on the display screen, the image of the object may actually be a composite of multiple images of the same object, except that at least one light source illuminates the object from a different angle in each of the multiple images. Depending on the viewer's viewing angle of the composite image, based on the tilt vector measured by one or more gyroscopes and / or accelerometers in the display device, for example, some of these multiple images may become completely transparent, making them unviewable based on the viewing angle, while one or more of the multiple images may become more opaque, thus generating a certain composite image of the object that displays light reflected from the object at a certain angle. A more detailed description will be presented herein with reference to the accompanying drawings of this disclosure.
[0028] refer to Figure 1A block diagram illustrating a mobile device 100 is presented according to some example embodiments. According to at least some example embodiments, the mobile device 100 may be configured to record images of an object with specular highlights and to view those images. The mobile device 100 may be configured to record images of an object, wherein each image has a light source pointing towards the object from a different angle. For example, a camera lens 185 may be configured to receive image data, which may be used by an image recorder 180 to record images of the object, the camera lens 185 being controlled by the image recorder 180. The mobile device 100 may alternatively or additionally be configured to view a composite image of the object, the composite image showing light pointing towards the object at various angles according to a tilt vector. For example, according to some example embodiments, a display 150 may be configured to display multiple images and / or a composite image. The mobile device 100 may include a processor 110. The processor 110 may be any processor suitable for a variety of different types of commercially available processors for mobile devices (e.g., an Xscale architecture microprocessor, a microprocessor without interlocked pipeline stage (MIPS) architecture processor, or another type of processor). According to some example embodiments, the processor 110 may be configured to combine multiple images of an object into a composite image. Memory 120, such as random access memory (RAM), flash memory, or other types of memory, is typically accessible to the processor. Memory 120 may be adapted to store an operating system (OS) 130 and applications 140, such as mobile applications for generating composite images of objects using multiple images, and / or mobile applications for viewing composite images. Processor 110 may be directly or via suitable intermediate hardware coupled to display 150 and one or more input / output (I / O) devices 160, such as keypads, touch panel sensors, microphones, etc. Similarly, in some embodiments, processor 110 may be coupled to transceiver 170, which interfaces with antenna 190. Depending on the nature of the mobile device 100, transceiver 170 may be configured to transmit and receive cellular network signals, wireless data signals, or other types of signals via antenna 190. In this way, connections to networks (such as those discussed in more detail below) can be established. Figure 2 The mobile device 100 may also include one or more means for obtaining the 3D orientation of the mobile device 100. For example, one or more gyroscopes and / or accelerometers (not shown) may be built into the mobile device, the gyroscopes and / or accelerometers being configured to determine the degree of tilt of the mobile device 100 relative to a vertical plane and / or a horizontal plane.
[0029] refer to Figure 2According to some example embodiments, a high-level client-server based network architecture 200 is illustrated. It will be apparent to those skilled in the art that network architecture 200 may include systems, applications, modules, and / or other means for utilizing the solutions of this disclosure. For example, network architecture 200 may include means for accessing multiple images of an object and for generating a composite image based on the multiple images and according to the solutions of this disclosure. Network architecture 200 may also be configured to transmit the composite image to one or more viewers. In some example embodiments, networked system 202 may facilitate a network-based marketplace or payment system 220 (providing server-side functionality to one or more client devices 210 and 212 via network 204 (e.g., the Internet or a wide area network (WAN))). Figure 2 This illustrates, for example, a web client 206 (e.g., a browser, such as one executed on respective client devices 210 and 212) Developed Internet A browser and a programming client 208. The web-based marketplace system 220 may include a website or other central repository for storing and displaying composite images. The images may, for example, be used as advertisements or descriptions of products for sale in the marketplace system 220.
[0030] Examples of client devices 210 and 212 may include, but are not limited to, mobile phones, desktop computers, laptop computers, portable digital assistants (PDAs), smartphones, tablets, ultrabooks, netbooks, laptops, multiprocessor systems, microprocessor-based or programmable consumer electronics, game consoles, set-top boxes, or any other communication device that a user can utilize to access the networked system 202. Example client devices 210 and 212 can be used with... Figure 1This corresponds to the mobile device 100 described herein. In some embodiments, client devices 210 and / or 212 may include display modules (not shown) for displaying information (e.g., in the form of a user interface) and images. In other embodiments, client devices 210 and / or 212 may include one or more of a touchscreen, accelerometer, gyroscope, camera, microphone, Global Positioning System (GPS) device, etc. In some example embodiments, the networked system 202 is a web-based marketplace that, in response to a request for a product listing, publishes a publication including a list of items available for purchase on the web-based marketplace and manages payments for transactions on these marketplaces. The product listing may include one or more images of one or more different products. Images may include one or more composite images of products as described herein. One or more users 205 may be people, machines, or other devices interacting with client devices 210 and 212. In embodiments, user 205 is not part of network architecture 200 but may interact with network architecture 200 via client devices 210 and 212 or by another means.
[0031] Application programming interface (API) server 214 and web server 216 are coupled to one or more application servers 218 and provide them with a programming interface and a web interface, respectively. Application server 218 may host one or more marketplace systems 220, which may include one or more modules or applications and may be embodied in hardware, software, firmware, or any combination thereof. Application server 218 is then shown coupled to one or more database servers 224, which facilitates access to one or more information repositories or databases 226. In some example embodiments, database 226 is a storage device for storing information to be published to marketplace system 220 (e.g., product releases or listings, images, etc.). According to example embodiments, database 226 may also store digital goods information.
[0032] Market system 220 can provide multiple market functions and services to users 205 who access networked system 202. Although market system 220... Figure 2 The system is shown as part of a networked system 202, but it should be understood that in alternative embodiments, system 220 may form part of a separate and distinct payment service from the networked system 202.
[0033] In addition, although Figure 2 The client-server network architecture 200 shown adopts a client-server architecture, but the subject matter of the present invention is certainly not limited to such an architecture, and applications can also be found in, for example, distributed or peer-to-peer architecture systems. Various marketplace systems 220 can also be implemented as standalone software programs that do not necessarily require networking capabilities.
[0034] Web client 206 accesses various marketplace systems 220 via a web interface supported by web server 216. Similarly, programming client 208 accesses various services and functions provided by marketplace system 220 via a programming interface provided by API server 214. Programming client 208 may be, for example, a seller application (e.g., by...). The company developed the Turbo Lister application, which enables sellers to create and manage lists offline on a networked system 202 and perform batch-mode communication between the programming client 208 and the networked system 202.
[0035] Furthermore, a third-party application 228 executing on third-party server 230 is shown to programmatically access networked system 202 via a programming interface provided by API server 214. For example, third-party application 228 may utilize information retrieved from networked system 202 to support one or more features or functions on a third-party hosted website. The third-party website may, for example, provide one or more promotional, marketing, or payment functions supported by related applications of networked system 202. Third-party server 230 may help proliferate the display of the composite image according to this disclosure by, for example, advertising the products shown in the composite image.
[0036] refer to Figure 3 Example image 300 of object 310 is shown, which can benefit from enhancements according to the scheme of this disclosure. Object 310 is used only as an example, and other objects can certainly be utilized in the example embodiment. In this document, object 310 may be a glass or crystal vase similar to a pineapple. Like a normal pineapple, object 310 contains many edges and grooves on its exterior, and such things reflect light in many directions when light shines on them. Unfortunately, if object 310 is shown as a single image, it may be difficult to fully appreciate how bright light shines from the many angled facets of the vase. Accordingly, a merchant expecting to sell such a product may not feel that publishing a single picture of object 310 online will effectively capture its full value. Even showing multiple pictures of object 310 from different sides may be insufficient, because object 310 (in this example, a pineapple vase) is relatively radially symmetrical, and therefore each side of object 310 will not provide significantly different perspectives. Furthermore, it is shown that a single still image will still not be able to capture all the sparkle intended to be shown by the many edges and grooves of object 310. In general, it should be understood that the specular highlights of an object (e.g., the reflective properties of the many edges and grooves of object 310) are not adequately captured by a single still image, no matter how detailed the image is.
[0037] refer to Figure 4 Example image 400 of object 310 illustrates the beginning of a process for enhancing specular highlights according to the scheme of this disclosure. As previously described, a composite image of object 310 can be generated based on multiple images of object 310 in the same location, but in each image, the light source is directed at object 310 from a different angle. The composite image can ultimately be loosely described as an interactive image, configured to be manipulated on a display device to display the changing angle of light on object 310 based on one or more of the multiple images and depending on the tilt direction of the display device. An example process may begin by recording a first image of object 310, which includes light directed at object 310 (e.g., a pineapple vase) from a light source at a first angle. In this case, a flash (not shown) from the upper right side of object 310 can illuminate object 310. The angle of light can be apparent based on the shadows formed by object 310 in image 400 (e.g., shadow 410) and, in some cases, also based on the brightest part of object 310 (e.g., highlight 420).
[0038] As an example of a process for practicing at least some of the solutions disclosed herein, a photographer may position a camera or a mobile device housing a camera or other image recorder on a tripod or other stabilizing device. Examples of cameras or mobile devices may include mobile device 100. Object 310 may be fixedly positioned on a stable surface (e.g., a sturdy stool or table). The camera may be positioned to record multiple images of object 310. According to some example embodiments, an application or other software program may guide the photographer to record images of object 310 using a light source pointed at object 310 from a specific angle (e.g., a light source pointing from the upper right side of object 310). For example, the user interface (UI) of an example application may appear on the display of mobile device 100 and instruct the user to record images of object 310 using a light source pointed at object 310 from a specific direction. The photographer may thus position a light source (e.g., a flash, camera flash, flash bulb, spotlight, or some other remote light source) on object 310 from a specified direction and use the camera or mobile device 100 to record images. In some example embodiments, the mobile device used to record images and the device used to operate an application or software with a UI can be the same device.
[0039] refer to Figure 5 According to some example embodiments, example images 510, 520, and 530 illustrate a continuation of the example process. For example, it can be seen from... Figure 4Additional images 510, 520, and 530 of object 310 (e.g., a pineapple vase) are recorded at the same location as image 400. The difference between each additional image 510, 520, and 530 may be that in each image, a light source (not shown) is directed at object 310 from a different angle. For example, images 510, 520, and 530 show the shadow of object 310 in different directions, indicating that the light source is directed at object 310 from different angles in each image 510, 520, and 530. In this case, rubrics 515, 525, and 535 each show a picture of flashlight 540, indicating the direction in which the light source illuminates object 310 in each image 510, 520, and 530, respectively. Here, image 510 is recorded using a light source directed at object 310 from its upper left. Similarly, image 520 is recorded using a light source directed at object 310 from directly above it. Finally, image 530 is recorded using a light source pointing from the upper right side of object 310 towards object 310. It is evident that these directions correspond to the flash directions shown in gauges 515, 525, and 535, respectively. According to some example embodiments, a mobile device or other digital device may store images of each angle containing object 310 and variations in the directional light, which are to be blended or “stitched” together to form a composite image of object 310.
[0040] Follow Figures 4 to 5 The extension of the process, see reference Figure 6A and Figure 6B According to some example embodiments, example composite image 600 shows a more comprehensive collection of images of object 310. Reference Figure 6A This example aggregates nine images of object 310, each recording object 310 at the same location, but with the light source pointing at object 310 from a different angle in each image. (Reference) Figure 6B Each square in gauge 610 displays a flash icon, which, within a square at the same location in gauge 610, demonstrates the orientation of a light source pointing towards object 310 in each corresponding image of the composite image 600. As used herein, "composite image set" can refer to a collection of images capturing light sources pointing towards object 310 from various angles (e.g., 360 degrees in two dimensions, all around a hemisphere centered on the object, etc.) in a fairly average and / or uniform manner around object 310. In this case, eight images are used to capture light all pointing around object 310, and in the ninth image, the light is pointed directly at object 310 from a neutral angle. In other cases, more or fewer images may be used, and the embodiments are not limited thereto. For example, four or sixteen images may be used.
[0041] Add more content for practice Figure 4 The example process of the present disclosure, which begins here, in some example embodiments, involves combining the numbers in the corners of each square in image 600 and gauge 610 to represent the order in which images of object 310 are stored by an application employing the present disclosure. For example, continuing with an example of an application with a UI, the UI can guide the photographer to take a specific number of photos of object 310, where, for each photo, the light source is directed at object 310 in a specific order. For example, as... Figure 6A As indicated by number "1" in the composite image 600, the UI can instruct the photographer to record the first image in the composite image 600 as an image of object 310, where the light source is directly forward (e.g., at a neutral angle relative to the center of object 310). This image is the center image of the composite image 600. The photographer can record the image using, for example, a mobile device 100, and the application can store this image as the center image. Next, as indicated by number "2" in the top center image, the UI can instruct the photographer to record the second image in the composite image 600 as an image of the light source of object 310 originating from the top of object 310. The photographer can record the image, and the application can store the second image as an image of the light source pointing upwards. Third, as indicated by number "3" in the upper right image, the application stores an image of the light source of object 310 originating from the upper right side of object 310, and so on with the numbering. In some cases, the application can guide the photographer to record each of these images in a specified order, and thus store the images in the order they were captured. Of course, the order shown is merely an example, and other orders are obviously possible according to various embodiments. In other cases, the photographer may have previously recorded a series of images of object 310 at different light angles, and these images can be manually sorted in the application, whereby the application also receives indication of the direction from which the light is coming. The exact mechanism of this process can vary, and many other possibilities will be apparent to those skilled in the art. All variations are within the scope of this disclosure, and embodiments are not limited thereto.
[0042] refer to Figure 7By accessing a comprehensive set of images showing light at different angles pointing towards object 310, a composite image of object 310 can be generated according to the scheme of this disclosure. As used herein, a "composite image" can refer to the overlap or superposition of multiple images in a comprehensive set of images, thereby allowing a subset of the comprehensive set of images to be displayed with varying opacities based on a correspondence with the tilt or orientation of the device displaying the composite image. The process of generating a composite image is represented by the cascading of nine images in a comprehensive set of images, as shown in image 700. In this way, a "composite image" can be understood not merely as a single image, but as a series of multiple images overlapping each other, each of the overlapping images being configured to be modified with varying degrees of opacity (or transparency). In this example, the numbering of the cascaded images shown can signal the order in which the images overlap each other. In other example embodiments, such an order is not specified, and the embodiments are not limited thereto.
[0043] As an example use case, in the case of the now-generated composite image, a viewer can utilize an application on a mobile device to view the composite image of object 310. In some example embodiments, if the neutral angle of the composite image is defined as any orientation of the viewing device when it first displays the composite image, then when the viewer rotates, turns, and / or tilts the viewing device, some images within the composite set of images will become completely transparent (i.e., invisible), while certain other images may be shown with a degree of opacity, allowing one or more images to be "blended" together. The determination of the degree of opacity (or conversely, transparency) of the nine images of object 310 may depend on the degree of tilt (e.g., when expressed in two dimensions, relative to the neutral angle of the viewing device (e.g., the initial orientation of the viewing device)).
[0044] As an example of multiple images in a “blended” composite image, suppose a viewer displays object 310 on a viewing device (e.g., mobile device 100), starting with the viewing device lying flat on a table with the display screen facing upwards. The initial presentation of object 310 could then be a central image of object 310, as shown in the central image of image 600 (e.g., box #1), while all other eight images become completely transparent and invisible. The viewer could then tilt the viewing device, for example, simply raising the right side of the viewing device so that the display screen is now slightly facing to the left. In some example embodiments, the composite image can be arranged such that the orientation of the light source illuminating the displayed object is assumed to be from the viewer’s initial position. Thus, here, by tilting the device slightly to the left, the application could now show an image where the light source of object 310 is from the right side of object 310 (e.g., the image in box #4 of image 600), while all other eight images become completely transparent and invisible. In other words, it now appears to the viewer that the light pointing at object 310 is from the right, allowing the viewer to see how light is reflected differently from object 310. In some example embodiments, the progressive process from orienting the viewing device in an initial neutral position to tilting it to the left (i.e., only raising the right side of the viewing device) can correspondingly involve a progressive change from viewing the central image (e.g., box #1 in image 600) to viewing an image with the light source coming from the right (e.g., box #4 in image 600). Generally, the progressive process from positioning the viewing device from a first tilt orientation to a second tilt orientation can correspondingly involve a progressive change from viewing the object 310 based on a first mixed image set corresponding to the first tilt orientation, and the second mixed image set corresponding to the second tilt orientation.
[0045] For example, midway between when the right side of the viewing device is fully tilted, the center image of object 310 can be set to 50% transparency, and the image with the light source from the right can also be set to 50% transparency. This generates a blended view of the two images, representing what object 310 can look like midway between when the light source is pointing towards the center and when it is entirely from the right. This blended view also corresponds to the degree of tilt of the viewing device. As another example, if the device is tilted only to the left by a full quarter of the tilt angle (e.g., the right side of the viewing device is tilted only a quarter of the full amount), the center image of object 310 can be shown with 75% opacity (e.g., 25% transparency), while the right image can overlap the center image and be shown with 25% opacity (e.g., 75% transparency), thus representing a proportional amount of the angle of the light source according to the degree of tilt of the viewing device. Similarly, the transparency (or opacity) of each image can be smoothly changed and adjusted according to the degree of tilt of the viewing device.
[0046] refer to Figure 8A and 8B Two other examples are shown in images 800 and 810, respectively, illustrating the blending of composite sets of images. These two examples can illustrate more complex cases. (Reference) Figure 8A In image 800, the "X" and "Y" values in the lower right corner can indicate the result of a length measurement, or in other cases, the percentage of tilt of the viewing device away from its horizontal and vertical axes. For example, the values "X = +0.75" and "Y = +0.50" can indicate that the viewing device is tilted upwards from the right by 75% of its total tilt view and upwards from the top by 50% of its total tilt view. Accordingly, a composite image of the rightmost and upper right images (e.g., the images in boxes #3 and #4 in image 600) can be used to express how light can be emitted from object 310 at a specified tilt angle. In other cases, the center image may also be used, since the tilt may not be entirely towards the top or right.
[0047] refer to Figure 8BSimilar to image 810, the values “X = -0.793402” and “Y = 0.13847” can indicate that the viewing device tilts its entire tilt view down from the right (i.e., up from the left) by ~79% and down from the top (i.e., up from the bottom) by ~13% of its entire tilt view. Accordingly, a composite image of the leftmost and lower left images (e.g., the images in boxes #7 and #8 in image 600) can be used to express how light can be emitted from object 310 at a specified tilt angle. In other cases, the center image may also be used, since the tilt may not be entirely towards the top or right. In other cases, the bottom image may also be used, since the tilt angle can also be considered to include a portion of the bottom image.
[0048] Generally, "stitching" or "blending" algorithms can be implemented to calculate the transparency of each of multiple images based on a tilted input. For example, an algorithm for calculating a view of a synthesized image based on the blending level between multiple images in a composite set of images can be based on the calculation of Euclidean distance. The Euclidean distance function can take the difference between the initial orientation of the light source angle and the current tilt angle as a parameter. In some example embodiments, the angle can be decomposed into two-dimensional components (e.g., the "X" direction and the "Y" direction). As will be apparent to those skilled in the art, other two-dimensional coordinate systems and other distance functions or even other methods for calculating a view of a synthesized image based on the degree of tilt can certainly be used, and the embodiments are not limited thereto. In some example embodiments, a separate smoothing function can be used to show the gradual change between the initial tilt orientation and the current tilt orientation. The smoothing function can interpolate the movement between the two orientations and accordingly show the change in the light angle of object 310.
[0049] Generally, the scheme of this disclosure can display a composite set of multiple images varying in a composite image based on the corresponding tilt degree of the viewing device displaying the composite image of the object 310, each set being displayed with varying opacity (or transparency). As the orientation and tilt degree change (e.g., based on how the viewer rotates and tilts the device), the opacity of each image can change accordingly, as discussed herein. Thus, when the viewer tilts and rotates the device displaying the composite image, the viewer can obtain interactive perspectives of how light is reflected from the object 310 at multiple different angles, because the composite image will continuously change according to the changing tilt and / or rotation.
[0050] The solution disclosed herein can therefore help facilitate the presentation of objects with prominent mirror properties, things that might otherwise be difficult to express effectively through conventional means. Furthermore, unlike when attempting to demonstrate mirror properties through video or other animations, users have the freedom and control to examine multiple mirror properties of an object in at least two planar dimensions, not limited to viewing the object's video at most forward or backward.
[0051] While it may not be possible to record actual images of an object from every single, minute angle (e.g., in this example, only nine images are used to generate all available viewing angles), the composite images create a simulated sense of what the object might look like under different lighting conditions. The human brain generally considers this sufficient, as it is typically unable to distinguish between an actual image and approximate images between two or more seemingly similar images. In other words, the human brain tends to be quite lenient in processing reflected light. Furthermore, the human brain tends to pay more attention to changes in light on an object as the viewpoint shifts, and for the sake of realism, the precision of a static image transitioning from one image to the next is less important than the smoothness of the transition from one image to another.
[0052] In some example embodiments, the correct “blending” of images in a composite image can be displayed based on inputs similar to tilt angles (e.g., mouse-controlled scrolling or dragging of the composite image). For example, tilting and rotation of the composite image can also be displayed on a PC that does not have any means for detecting tilt movement (such as a gyroscope, laser tracker, or other positioning means). Instead, for example, the composite image can be “clicked and dragged,” where the position of the mouse cursor on the image relative to its center can serve as an analog quantity for measuring the degree of tilt. Accordingly, the proper blending of the images can be based on the corresponding position of the mouse cursor on the image relative to its center. As another example, two scroll bars (one positioned along the right side of the composite image and the other along the bottom of the composite image) can be scrolled back and forth as an analog quantity for measuring the degree of tilt. As another example, tilt can be simulated by scrolling or sliding a finger along the display screen, whereby, for example, sliding a finger along the top of the display can show changes in light reflection on an object viewed from the top corner, and so on. Similarly, other means that are obvious to those skilled in the art can be used to determine the proper blending of images in a composite image, and the embodiments are not limited thereto. Therefore, as used herein, references to the degree of tilt or rotation according to the various techniques of this disclosure also include similar methods for devices that do not have the ability to determine the degree of tilt or rotation.
[0053] In some example embodiments, multiple sides or faces of an object may also be connected together, wherein each side or face of the object is itself a composite image of overlapping images of that side or face recorded at different light angles. For example, a previous image of object 310 shows only one side of the vase. A top or top view of object 310 is not shown, but it may also be shown using the methods described herein. In other words, for example, nine images of the top view of object 310 may also be recorded in a manner consistent with that described in the presented disclosure (see, for example, nine images of the top view of object 310). Figure 4 , 5 The nine images are recorded in a similar manner to 6A, 6B, and 7. A composite image of the top view of object 310 can then be generated.
[0054] In some embodiments, different faces or sides of an object can be joined together to add an additional dimension to the viewing experience. For example, a user of the viewer device may also be able to slide their finger down the display across the face of a side image of object 310. This allows the image to scroll or flip to a top-view composite image of object 310, at which point the user can tilt and rotate the viewer device to experience how light reflects off the top of object 310. In some example embodiments, known image joining techniques similar to those used to stitch images together to create a panoramic view can also be used to smoothly blend or stitch the scrolling from side view to top view. In other example embodiments, instead of joining multiple composite images showing different sides in this way, the user can simply tap or swipe to the next composite image showing a different view of object 310.
[0055] In some example embodiments, the blending direction between multiple images may be opposite to the directions described above, and the embodiments are not limited thereto. For example, the proportion of images blended according to the described example techniques may be based on the degree of tilt from the left and bottom of the viewer's device rather than from the right and top. In general, the exact direction and / or degree of image blending may be based on different orientations or degrees of tilt or rotation, and the embodiments are not limited thereto.
[0056] refer to Figure 9 Example flowchart 900 illustrates an example method for generating a composite image of an object. The example method may be similar to those described herein (including, for example, in...). Figure 3 , Figure 4 , Figure 5 , Figure 6A , Figure 6B , Figure 7 , Figure 8A and Figure 8B The method described in [the document] is consistent with the method described in [the document]. In box 910, the device (e.g., in [the document]) Figure 1The mobile device 100 described herein can access a first plurality of images, each of which includes: an object recorded from a first location (e.g., Figure 3 The object 310, and the reflection of light on the object from a light source located at a different position from each of the other images in the first plurality of images. The first plurality of images can be represented by the methods described herein (including, for example, in...). Figure 4 , 5 The recording is performed as described in 6A and 6B. For example, the device can be stabilized in a certain position and record a first plurality of objects, wherein in each of the first plurality of images, a light source illuminates the objects from a different position. The images can be stored in the device, or in other cases, via a network to a remote server such as a cloud server. In some cases, the device can be a remote server, and the images can be accessed from the mobile device recording the images.
[0057] In box 920, the device can generate a first composite image of an object, the first composite image comprising a superposition of a first plurality of images, wherein each of the first plurality of images is configured to: within the first composite image and according to a first input based on a tilt degree, change its transparency. This composite image can be compared with the description of composite images discussed herein (e.g., in...). Figure 4 , Figure 5 , Figure 6A , Figure 6B , Figure 7 , Figure 8A and Figure 8B The composite image is consistent with the device. The composite image can be stored on the device. In other cases, the composite image can be stored on a remote server, such as a cloud server. After the composite image is generated, in some example embodiments, the composite image can be transmitted to a viewer device separate from the device that generated the composite image. In other cases, the device that generates the composite image can be the same as the viewer device.
[0058] In some example embodiments, the change in transparency of each of the first plurality of images is further based on the orientation of the light source relative to the object in each of the first plurality of images. In some example embodiments, the change in transparency of each of the first plurality of images is based on a correspondence between the following two: the degree of tilt, and the orientation of the light source relative to the object in each of the first plurality of images. In some example embodiments, the change in transparency of each of the first plurality of images is based on a tilt calculation performed according to a stitching algorithm. These descriptions may be consistent with descriptions discussed throughout the disclosure (e.g., in...). Figure 4 , Figure 5 , Figure 6A , Figure 6B , Figure 7 , Figure 8A and Figure 8B (in Chinese) consistent with.
[0059] In some example embodiments, the first input based on the degree of tilt includes measurements from an accelerometer or gyroscope in a display device configured to display the first composite image. For example, the display device may measure the degree of tilt of the user toward the device based on readings from one or more accelerometers or gyroscopes in the display device. In some example embodiments, the first input based on the degree of tilt includes touch data from the display screen of the device configured to display the first composite image. For example, the degree of tilt may be based on readings of finger swiping on a capacitive touchscreen displaying the composite image. In some example embodiments, the first input based on the degree of tilt includes data from mouse scrolling. For example, a click and drag input coupled to the movement of the mouse cursor can simulate a tilt angle, and the transparency in each image of the image can change depending on the position of the mouse movement. These descriptions may be consistent with the descriptions discussed throughout the disclosure (e.g., in Figure 4 , Figure 5 , Figure 6A , Figure 6B , Figure 7 , Figure 8A and Figure 8B (in Chinese) consistent with.
[0060] In some example embodiments, a second composite image of the object may be concatenated with a first composite image via some smooth graphical connection, the second composite image of the object being recorded from different positions to record different sides of the object. The second composite image can be generated by means similar to that of the first composite image but from different positions showing different sides of the object. A graphical connection can be generated between the first and second composite images, wherein the display of the first composite image is configured to transition to the display of the second composite image, the transition being based on the graphical connection between the first and second composite images. These descriptions may be consistent with the descriptions discussed throughout the disclosure (e.g., in...). Figure 4 , Figure 5 , Figure 6A , Figure 6B , Figure 7 , Figure 8A and Figure 8B (in Chinese) consistent with.
[0061] refer to Figure 10 Flowchart 1000 shows the process in Figure 9The corresponding method described herein (but in this case involves accessing and viewing the composite image). The method described herein can be implemented by accessing or storing the composite image on a display device. The display device may be different from the device used to record multiple images. In other cases, the display device may be the same as the device used to record multiple images. In some cases, the display device may also generate the composite image but may not have recorded the multiple images.
[0062] In box 1010, the display device can access a first composite image of an object (e.g., object 310), the first composite image comprising a superposition of a first plurality of images, wherein each of the first plurality of images comprises: an object recorded from a first location, and reflections of light from a light source located at a different location from each of the other images in the first plurality of images on the object. In box 1020, the display device can access a first input based on a tilt degree. As previously described, the tilt degree can be based on a plurality of different input means, including, for example, data from a gyroscope, accelerometer, touch data, or mouse input, which may include simulations of tilt data as described above. In box 1030, the display device can display the composite image, wherein each image within the composite image is displayed with transparency according to the first tilt degree input. For example, some images in the image may be completely transparent, while a few images may have non-zero opacity based on the accessed tilt input, the non-zero opacity corresponding to a calculated angle that the viewer expects to see with the object. Generally, the methods described herein can be consistent with those described throughout the disclosure (including, for example, in...). Figure 4 , Figure 5 , Figure 6A , Figure 6B , Figure 7 , Figure 8A and Figure 8B The method described in the text is consistent with the method described in the text.
[0063] In some example embodiments, similar to the method for generating a composite image, the second composite image may be graphically concatenated with the first composite image, and the viewer may input a second input to smoothly scroll between the first and second composite images.
[0064] refer to Figure 11 According to some example embodiments, the block diagram illustrates the components of machine 1100, which is capable of reading instructions 1124 from machine-readable medium 1122 (e.g., a non-transitory machine-readable medium, a machine-readable storage medium, a computer-readable storage medium, or any suitable combination thereof) and performing any one or more of the methods discussed herein, either wholly or partially. Specifically, Figure 11Machine 1100, which is shown as an example form of a computer system (e.g., a computer), can execute, in whole or in part, instructions 1124 (e.g., software, program, application, app, or other executable code) for causing machine 1100 to perform any or more of the methods discussed herein.
[0065] In alternative embodiments, machine 1100 may operate as a standalone device or may be connected (e.g., networked) to other machines. In a networked deployment, machine 1100 may operate as a server machine or a client machine in a server-client network environment, or as a peer machine in a distributed (e.g., peer-to-peer) network environment. Machine 1100 may include hardware, software, or a combination thereof, and may, by way of example, be a server computer, client computer, personal computer (PC), tablet computer, laptop computer, netbook, cellular phone, smartphone, set-top box (STB), personal digital assistant (PDA), web application, network router, network switch, bridge, or any machine capable of sequentially or otherwise executing instructions 1124 specifying actions to be taken by that machine. Furthermore, although only a single machine is shown, the term "machine" will also be considered to include any collection of machines that individually or jointly execute instructions 1124 to implement all or part of any one or more of the methods discussed herein.
[0066] Machine 1100 includes a processor 1102 (e.g., a central processing unit (CPU), graphics processing unit (GPU), digital signal processor (DSP), application-specific integrated circuit (ASIC), radio frequency integrated circuit (RFIC), or any suitable combination thereof), main memory 1104, and static memory 1106, which are configured to communicate with each other via bus 1108. Processor 1102 may include microcircuits that can be temporarily or permanently configured by some or all of the instructions 1124, such that processor 1102 can be configured to perform any one or more of the methods described herein, either wholly or partially. For example, a collection of one or more microcircuits of processor 1102 may be configured to perform one or more modules (e.g., software modules) described herein.
[0067] Machine 1100 may also include a video display 1110 (e.g., a plasma display panel (PDP), a light-emitting diode (LED) display, a liquid crystal display (LCD), a projector, a cathode ray tube (CRT), or any other display capable of displaying graphics or video). Machine 1100 may also include an alphanumeric input device 1112 (e.g., a keyboard or keypad), a cursor control device 1114 (e.g., a mouse, touchpad, trackball, joystick, motion sensor, glasses-tracking device, or other pointing instrument), a storage unit 1116, an audio generation device 1118 (e.g., a sound card, amplifier, speaker, headphone jack, or any suitable combination thereof), and a network interface device 1120.
[0068] Storage cell 1116 includes machine-readable medium 1122 (e.g., tangible and non-transitory machine-readable storage medium) thereon storing information embodied in the description herein (including, for example, Figure 1 , Figure 2 , Figure 3 , Figure 4 , Figure 5 , Figure 6A , Figure 6B , Figure 7 , Figure 8A , Figure 8B , Figure 9 and / or Figure 10 The instructions 1124 are any one or more of the methods or functions described in the description. The instructions 1124 may also reside wholly or at least partially in main memory 1104, in processor 1102 (e.g., in the processor's cache memory), or both before or during their execution by machine 1100. The instructions may also reside in static memory 1106.
[0069] Accordingly, main memory 1104 and processor 1102 can be considered as machine-readable media (e.g., tangible and non-transitory machine-readable media). Instructions 1124 can be transmitted or received via network 1126 through network interface device 1120. For example, network interface device 1120 can use any one or more transport protocols (e.g., Hypertext Transfer Protocol (HTTP)) to transmit instructions 1124. Machine 1100 can also represent functions for performing the functions described herein (including...). Figure 1 , Figure 2 , Figure 3 , Figure 4 , Figure 5 , Figure 6A , Figure 6B , Figure 7 , Figure 8A , Figure 8B , Figure 9 and / or Figure 10Example means of any of the processes described in the document.
[0070] In some example embodiments, machine 1100 may be a portable computing device (such as a smartphone or tablet computer) and has one or more additional input components (e.g., sensors or instruments, not shown). Examples of such input components include image input components (e.g., one or more cameras), audio input components (e.g., microphones), direction input components (e.g., compasses), location input components (e.g., GPS receivers), orientation components (e.g., gyroscopes), motion detection components (e.g., one or more accelerometers), altitude detection components (e.g., altimeters), and gas detection components (e.g., gas sensors). Input acquired by any one or more of these input components may be accessible and usable by any of the modules described herein.
[0071] As used herein, the term "memory" refers to a machine-readable medium capable of temporarily or permanently storing data and may be considered to include, but is not limited to, random access memory (RAM), read-only memory (ROM), buffer memory, flash memory, and cache memory. While machine-readable medium 1122 is shown as a single medium in the example embodiment, the term "machine-readable medium" should be considered to include a single medium or multiple media capable of storing instructions (e.g., a centralized or distributed database or associated cache and server). The term "machine-readable medium" will also be considered to include any medium or combination of media capable of storing instructions 1124 for execution by machine 1100, such that when executed by one or more processors of machine 1100 (e.g., processor 1102), the instructions 1124 cause machine 1100 to perform, wholly or partially, any or more of the methods described herein. Accordingly, "machine-readable medium" refers to a single storage device or apparatus and a cloud-based storage system or storage network comprising multiple storage devices or apparatuses. The term “machine-readable medium” will be accordingly considered to include, but is not limited to, one or more tangible (e.g., non-transient) data repositories in the form of solid-state storage, optical media, magnetic media, or any suitable combination thereof.
[0072] Throughout this specification, multiple instances can implement components, operations, or structures described as a single instance. Although individual operations of one or more methods are shown and described as separate operations, one or more of these individual operations may be executed concurrently, and the operations are by no means required to be executed in the order shown. Structures and functionalities presented as separate components in the example configurations can be implemented as composite structures or components. Similarly, structures and functionalities presented as single components can be implemented as single components. These and other variations, modifications, additions, and improvements fall within the scope of this document.
[0073] Some embodiments described herein include logic or multiple components, modules, or mechanisms. Modules may constitute software modules (e.g., code stored or otherwise contained on or transmitted on a machine-readable medium), hardware modules, or any suitable combination thereof. A “hardware module” is a tangible (e.g., non-transient) unit capable of performing certain operations and may be configured or arranged in a physical manner. In various example embodiments, one or more computer systems (e.g., standalone computer systems, client computer systems, or server computer systems) or one or more hardware modules of a computer system (e.g., processors or groups of processors) may be configured by software (e.g., an application or a portion of an application) to operate as hardware modules to perform certain operations as described herein.
[0074] In some embodiments, a hardware module may be implemented mechanically, electronically, or in any suitable combination thereof. For example, a hardware module may include dedicated circuitry or logic permanently configured to perform certain operations. For instance, a hardware module may be a dedicated processor (such as a field-programmable gate array (FPGA) or an ASIC). A hardware module may also include programmable logic or circuitry temporarily configured by software to perform certain operations. For instance, a hardware module may include software contained within a general-purpose processor or other programmable processor. It should be understood that cost and time considerations may drive the decision to implement a hardware module mechanically in dedicated and permanently configured circuitry or in temporarily configured (e.g., software-configured) circuitry.
[0075] Accordingly, the phrase "hardware module" should be understood to include tangible entities, and such tangible entities can be physically constructed, permanently configured (e.g., hardwired), or temporarily configured (e.g., programmed) to operate in a certain manner or perform certain operations described herein. As used herein, "hardware-implemented module" refers to a hardware module. Consider embodiments where hardware modules are temporarily configured (e.g., programmed), it is not necessary to configure or instantiate each of the hardware modules at any given time. For example, where a hardware module includes a general-purpose processor configured by software to be a dedicated processor, the general-purpose processor can be configured to act as different dedicated processors (e.g., including different hardware modules) at different times. Software (e.g., software modules) can accordingly configure, for example, one or more processors to constitute a particular hardware module at one time and different hardware modules at different times.
[0076] Hardware modules can provide and receive information from other hardware modules. Accordingly, the described hardware modules can be considered communicatively coupled. In the presence of multiple hardware modules simultaneously, communication can be achieved through signal transmission (e.g., via appropriate circuitry and buses) between or among two or more hardware modules. In embodiments where multiple hardware modules are configured or instantiated at different times, communication between such hardware modules can be achieved, for example, through the storage and retrieval of information in a memory structure to which multiple hardware modules have access. For example, a hardware module can perform an operation and store the output of that operation in a memory device to which it is communicatively coupled. Another hardware module can then access the memory device at a later time to retrieve and process the stored output. Hardware modules can also initiate communication with input or output devices and can operate on resources (e.g., collections of information).
[0077] The various operations of the example methods described herein can be performed, at least in part, by one or more processors that are temporarily configured (e.g., by software) or permanently configured to perform the relevant operations. Whether temporarily or permanently configured, such processors can constitute processor implementation modules that operate to perform one or more of the operations or functions described herein. As used herein, "processor implementation module" refers to a hardware module implemented using one or more processors.
[0078] Similarly, the methods described herein may be implemented at least partially by a processor, which is an example of hardware. For example, at least some of the operations of the methods may be performed by one or more processors or processor-implemented modules. As used herein, a “processor-implemented module” refers to a hardware module in which the hardware includes one or more processors. Furthermore, one or more processors may also operate to support the execution of related operations in a “cloud computing” environment or as “Software as a Service” (SaaS). For example, at least some of the operations may be performed by a group of computers (as an example of machines including processors), where these operations are accessible via a network (e.g., the Internet) and via one or more appropriate interfaces (e.g., application programming interfaces (APIs)).
[0079] The execution of certain operations can be distributed across one or more processors (not just residing within a single machine, but deployed across multiple machines). In some example embodiments, one or more processors or processor-implemented modules may reside in a single geographic location (e.g., in a home environment, an office environment, or a server cluster). In other example embodiments, one or more processors or processor-implemented modules may be distributed across multiple geographic locations.
[0080] Parts of the subject matter discussed herein can be presented through algorithms or symbolic representations of operations on data stored as bit or binary digital signals in machine memory (e.g., computer memory). Such algorithms or symbolic representations are examples of techniques used by those of ordinary skill in the art of data processing to communicate the substance of their work to others skilled in the art. As used herein, an "algorithm" is a self-consistent sequence of operations or similar processes that results in a desired outcome. In this context, algorithms and operations involve the physical manipulation of physical quantities. Typically, but not necessarily, such quantities can take the form of electrical, magnetic, or optical signals that can be stored, accessed, transmitted, combined, compared, or otherwise manipulated by a machine. Sometimes, primarily for reasons of general use, it is convenient to refer to such signals using terms such as "data," "content," "bit," "value," "element," "symbol," "character," "term," "number," "numerical," etc. However, these terms are merely convenient labels and will be associated with appropriate physical quantities.
[0081] Unless otherwise expressly stated, the use of terms such as “processing,” “computing,” “calculating,” “determining,” “presenting,” “displaying,” etc., herein can refer to the actions or processes of a machine (e.g., a computer) that manipulate or transform data presented as physical (e.g., electronic, magnetic, or optical) quantities within one or more memories (e.g., volatile memory, non-volatile memory, or any suitable combination thereof), registers, or other machine components that receive, store, transmit, or display information. Furthermore, unless otherwise expressly stated, the terms “a” or “an”, as commonly used in patent documents, are used herein to include one or more instances. Finally, as used herein, unless otherwise expressly stated, the conjunction “or” refers to a non-exclusive “or.”
Claims
1. A computer-implemented method, comprising: Access a first composite image of the object, the first composite image comprising a superposition of a first plurality of images, each of the first plurality of images comprising: The object recorded from the first position, and Reflection of light from a light source located at a different position than in each of the other images in the first plurality of images onto the object; Access the first input based on the degree of tilt; and The first synthesized image is displayed, wherein each image within the first synthesized image is displayed with transparency based on the first input based on the tilt degree.
2. The method according to claim 1, wherein, The transparency of each of the first plurality of images is further based on the orientation of the light source relative to the object in each of the first plurality of images.
3. The method according to claim 1, wherein, The transparency of each of the first plurality of images changes based on the following correspondence: the degree of tilt, and the orientation of the position of the light source relative to the object in each of the first plurality of images.
4. The method according to claim 1, wherein, The transparency of each of the first plurality of images is changed based on a tilt calculation performed according to the stitching algorithm.
5. The method according to claim 1, wherein, The first input based on tilt level includes touch data from the display screen of a device configured to display the first synthetic image.
6. The method according to claim 1, wherein, The first input based on tilt level includes data from mouse scrolling.
7. The method according to claim 1, further comprising: Access a second composite image of the object, the second composite image comprising a superposition of a second plurality of images, each of the second plurality of images comprising: The object recorded from the second position, and The reflection of light from a light source located at a different position than in each of the other images in the second plurality of images onto the object; Access the second input based on the degree of tilt; and The second composite image is displayed, wherein each image within the second composite image is displayed with transparency based on the second input based on the degree of tilt. Specifically, based on the graphical connection between the first composite image and the second composite image, the display of the first composite image transitions to the display of the second composite image.
8. A computer-implemented system, comprising: A first memory, coupled to a first processor, the first processor being configured to: Access a first composite image of the object, the first composite image comprising a superposition of a first plurality of images, each of the first plurality of images comprising: The object recorded from the first position, and Reflection of light from a light source located at a different position than in each of the other images in the first plurality of images onto the object; Access the first input based on the degree of tilt; and The first synthesized image is displayed, wherein each image within the first synthesized image is displayed with transparency based on the first input based on the tilt degree.
9. The system according to claim 8, wherein, The transparency of each of the first plurality of images is further based on the orientation of the light source relative to the object in each of the first plurality of images.
10. The system according to claim 8, wherein, The first input based on tilt includes measurements from an accelerometer and / or gyroscope in a display device configured to display the first synthetic image.
11. The system according to claim 8, wherein, The processor is also configured to: Access a second composite image of the object, the second composite image comprising a superposition of a second plurality of images, each of the second plurality of images comprising: The object recorded from the second position, and The reflection of light from a light source located at a different position than in each of the other images in the second plurality of images onto the object; Access the second input based on the degree of tilt; and The second composite image is displayed, wherein each image within the second composite image is displayed with transparency based on the second input based on the degree of tilt. Specifically, based on the graphical connection between the first composite image and the second composite image, the display of the first composite image transitions to the display of the second composite image.
12. A computer-implemented method, comprising: Access a first plurality of images, each of the first plurality of images including: an object recorded from a first location, and reflections of light from a light source located at a different location from each of the other images in the first plurality of images on the object; A first composite image of the object is generated, the first composite image comprising a superposition of the first plurality of images, wherein each of the first plurality of images is configured to: change its transparency within the first composite image and according to a first input based on a tilt degree; and In response to user input for presenting an interactive perspective of light reflection from the object, the transparency of each of the first plurality of images is adjusted.
13. The method according to claim 12, wherein, The change in transparency of each of the first plurality of images is based on a tilt calculation performed according to the stitching algorithm.
14. The method of claim 12, further comprising: Access a second composite image of the object, the second composite image comprising a superposition of a second plurality of images, each of the second plurality of images comprising: The object recorded from the second position, and The reflection of light from a light source located at a different position than in each of the other images in the second plurality of images onto the object; Access the second input based on the degree of tilt; and The second composite image is displayed, wherein each image within the second composite image is displayed with transparency based on the second input based on the degree of tilt. Specifically, based on the graphical connection between the first composite image and the second composite image, the display of the first composite image transitions to the display of the second composite image.
15. The method according to claim 12, wherein, The transparency of each of the first plurality of images is further based on the orientation of the light source relative to the object in each of the first plurality of images.
Citation Information
Patent Citations
Stereoscopic camera device
JP2000092518A
Refraction assisted illumination for imaging
US20110102615A1