Electronic device, method, and recording medium for outputting stereoscopic image

Abstract

The present disclosure relates to an electronic device for outputting a stereoscopic image. The electronic device may comprise: a memory including one or multiple storage media for storing instructions; and at least one processor including processing circuitry. The instructions may cause, when individually or collectively executed by the at least one processor, the electronic device to perform one or more operations. The one or more operations may comprise the operations of: outputting, to a display, a first stereoscopic image frame corresponding to a first input image frame on the basis of a first disparity search range; and outputting, to the display, a second stereoscopic image frame corresponding to a second input image frame on the basis of a second disparity search range. A stereoscopic effect of a specific object in a first stereoscopic image displayed on the display by the first stereoscopic image frame may be different from a stereoscopic effect of the specific object in a second stereoscopic image displayed on the display by the second stereoscopic image frame. A display position and / or a display area of the specific object in the first stereoscopic image may be different from a display position and / or a display area of the specific object in the second stereoscopic image.

Description

Electronic device, method, and recording medium for outputting stereoscopic images

[0001] The present disclosure relates to an electronic device for outputting a stereoscopic image, a method of operation thereof, and a recording medium.

[0002] With the advancement of digital and / or communication technologies, electronic devices such as home appliances, smartphones, tablet PCs, and navigation systems inherently include displays. Electronic devices can have displays of different sizes depending on their intended use. Furthermore, electronic devices are sometimes equipped with form factors that allow the display size to be expanded or reduced.

[0003] When viewing stereoscopic images with a fixed parallax, viewers may experience fatigue due to variables that affect the viewing environment, such as display size or viewing distance. For example, if stereoscopic images created for viewing on large screens like televisions are viewed on a relatively small screen like a smartphone, viewers may experience fatigue due to the excessive sense of depth.

[0004] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. None of the foregoing is to be claimed as prior art related to the present disclosure, nor is it to be used to determine prior art.

[0005] The present disclosure may provide an electronic device that analyzes the disparity or depth of an input frame and outputs a stereoscopic image by applying a disparity search range that reflects a disparity distribution obtained from the analysis result, a method of operation thereof, and a recording medium.

[0006] According to one example, the electronic device may include a memory comprising one or more storage media for storing instructions. The electronic device may include at least one processor comprising a processing circuit. When the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to perform at least one operation. The at least one operation may include an operation of outputting a first stereoscopic image frame corresponding to a first input image frame to a display based on a first parallax search range. The at least one operation may include an operation of outputting a second stereoscopic image frame corresponding to a second input image frame to the display based on a second parallax search range. The stereoscopic sense of a specific object in the first stereoscopic image displayed on the display by the first stereoscopic image frame may differ from the stereoscopic sense of the specific object in the second stereoscopic image displayed on the display by the second stereoscopic image frame. The display position and / or display area of ​​the specific object in the first stereoscopic image may differ from the display position and / or display area of ​​the specific object in the second stereoscopic image.

[0007] According to one example, the method of operation of an electronic device may include the operation of outputting a first stereoscopic image frame corresponding to a first input image frame to a display based on a first parallax search range. The method of operation may include the operation of outputting a second stereoscopic image frame corresponding to a second input image frame to the display based on a second parallax search range. The stereoscopic sense of a specific object in the first stereoscopic image displayed on the display by the first stereoscopic image frame may differ from the stereoscopic sense of the specific object in the second stereoscopic image displayed on the display by the second stereoscopic image frame. The display position and / or display area of ​​the specific object in the first stereoscopic image may differ from the display position and / or display area of ​​the specific object in the second stereoscopic image.

[0008] According to one example, a recording medium may store instructions that can be read by a computer. When executed by at least a part of at least one processor included in an electronic device, the instructions may cause the electronic device to perform at least one operation. The at least one operation may include an operation of outputting a first stereoscopic image frame corresponding to a first input image frame to a display based on a first parallax search range. The at least one operation may include an operation of outputting a second stereoscopic image frame corresponding to a second input image frame to the display based on a second parallax search range. The stereoscopic sense of a specific object in the first stereoscopic image displayed on the display by the first stereoscopic image frame may differ from the stereoscopic sense of the specific object in the second stereoscopic image displayed on the display by the second stereoscopic image frame. The display position and / or display area of ​​the specific object in the first stereoscopic image may differ from the display position and / or display area of ​​the specific object in the second stereoscopic image.

[0009] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0010] Figure 1 is a diagram illustrating, by way of example, a stereoscopic imaging technology that generates a target frame by applying depth information or parallax information to a reference frame.

[0011] Figure 2 is a diagram illustrating, by way of example, stereoscopic image technology that enables an image displayed on a display to be perceived as a stereoscopic image by a viewer.

[0012] Figure 3a is a diagram illustrating the correlation between the parallax distribution in stereoscopic images and the fatigue felt by viewers.

[0013] Figure 3b is a diagram illustrating the adjustment of the visual comfort zone according to the viewer's field of view.

[0014] Figure 3c is a diagram illustrating that the visual comfort zone can be adjusted according to the viewer's movement.

[0015] FIG. 4a or FIG. 4b is a drawing for exemplarily illustrating determining a parallax search range to be applied to obtain a stereoscopic image frame in a visual comfort zone based on a parallax distribution according to one embodiment.

[0016] FIG. 5 is a block diagram for generating a stereoscopic image in an electronic device according to one embodiment.

[0017] FIG. 6 is a control flowchart for outputting a stereoscopic image in an electronic device according to one embodiment.

[0018] FIG. 7 is a block diagram relating to a functional module for generating a stereoscopic image frame for outputting a stereoscopic image in an electronic device according to one embodiment.

[0019] FIG. 8 is a control flowchart for adjusting pixel-by-pixel parallax to obtain a stereoscopic image in an electronic device according to one embodiment.

[0020] FIG. 9 is a diagram illustrating an example of analyzing an input image based on the correlation with the parallax distribution characteristics according to one embodiment.

[0021] FIG. 10 is a diagram illustrating an example of obtaining the correlation between the characteristic value of the characteristic vector shown in FIG. 9 and a plurality of position vectors.

[0022] Figure 11 is a diagram illustrating the change in the frame coefficient according to the parallax distribution of the input frame.

[0023] Figure 12 is a diagram illustrating the change in the parallax search range according to the parallax distribution of the input frame.

[0024] FIG. 13 is a block diagram of an electronic device in a network environment according to various embodiments.

[0025] Hereinafter, embodiments of the present disclosure are described in detail with reference to the drawings so that those skilled in the art can easily practice them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and brevity.

[0026] FIG. 1 is a drawing (100) for exemplarily explaining a stereoscopic image or 3D image technology that generates a target frame by applying depth information or disparity information to a reference frame.

[0027] The stereoscopic image technology, which will be described exemplarily with reference to FIG. 1, enables three-dimensional perception of an image by utilizing the parallax between the viewer's left eye field of view (or left eye image) and the right eye field of view (or right eye image). For example, the stereoscopic image may be provided by a series of stereoscopic image frames. A stereoscopic image frame may consist of a pair of reference frames (110) and target frames (130). For example, the reference frame (110) may be a two-dimensional (2D) image frame provided as an input image. The 2D image frame provided as the reference frame (110) may be used as either a left eye image or a right eye image to provide a stereoscopic image. The target frame (130) may be used as the remaining image among the left eye image or right eye image that is not used as the reference frame (110) to provide a stereoscopic image. The target frame (130) may be generated by applying information regarding depth or information regarding parallax to the reference frame (110).

[0028] Information regarding the depth of the reference frame (110) can be obtained from a depth map for the reference frame (110). Information regarding the parallax of the reference frame (110) can be obtained from a disparity map for the reference frame (110). Since the depth map and the disparity map are closely related, knowing the depth map can be understood as having the same meaning as knowing the disparity map. Reference numeral 120 may be either a depth map or a disparity map. In this disclosure, the description assumes that the disparity map is referenced to generate a stereoscopic image, but this is merely an example, and it is understood that the described implementation example can be carried out in the same way by referencing the depth map.

[0029] For example, a depth map may be an image that visualizes depth information by distinguishing the relative distances of pixels in the image in grayscale. A depth map may be an image that visualizes depth information by pixel or by object. In a depth map, close parts may be depicted brightly, and distant parts may be depicted darkly. For example, a parallax map may be an image that visualizes parallax information between a left-eye image and a right-eye image. A parallax map may be prepared based on parallax information for each pixel of a reference frame (110). Information regarding depth and information regarding parallax may have a relative relationship. This will be explained in more detail with reference to FIG. 2. In this disclosure, for convenience of explanation, the term 'reference frame (120)' may be used to refer to the depth map and / or parallax map. The reference frame (120) includes, for example, depth values ​​or parallax values ​​of pixels (121, 123) that are in a matching relationship in the left-eye image and the right-eye image.

[0030] Specific pixels (111, 113) of a reference frame (110) may have a certain disparity (101, 103) with specific pixels (131, 133) of a target frame (130). The disparity (101, 103) between the reference frame (110) and the target frame (130) can provide a sense of depth to the video that the viewer is watching. For example, the greater the disparity (101, 103) between the reference frame (110) and the target frame (130), the greater the sense of depth in the video, but conversely, it may increase viewer fatigue. For example, the smaller the disparity between the reference frame (110) and the target frame (130), the less the sense of depth in the video, but conversely, it may reduce viewer fatigue. Viewer fatigue may be caused by the difference between the position where an object included in the video is displayed and the position of the object that is visually perceived.

[0031] FIG. 2 is a drawing (200) for exemplarily explaining stereoscopic image technology that allows an image displayed on a display (or screen) to be perceived as a stereoscopic image by a viewer.

[0032] In FIG. 2, it is assumed that points A (210), B (220), and F (230) are objects. A viewer may gaze at point F (230). Point F (230) may be an object presented on a display (e.g., display (160) in FIG. 1) (200) that is indicated by a horizontal line. A user may gaze at point A (210). Point A (210) may be an object presented on the back of the display (200), in the direction opposite to the direction in which the image is displayed on the display (200). A user may gaze at point B (220). Point B (220) may be an object presented on the front of the display (200), in the direction in which the image is displayed on the display (200). The distance between the user and point B (220) may be shorter than the distance between the user and point A (210). The electronic device (500) may display a corresponding left eye pixel on AL (211) and a corresponding right eye pixel on AR (213) to display point A (210). The electronic device (500) may display corresponding left eye and right eye pixels on BR (223) and BL (221), respectively, to display point B (220). Point A (210) may appear to be virtually located at a first distance (240) on the back of the display (200), and point B (230) may appear to be virtually located at a second distance (250) on the front of the display (200). The first distance (240) may depend on the difference (parallax or disparity) between AL (211) and AR (213) and the viewing distance (distance between the viewer's eyes and the display screen). The second distance (250) may depend on the difference (parallax or variance) between BL (221) and BR (223) and the viewing distance (distance between the viewer's eyes and the display screen). For example, when the user looks at point F (230), the viewer's eyes may focus on the distance of the display (200) and converge on point F (230). In this case, there is no discrepancy between the convergence of the gaze and the focus adjustment.When looking at point A (210), the viewer's eyes may focus on the distance of the display (200), but may converge on point A (210) which is a first distance (240) further away than the distance of the display (200). In this case, there is a mismatch between the convergence of the gaze and the focus adjustment. When the user looks at point B (220), the viewer's eyes may focus on the distance of the display (200), but may converge on point B (220) which is a second distance (250) closer than the distance of the display (200). In this case, there is a mismatch between the convergence of the gaze and the focus adjustment. The mismatch between the convergence of the gaze and the focus adjustment may cause visual fatigue.

[0033] FIG. 3a is a diagram (300a) for explaining the correlation between the disparity distribution in stereoscopic images and the fatigue felt by the viewer.

[0034] In FIG. 3a, it is assumed that the viewer (310) is located near the middle of the screen (330), but this is merely an example. For example, if the viewer (310) is located near the left side of the middle of the screen (330) or near the right side, the visual comfort zone (320) can be modified based on the position of the viewer (310). This will be explained below with reference to FIG. 3c.

[0035] Referring to FIG. 3a, when a stereoscopic image is output based on the original comfort zone (Z) (350), even if an object has the same disparity (or the same depth) in a reference frame (e.g., a depth frame or a disparity frame) corresponding to the reference frame, the viewer (310) may perceive the object's stereoscopic quality differently depending on the position where it is displayed on the screen (330). Here, the original comfort zone (Z) (350) may have a uniform disparity search range across all areas of the screen (330). The upper threshold disparity and the lower threshold disparity that determine the disparity search range in the original comfort zone (Z) (350) may be constant. For example, in the original comfort zone (Z) (350), the upper threshold disparity may have a relatively larger value compared to the lower threshold disparity. This is because positive parallax (325) can have a relatively less impact on the fatigue of the viewer (310) compared to negative parallax (327). That is, the viewer (310) may feel relatively higher fatigue due to the stereoscopic effect caused by negative parallax (327) than due to the stereoscopic effect caused by positive parallax (325). Positive parallax (325) can determine the degree to which the corresponding point in the right-eye image that can be viewed with the right eye (311) is cross-displayed with the corresponding point in the left-eye image that can be viewed with the left eye (311), so that the object feels like it is behind the screen (330). The negative parallax (327) may correspond to the degree that the corresponding point in the right eye image is displayed cross-referenced with the corresponding point in the left eye image, making it feel as though the object (e.g., the first object (341) or the second object (343)) is at the front of the screen (330).

[0036] Phenomena such as stereo window violation (SWV) or crosstalk in stereoscopic images can cause fatigue in viewers (310). SWV is a phenomenon in which part or all of an object is visible in only one of the left or right images at the edges of the screen (330). Due to SWV, viewers (310) may unconsciously perceive the object displayed in only one image as being behind the screen (330), thereby causing visual fatigue, i.e., fatigue. Fatigue caused by SWV may be more likely to occur at the edges. Crosstalk is a phenomenon in which, due to a slanted structure, the viewer (310) is shown an image that is not a complete image at that point in time but is interfered with by images from surrounding views. Crosstalk can cause symptoms of severe blurring in stereoscopic images. The probability of crosstalk occurring increases as one moves further away from the center of the screen (330). Therefore, phenomena such as SWV or crosstalk can be improved by reducing the sense of depth caused by parallax. For example, a disparity search range to determine the degree of stereoscopic effect can be adaptively applied by considering the distribution of one or more objects (hereinafter referred to as 'disparity distribution') that need to be highlighted in a stereoscopic image. For example, the disparity distribution may be influenced by the complexity of the image and / or the location of salient objects with relatively high disparity.

[0037] According to one example, the parallax distribution may be influenced by the location of a key object included in the image. The key object may be, for example, the most protruding object in the image or the object with the largest negative parallax (or the greatest sense of depth in the negative direction) in the reference frame. An image in which the key object is located near the edge may have a relatively greater impact on the fatigue felt by the viewer (310) compared to an image in which the key object is located near the center. For example, the edge area may refer to an area provided within a predetermined range from the edge of the area where the image is displayed. For example, the edge area may refer to an area provided within a predetermined range from the edge of the area where the viewer's field of vision extends. For example, the edge area may refer to the remaining area excluding the center area, which is within a certain range relative to the center point in the area where the image is displayed. Subsequently, in this disclosure, the area corresponding to the center area will be referred to as the 'center display area' or 'first display area'. Hereinafter, in the present disclosure, the area corresponding to the vicinity of the edge will be referred to as the 'outer display area' or the 'second display area'.

[0038] Therefore, considering the fatigue felt by the viewer (310), it may be desirable to use a parallax search range that has a relatively narrow width for the reference frame in which the core object is located in the outer display area compared to the reference frame in which the core object is located in the center display area. On the other hand, it may be desirable to use a parallax search range that has a relatively wide width for the reference frame in which the core object is located in the center display area compared to the reference frame in which the core object is located in the outer display area. The width of the parallax search range may be determined by an upper threshold parallax and / or a lower threshold parallax.

[0039] According to one example, the parallax distribution can be influenced by the complexity of the image. For example, the complexity of the image can be influenced by the number of key objects included in the image. For example, an image containing a large number of key objects may have higher complexity than an image containing a relatively small number of key objects. For example, the complexity of the image may be influenced by the arrangement of key objects included in the image. For example, an image in which key objects are dispersed may have higher complexity than an image in which key objects are clustered. For example, the complexity of the image may be influenced by the area of ​​key objects included in the image. For example, an image in which the area of ​​key objects is narrow may have higher complexity than an image in which the area of ​​key objects is wide. An image with high complexity may have a relatively greater impact on the fatigue felt by the viewer (310) compared to an image with low complexity. Therefore, for a reference frame with high complexity, a parallax search range having a relatively narrow width compared to a reference frame with low complexity may be used. In contrast, for reference frames of low complexity, a disparity search range having a relatively wider width compared to reference frames of high complexity may be used. The width of the disparity search range may be determined by an upper threshold disparity and / or a lower threshold disparity.

[0040] In order to reflect the above, the present disclosure requires a new design of the visual comfort zone (320) by considering the correlation between the parallax distribution and the fatigue level felt by the viewer (310). As an example, the visual comfort zone (320) may be designed so that a relatively wide parallax search range is allocated for frames where the viewer (310) is predicted to feel relatively low fatigue. For example, a section designed to allocate a parallax search range that is wider than the parallax search range defined in the original comfort zone (Z))(350) in the visual comfort zone (320) may be referred to as the 'first section'. As an example, the visual comfort zone (320) may be designed so that a relatively narrow parallax search range is allocated for frames where the viewer (310) is predicted to feel relatively high fatigue. For example, a section designed to allocate a narrower range of parallax search range compared to the original comfort zone (Z) (350) in the visual comfort zone (320) may be referred to as a ‘second section’. The stereoscopic image output by the visual comfort zone (320) designed in this way may have a vergence-accommodation conflict (VAC) that causes fatigue that is substantially the same or similar.

[0041] For example, if the core object is located in the first display area so that the viewer (310) can feel relatively less fatigue, the parallax search area may be determined to have a relatively wide width based on the visual comfort zone (320) (e.g., see FIG. 4a). Conversely, if the core object is located in the second display area so that the viewer (310) can feel relatively more fatigue, the parallax search area may be determined to have a relatively narrow width based on the visual comfort zone (320) (e.g., see FIG. 4b). The width of the parallax search range may be determined by an upper threshold parallax and / or a lower threshold parallax. This will be explained in more detail with reference to FIG. 4a or FIG. 4b.

[0042] For example, to obtain a target frame from a reference frame of low complexity, a disparity search range having a relatively wide width in the first section of the visual comfort zone (320) can be selected. Conversely, to obtain a target frame from a reference frame of high complexity, a disparity search range having a relatively narrow width in the second section of the visual comfort zone (320) can be selected. The width of the disparity search range can be determined by an upper threshold disparity and / or a lower threshold disparity.

[0043] FIG. 3b is a diagram (300b) for explaining the adjustment of a visual comfort zone (e.g., the visual comfort zone (320) of FIG. 3a) according to the viewer's field of view.

[0044] In FIG. 3b, it is assumed that the viewer (310) is located near the middle of the screen (370) (e.g., a wide monitor), but this is merely an example. For example, if the viewer (310) is located near the left side of the middle of the screen (370) or near the right side, the visual comfort zone (320) may be changed based on the position of the viewer (310). This will be explained below with reference to FIG. 3c.

[0045] Referring to FIG. 3b, the entire display area of ​​the screen (370) may not be included in the viewing range of the viewer (310) (e.g., a wide monitor). In this case, the viewer (310) may selectively view the partial stereoscopic image displayed in the left area (373) of the screen (370) or the partial stereoscopic image displayed in the right area (374). For example, an electronic device (e.g., the electronic device (500) of FIG. 5) may set the viewing area (373, 374) of the viewer (310) based on information regarding the viewer's (310) field of view. For example, the electronic device (500) may set the first viewing area (373) by reflecting the first viewing angle (371) by the viewer (310) when the viewer's (310) gaze is directed toward the left side of the screen (see 310a). The electronic device (500) can set a first viewing area (373) based on the distance (375) to which the gaze reaches the screen and the angle (376) between the direction the gaze is directed and the direction facing forward. For example, the electronic device (500) can set a second viewing area (374) by reflecting the second viewing angle (372) that the viewer (310) can view when the viewer's (310) gaze is directed toward the right side of the screen (see 310b). The electronic device (500) can set a second viewing area (374) based on the distance (377) to which the gaze reaches the screen and the angle (378) between the direction the gaze is directed and the direction facing forward.

[0046] According to one example, the electronic device (500) can adjust the visual comfort zone (320) to correspond to the set viewing area when either the first viewing area (373) or the second viewing area (374) is set as the viewing area of ​​the viewer (310). For example, the visual comfort zone (320) can be adjusted based on an analysis of the parallax distribution for a specific area of ​​the stereoscopic image to be displayed in the viewing area.

[0047] FIG. 3c is a diagram (300c) for explaining that a visual comfort zone (e.g., the visual comfort zone (320) of FIG. 3a) can be adjusted according to the movement of the viewer.

[0048] Referring to FIG. 3c, an electronic device (e.g., the electronic device (500) of FIG. 5) can adjust the visual comfort zone (320) based on the position where the viewer (e.g., the viewer (310) of FIG. 3a) is watching the stereoscopic image. For example, it can be assumed that the viewer (310) has moved from a first position (310c) to a second position (310d) (381). In this case, the electronic device (500) can change the first visual comfort zone (320) used to provide the stereoscopic image when the viewer (310) is at the first position (310c) to a second visual comfort zone (320'). The second visual comfort zone (320') can be provided to allow the viewer (310) to watch the stereoscopic image without fatigue at the second position (310d). If the first viewing position (310c) and the second viewing position (310d) only change their positions and the distance to the screen (330) is substantially maintained, the parallax search range according to the upper threshold parallax curve (321, 321') and the lower threshold parallax curve (323, 323') of the first visual comfort zone (320) and the second visual comfort zone (320') may be substantially the same.

[0049] For example, an electronic device (500) that provides multi-viewer support features can set customized visual comfort zones for each viewing position. In this case, all viewers watching the same stereoscopic image from different positions can experience similar levels of fatigue.

[0050] FIG. 4a or FIG. 4b is a drawing for exemplarily illustrating determining a parallax search range to be applied to obtain a stereoscopic image frame in a visual comfort zone based on a parallax distribution according to one embodiment.

[0051] In FIG. 4a or FIG. 4b, the electronic device may obtain reference frames (420a, 420b) corresponding to reference frames (410a, 410b). The reference frames (420a, 420b) may include parallax information corresponding to the reference frames (410a, 410b) or depth information. For example, the reference frames (420a, 420b) may be provided together with the reference frames (410a, 410b). For example, the reference frames (420a, 420b) may be generated from the reference frames (410a, 410b) based on a specific algorithm. For example, if the reference frames (410a, 410b) are 2D video frames, the electronic device can generate reference frames (420a, 420b) by obtaining pixel-wise parallax information from the reference frames (410a, 410b) using a mono-depth extraction algorithm such as MiDaS. For example, if the reference frames (410a, 410b) are 3D video frames, the electronic device can generate reference frames (420a, 420b) by obtaining pixel-wise parallax information from the reference frames (410a, 410b) using an extraction algorithm such as RAFT or stereo matching. A visual comfort zone (440) provided to obtain a target frame from the reference frames (420a, 420b) can be defined by an upper threshold parallax curve (441) and a lower threshold parallax curve (443). For example, the visual comfort zone (440) may provide a non-uniform time difference search range in which the offset between the upper threshold time difference and the lower threshold time difference increases in the first section and the offset between the upper threshold time difference and the lower threshold time difference decreases in the second section.

[0052] For example, an electronic device may obtain information regarding the disparity distribution in reference frames (420a, 420b). Here, the information regarding the disparity distribution may include information regarding one or more factors that may affect fatigue. The information regarding one or more factors that may affect fatigue may be based on the distribution characteristics of the disparity values ​​of pixels in reference frames (410a, 410b). For example, the information regarding the disparity distribution may include information regarding the number of key objects that may affect the complexity of the image corresponding to the reference frames (410a, 410b). For example, the information regarding the disparity distribution may include information regarding the area of ​​key objects that may affect the complexity of the image corresponding to the reference frames (410a, 410b). For example, the information regarding the disparity distribution may include information regarding the distribution of key objects that may affect the complexity of the image corresponding to the reference frames (410a, 410b). For example, information regarding the disparity distribution may include at least one of information regarding the number of key objects that can affect the complexity of the image corresponding to the reference frame (410a, 410b), information regarding the area of ​​the key objects, and / or information regarding the distribution of the key objects.

[0053] Referring to FIG. 4a, as an example, if the parallax information included in the reference frame (420a) is analyzed and it is determined that the reference frame (410a) has low complexity because a single core object is located near the center of the screen, the parallax search range (450a) can be determined to have a high upper threshold parallax value and a low lower threshold parallax value in the visual comfort zone (440) (400a). In this case, the stereoscopic image generated from the reference frame (410a) based on the reference frame (410a) and the parallax search range (450a) can have a high sense of stereoscopicity. That is, if it is predicted that the stereoscopic image will cause relatively low fatigue to the viewer, the reference frame (410a) and the target frame are made to have a relatively large parallax so that the user is provided with an image with a high sense of stereoscopicity.

[0054] Referring to FIG. 4b, as an example, if the parallax information included in the reference frame (420b) is analyzed and it is determined that the reference frame (420b) is located in a second display area, which is an outer display area of ​​the screen where the core object has low complexity but the viewer's gaze is not relatively focused, the parallax search range (450b) can be determined by a low upper threshold parallax value and a high lower threshold parallax value in the visual comfort zone (440) (400b). In this case, the stereoscopic image generated from the reference frame (410b) based on the reference frame (450b) and the parallax search range (450b) may have a low stereoscopic effect. That is, if it is predicted that the stereoscopic image will cause relatively high fatigue to the viewer, the reference frame (410b) and the target frame are made to have a relatively small parallax so that an image with a low stereoscopic effect is provided to the user.

[0055] FIG. 5 is a block diagram for generating a stereoscopic image in an electronic device according to one embodiment (e.g., the electronic device (1301) of FIG. 13).

[0056] Referring to FIG. 5, the electronic device (500) may include at least one processor (510) (hereinafter referred to as 'processor (510)'), at least one memory (520) (hereinafter referred to as 'memory (520)'), or an input / output (I / O (input / output)) circuit (530). According to one example, the electronic device (500) may output a stereoscopic image by applying a predetermined parallax information (or depth information) to a reference frame (e.g., the reference frame (110) of FIG. 1) which is an input image.

[0057] The processor (510) may be implemented as one or more IC (integrated circuit (or circuitry)) chips and may perform various data processing operations. The processor (510) may include at least one electrical circuit and may process instructions (or programs, data, etc.) stored in memory (520) individually or collectively in a distributed manner. The processor (510) may include a processor assembly comprising one or more processing circuits. The processor (510) may include any processing circuit operative to control the performance or operation of one or more components of the electronic device (500) (e.g., memory (520), and / or I / O circuit (530). The processor (510) (e.g., application processor (AP) or communication processor (CP)) may be implemented, for example, as a system on chip (SoC). The processor (510) may be implemented as a plurality of cores (or at least one core circuit), a plurality of chips, or a plurality of chipsets. The processor (510) may include one or more processing circuits. The processor (510) may include one or more processing circuits configured to perform the various functions of the present disclosure individually and / or collectively. By example, without limitation, at least a portion of the processor (510) is included in a first chip of the electronic device (500), and at least another portion of the processor (510) is different from the first chip of the electronic device (500). It can be included in the second chip of the device.

[0058] The processor (510) can generate a target frame by applying a disparity to each pixel of the reference frame using a disparity search range. The processor (510) can output a stereoscopic image corresponding to a stereoscopic image frame based on the reference frame and the target frame.

[0059] For example, the processor (510) may obtain a disparity distribution based on the location and / or area of ​​one or more objects in the screen based on information regarding the disparity of pixels included in the input image frame. The processor (510) may determine a disparity search range based on the disparity distribution. For example, the processor (510) may obtain information regarding the movement of a viewer and determine a disparity search range to be used to convert the input image frame into a stereoscopic image frame by considering the obtained information regarding the movement of the user. The information regarding the movement of the viewer may include information regarding at least one of the direction the viewer is looking or the viewing position of the viewer.

[0060] Memory (520) can store various data used by at least one component (e.g., processor (510)) of the electronic device (500). The data may include, for example, software (e.g., a program) and input or output data for instructions associated therewith. Memory (520) may include volatile memory or non-volatile memory. A program may be stored in memory (520) as software, for example. According to one example, memory (520) may include an operating system, middleware, or application.

[0061] The I / O circuit (530) can be used to connect the electronic device (500) to an external electronic device, such as a display device, based on a predetermined interface protocol. The I / O circuit (530) may support one or more specified interface protocols. The I / O circuit (530) may include, for example, an HDMI (high definition multimedia interface), a USB (universal serial bus) interface, an SD card interface, or an audio interface.

[0062] FIG. 6 is a control flowchart for outputting a stereoscopic image in an electronic device according to one embodiment (e.g., the electronic device (500) of FIG. 5).

[0063] In the following examples of operations, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, or at least two operations may be performed in parallel.

[0064] Referring to FIG. 6, the electronic device (500) can, in operation 610, obtain a disparity image frame corresponding to an input frame, namely a disparity map (e.g., a disparity map (120) of FIG. 1). For example, the disparity map (120) may be provided together with the reference frame (110). For example, if the reference frame (110) is a 2D image frame, the electronic device (500) can generate the disparity map (120) by pixel-wise disparity information of the reference frame (110) obtained using a mono-depth extraction algorithm such as MiDaS. For example, if the reference frame (110) is a 3D image frame, the electronic device (500) can generate the disparity map (120) by pixel-wise disparity information of the reference frame (110) obtained using an extraction algorithm such as RAFT or stereo matching.

[0065] The electronic device (500) can determine a coefficient value (or a disparity search range) for determining the disparity for each pixel of the reference frame (110) by analyzing a disparity map (120) corresponding to the disparity image frame in operation 620.

[0066] For example, the electronic device (500) can determine a disparity search range in a visual comfort zone (e.g., the visual comfort zone (320) of FIG. 3a) by considering one or more factors that may affect fatigue in a reference frame (110). The disparity search range is defined according to the complexity of the screen in the visual comfort zone (320). The electronic device (500) can determine a disparity search range for a reference frame of relatively high complexity in a section where the offset between the upper threshold disparity value and the lower disparity value is narrow in the visual comfort zone (320). The electronic device (500) can determine a disparity search range for a reference frame of relatively low complexity in a section where the offset between the upper threshold disparity value and the lower disparity value is wide in the visual comfort zone (320). The operation of the electronic device (500) determining the parallax search range based on the complexity of the reference frame (110) in the visual comfort zone (320) is as described above with reference to FIG. 4a or FIG. 4b.

[0067] For example, the electronic device (500) can analyze the parallax distribution in a parallax map corresponding to a reference frame and determine the feature values ​​of the partial regions that divide the fatigue calculation area based on the analyzed parallax distribution. Here, the partial regions can be defined by equally dividing the fatigue acquisition area included in the display area of ​​the display. The fatigue acquisition area may be an area set to analyze the parallax distribution within the entire area of ​​the display. For example, the fatigue acquisition area may be set as the remaining middle area excluding a certain upper area and / or a certain lower area within the entire area of ​​the display. The electronic device (500) provides information (α) regarding the correlation between the feature values ​​and the predetermined positional correlation coefficients corresponding to the partial regions. k, where k is the number of partial regions) can be obtained. Based on the information regarding the correlation between the obtained partial regions, the electronic device (500) can determine a coefficient value to adjust the disparity value so that the disparity value per pixel of the reference frame (110) exists within the disparity search range. The coefficient value may include a scale value and a shift value.

[0068] For example, the electronic device (500) may acquire information regarding the movement of a viewer and determine a parallax search range to be used to convert the reference frame (110) into a stereoscopic image frame by taking into account the acquired information regarding the movement of the user. The information regarding the movement of the viewer may include information regarding at least one of the direction the viewer is looking or the viewing position of the viewer.

[0069] The electronic device (500) can generate a target frame (130) corresponding to a reference frame (110) using a coefficient value (or a disparity search range) in operation 630. The electronic device (500) can output a stereoscopic image frame based on the reference frame (110) and the target frame (130). For example, the electronic device (500) can generate a target frame (130) by changing a disparity value defined pixel by pixel in a disparity map (120) to a disparity value belonging to a disparity search range, and applying the changed disparity value pixel by pixel of the reference frame (110).

[0070] According to the above description, the electronic device (500) can generate a first target frame by applying a disparity to each pixel of a first reference frame using a first disparity search range. The electronic device (500) can output a first stereoscopic image corresponding to a first stereoscopic image frame using the first reference frame and the first target frame. The electronic device (500) can generate a second target frame by applying a disparity to each pixel of a second reference frame using a second disparity search range. The electronic device (500) can output a second stereoscopic image corresponding to a second stereoscopic image frame using the second reference frame and the second target frame. For example, the stereoscopic sense of a specific object in the first stereoscopic image may differ from the stereoscopic sense of a specific object in the second stereoscopic image. This is based on the premise that the first screen characteristics according to the disparity distribution of the first reference frame and the second screen characteristics according to the disparity distribution of the second reference frame are changed. For example, if an object located in the center display area (or first display area) in the first reference frame moves to the outer display area (or second display area) away from the center display area in the second reference frame, the electronic device (500) may increase viewer fatigue due to changes in screen complexity, so to prevent this, pixel-wise parallax determining the three-dimensionality of the object may be applied differently to the first reference frame and the second reference frame.

[0071] For example, the electronic device (500) may change the second lower limit threshold value determining the second time difference search range to a value different from the first lower limit threshold value determining the first time difference search range in order to change the time difference search range. For example, the electronic device (500) may change the second upper limit threshold value and the second lower limit threshold value determining the second time difference search range to values ​​different from the first upper limit threshold value and the first lower limit threshold value determining the first time difference search range in order to change the time difference search range.

[0072] The electronic device (500) can determine a first parallax search range in a visual comfort zone (e.g., the visual comfort zone (320) of FIG. 3a) by considering one or more factors that may affect fatigue in a first input image frame. The parallax search range of the first area in the visual comfort zone (320) may be relatively wider than the parallax search range of the second area. The first area may be an area in the visual comfort zone (320) that includes objects requiring a relatively high sense of depth or near the center with respect to the horizontal axis. The second area may be an area in the visual comfort zone (320) that includes objects requiring objects requiring a relatively low sense of depth or near the edge with respect to the horizontal axis. One or more factors that may affect fatigue may include information regarding at least one of the number of key objects, the area of ​​key objects, and / or the distribution of key objects that may affect the complexity of the image corresponding to the first input image frame.

[0073] For example, the electronic device (500) may obtain a first disparity distribution based on the location and / or area of ​​one or more objects in the screen based on information regarding the disparity of pixels included in the first input image frame. The electronic device (520) may determine a first disparity search range based on the first disparity distribution. For example, the electronic device (500) may obtain information regarding the movement of a viewer and determine a first disparity search range to be used to convert the input image frame into a stereoscopic image frame by considering the obtained information regarding the movement of the user. The information regarding the movement of the viewer may include information regarding at least one of the direction the viewer is looking or the viewing position of the viewer.

[0074] To explain more specifically, the electronic device (500) can analyze the disparity distribution in a first disparity map corresponding to a first reference frame and determine first feature values ​​for partial regions based on the analyzed disparity distribution. Here, the partial regions can be set by evenly dividing the fatigue acquisition area included in the display area of ​​the display. The fatigue acquisition area may be an area set to analyze the disparity distribution within the entire area of ​​the display. For example, the fatigue acquisition area may be set as the remaining middle area excluding a certain upper area and / or a certain lower area within the entire area of ​​the display. The electronic device (500) can obtain information regarding the correlation between the first feature values ​​and predetermined position correlation coefficients corresponding to the partial regions. Based on the information regarding the correlation between the first partial regions, the electronic device (500) can determine a first scale value and a first shift value as coefficient values ​​to adjust the disparity so that the disparity of the pixels included in the first input image frame exists within the first disparity search range.

[0075] The electronic device (500) may determine a second parallax search range in the visual comfort zone (320) by considering one or more factors that may affect fatigue in the second input image frame. The parallax search range of the first area in the visual comfort zone (320) may be relatively wider than the parallax search range of the second area. The first area may be an area in the visual comfort zone (320) that includes objects requiring a relatively high sense of depth or near the center with respect to the horizontal axis. The second area may be an area in the visual comfort zone (320) that includes objects requiring a relatively low sense of depth or near the edge with respect to the horizontal axis. One or more factors that may affect fatigue may include, for example, information regarding at least one of the number of key objects, the area of ​​key objects, and / or the distribution of key objects that may affect the complexity of the image corresponding to the second input image frame.

[0076] For example, the electronic device (500) may obtain a second disparity distribution based on the location and / or area of ​​one or more objects in the screen based on information regarding the disparity of pixels included in the second input image frame. The electronic device (520) may determine a second disparity search range based on the second disparity distribution. For example, the electronic device (500) may obtain information regarding the movement of a viewer and determine a second disparity search range to be used to convert the input image frame into a stereoscopic image frame by considering the obtained information regarding the movement of the user. The information regarding the movement of the viewer may include information regarding at least one of the direction the viewer is looking or the viewing position of the viewer.

[0077] To explain more specifically, the electronic device (500) can analyze the disparity distribution in a second disparity map corresponding to a second reference frame and determine second feature values ​​for partial regions based on the analyzed disparity distribution. Here, the partial regions can be set by evenly dividing the fatigue acquisition area included in the display area of ​​the display. The fatigue acquisition area may be an area set to analyze the disparity distribution within the entire area of ​​the display. For example, the fatigue acquisition area may be set as the remaining middle area excluding a certain upper area and / or a certain lower area within the entire area of ​​the display. The electronic device (500) can obtain information regarding the correlation between the second feature values ​​and predetermined position correlation coefficients corresponding to the partial regions. Based on the information regarding the correlation between the second partial regions, the electronic device (500) can determine a second scale value and a second shift value as coefficient values ​​to adjust the disparity so that the disparity of the pixels included in the second input image frame exists within the second disparity search range.

[0078] FIG. 7 is a block diagram relating to a functional module for generating a stereoscopic image frame for outputting a stereoscopic image in an electronic device (e.g., the electronic device (500) of FIG. 5) according to one embodiment.

[0079] Referring to FIG. 7, an electronic device (500) for generating stereoscopic image frames may include a parallax (or depth) distribution analysis module (710), a parallax (or depth) determination module (720), or an image frame conversion module (730). The electronic device (500) may further include an interest analysis module (740). For example, the electronic device (500) may analyze a parallax image frame (701) to obtain a parallax distribution, and based on the obtained parallax distribution, adjust the stereoscopic effect of the input image so as to reduce the fatigue that a viewer may experience when viewing stereoscopic images.

[0080] The disparity distribution analysis module (710) can obtain information regarding the disparity distribution by analyzing the disparity image frame (701). The information regarding the disparity distribution may indicate the degree of change in disparity within the input image frame (703). The disparity image frame (701) may correspond to a disparity map. The disparity map may be provided together with the input image frame (703). The disparity map may be obtained from the input image frame (703) using a predetermined algorithm for extracting disparity (e.g., MiDaS, RAFT, or stereo matching).

[0081] For example, the parallax distribution analysis module (710) can obtain information regarding the parallax distribution by analyzing the placement locations of one or more objects included in the parallax image frame (701). The object to be analyzed for obtaining the parallax distribution may be, for example, the most protruding object in the image or the object with the largest negative parallax (or the largest sense of depth in the negative direction) in the parallax image frame (701). An image in which an object is located near the edge (e.g., a second display area which is the outer display area) may have a relatively greater impact on the fatigue felt by the viewer (310) compared to an image in which an object is located near the center (e.g., a first display area which is the center display area).

[0082] For example, the parallax distribution analysis module (710) can obtain information regarding the complexity of the image based on the magnitude and / or distribution of the pixel-wise parallax values ​​of the parallax image frame (701). The complexity of the image may be influenced by the number of objects included in the image. For example, an image containing a large number of objects may have higher complexity than an image containing a relatively small number of objects. The complexity of the image may be influenced by the arrangement of objects included in the image. For example, an image in which objects are dispersed may have higher complexity than an image in which core objects are clustered together. The complexity of the image may be influenced by the area of ​​objects included in the image. For example, an image in which the area of ​​objects is narrow may have higher complexity than an image in which the area of ​​objects is wide. An image with high complexity may have a relatively greater impact on the fatigue felt by the viewer compared to an image with low complexity.

[0083] The interest factor analysis module (740) can analyze the parallax video frame (701) and / or external information (e.g., sensing information from a sensor) to generate additional information to be considered when determining parallax to reduce viewer fatigue. For example, the interest factor analysis module (740) can track the viewer's eye movements to analyze the area where the viewer's gaze rests. For example, the interest factor analysis module (740) can analyze information regarding the area in the video where the viewer can focus well. For example, the interest factor analysis module (740) can analyze information regarding the location where the viewer is watching the stereoscopic video.

[0084] The parallax (or depth) determination module (720) can determine the pixel-wise parallax to be applied to generate a target frame using the input image frame (703) as a reference frame, based on information regarding the parallax distribution obtained by the parallax distribution analysis module (710).

[0085] For example, the parallax determination module (720) can determine a parallax search range that provides a sense of depth to the extent that the viewer does not feel fatigued, by considering the parallax distribution in the parallax image frame (701). For example, when an object is located near the edge (e.g., outer display area or second display area) in the input image frame (703), the parallax determination module (720) can select a parallax search range that has a relatively narrow width compared to when the object is located near the center (e.g., center display area or first display area). Conversely, when an object is located near the center (e.g., center display area or first display area) in the input image frame (703), the parallax determination module (720) can select a parallax search range that has a relatively wide width compared to when the object is located near the edge (e.g., outer display area or second display area). The width of the parallax search range can be determined by an upper threshold parallax and / or a lower threshold parallax.

[0086] For example, the parallax determination module (720) can determine a parallax search range that provides a sense of depth to the extent that the viewer does not feel fatigued, by considering the complexity of the parallax video frame (701). For example, the parallax determination module (720) can select a parallax search range that has a relatively narrow width for an input video frame (703) with high complexity compared to an input video frame with low complexity. Conversely, the parallax determination module (720) can select a parallax search range that has a relatively wide width for an input video frame (703) with low complexity compared to an input video frame with high complexity. The width of the parallax search range can be determined by an upper threshold parallax and / or a lower threshold parallax.

[0087] For example, the parallax determination module (720) can determine a parallax search range that provides a sense of depth that does not cause fatigue to the viewer by additionally considering the interest factor analyzed by the interest factor analysis module (740) in addition to the parallax distribution in the parallax image frame (701) and / or the complexity of the parallax image frame (701).

[0088] The video frame conversion module (730) can generate a target frame by applying the pixel-by-pixel parallax value determined by the parallax determination module (720) to each pixel of the input video frame (703). The video frame conversion module (730) can output an output video frame (705) that pairs the reference frame and the target frame, which are the input video frames (703).

[0089] FIG. 8 is a control flowchart for adjusting pixel-wise parallax to obtain a stereoscopic image in an electronic device (e.g., the electronic device (500) of FIG. 5) according to one embodiment. FIG. 9 is a diagram illustrating an example of analyzing an input image based on a correlation with a parallax distribution characteristic according to one embodiment. FIG. 10 is a diagram illustrating an example of obtaining a correlation between a characteristic value of a characteristic vector (940) shown in FIG. 9 and a plurality of position vectors (951, 952, 955, 957, 959).

[0090] In the following examples of operations, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, or at least two operations may be performed in parallel.

[0091] Referring to FIG. 8, FIG. 9, or FIG. 10, the electronic device (500) may, in operation 810, set a disparity area for analyzing a disparity distribution and divide the set disparity area into a predetermined number of partial disparity areas. For example, the electronic device (500) may set the remaining intermediate area, excluding the upper part and / or lower part of the disparity map (e.g., the disparity frame (920) of FIG. 9), as the disparity area. The reason the upper part and / or lower part of the disparity map (920) is not included in the disparity area is that, generally, there is almost no disparity between the right eye image and the left eye image in that area. For example, the reason the upper part and / or lower part of the disparity map (920) is not included in the disparity area is that not only is it unlikely that a significant object exists, but there is also a high probability that an object with an inaccurate depth value, such as the sky, is located there. Here, the parallax map (920) may be an image visualizing the pixel-by-pixel parallax of a reference frame (e.g., the reference frame (910) of FIG. 9). The parallax map (920) may darken pixels that appear to be far away in the positive direction (e.g., the direction away from the viewer) in the output stereoscopic image. The parallax map (920) may brighten pixels that appear to be close in the negative direction (e.g., the direction approaching the viewer) in the output stereoscopic image.

[0092] According to one example, the electronic device (500) may divide the disparity region in the horizontal direction into n partial disparity regions in order to analyze the disparity distribution in the horizontal direction of the image. Here, n is a natural number greater than or equal to 3. For example, the disparity region may be divided equally into 12 partial disparity regions.

[0093] The electronic device (500) can generate a feature vector based on a parallax distribution in operation 820. According to one example, the electronic device (500) can obtain feature values ​​for each of the segmented regions 1, ②, ③, ④, ⑤, ⑥, ⑦, ⑧, or ⑨. As an example, in FIG. 9, the reference frame (910) can provide a reference image in which three core objects (913, 915, 917) are placed on a background (911). The background (911) and the three core objects (913, 915, 917) included in the reference image may have different parallax information. That the background (911) and the three core objects (913, 915, 917) included in the reference image have different parallax can be confirmed by the brightness of the corresponding object in the parallax frame (920) corresponding to the parallax map. For example, according to the parallax frame (920), the parallax value can decrease in the order of the third object (927), the second object (925), the first object (923), and the background (921).

[0094] According to one example, the electronic device (500) can obtain a feature value for each segmented area based on the disparities of the pixels included in the segmented area. For example, the average value of the disparities of the pixels included in the segmented area can be determined as the feature value. For example, the average value of the values ​​for the multipliers of the disparities of the pixels included in the segmented area can be determined as the feature value. For example, the largest disparity among the disparities of the pixels included in the segmented area can be determined as the feature value.

[0095] Referring to FIG. 9 or FIG. 10, 12 feature values ​​(1010) for each segmented region based on a feature vector (940) (D1, D2, D3, D4, D5, D6, D7, D8, D9, D 10 , D 11 , D 12) can be determined as “10, 35, 45, 43, 25, 25, 60, 80, 50, 0, 0”. 12 feature values ​​per segmented region (1010) (D1, D2, D3, D4, D5, D6, D7, D8, D9, D 10 , D 11 , D 12 ) can define a single feature vector.

[0096] The electronic device (500) can obtain a correlation between a characteristic vector (940) and a position vector (950) for each divided region in operation 830. The electronic device (500) can obtain a characteristic value (1010) for each divided region corresponding to the characteristic vector (940) in operation 820 (D1, D2, D3, D4, D5, D6, D7, D8, D9, D 10 , D 11 , D 12 ) was obtained. The electronic device (500) can determine position correlation coefficients for each segmented region corresponding to position vectors for calculating the correlation with the characteristic vector (940).

[0097] According to one example, the electronic device (500) can obtain a positional correlation coefficient for each of the divided regions ①, ②, ③, ④, ⑤, ⑥, ⑦, ⑧, or ⑨. The positional correlation coefficient for each divided region can be pre-set. For example, position vectors (951, 953, 955, 957, 959) may have a positional correlation coefficient for a predetermined number of divided regions among the divided regions. Some of the position vectors (953, 955, 957) among the position vectors (951, 953, 955, 957, 959) may have the same number (e.g., 6) of divided regions having a positional correlation coefficient (963, 965, 967). Among the remaining position vectors (951, 953, 955, 957, 959), the number of segmented regions having position correlation coefficients may differ (e.g., 3) (961, 959). The pattern of the illustrated position vectors (951, 953, 955, 957, 959) is exemplary and can be modified into various shapes. For example, the pattern of the position vectors (951, 953, 955, 957, 959) can be designed as an impulse vector or a Gaussian shape vector.

[0098] The electronic device (500) can calculate the correlation between the characteristic vector (940) and each of the position vectors (951, 953, 955, 957, 959). There are no limitations on the method for calculating the correlation between the two vectors. For example, the electronic device (500) can calculate the correlation between the characteristic vector (940) and each of the position vectors (951, 953, 955, 957, 959) by applying a specific correlation calculation method (e.g., cosine similarity). As an example, the electronic device (500) can calculate the correlation between the characteristic vector (940) and each of the first to fifth position vectors (951, 953, 955, 957, 959).

[0099] Referring to FIG. 9 or FIG. 10, feature values ​​(1010) (D1, D2, D3, D4, D5, D6, D7, D8, D9, D) for each segmented region of the feature vector (940). 10 , D 11 , D 12 ) is assumed to be “10, 35, 45, 43, 25, 25, 60, 80, 50, 0, 0”. The first position correlation coefficients (1021) (P) of the first position vector (951) 11 , P 12 , P 13 , P 14 , P 15 , P 16 , P 17 , P 18 , P 19 , P 1a , P 1b1 , P 1c ) is assumed to be “1, 0.5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0”. The second position correlation coefficients (1023) (P of the second position vector (953) 21 , P 22 , P 23 , P 24 , P 25 , P 26 , P 27 , P 28 , P 29 , P 2a , P 2b , P 2c ) is assumed to be “0, 0, 0.5, 1, 1, 0.5, 0, 0, 0, 0, 0, 0”. The third position correlation coefficients (1025)(P) of the third position vector (955) 31 , P 32 , P 33 , P 34 , P 35 , P 36 , P 37 , P 38 , P 39 , P 3a , P 3b , P 3c) is assumed to be “0, 0, 0, 0, 0.5, 1, 1, 0.5, 0, 0, 0, 0”. The fourth position correlation coefficients (1027) (P) of the fourth position vector (957) are 41 , P 42 , P 43 , P 44 , P 45 , P 46 , P 47 , P 48 , P 49 , P 4a , P 4b , P 4c ) is assumed to be “0, 0, 0, 0, 0, 0, 0.5, 1, 1, 0.5, 0, 0”. The fifth position correlation coefficients (1029)(P of the fifth position vector (959) 51 , P 52 , P 53 , P 54 , P 55 , P 56 , P 57 , P 58 , P 59 , P 5a , P 5b , P 5c ) is assumed to be “0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0.5, 1”.

[0100] The correlation (c1, c2, c3, c4, c5) calculated by the cosine similarity technique using the feature values ​​(1010) for each segmented region of the feature vector (940) assumed above and the first to fifth position correlation coefficients (1021, 1023, 1025, 1027, 1029) may be [0.15, 0.41, 0.55, 0.85, 0.00].

[0101] The electronic device (500) can perform screen analysis based on the correlation obtained in operation 840 to derive a parallax characteristic for adjusting per-pixel parallax. For example, the parallax characteristic may be a coefficient value for adjusting per-pixel parallax. The electronic device (500) may output a coefficient value that changes a first parallax value corresponding to the pixels of the input frame into a second parallax value for generating a stereoscopic image, taking into account the viewer's fatigue. For example, the parallax characteristic may be a parallax search range for determining per-pixel parallax. The electronic device (500) may output a parallax search range suitable for the screen (e.g., upper threshold parallax and / or lower threshold parallax) taking into account the viewer's fatigue.

[0102] According to one example, the electronic device (500) has a calculated correlation (c k ) and pre-set weights (α) for each phase vector k Screen coefficients (S) representing characteristics regarding the parallax distribution of the reference frame using ) coef ) can be determined. For example, α k is the correlation c at each location k As a weight corresponding to it, it may have a negative value when the fatigue level is predicted to be relatively high according to the definition of the characteristic value, and a positive value when the fatigue level is predicted to be relatively low.

[0103] The following <Mathematical Formula 1> is the screen coefficient (S coef It proposed an example of a decision of ).

[0104]

[0105] Here, k is the identifier of the position vector.

[0106] For example, l is 5, and the weights per phase vector (α kIf we apply the case where ) is [-1.2, 0.3, 0.7, 0.35, -1.2] and the calculated correlation (c1, c2, c3, c4, c5) is [0.15, 0.41, 0.55, 0.85, 0.00] to the above <Equation 1>,

[0107] S coef = [0.15, 0.41, 0.55, 0.85, 0.00] * [-1.2, 0.3, 0.7, 0.35, -1.2] T

[0108] = 0.28

[0109] It can be determined as.

[0110] According to the above <Mathematical Formula 1>, the screen coefficient (S coef The range of ) is -1 ≤ S coef It can be ≤+1. S coef When ga is -1, it corresponds to SWV, and S coef The case where is +1 corresponds to the Center object.

[0111] According to one example, the electronic device (500) has a calculated correlation (c k ) values, phase vector-specific weights (α k max(c according to ) k , c k+1 ), min(c k , c k+1 It can be used by combining them non-linearly using the relationship of ).

[0112] For example, when l=5,

[0113] S coef = 2*max(c1, c5)*(-1.2) + 2*max(c2, c4)*0.35 + c3*0.7

[0114] You can use relationships such as that.

[0115] As described above, the electronic device (500) has a screen coefficient (S) between -1 and 1 depending on the complexity of the image and / or the position of the object having a three-dimensional effect. coef It can output ) as a result.

[0116] According to one example, the electronic device (500) has a calculated correlation (c k ), pre-set weights (α) for each phase vector k ) and weights by viewer location (p k Screen coefficients (S) representing characteristics regarding the parallax distribution of the reference frame using ) coef ) can be determined. For example, weights based on the viewer's location (p k ) can change depending on the viewer's position and / or gaze direction. For example, when k is 5, the weight according to viewer position (p k ) can be [0.4, 1, 0.4, 0.2, 0.1].

[0117] The following <Mathematical Formula 2> is the screen coefficient (S coef It proposed an example of a decision of ).

[0118]

[0119] Here, k is the identifier of the position vector.

[0120] According to one example, the electronic device (500) has a calculated correlation (c k ), pre-set weights (α) for each phase vector k In addition to ), the weight (α) for the positional correlation of key objects in the saliency map is a factor of interest. saliency ) and weights (α) for the positional correlation of key objects in the blur map blur Screen coefficients (S) representing characteristics regarding the parallax distribution of the reference frame using ) coef ) can be determined.

[0121] The following <Mathematical Formula 3> is the screen coefficient (S coef It proposed an example of a decision of ).

[0122]

[0123] Here, k is the identifier of the position vector, and the weight (α k ), weight(αsaliency ), and weights (α blur ) is a weight for a linear combination. Weight(α k ) is a coefficient value such as [-1.2, 0.3, 0.7, 0.3, -1.2], which was used to derive feature values ​​indicating whether the screen is an SWV or a complex screen by utilizing the correlation with the position vector after analyzing the disparity distribution, and may be a value for reflecting the disparity distribution. Weight (α saliency ) can be a value to reflect the distribution of the saliency map. Weight (α blur ) can be a value to reflect the distribution of the focus map. Weight (α k ), weight(α saliency ), and weights (α blur Depending on the situation, ) may be used as a single coefficient value by multiplying three values. Alternatively, a linear combination reflecting the coefficient value for each map can be used.

[0124] According to one example, the electronic device (500) has a calculated correlation (c k ), pre-set weights (α) for each phase vector k In addition to ), the positional correlation of key objects in the saliency map (C) is a factor of interest. saliency ) and weights (α saliency ), positional correlation of key objects in a blur map (C blur ) and weights (α blur Screen coefficients (S) representing characteristics regarding the parallax distribution of the reference frame using ) coef ) can be determined.

[0125] The following <Mathematical Formula 4> is the screen coefficient (S coef It proposed an example of a decision of ).

[0126]

[0127] Here, k is the identifier of the position vector, and the weight (α k ), weight(α saliency ), and weights (αblur ) is the weight for the linear combination.

[0128] The electronic device (500) is a screen count (S coef If you determine ), you can determine the coefficient values ​​for parallax adjustment. The coefficient values ​​can include scale values ​​and shift values. For example, the scale value, which is one of the coefficient values, is “scale = func(S coef It can be obtained by “, input disparity range)”. For example, the shift value, which is one of the coefficient values, is “shift = func(S coef It can be obtained by “, input disparity range, scale)”.

[0129] The electronic device (500) can newly determine the disparity of each pixel of the reference frame using the scale value and shift value, which are coefficient values.

[0130] The following <Mathematical Formula 5> is the existing pixel-by-pixel parallax (D OLD ) new pixel-wise parallax values ​​(D NEW It proposed an example of adjusting to ).

[0131]

[0132] Fig. 11 shows the scene coefficient (S) according to the parallax distribution of the input frame. coef This is a drawing to explain the change (1110) of )

[0133] In the following description regarding FIG. 11, the screen coefficient (S coef The change in ) will be explained as a relative concept rather than an absolute value. Screen coefficient (S coef Changes in ) can adjust the parallax search range to determine pixel-wise parallax targeting the pixels of the corresponding input frame. For example, the frame coefficient (S coef If ) increases, the parallax search range can be widened, and the screen coefficient (Scoef If ) decreases, the time-lapse search range may narrow.

[0134] Referring to FIG. 11, the input frame #73 (1121) may have a first spatial disparity distribution in which a core object is located near the center of the screen and surrounding objects with relatively large depth values ​​are located to the left and right of the core object. The first spatial disparity distribution can be determined based on the analysis results of the disparity map #73 (1123) corresponding to the input frame #73 (1121). In this case, the first screen coefficient (S coef#1 ) can be determined to be a low value based on the lag distribution of the lag map #73 (1123), for example, by determining that the complexity is high.

[0135] For example, the screen coefficient (S) resulting from the parallax distribution of input frame #105 (1131) (or parallax map #105 (1133)), input frame #133 (1141) (or parallax map #133 (1143)), or input frame #169 (1151) (or parallax map #169 (1153)) coef# Explains the change in ).

[0136] In input frame #133 (1141), a change in the spatial parallax distribution occurred as the core object and surrounding objects, which were located near the center of the screen in input frame #105 (1131), moved forward. As a result, the third screen coefficient (S) determined based on the analysis results of the parallax map #133 (1143) corresponding to input frame #133 (1141) coef#3 The second screen coefficient (S) determined based on the analysis result of the parallax map #105 (1133) corresponding to the input frame #105 (1131). coef#2 It can be increased compared to ). Therefore, the disparity search range applied to obtain a stereoscopic image from input frame #133 (1141) can be wider than the disparity search range applied to obtain a stereoscopic image from input frame #105 (1131).

[0137] In input frame #169 (1151), a change in the spatial parallax distribution occurred as the core object and surrounding objects, which were located near the center of the screen in input frame #133 (1141), were completely zoomed out. As a result, the fourth screen coefficient (S) determined based on the analysis results of the parallax map #169 (1153) corresponding to input frame #169 (1151) coef#4 ) is a third screen coefficient (S) determined based on the analysis result of the parallax map #133 (1143) corresponding to the input frame #133 (1141). coef#3 It can be reduced compared to ). Therefore, the disparity search range applied to obtain a stereoscopic image from input frame #169 (1151) can be narrowed compared to the disparity search range applied to obtain a stereoscopic image from input frame #133 (1141).

[0138] For example, a screen coefficient (S) resulting from the parallax distribution of input frame #177 (1161) (or parallax map #177 (1163)) or input frame #201 (1171) (or parallax map #201 (1173)). coef# Explains the change in ).

[0139] In input frame #177 (1161), some objects are located near the center (e.g., the center display area or the first display area), and the remaining objects are located near the edges (e.g., the outer display area or the second display area). In this case, by analyzing the parallax map #177 (1163) corresponding to input frame #177 (1161), a parallax arrangement can be obtained as the objects are dispersed. Due to the parallax distribution in which the objects are dispersed in input frame #177 (1161), the fifth screen coefficient (S) for input frame #177 (1161) coef#5 ) can be changed.

[0140] In input frame #201 (1171), a change in the spatial parallax distribution occurred as an object located near the center of the screen (e.g., the center display area or the first display area) in input frame #177 (1161) moved away from the center. As a result, the sixth screen coefficient (S) determined based on the analysis results of the parallax map #201 (1173) corresponding to input frame #201 (1171) coef#6 ) is the fifth screen coefficient (S) determined for input frame #177 (1161). coef#5 It can be reduced compared to ). Therefore, the disparity search range applied to obtain a stereoscopic image from input frame #201 (1171) can be narrowed compared to the disparity search range applied to obtain a stereoscopic image from input frame #177 (1161).

[0141] FIG. 12 is a diagram illustrating the change in the parallax search range (1220) according to the parallax distribution of the input frame.

[0142] Referring to FIG. 12, the disparity search range to be applied to input frames to acquire stereoscopic images can be determined based on the screen characteristics of the corresponding input frames. The disparity search range corresponds to the interval for determining the disparity to be applied to the pixels of the target frame that will form a multi-viewpoint frame pair together with the reference frame, which is the corresponding input frame. That is, the disparity between each pixel of the reference frame and the pixel of the target frame to be matched must fall within the disparity search range. Therefore, to reduce viewer fatigue, a relatively wider disparity search range can be determined for input frames with low screen characteristics compared to input frames with high screen characteristics. For example, the complexity considered to determine screen characteristics can be analyzed based on at least one of the position of an object, the number of objects, the depth of an object, or the area of ​​an object.

[0143] For example, input frame #34 (1231) can be analyzed as having low-complexity screen characteristics because a single object with a large area is located near the center of the screen based on the parallax distribution in the parallax map (1233). Therefore, the parallax search range (1235) for input frame #34 (1231) can be determined to be relatively wide. A wide parallax search range (1235) may mean having a high upper threshold parallax (1221) and / or a low lower threshold parallax (1223). This is to enhance the sense of depth, as the stereoscopic image produced by input frame #34 (1231) causes relatively low fatigue to the viewer.

[0144] For example, input frame #82 (1241) can be analyzed as having high screen characteristics because objects are distributed near the edges of the screen based on the parallax distribution in the parallax map (1243), and the object with the highest parallax is located near the bottom of the screen. Therefore, the parallax search range (1245) for input frame #82 (1241) can be determined to be relatively narrow compared to input frame #34 (1231). A narrow parallax search range (1235) may mean having a low upper threshold parallax (1221) and / or a high lower threshold parallax (1223). This is to reduce the sense of depth, as the stereoscopic image from the second input frame #82 (1241) causes relatively high fatigue to the viewer.

[0145] For example, input frame #118 (1251) can be analyzed as having high screen characteristics because the core object with the highest parallax is located near the left edge of the screen based on the parallax distribution in the parallax map (1253). Therefore, the parallax search range (1255) for input frame #118 (1251) can be determined similarly to input frame #82 (1241).

[0146] For example, input frame #160 (1261) can be analyzed as having low-complexity screen characteristics because, based on the parallax distribution in the parallax map (1263), a single object with a wide area is located slightly to the left of the center of the screen. Therefore, the parallax search range (1265) for input frame #160 (1261) can be determined to be relatively wider than that of input frame #118 (1251). In this case, the sense of depth provided by input frame #160 (1261) can be increased compared to the sense of depth provided by input frame #118 (1251).

[0147] For example, input frame #214 (1271) can be analyzed as having screen characteristics with low complexity similar to input frame #34 (1231) because a single object with a large area on the screen is located based on the parallax distribution in the parallax map (1273). Therefore, the parallax search range (1275) for input frame #214 (1271) can be determined to be relatively wide.

[0148] As described above, according to the present disclosure, by adaptively adjusting the parallax search range to be applied for the output of stereoscopic images by considering screen characteristics corresponding to the complexity of the screen, the fatigue felt by the viewer can be reduced.

[0149] FIG. 13 is a block diagram of an electronic device (1301) in a network environment (1300) according to various embodiments.

[0150] Referring to FIG. 13, in a network environment (1300), an electronic device (1301) may communicate with an electronic device (1302) through a first network (1398) (e.g., a short-range wireless communication network) or with at least one of an electronic device (1304) or a server (1308) through a second network (1399) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (1301) may communicate with the electronic device (1304) through a server (1308). According to one embodiment, the electronic device (1301) may include a processor (1320), memory (1330), input module (1350), sound output module (1355), display module (1360), audio module (1370), sensor module (1376), interface (1377), connection terminal (1378), haptic module (1379), camera module (1380), power management module (1388), battery (1389), communication module (1390), subscriber identification module (1396), or antenna module (1397). In some embodiments, at least one of these components (e.g., connection terminal (1378)) may be omitted from the electronic device (1301), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (1376), camera module (1380), or antenna module (1397)) may be integrated into a single component (e.g., display module (1360)).

[0151] The processor (1320) can, for example, execute software (e.g., program (1340)) to control at least one other component (e.g., hardware or software component) of the electronic device (1301) connected to the processor (1320) and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (1320) can store commands or data received from other components (e.g., sensor module (1376) or communication module (1390)) in volatile memory (1332), process the commands or data stored in volatile memory (1332), and store the resulting data in non-volatile memory (1334). According to one embodiment, the processor (1320) may include a main processor (1321) (e.g., a central processing unit or an application processor) or an auxiliary processor (1323) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (1301) includes a main processor (1321) and an auxiliary processor (1323), the auxiliary processor (1323) may be configured to use less power than the main processor (1321) or to be specialized for a designated function. The auxiliary processor (1323) may be implemented separately from the main processor (1321) or as part thereof.

[0152] The auxiliary processor (1323) may control at least some of the functions or states associated with at least one component of the electronic device (1301) (e.g., display module (1360), sensor module (1376), or communication module (1390)) on behalf of the main processor (1321) while the main processor (1321) is in an inactive (e.g., sleep) state, or together with the main processor (1321) while the main processor (1321) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (1323) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (1380) or communication module (1390)). According to one embodiment, the auxiliary processor (1323) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (1301) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (1308)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0153] The memory (1330) can store various data used by at least one component of the electronic device (1301) (e.g., processor (1320) or sensor module (1376)). The data may include, for example, input data or output data for software (e.g., program (1340)) and related commands. The memory (1330) may include volatile memory (1332) or non-volatile memory (1334).

[0154] The program (1340) may be stored as software in memory (1330) and may include, for example, an operating system (1342), middleware (1344), or an application (1346).

[0155] The input module (1350) can receive commands or data to be used for a component of the electronic device (1301) (e.g., processor (1320)) from outside the electronic device (1301) (e.g., user). The input module (1350) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0156] The sound output module (1355) can output a sound signal to the outside of the electronic device (1301). The sound output module (1355) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0157] The display module (1360) can visually provide information to an external (e.g., user) of the electronic device (1301). The display module (1360) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (1360) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by the touch.

[0158] The audio module (1370) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (1370) can acquire sound through an input module (1350) or output sound through an audio output module (1355) or an external electronic device (e.g., electronic device (1302)) (e.g., speaker or headphones) that is directly or wirelessly connected to the electronic device (1301).

[0159] The sensor module (1376) can detect the operating state of the electronic device (1301) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (1376) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0160] The interface (1377) may support one or more specified protocols that can be used for the electronic device (1301) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (1302)). According to one embodiment, the interface (1377) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0161] The connection terminal (1378) may include a connector through which the electronic device (1301) can be physically connected to an external electronic device (e.g., electronic device (1302)). According to one embodiment, the connection terminal (1378) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0162] The haptic module (1379) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (1379) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0163] The camera module (1380) can capture still images and video. According to one embodiment, the camera module (1380) may include one or more lenses, image sensors, image signal processors, or flashes.

[0164] The power management module (1388) can manage power supplied to the electronic device (1301). According to one embodiment, the power management module (1388) may be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0165] The battery (1389) can supply power to at least one component of the electronic device (1301). According to one embodiment, the battery (1389) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0166] The communication module (1390) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (1301) and an external electronic device (e.g., electronic device (1302), electronic device (1304), or server (1308)), and the performance of communication through the established communication channel. The communication module (1390) may include one or more communication processors that operate independently of the processor (1320) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1390) may include a wireless communication module (1392) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (1394) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (1304) via a first network (1398) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (1399) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1392) can identify or authenticate the electronic device (1301) within a communication network such as the first network (1398) or the second network (1399) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (1396).

[0167] The wireless communication module (1392) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (1392) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (1392) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (1392) can support various requirements specified in the electronic device (1301), external electronic device (e.g., electronic device (1304)), or network system (e.g., second network (1399)). According to one embodiment, the wireless communication module (1392) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.

[0168] An antenna module (1397) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (1397) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (1397) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (1398) or a second network (1399), may be selected from the plurality of antennas, for example, by a communication module (1390). A signal or power may be transmitted or received between the communication module (1390) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (1397).

[0169] According to various embodiments, the antenna module (1397) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0170] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0171] According to one embodiment, commands or data may be transmitted or received between an electronic device (1301) and an external electronic device (1304) through a server (1308) connected to a second network (1399). Each of the external electronic devices (1302, or 1304) may be the same or a different type of device as the electronic device (1301). According to one embodiment, all or part of the operations performed on the electronic device (1301) may be performed on one or more of the external electronic devices (1302, 1304, or 1308). For example, if the electronic device (1301) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (1301) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (1301). The electronic device (1301) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (1301) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (1304) may include an Internet of Things (IoT) device. The server (1308) may be an intelligent server using machine learning and / or neural networks.According to one embodiment, an external electronic device (1304) or server (1308) may be included within the second network (1399). The electronic device (1301) may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0172] The electronic devices according to the various examples disclosed in this document may be of various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or consumer electronics. The electronic devices according to the examples in this document are not limited to the devices described above.

[0173] As an example, the electronic device (500) may include a memory (520) comprising one or more storage media for storing instructions. The electronic device (500) may include at least one processor (510) comprising a processing circuit. When the instructions are executed individually or collectively by the at least one processor (510), the electronic device (500) may be caused to perform at least one operation. The at least one operation may include an operation of outputting a first stereoscopic image frame corresponding to a first input image frame to a display based on a first disparity search range. The at least one operation may include an operation of outputting a second stereoscopic image frame corresponding to a second input image frame to the display based on a second disparity search range. The stereoscopic sense of a specific object in the first stereoscopic image displayed on the display by the first stereoscopic image frame may differ from the stereoscopic sense of the specific object in the second stereoscopic image displayed on the display by the second stereoscopic image frame. The display position and / or display area of ​​the specific object in the first stereoscopic image may differ from the display position and / or display area of ​​the specific object in the second stereoscopic image.

[0174] As an example, the first lower limit threshold value determining the first time difference search range may be different from the second lower limit threshold value determining the second time difference search range.

[0175] As an example, the first upper threshold value and the first lower threshold value determining the first time difference search range may be different from the second upper threshold value and the second lower threshold value determining the second time difference search range.

[0176] As an example, when the above instructions are executed individually or collectively by at least one processor (510), the electronic device (500) may be caused to perform an operation of determining the first parallax search range in the visual comfort zone by considering one or more factors that may affect fatigue in the first input image frame.

[0177] As an example, when the above instructions are executed individually or collectively by at least one processor (510), the electronic device (500) may be caused to perform an operation of determining the second parallax search range in the visual comfort zone by considering one or more factors that may affect the fatigue in the second input image frame.

[0178] As an example, the parallax search range of the first area in the above visual comfort zone may be relatively wider than the parallax search range of the second area.

[0179] As an example, the first area may be an area containing objects that are near the center or require a relatively high sense of three-dimensionality based on the horizontal axis in the visual comfort zone.

[0180] As an example, the second area may be an area containing objects that require a relatively small sense of depth or are located near the edge with respect to the horizontal axis in the visual comfort zone.

[0181] As an example, one or more factors that may affect the fatigue may include at least one of the number of key objects, the area of ​​key objects, and / or the distribution of key objects that may affect the complexity of the image corresponding to the first input image frame or the second input image frame.

[0182] As an example, when the above instructions are executed individually or collectively by at least one processor (510), the electronic device (500) may be caused to perform an operation of obtaining a first disparity distribution according to the position and / or area of ​​one or more objects in the screen based on information regarding the disparity of pixels included in the first input image frame.

[0183] As an example, when the above instructions are executed individually or collectively by at least one processor (510), the electronic device (500) may be caused to include an operation of determining the first disparity search range based on the first disparity distribution.

[0184] As an example, when the above instructions are executed individually or collectively by at least one processor (510), the electronic device (500) may be caused to perform an operation of obtaining a second disparity distribution according to the position and / or area of ​​one or more objects in the screen based on information regarding the disparity of pixels included in the second input image frame.

[0185] As an example, when the above instructions are executed individually or collectively by at least one processor (510), the electronic device (500) may be caused to perform the operation of determining the second disparity search range based on the second disparity distribution.

[0186] As an example, when the above instructions are executed individually or collectively by at least one processor (510), the electronic device (500) may be caused to perform an action of acquiring information regarding the movement of a viewer.

[0187] As an example, when the above instructions are executed individually or collectively by at least one processor (510), the electronic device (500) may be caused to perform an operation to determine a parallax search range to be used to convert the corresponding input image frame into a stereoscopic image frame by taking into account the information regarding the acquired user's movement.

[0188] As an example, the information regarding the movement of the viewer may include information regarding at least one of the direction the viewer is looking or the viewer's viewing position.

[0189] As an example, when the above instructions are executed individually or collectively by at least one processor (510), the electronic device (500) may be caused to perform an operation of determining feature values ​​for a plurality of partial regions based on the disparity distribution of a first or second disparity image frame corresponding to the first or second input image frame.

[0190] As an example, when the above instructions are executed individually or collectively by at least one processor (510), the electronic device (500) may be caused to perform an operation of obtaining information regarding the correlation between the feature values ​​and predetermined positional correlation coefficients corresponding to the plurality of partial regions.

[0191] As an example, when the above instructions are executed individually or collectively by at least one processor (510), the electronic device (500) may be caused to perform an operation of determining a scale value and a shift value to adjust the disparity so that the disparity of pixels included in the first or second input image frame exists within the first or second disparity search range based on the information regarding the acquired partial region correlation.

[0192] As an example, here, the plurality of partial regions can be determined by equally dividing the fatigue acquisition region included in the display area of ​​the display.

[0193] For example, the operation method of the electronic device (500) may include the operation of outputting a first stereoscopic image frame corresponding to a first input image frame to a display based on a first disparity search range. The operation method may include the operation of outputting a second stereoscopic image frame corresponding to a second input image frame to the display based on a second disparity search range. The stereoscopic sense of a specific object in the first stereoscopic image displayed on the display by the first stereoscopic image frame may differ from the stereoscopic sense of the specific object in the second stereoscopic image displayed on the display by the second stereoscopic image frame. The display position and / or display area of ​​the specific object in the first stereoscopic image may differ from the display position and / or display area of ​​the specific object in the second stereoscopic image.

[0194] As an example, the first lower limit threshold value determining the first time difference search range may be different from the second lower limit threshold value determining the second time difference search range.

[0195] As an example, the first upper threshold value and the first lower threshold value determining the first time difference search range may be different from the second upper threshold value and the second lower threshold value determining the second time difference search range.

[0196] As an example, the operation of outputting the first stereoscopic image frame to the display may include the operation of determining the first parallax search range in the visual comfort zone by considering one or more elements that may affect fatigue in the first input image frame.

[0197] As an example, the operation of outputting the second stereoscopic image frame to the display may include the operation of determining the second parallax search range in the visual comfort zone by considering one or more elements that may affect the fatigue level in the second input image frame.

[0198] For example, in the visual comfort zone above, the parallax search range of the first area may be relatively wider than the parallax search range of the second area.

[0199] As an example, the first area may be an area containing objects that are near the center or require a relatively high sense of three-dimensionality based on the horizontal axis in the visual comfort zone.

[0200] As an example, the second area may be an area containing objects that require a relatively small sense of depth or are located near the edge with respect to the horizontal axis in the visual comfort zone.

[0201] As an example, one or more factors that may affect the fatigue may include at least one of the number of key objects, the area of ​​key objects, and / or the distribution of key objects that may affect the complexity of the image corresponding to the first input image frame or the second input image frame.

[0202] As an example, the above operation method may include an operation of obtaining a first disparity distribution according to the position and / or area of ​​one or more objects in the screen based on information regarding the disparity of pixels included in the first input image frame.

[0203] As an example, the above operation method may include an operation to determine the first disparity search range based on the first disparity distribution.

[0204] As an example, the above operation method may include an operation of obtaining a second disparity distribution according to the position and / or area of ​​one or more objects in the screen based on information regarding the disparity of pixels included in the second input image frame.

[0205] As an example, the above operation method may include an operation to determine the second disparity search range based on the second disparity distribution.

[0206] As an example, the above method of operation may include an operation to obtain information regarding the movement of a viewer.

[0207] As an example, it may include an operation to determine a parallax search range to be used to convert the corresponding input video frame into a stereoscopic video frame by considering the information regarding the user's movement acquired above.

[0208] As an example, the information regarding the movement of the viewer may include information regarding at least one of the direction the viewer is looking or the viewer's viewing position.

[0209] As an example, the operation of outputting the first stereoscopic image frame to a display may include the operation of determining first feature values ​​for partial regions based on the parallax distribution of a first parallax image frame corresponding to the first input image frame.

[0210] As an example, the operation of outputting the first stereoscopic image frame to a display may include the operation of obtaining information regarding the correlation degree between the first partial region and the predetermined positional correlation coefficients corresponding to the first feature values ​​and the partial regions.

[0211] For example, the operation of outputting the first stereoscopic image frame to a display may include determining a first scale value and a first shift value to adjust the disparity so that the disparity of the pixels included in the first input image frame exists within the first disparity search range, based on information regarding the correlation between the first partial regions obtained.

[0212] As an example, the operation of outputting the second stereoscopic image frame to a display may include the operation of determining second feature values ​​for the partial regions based on the parallax distribution of the second parallax image frame corresponding to the second input image frame.

[0213] As an example, the operation of outputting the second stereoscopic image frame to a display may include the operation of obtaining information regarding the correlation between the second feature values ​​and the predetermined positional correlation coefficients for each second partial region.

[0214] As an example, the operation of outputting the second stereoscopic image frame to a display may include determining a second scale value and a second shift value to adjust the disparity so that the disparity of the pixels included in the second input image frame exists within the second disparity search range, based on information regarding the correlation between the acquired second partial regions.

[0215] As an example, the above multiple partial regions may be determined by equally dividing the fatigue acquisition region included in the display area of ​​the display.

[0216] For example, a recording medium may store instructions that can be read by a computer. When executed by at least part of at least one processor (510) included in the electronic device (500), the instructions may cause the electronic device (500) to perform at least one operation. The at least one operation may include an operation of outputting a first stereoscopic image frame corresponding to a first input image frame to a display based on a first disparity search range. The at least one operation may include an operation of outputting a second stereoscopic image frame corresponding to a second input image frame to the display based on a second disparity search range. The stereoscopic sense of a specific object in the first stereoscopic image displayed on the display by the first stereoscopic image frame may differ from the stereoscopic sense of the specific object in the second stereoscopic image displayed on the display by the second stereoscopic image frame. The display position and / or display area of ​​the specific object in the first stereoscopic image may differ from the display position and / or display area of ​​the specific object in the second stereoscopic image.

[0217] The embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0218] As used in one embodiment of this document, the term “module” may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0219] One embodiment of the present document may be implemented as software comprising one or more instructions stored in a storage medium (e.g., memory (230)) readable by a machine (e.g., electronic device (200)). For example, a processor (e.g., processor (210)) of the machine (e.g., electronic device (200)) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0220] According to one embodiment, the method according to one embodiment disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0221] According to one embodiment, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to one embodiment, one or more of the components or operations among the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to one embodiment, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (500), Memory (520) comprising one or more storage media for storing instructions; and It includes at least one processor (510) including a processing circuit, and When the above instructions are executed individually or collectively by at least one processor (510), the electronic device (500) is caused to perform at least one operation, and The above at least one operation is, An operation of outputting a first stereoscopic image frame corresponding to a first input image frame to a display based on a first disparity search range; and Operation of outputting a second stereoscopic image frame corresponding to a second input image frame to the display based on a second disparity search range Includes, Here, the stereoscopic sense of a specific object in the first stereoscopic image displayed on the display by the first stereoscopic image frame is different from the stereoscopic sense of the specific object in the second stereoscopic image displayed on the display by the second stereoscopic image frame, and An electronic device (500) in which the display position and / or display area of ​​the specific object in the first stereoscopic image is different from the display position and / or display area of ​​the specific object in the second stereoscopic image.

2. In Paragraph 1, An electronic device (500) in which a first lower limit threshold value determining the first time difference search range is different from a second lower limit threshold value determining the second time difference search range.

3. In Paragraph 1, An electronic device (500) in which the first upper threshold value and the first lower threshold value determining the first time difference search range are different from the second upper threshold value and the second lower threshold value determining the second time difference search range.

4. In any one of paragraphs 1 through 3, When the above instructions are executed individually or collectively by at least one processor (510), the electronic device (500) is: An operation to determine the first parallax search range in the visual comfort zone by considering one or more elements that may affect fatigue in the first input image frame; and Operation of determining the second disparity search range in the visual comfort zone by considering one or more factors that may affect the fatigue in the second input video frame. Cause it to perform, In the above visual comfort zone, the parallax search range of the first area is relatively wider than the parallax search range of the second area, and The first area above is an area containing objects that are required to be near the center or have a relatively high sense of three-dimensionality based on the horizontal axis in the visual comfort zone, and The second area above is an area containing objects requiring a relatively small sense of depth or near the edge with respect to the horizontal axis in the visual comfort zone, and An electronic device (500) comprising at least one of the number of key objects, the area of ​​key objects, and / or the distribution of key objects, which can affect the complexity of the image corresponding to the first input image frame or the second input image frame, and which can affect the fatigue level of the above one or more factors.

5. In any one of paragraphs 1 through 4, When the above instructions are executed individually or collectively by at least one processor (510), the electronic device (500) is: An operation of obtaining a first disparity distribution according to the position and / or area of ​​one or more objects in the screen based on information regarding the disparity of pixels included in the first input image frame; An operation to determine the first time difference search range based on the first time difference distribution; An operation of obtaining a second disparity distribution according to the position and / or area of ​​one or more objects in the screen based on information regarding the disparity of pixels included in the second input image frame; and Operation of determining the second disparity search range based on the second disparity distribution An electronic device (500) that causes to perform.

6. In any one of paragraphs 1 through 5, When the above instructions are executed individually or collectively by at least one processor (510), the electronic device (500) is: Action of acquiring information regarding the viewer's movement; and Operation of determining the parallax search range to be used to convert the corresponding input video frame into a stereoscopic video frame by considering the information regarding the user's movement acquired above. Causing to perform and The electronic device (500) includes information regarding the movement of the viewer, which includes information regarding at least one of the direction the viewer is looking or the viewing position of the viewer.

7. In any one of paragraphs 1 through 6, When the above instructions are executed individually or collectively by at least one processor (510), the electronic device (500) is: An operation of determining feature values ​​for a plurality of partial regions based on the disparity distribution of a first or second disparity image frame corresponding to the first or second input image frame; An operation to obtain information regarding the correlation between the feature values ​​and the predetermined positional correlation coefficients corresponding to the plurality of partial regions; and Operation of determining a scale value and a shift value to adjust the disparity so that the disparity of pixels included in the first or second input image frame exists within the first or second disparity search range, based on the information regarding the correlation by partial region obtained above. Causing to perform, Here, an electronic device (500) in which the plurality of partial regions are determined by equally dividing the fatigue acquisition region included in the display area of ​​the display.

8. In the method of operating the electronic device (500), An operation of outputting a first stereoscopic image frame corresponding to a first input image frame to a display based on a first disparity search range; and Operation of outputting a second stereoscopic image frame corresponding to a second input image frame to the display based on a second disparity search range Includes, Here, the stereoscopic sense of a specific object in the first stereoscopic image displayed on the display by the first stereoscopic image frame is different from the stereoscopic sense of the specific object in the second stereoscopic image displayed on the display by the second stereoscopic image frame, and A method of operation in which the display position and / or display area of ​​the specific object in the first stereoscopic image is different from the display position and / or display area of ​​the specific object in the second stereoscopic image.

9. In Paragraph 8, A method of operation in which a first lower limit threshold value determining the first time difference search range is different from a second lower limit threshold value determining the second time difference search range.

10. In Paragraph 8, A method of operation in which the first upper threshold value and the first lower threshold value determining the first time difference search range are different from the second upper threshold value and the second lower threshold value determining the second time difference search range.

11. In any one of paragraphs 8 through 10, The operation of outputting the above-mentioned first stereoscopic image frame to the display is, Operation of determining the first parallax search range in the visual comfort zone by considering one or more factors that may affect fatigue in the first input video frame. Includes, The operation of outputting the above second stereoscopic image frame to the display is, Operation of determining the second disparity search range in the visual comfort zone by considering one or more factors that may affect the fatigue in the second input video frame. Includes, In the above visual comfort zone, the parallax search range of the first area is relatively wider than the parallax search range of the second area, and The first area above is an area containing objects that are required to be near the center or have a relatively high sense of three-dimensionality based on the horizontal axis in the visual comfort zone, and The second area above is an area containing objects requiring a relatively small sense of depth or near the edge with respect to the horizontal axis in the visual comfort zone, and A method of operation comprising at least one of the number of key objects, the area of ​​key objects, and / or the distribution of key objects, which can affect the complexity of an image corresponding to the first input image frame or the second input image frame, wherein one or more elements that can affect the fatigue level include at least one of the elements that can affect the complexity of the image corresponding to the first input image frame or the second input image frame.

12. In any one of paragraphs 8 through 11, An operation of obtaining a first disparity distribution according to the position and / or area of ​​one or more objects in the screen based on information regarding the disparity of pixels included in the first input image frame; An operation to determine the first time difference search range based on the first time difference distribution; An operation of obtaining a second disparity distribution according to the position and / or area of ​​one or more objects in the screen based on information regarding the disparity of pixels included in the second input image frame; and Operation of determining the second disparity search range based on the second disparity distribution A method of operation including 13. In any one of paragraphs 8 through 12, Action of acquiring information regarding the viewer's movement; and Operation of determining the parallax search range to be used to convert the corresponding input video frame into a stereoscopic video frame by considering the information regarding the user's movement acquired above. Includes, The above-mentioned information regarding the movement of the viewer includes information regarding at least one of the direction the viewer is looking or the viewing position of the viewer, in a method of operation.

14. In any one of paragraphs 8 through 13, The operation of outputting the above-mentioned first stereoscopic image frame to a display is, An operation of determining first feature values ​​for partial regions based on the disparity distribution of a first disparity image frame corresponding to the first input image frame; An operation to obtain information regarding the correlation degree between the first partial region and the predetermined positional correlation coefficients corresponding to the first feature values ​​and the partial regions; and An operation to determine a first scale value and a first shift value to adjust the disparity so that the disparity of pixels included in the first input image frame exists within the first disparity search range, based on the information regarding the correlation by the first partial region obtained above. Includes, The operation of outputting the above-mentioned second stereoscopic image frame to a display is, An operation of determining second feature values ​​for the partial regions based on the disparity distribution of the second disparity image frame corresponding to the second input image frame; An operation to obtain information regarding the correlation between the second feature values ​​and the predetermined positional correlation coefficients for each second sub-region; and An operation to determine a second scale value and a second shift value to adjust the disparity so that the disparity of pixels included in the second input image frame exists within the second disparity search range, based on the information regarding the correlation by the second partial region obtained above. Includes, Herein, a method of operation in which the above partial regions are determined by equally dividing the fatigue acquisition region included in the display area of ​​the display.

15. In a recording medium storing computer-readable instructions, When the above instructions are executed by at least part of at least one processor (510) included in the electronic device (500), the electronic device (500) causes at least one operation to be performed, and The above at least one operation is, An operation of outputting a first stereoscopic image frame corresponding to a first input image frame to a display based on a first disparity search range; and Operation of outputting a second stereoscopic image frame corresponding to a second input image frame to the display based on a second disparity search range Includes, Here, the stereoscopic sense of a specific object in the first stereoscopic image displayed on the display by the first stereoscopic image frame is different from the stereoscopic sense of the specific object in the second stereoscopic image displayed on the display by the second stereoscopic image frame, and A recording medium in which the display position and / or display area of ​​the specific object in the first stereoscopic image is different from the display position and / or display area of ​​the specific object in the second stereoscopic image.

Images