Image location based on perceptual attention

Abstract

Methods, apparatus, and non-transitory machine-readable media are described for image location based on perceptual attention. The apparatus may include a display, a memory device, and a controller. In one example, the controller may assign perceptual attention and classify images in part based on the perceptual attention. In another example, the method may include: assigning perceptual attention to an image among a plurality of images via a controller coupled to the memory device, wherein the perceptual attention is assigned in part based on a time period during which the image is visible on a display coupled to the memory device; selecting the image from an initial viewing position in response to the assigned perceptual attention; and transferring the image to different viewing positions, wherein the initial viewing position and the different viewing positions are visible on the display.

Description

Technical Field

[0001] This disclosure generally relates to devices, non-transitory machine-readable media, and methods for image location based on perceived attention. Background Technology

[0002] Images can be viewed on a computing device. A computing device is a mechanical or electrical device that transmits or modifies energy to perform or assist in the performance of human tasks. Examples include thin clients, personal computers, printing devices, laptops, mobile devices (e.g., e-readers, tablets, smartphones, etc.), Internet of Things (IoT) enabled devices, and game consoles, etc. IoT enabled devices can refer to devices embedded with electronics, software, sensors, actuators, and / or network connectivity that enables such devices to connect to networks and / or exchange data. Examples of IoT enabled devices include mobile phones, smartphones, tablets, phablets, computing devices, implantable devices, vehicles, home appliances, smart home devices, monitoring devices, wearable devices, devices enabling smart shopping systems, and other cyber-physical systems.

[0003] The computing device may include a display for viewing images and / or text. The display may be a touchscreen display used as an input device. When a finger, digital pen (e.g., stylus), or other input mechanism touches the touchscreen display, the computing device may receive associated data. The touchscreen display may contain images and / or words, particularly images and / or words that a user can touch to interact with the device. Summary of the Invention

[0004] In one aspect, this disclosure relates to a method comprising: identifying data of an image among a plurality of images displayed via a user interface; determining perceptual attention to the image, wherein the perceptual attention is determined in part based on a period of time during which the image is visible on the user interface; writing metadata associated with the data of the image to a memory coupled to the user interface, at least in part based on the perceptual attention; and grouping the plurality of images based on the perceptual attention.

[0005] In another aspect, this disclosure relates to a non-transitory machine-readable medium comprising instructions executable to: determine, by means of a controller coupled to a mobile device, an amount of search events for a plurality of images generated by the mobile device; assign perceptual attention to each of the plurality of images, wherein the perceptual attention is in part based on the determined amount of search events; and classify the plurality of images into a plurality of viewing locations based on the perceptual attention in response to the assigned perceptual attention, wherein the plurality of viewing locations are visible on a display of the mobile device.

[0006] In another aspect, this disclosure relates to an apparatus comprising: a memory device coupled to a display; and a controller coupled to the memory device, wherein the controller is configured to: determine a time period during which an image of a plurality of images is visible on the display; allocate perceptual attention to the image based on the determined time period; and transfer the image from an initial viewing position on the display to a different viewing position on the display in response to the allocated perceptual attention. Attached Figure Description

[0007] Figure 1 This is a functional block diagram of a device having a display, a memory device, and a controller, according to several embodiments of the present disclosure.

[0008] Figure 2 The figure illustrates an example of a computing device comprising a display having a visible image, according to several embodiments of the present disclosure.

[0009] Figures 3A to 3E A diagram illustrating an example display comprising visible and invisible images according to several embodiments of the present disclosure.

[0010] Figures 4A to 4B This is a functional diagram illustrating a computing device for image position on a display based on perceptual attention, according to several embodiments of the present disclosure.

[0011] Figure 5 This is a block diagram illustrating an example of image location based on perceptual attention according to several embodiments of the present disclosure.

[0012] Figure 6 This is a flowchart illustrating an example method for image location based on perceptual attention, according to several embodiments of the present disclosure.

[0013] Figure 7 This is a functional diagram illustrating communication between a processing resource according to several embodiments of the present disclosure and a memory resource on which instructions for perceptually interested image locations are written. Detailed Implementation

[0014] This describes devices, machine-readable media, and methods related to image location based on perceptual attention. A computing device display (e.g., a monitor, mobile device screen, laptop screen, etc.) can be used to view images (e.g., still images, video images, and / or text) on the display. Users of the computing device may prefer some images over others and categorize these images into various viewing locations on the display. The computing device can organize the images to facilitate the user. For example, the computing device may include a controller and a memory device to organize the images based on user preferences. Preferences may be based on the user's perceptual attention to the images. In one example, the method may include: allocating perceptual attention to images among a plurality of images via a controller coupled to the memory device, wherein the perceptual attention is allocated in part based on the time period during which the image is visible on the display coupled to the memory device; selecting an image from an initial viewing location in response to the allocated perceptual attention; and transferring the image to different viewing locations, wherein the initial viewing location and the different viewing locations are visible on the display.

[0015] As used herein, the term "viewing location" refers to a location visible on the display of a computing device. The display may be part of a user interface for the computing device, whereby the user interface allows the user to receive information from and provide input to the computing device. The viewing location may be selected by the user of the computing device. For example, a user may select a viewing location visible on the display to view an image assigned to that location. Images assigned to a specific viewing location may share common perceptual attention.

[0016] As used herein, the term "perceived attention" refers to the level of importance an image is perceived to have. For example, perceived attention to an image can correspond to the allocation of a user's subjective attention to the image. For instance, a user may generate an image using a computing device (e.g., a smartphone) equipped with an image sensor (e.g., a camera). In other instances, the computing device may receive (or otherwise acquire) images from the Internet, screenshots, emails, text messages, or other transmissions. Furthermore, the computing device may generate image groups based on criteria that attempt to correlate perceived attention in grouped images.

[0017] Computing devices can group images without requiring user input. For example, some methods for generating image groups using a user's perceptual attention on a computing device include grouping images by geographic location, by facial recognition (e.g., grouping images based on content contained in the images), and / or by time (e.g., by day, month, year, and / or season). However, images grouped by a computing device using location, facial recognition, and / or time may be inaccurate and fail to capture the user's subjective perceptual attention to the images. For example, the grouped images may not represent content that the user subjectively (e.g., actually) perceives as interesting, and may actually be grouped as repetitive, low-quality, uninteresting, or other undesirable images. Inaccurate image grouping can result in cluttered image viewing locations on the computing device's display and lead to situations where the user frequently searches for specific images. This can lead to disappointment and wasted time, resources, and computing power (e.g., battery life).

[0018] Examples of this disclosure can reduce disappointment and clutter, and save resources and / or computing power by grouping images that share a user's perceived interest together. For example, perceived interest can be assigned to images generated, received, and / or otherwise acquired by a computing device (e.g., a smartphone camera) based on the time period during which the image is visible on the display of a computing device. In other words, if a user locates an image so that it is frequently visible on the display and / or for a period of time (e.g., a configurable predetermined time period), then perceived interest can be assigned to it. Images with shared perceived interest can be made available to the user on the display, making it easy for the user to find frequently searched images. In other embodiments, unwanted images generated by the computing device can be identified and made available on the display, allowing the user to review and discard images, thus removing clutter.

[0019] For example, images generated by a computing device that are not visible on the display for a period of time and / or are not frequently reviewed or searched by the user can be assigned perceptual attention corresponding to undesired preferences (e.g., lack of perceptual attention) and moved to a viewing location so that the user can review and discard the images. In other words, sometimes a user may capture, receive, and / or otherwise obtain images on a computing device (e.g., a smartphone) that may not be important to the user, or may be repetitive. These infrequently viewed images can be grouped together, and the computing device can prompt the user to discard the images.

[0020] In the following detailed description of this disclosure, reference is made to the accompanying drawings, which form a part of this disclosure, and the drawings illustrate by way of illustration one or more embodiments of this disclosure that may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice embodiments of this disclosure, and it should be understood that other embodiments may be utilized and process, electrical, and structural changes may be made without departing from the scope of this disclosure.

[0021] As used herein, designators such as “N”, “M”, etc., specifically relating to the reference numerals in the figures, indicate the number of specific features that may be included. It should also be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used herein, unless the context explicitly states otherwise, the singular forms “a” and “the” may include both singular and plural designations. Additionally, “a plurality of,” “at least one,” and “one or more” (e.g., a plurality of memory devices) may refer to one or more memory devices, while “a plurality of” is intended to mean more than one of such things. Furthermore, the word “can” and “may” are used throughout this application in an permissive sense (i.e., possible, able) rather than a mandatory sense (i.e., must). The term “comprising” and its derivatives mean “including but not limited to.” Depending on the context, the terms “coupled” and “coupling” mean physically directly or indirectly connected or accessing and moving (transmitting) commands and / or data. Depending on the context, the terms “data” and “data value” are used interchangeably and may have the same meaning in this document.

[0022] The diagrams in this document follow a numbering rule, where the first one or more digits correspond to the diagram number, and the remaining digits identify elements or components within the diagram. Similar elements or components between different diagrams can be identified using similar digits. For example, 222 can be mentioned... Figure 2 Element "22" is shown in Figure 3, and similar elements may be represented as 322. It should be understood that elements shown in various embodiments herein may be added, interchanged, and / or removed to provide several additional embodiments of this disclosure. Furthermore, the scale and / or relative dimensions of the elements provided in the figures are intended to illustrate certain embodiments of this disclosure and should not be construed as limiting.

[0023] Figure 1 This is a functional block diagram of a computing system in the form of a device 100 including a display 102, a memory device 106, and a controller 108 (e.g., a processor, control circuitry, hardware, firmware, and / or software) according to several embodiments of the present disclosure. In some embodiments, the memory device 106 may include non-transitory machine-readable media (MRM), and / or may be similar to [the aforementioned...]. Figure 7 The memory device 792 described.

[0024] For example, device 100 may be a computing device, and display 102 may be a touchscreen display of a mobile device such as a smartphone. Controller 108 may be communicatively coupled to memory device 106 and / or display 102. As used herein, “communicatively coupled” may include coupling via various wired and / or wireless connections between devices to allow data to be transmitted between devices in various directions. The coupling need not be a direct connection, and in some instances, may be an indirect connection.

[0025] Memory device 106 may include non-volatile or volatile memory. For example, non-volatile memory can provide permanent data by retaining written data when no power is supplied, and non-volatile memory types may include NAND flash memory, NOR flash memory, read-only memory (ROM), electrically erasable programmable ROM (EEPROM), erasable programmable ROM (EPROM), and memory-class memory (SCM) that may include resistive variable memory, such as phase-change random access memory (PCRAM) and three-dimensional crosspoint memory (e.g., 3D XPoint). TM Resistive random access memory (RRAM), ferroelectric random access memory (FeRAM), magnetoresistive random access memory (MRAM), and programmable conductive memory, as well as other types of memory. Volatile memory may require power to maintain its data and may include random access memory (RAM), dynamic random access memory (DRAM), and static random access memory (SRAM), etc.

[0026] In other embodiments, such as Figure 1 As described herein, memory device 106 may include one or more memory media types. Figure 1 This illustration describes non-limiting examples of multiple memory media types in the form of DRAM 112 including control circuitry 113, SCM 114 including control circuitry 115, and NAND 116 including control circuitry 117. While three memory media types (e.g., DRAM 112, SCM 114, and NAND 116) are illustrated, the embodiments are not limited thereto, and more or fewer memory media types may exist. Furthermore, the types of memory media are not limited to... Figure 1The three specific types described herein (e.g., DRAM 112, SCM 114, and / or NAND 116) cover other types of volatile and / or non-volatile memory media. In several embodiments, the controller 108, the memory media DRAM 112, SCM 114, and / or NAND 116 may physically reside on a single die or within a single package (e.g., a managed memory application). Additionally, in several embodiments, multiple memory media (e.g., DRAM 112, SCM 114, and NAND 116) may be contained on a single memory device.

[0027] The computing device may include an image sensor (e.g., a camera) to produce images that can be seen on display 102. For example, display 102 may be part of a mobile device that includes a camera (e.g., a smartphone). Images produced by the image sensor may be written to (e.g., stored) on memory device 106. Controller 108 may present images on display 102 in response to selections made by a user on display 102. For example, a user may select images available for viewing on display 102 via a menu displayed on display 102 (e.g., a "Settings" menu, an "Image" or "Picture" menu, etc.). Such menus may provide the user with options regarding how many images the user wishes to view and / or allow the user to manually select and customize images into groups. For example, a user may select a set of images as "Favorites," and other "Favorites" may be grouped together to create albums that can be tagged as desired by the user.

[0028] Manually selecting images as "favorite images" can be tedious, and as mentioned above, grouping images without user input (e.g., by geolocation, facial recognition, etc.) may be inaccurate and contain unwanted duplicate images, thus requiring the user to manually search and select desired images. As previously mentioned, device 100 may be a computing device and includes a memory device 106 coupled to display 102 via controller 108. To group images to viewing positions on the display based on perceived attention, controller 108 may be configured to determine the time period during which an image among multiple images is visible on the display. Controller 108 can determine the time period during which an image has been visible on display 102. For example, a user may scroll through multiple images and stop at a specific image within a certain time period, making that specific image visible on the display during said time period. Controller 108 can determine the time period during which a specific image is visible on display 108 and correlate it with perceived attention.

[0029] The controller 108 can assign perceptual attention to a specific image based on a determined time period. Perceptual attention can be assigned to a specific image by the controller 108 based on the time period during which the specific image is visible on the display 102. Similarly, other images that are not selected but are scrolled over by the user can be assigned perceptual attention corresponding to the lack of attention. The controller 108 can transfer a specific image to a specific viewing location on the display. As used herein, the term "transfer" means moving and / or creating a copy of an image and moving it from a first viewing location to a different viewing location. In some instances, the corresponding viewing location may contain other images sharing a common perception of attention.

[0030] For example, controller 108 may transfer a specific image from an initial viewing position on display 102 to a different viewing position on display 102 in response to assigned perceptual attention. Controller 108 may transfer a specific image from a preset viewing position on display 102 to a different viewing position on display 102. In some instances, the different viewing positions may include other images that have previously been identified as having perceptual attention. In other instances, controller 108 may transfer an image with different perceptual attention (e.g., not selected, visible on the display, etc.) to a viewing position on display 102, allowing the user to review the image and discard it.

[0031] In one example embodiment, controller 108 may be coupled to multiple memory media types (e.g., DRAM 112, SCM 114, and / or NAND 116), wherein an image contained in an initial viewing position may be written to a first memory media type (e.g., DRAM 112), and images contained in different viewing positions may be written to a second memory media type (e.g., NAND 116). For example, different viewing positions on display 102 may contain images written to a memory media type that is more secure and / or more suitable for long-term storage on a computing device. Therefore, viewing positions written to a corresponding memory media type (e.g., DRAM 112, SCM 114, and / or NAND 116) may contain additional images that have been selected by controller 108 based on corresponding perceived attention.

[0032] Figure 2 The figure illustrates an example of a computing device 210 comprising a display 202 having a visible image 218, according to several embodiments of the present disclosure. Figure 2 The description includes a computing device 210, such as a mobile device, which includes a display 202. The computing device 210 further includes a memory device 206, similar to... Figure 1 The memory device 106. The memory device 206 may be coupled to the controller 208, which may be similar to... Figure 1 The controller 108. Figure 2 Display 202 is described as containing a plurality of images 218-1, 218-2, 218-3, 218-4 and 218-N, which may be referred to herein as images 218.

[0033] Figure 2 The illustrations depict specific images 218-3 marked with stars and other images 218-1, 218-2, 218-4, and 218-N marked with circles, representing non-limiting examples. Other squares illustrated in display 202 are similar to image 218, but are not labeled herein to avoid confusion with examples of this disclosure.

[0034] Display 202 contains multiple images 218. In some instances, the multiple images 218 may be contained in an initial viewing position on display 202 and presented in chronological order. In other words, the multiple images 218 may be images presented to the user in the order they are generated by an image sensor (e.g., a camera) and / or received, transmitted, or otherwise obtained by computing device 210. The user may use an accessory (e.g., a finger) or device (e.g., a stylus, digital pen, etc.) to select one or more images 218-1, 218-2, 218-3, 218-4, 218-N from the multiple images 218. The selection of a particular image 218-3 instead of other images 218-1, 218-2, 218-4, and / or 218-N may indicate a perceived attention corresponding to the user's desired preference.

[0035] The controller 208 can use several methods to allocate perceptual attention to the image 218. For example, the controller 208 can allocate perceptual attention based on the selection of a specific image 218-3, such that image 218-3 is visible on the display for a period of time. When a specific image 218-3 is selected, the specific image 218-3 can be magnified so that it covers all or most of the display 202, as combined with Figures 3A to 3E As described. The time period can be configured as a user-configurable setting. For example, the user can configure computing device 210 (e.g., controller 208) to allocate perceptual attention to an image corresponding to the user's desired preference (e.g., image 218-3) selected from a set of images 218, while the image is visible on the display for a period of five seconds or longer. Although five seconds is used as an example herein, the time period can be shorter or longer than five seconds. Computing device 210 can store metadata (including metadata values) associated with images that can indicate perceptual attention to an image, the position of the image on the display, the grouping of images, and other information that may be included in the metadata associated with the image. Eliminating the need for the user to manually label images as "favorite images" reduces clutter and disappointment in the user experience of computing device 210.

[0036] In another non-limiting example, controller 208 may assign perceptual attention to image 218 when image 218 is modified or otherwise altered. For example, controller 208 may assign perceptual attention to a specific image 218-3 when selecting and editing images. Editing may include modifications to the image, such as cropping the image, applying filters to the image, etc.

[0037] In another non-limiting instance, controller 208 may allocate perceptual attention to image 218 based on the amount of search events. Search events may include a user searching for an image using keywords, uttering phrases, etc. Search events may also include scrolling or swiping across images 218 to locate a specific image 218-3. For example, a search event may include image 218-3 being visible on the display for a period of time before moving to another image. In other words, a search event for image 218-3 may include a user scrolling past images 218-1, image 218-2, pausing at image 218-3 for a period of time, and scrolling to images 218-4 and 218-N. Another instance of a search event may include a user scrolling past a specific image 218-3 and then returning to that specific image 218-3 (see reference). Figures 3A to 3E (As discussed). The search event may also include, instead of continuing to scroll and / or swipe to another image after pausing at image 218-3 within the said time period, the controller 208 may switch to another application (e.g., opening an email, browsing a webpage, etc.).

[0038] In some instances, perceived attention can be assigned to images 218 that are not selected or otherwise visible on display 202 for a period of time. For example, assuming images 218-1, 218-2, 218-4, and 218-N are not selected by controller 208, they can be assigned perceived attention corresponding to images that are not desired by the user. In this instance, images with perceived attention reflecting user disinterest can be categorized and conveyed to viewing positions on display 202. In some instances, this viewing position can be used to prompt the user to discard these images to reduce clutter and free up memory space on memory device 206.

[0039] In some embodiments, controller 208 may alter the perceptual attention of image 218. For example, image 218-1 may be assigned perceptual attention corresponding to a user's undesired preference for computing device 210. Subsequently, in response to selecting and / or editing image 218-1, controller 208 may assign new perceptual attention to represent the image desired by the user. In this example, controller 208 may transmit and / or copy the image to a viewing location on display 202 representing the image desired by the user. In other words, controller 208 may be configured to edit image 218-1 among a plurality of images 218 and alter the perceptual attention of a particular image, wherein the perceptual attention is based in part on the edits made to image 218-1.

[0040] The controller 208 can categorize multiple images 218 based on assigned perceptual attention. This can be done without user input (e.g., the controller 208 can be configured with user preferences after the computing device is set up), or the user can choose to be prompted whether this is a preference. For example, after the application is loaded, the controller 208 determines that the user may want to include perceptual attention in a specific image and may prompt the user for confirmation. Alternatively, the controller 208 can determine that the user may want to include perceptual attention corresponding to the user's undesired preference in images 218 that have not been selected within a specific time period and may prompt the user to discard the image.

[0041] In some embodiments, the controller 208 may assign perceptual attention to each of a plurality of images 218 and classify the plurality of images 218 based on the assigned perceptual attention. The controller 208 may select a subset of the plurality of images 218 having perceptual attention above or below a threshold, and prompt the computing device 210 to display the subset of the plurality of images at different viewing locations on the display 202. For example, images that are not frequently seen on the display 202 over a period of time (e.g., not selected, viewed, or searched) may be below the perceptual attention threshold, while images that are frequently viewed and / or searched may be above the perceptual attention threshold. In other words, the controller 208 may determine the perceptual attention threshold and classify the images 218 into multiple viewing locations on the display 202 according to the assigned perceptual attention.

[0042] Figures 3A to 3E A diagram illustrating an example display comprising visible and invisible images 318 according to several embodiments of the present disclosure. Figures 3A to 3E Each explanation is similar to Figure 1 and 2 Displays 102 and 202, and display 302. Display 302 may be a computing device (e.g., Figure 2 A part of the computing device 210, and coupled to the controller (e.g., Figure 2 The controller 208) and the memory device (e.g., Figure 2(Memory device 206). Figures 3A to 3E Each contains images 318-1 to 318-N, which are similar to Figure 2 Image 218, and may be referred to herein as image 318. Image 318 may be described using solid lines, dashed lines, or a combination of both. Solid lines indicate that a portion or the entire image 318 is visible on the display, while dashed lines indicate that the entire image 318 or a portion of the image is not visible on the display 302. For example, Figure 3A Image 318-2 is described as being partially visible on display 302, and image 318-3 is fully visible and centered on display 302.

[0043] Figure 3A This illustrates an instance where image 318-3 has been selected from multiple images 318. When image 318-3 is selected, it can be centered on display 302. In some instances (not depicted), the only visible image is the selected image 318-3. In other instances, such as those shown... Figures 3A to 3E As illustrated, the selected image 318-3 can be centered on the display 302, and the previous image 318-2 and the subsequent image 318-4 can be partially visible on the display 302. The controller coupled to the display 302 can be configured to allocate the amount of time (e.g., a threshold amount of time) corresponding to the perceived attention of the image 318 will require to be visible.

[0044] For example, such as Figure 3A As explained, if the threshold time period is five seconds, the controller can determine whether the selected image 318-3 is visible on the display 302 for five seconds or longer. If so, the controller can assign perceptual attention corresponding to user preference to image 318-3. Conversely, if image 318-3 is not visible on the display for the threshold time period of five seconds, the controller can assign perceptual attention corresponding to undesirable user preference (e.g., indifference) to image 318-3. In some instances, the controller can assign perceptual attention based on image search events.

[0045] For example, the controller can be configured to include search events that include a threshold amount. For instance, the controller can determine the number of times an image has been searched. In some instances, a search event might include the user scrolling across images on display 302, past the image the user is looking for (e.g., image 318-3), and returning to the desired image 318-3. This concept is derived from... Figure 3A , 3B Explanation of 3C, 3D and 3E.

[0046] In a non-limiting instance, the perceived attention corresponding to a preference for an image can be allocated in part over a time period based on the following: an image visible on the display before different images are visible on the display; and a subsequent return to the image visible on the display. For example, as indicated by arrow 319, Figure 3B This indicates that the image moves to the left side of the page, past specific image 318-3, so that image 318-4 is centered on display 302. As indicated by arrow 319, Figure 3C This indicates that the image moves to the left side of the page, further past image 318-3, so that image 318-5 is centered on display 302. As indicated by arrow 320, Figure 3D This indicates that the image moves to the right of the page, centering image 318-4 on monitor 302. As indicated by arrow 320, Figure 3E The image moves to the right side of the page, returning to a specific image 318-3, so that image 318-3 is centered on the display 302. The controller may be partially based on, for example, [the following text is missing from the original] Figures 3A to 3E The search event described is assigned perceived attention. In other words, a search event may include a specific image 318-3 being visible two or more times within a time period, wherein at least one different image is visible between the two or more instances.

[0047] In some instances, images 318-1 to 318-N are stored chronologically in the initial viewing position, and a search event comprises resuming from subsequent and / or previous images (e.g., 318-1, 318-2, 318-4, 318-5, ..., 318-N) to a specific image 318-3 within a time period of viewing multiple images in the initial viewing position. In other words, within a configured time period, a user may scroll past a desired image 318-3 and then resume to it; the controller can use this event as a search event and assign image 318-3 to the user's perceived attention, corresponding to a preference for said image.

[0048] Alternatively, the controller may use the number of search events to allocate perceptual attention to an image. The controller may be configured to allocate perceptual attention corresponding to a preference to an image after it has been searched three or more times. While the number three is used herein for illustrative purposes, the number may be greater than or less than three. For example, if image 318-3 experiences a single search event, the controller may avoid allocating perceptual attention corresponding to a preference to image 318-3. However, if an image experiences a total of three or more search events, the controller may allocate perceptual attention corresponding to a preference to image 318-3. This image 318-3 may then be transmitted to a viewing position on a display used for a preferred image.

[0049] In another example embodiment, the controller may be configured to assign perceived attention corresponding to a non-desired preference (e.g., indifference) for an image when it has been searched two or fewer times. While the number two is used herein for illustrative purposes, the number may be greater than or less than two. For example, if image 318-1 experiences only one search event, or is only visible on the display once, the controller may assign perceived attention corresponding to indifference to the user. This image 318-1 may then be transmitted to a viewing location on a display intended to be reviewed and discarded.

[0050] Figures 4A to 4B This is a functional diagram illustrating a computing device 410 for image position on a display 402 based on perceptual attention, according to several embodiments of the present disclosure. Figure 4A and 4B Each explanation is similar to Figure 1 , 2 Displays 102, 202, and 302, and display 402, and similar displays. Figure 2 Images 218 and 318, and images 418-1 to 418-N, which may be referred to herein as images 418. Display 402 may be part of computing device 410 and similar to... Figure 2 The computing device 210, and coupled to a similar Figure 1 and 2 Controllers 108 and 208, controller 408, and similar Figure 1 and 2 The memory devices 106 and 206.

[0051] Figure 4B This describes the image viewing positions visible on display 402. An initial viewing position 424-1 may include each of a plurality of images 418. Images 418 may be viewed sequentially in the initial viewing position 424-1 and / or in preset image viewing positions for images generated, received, or otherwise obtained by the computing device 410. A second viewing position may be a preferred image viewing position 424-2, where the images to be viewed may include images that have been assigned (by controller 408) to correspond to the user's desired preferences for perceived attention. A discarded viewing position 424-M may include images that have been assigned (by controller 408) to correspond to the user's non-desired preferences for perceived attention. Images 418 may be grouped and transmitted to viewing positions on display 402 at least in part based on the perceived attention assigned by controller 408. Figure 4A Image 418 may be the content of the initial viewing position 424-1 as described.

[0052] At box 422, controller 408 may assign perceptual attention to each of images 418. Controller 408 may group multiple images based on perceptual attention. Controller 408 may be further configured to determine the perceptual attention assigned to each of the multiple images 418 and classify the multiple images 418 based on the assigned perceptual attention. Images with perceptual attention corresponding to the desired preference may be stored. Figure 4B The preferred viewing position 424-2 is described herein. For example, the controller 408 may transmit a subset of images with perceived interest corresponding to the desired preference to a different viewing position (e.g., the preferred viewing position 424-2), wherein, in response to based on Figure 4A The perceptual attention assigned at frame 422 classifies multiple images to identify a subset of images (e.g., 418-3). In this example, different viewing positions are presented on display 402 as folders indicating perceptual attention (e.g., preferred viewing position 424-2).

[0053] In another instance, an image 418 that determines perceived attention corresponding to undesired preferences (e.g., user indifference) may be stored in [the database]. Figure 4B The discard viewing location 424-M is described in the diagram. For example, controller 408 may transmit a subset of images with perceived attention corresponding to undesirable preferences (e.g., 418-1, 418-2, 418-4, and 418-N) to different viewing locations (e.g., discard viewing location 424-M), wherein the subset of images (e.g., 418-1, 418-2, 418-4, and 418-N) is identified in response to classifying multiple images based on assigned perceived attention. In this example, the different viewing locations are presented on display 402 as a folder (e.g., discard viewing location 424-M) of a recommended set of images to be discarded from among multiple images.

[0054] Figure 5 Block diagram 539 is an example of an image location based on perceptual attention according to several embodiments of the present disclosure. Figure 5 Describe a computing device (e.g., computing device 410 of FIG4) equipped with a camera for generating images and a controller for receiving, transmitting, or otherwise acquiring images (e.g., Figure 1 (Controller 108). At box 540, the computing device can generate an image and the controller can receive the image. The image can be saved to the initial viewing position (e.g., Figure 4B The initial viewing position is 424-1. At box 542, the controller can determine the image on the display (e.g., ...). Figure 1The amount of time the image is visible on display 102. At box 544, the controller can assign perceptual attention to the image. For example, if the image has been edited, and / or if the image has been visible for a time greater than or less than a threshold amount of time, or a combination thereof, then perceptual attention can be assigned by determining the amount of search event.

[0055] For example, the controller can be configured with a threshold time duration (e.g., five seconds) or a threshold search event (e.g., two search events). Images above the threshold correspond to desired image preferences, and images below the threshold correspond to undesired preferences. At box 546, the controller can transfer images from an initial viewing position on the display to different viewing positions on the display (e.g., preferred viewing position 424-2 or discarded viewing position 424-M in Figure 4). In other words, the controller can display images from a plurality of images as a recommended preferred group on the computing device based on perceived attention being above a threshold. As mentioned, if the assigned perceived attention is below a threshold, then the controller can display images from a plurality of images as a recommended discard group on the computing device based on perceived attention being below a threshold.

[0056] In some example embodiments, at box 548, the controller may determine that the image has been modified. As mentioned herein, an altered or edited image (e.g., applying filters, cropping, combining with another image, etc.) may indicate perceptual attention corresponding to a desired preference. The controller may be configured to edit the image by selecting it from a different viewing location (e.g., preferred viewing location 424-2 or discarded viewing location 424-M), and at box 550, to assign new perceptual attention to the image. The controller may be configured to transfer the image from a different viewing location to a new viewing location at box 556 (e.g., from a discarded viewing location to a preferred viewing location and / or a new viewing location), or at box 558, to avoid transferring the image (e.g., the image may remain in the preferred viewing location). While “preferred viewing location,” “discarded viewing location,” and “initial viewing location” are discussed, additional and / or different viewing locations may exist, such as “editing viewing locations,” “viewing locations frequently sent via email or text,” etc.

[0057] Figure 6This is a flowchart illustrating an example method 680 for image location based on perceived attention, according to several embodiments of the present disclosure. At 682, method 680 includes data identifying images among a plurality of images displayed via a user interface. The method may include allocating perceived attention to images among the plurality of images via a controller coupled to a memory device, wherein the perceived attention is allocated in part based on the time period during which the images are visible on a display coupled to the memory device. The controller may be coupled to a computing device having a touchscreen display, such as a mobile device. The controller may allocate perceived attention based on: search events, whether the image has been edited, the duration the image is visible on the display, the number of times the image has been selected and / or searched, whether the image is sent to another device in text or email form, and combinations thereof.

[0058] At 684, method 680 includes determining perceptual attention to an image, wherein the perceptual attention is determined in part based on the time period during which the image is visible on the user interface. The method may include selecting an image from an initial viewing position in response to the assigned perceptual attention. In this example, the initial viewing position may be a preset viewing position where all images generated by the computing device are stored. The user can scroll through images and select, edit, or otherwise view images from the initial viewing position. The user configures the computing device with the images visible on the display to be assigned a threshold time period of perceptual attention corresponding to the user's desired preferences. The controller may apply the configuration to the images while the user is operating the computing device and select images based on the assigned perceptual attention when there is no user input.

[0059] At 686, method 680 includes writing metadata associated with image data to a memory coupled to a user interface, at least partially based on perceptual attention, and grouping multiple images based on perceptual attention. The method may include transferring images to different viewing locations, wherein an initial viewing location and different viewing locations are visible on a display. For example, different viewing locations may be viewing locations where an image has perceptual attention corresponding to a desired preference. When adding an image, the controller may periodically prompt the user, allowing the user to make changes or alterations to preferences (e.g., changing a threshold time period or the amount of search events). The method may include: reading metadata from memory, displaying the image at a location on the user interface, at least partially based on the value of the metadata, writing image data to a different address in memory or external storage, and / or modifying the image data, at least partially based on the value of the metadata.

[0060] In another non-limiting example, the controller may move an image from an initial viewing location to a different viewing location designated for an image assigned perceived attention corresponding to a user's undesirable preference. For example, an image is likely unimportant to the user if it is not selected or if browsing is rarely paused. The controller may assign perceived attention corresponding to an undesirable preference for the image. In such an example, the user may be periodically prompted to delete images stored at this viewing location, and / or the user may be configured to automatically discard images after a period of time. Several embodiments may include: determining perceived attention partly based on the time period during which the image is visible on the user interface and / or partly based on images visible on the user interface prior to the appearance of different images; and subsequently returning to the image visible on the user interface.

[0061] Figure 7 This diagram illustrates the function of a processing resource 791 according to several embodiments of the present disclosure, and a memory resource 792 on which instructions 794, 796, 798 for perceptually interested image locations are written. In some embodiments, the memory device 792 may be similar to that described above. Figure 1 The memory device 106 is described. In some instances, the processing resource 791 may be similar to that described above. Figure 1 The controller 108 is described.

[0062] System 790 may be a server or computing device (and others) and may include processing resources 791. System 790 may further include memory resources 792 (e.g., a non-transitory MRM) on which instructions, such as instructions 794, 796, and 798, may be stored. Although the following description refers to processing resources and memory resources, the description is also applicable to systems having multiple processing resources and multiple memory resources. In such instances, instructions may span multiple memory resource distributions (e.g., stored) and instructions may span multiple processing resource distributions (e.g., executed by said multiple processing resources).

[0063] Memory resource 792 may be an electronic, magnetic, optical, or other physical storage device for storing executable instructions. Therefore, memory resource 792 may be, for example, a non-transitory MRM, including random access memory (RAM), electrically erasable programmable ROM (EEPROM), a memory drive, optical disc, etc. Memory resource 792 may be housed within a controller and / or computing device. In this example, executable instructions 794, 796, and 798 may be "mounted" on the device. Alternatively and additionally, memory resource 792 may be, for example, a portable, external, or remote storage medium that allows system 790 to download instructions 794, 796, and 798 from the portable / external / remote storage medium. In this case, the executable instructions may be part of an "installation package." As described herein, memory resource 792 may be encoded with executable instructions for image locations based on perceived interest.

[0064] Instruction 794, when executed by a processing resource such as processing resource 791, may include instructions for determining the amount of search events for multiple images generated by the mobile device by a controller coupled to the mobile device. In some instances, search events may include voice-activated search, keyword search, scrolling over an image and stopping on a specific image within a time period, and / or a specific image being visible two or more times within a time period while at least one different image is visible between said two or more times.

[0065] Instruction 796, when executed by a processing resource such as processing resource 791, may include instructions for allocating perceptual attention to each of a plurality of images, wherein the perceptual attention is partially based on a determined amount of search events. The controller may be configured to include search events that require a threshold amount of perceptual attention to be allocated corresponding to the desired image. To avoid errors and to measure the user's subjective attention, the instance threshold may be such that an image needs to undergo three or more search events with the controller to allocate perceptual attention corresponding to the desired image preference. This instance prevents the user from unintentionally indicating the desired image when unintentionally selecting an image.

[0066] Instruction 798, when executed by a processing resource such as processing resource 791, may include instructions for classifying multiple images into multiple viewing locations based on assigned perceptual attention, wherein the multiple viewing locations are visible on the display of a mobile device. The controller may classify the multiple images based on the assigned perceptual attention. This can be done without user input (e.g., after setting up the computing device, the controller may be configured with user preferences), or the user may choose to be prompted whether this is a preference. For example, after loading an application, the controller may determine that the user may want to include perceptual attention in a specific image and may prompt the user for confirmation. Alternatively, the controller may determine that the user may want to include perceptually lacking attention in images that have not been selected within a specific time period and may prompt the user to discard the image.

[0067] While specific embodiments have been illustrated and described herein, those skilled in the art will understand that arrangements calculated to achieve the same results may replace the specific embodiments shown. This disclosure is intended to cover modifications or variations of one or more embodiments of this disclosure. It should be understood that the above description has been presented illustratively and not restrictively. Combinations of the above embodiments and other embodiments not specifically described herein will be apparent to those skilled in the art upon review of the above description. The scope of one or more embodiments of this disclosure includes other applications in which the above structures and processes are used. Therefore, the scope of one or more embodiments of this disclosure should be determined with reference to the appended claims, together with the full scope of the equivalents given by such claims.

[0068] In the foregoing detailed embodiments, some features are grouped together in a single embodiment for the purpose of simplifying this disclosure. This approach should not be construed as reflecting an intention that the disclosed embodiments must use more features than expressly stated in each claim. In fact, as reflected in the appended claims, the subject matter of the invention lies in less than all the features of a single disclosed embodiment. Therefore, the appended claims are hereby incorporated into the detailed embodiments, wherein each claim is, in itself, a separate embodiment.

Claims

1. A method (680), comprising: identifying data (682) of an image of a plurality of images (218-1,..., 218-N, 318-1,..., 318-N) displayed via a user interface; determining a perceived attention (684) of the image, wherein the perceived attention is determined based in part on a time period that the image is visible at a first viewing location on the user interface (102, 202, 302, 402) while using a first application and based in part on a second application launched within the time period that the image is visible on the user interface; writing metadata associated with the data of the image to a memory (686) coupled to the user interface (102, 202, 302, 402) based at least in part on the perceived attention; grouping (686) the plurality of images (218-1,..., 218-N, 318-1,..., 318-N) based on the perceived attention; and displaying the image at a second viewing location on the user interface based on the perceived attention of the image, wherein the second viewing location indicates that the image is desired, and wherein the image is visible at the second viewing location on the user interface while using the first application.

2. The method (680) of claim 1, further comprising: reading the metadata from the memory; and displaying the image at a location on the user interface (102, 202, 302, 402) based at least in part on a value of the metadata.

3. The method (680) of claim 1, further comprising: reading the metadata from the memory; writing the data of the image to a different address of the memory or an external storage device based at least on a value of the metadata.

4. The method (680) of claim 1, further comprising: reading the metadata from the memory; and modifying the data of the image based at least in part on a value of the metadata.

5. The method (680) of claim 1, further comprising: determining a perceived attention of each of the plurality of images (218-1,..., 218-N, 318-1,..., 318-N); and categorizing the plurality of images (218-1,..., 218-N, 318-1,..., 318-N) based on the determined perceived attention.

6. The method (680) of claim 5, further comprising transferring a subset of images having a perceived attention corresponding to a desired preference to a different viewing location on the user interface (102, 202, 302, 402), wherein the subset of images is identified in response to categorizing the plurality of images (218-1,..., 218-N, 318-1,..., 318-N) based on the determined perceived attention of each of the plurality of images (218-1,..., 218-N, 318-1,..., 318-N).

7. The method (680) of claim 5, further comprising communicating a subset of images having a perceived attention corresponding to a non-desired preference to a different viewing location on the user interface (102, 202, 302, 402), wherein the subset of images is identified in response to classifying the plurality of images (218-1,..., 218-N, 318-1,..., 318-N) based on the determined perceived attention of each of the plurality of images (218-1,..., 218-N, 318-1,..., 318-N).

8. The method (680) of claim 1, further comprising determining the perceived attention based in part on a time period during which the image is visible on the user interface (102, 202, 302, 402).

9. The method (680) of claim 8, wherein the perceived attention is determined based in part on: the image being visible on the user interface (102, 202, 302, 402) before different images are visible on the user interface (102, 202, 302, 402); and a subsequent return to the image being visible on the user interface (102, 202, 302, 402).

10. An apparatus (100) comprising: a memory device (106) coupled to a display (102, 202, 302, 402); a controller (108) coupled to the memory device (106), wherein the controller (108) is configured to: determine a first time period and a second time period during which an image of a plurality of images (218-1,..., 218-N, 318-1,..., 318-N) is visible on the display (102, 202, 302, 402) while using a first application, wherein the first time period and the second time period are separated by a third time period during which the image is not visible on the display while using a second application; assign a perceived attention to the image based on the determined first time period and second time period; and communicate the image from an initial viewing location on the display (102, 202, 302, 402) to a different viewing location on the display (102, 202, 302, 402) in response to the assigned perceived attention, wherein the different viewing location indicates that the image is desired, and wherein the image is visible on the display at the different viewing location while using the first application.

11. The apparatus (100) of claim 10, wherein the display (102, 202, 302, 402) is part of a computing device.

12. The apparatus (100) of claim 10, wherein the controller (108) is further configured to: edit the image by selecting the image from the different viewing location; assign a new perceived attention to the image based on the edit made to the image; and communicate the image from the different viewing location to a new viewing location.

13. The device (100) of claim 10, further comprising a plurality of memory media types (112, 114, 116) coupled to the memory device (106), wherein images included in the initial viewing position are stored in a first memory media type and images included in the different viewing positions are stored in a second memory media type.

14. The device (100) of claim 10, wherein the different viewing positions in the respective memory media types (112, 114, 116) include other images that have been selected based on respective perceptual interest.

15. The device (100) of claim 10, wherein the different viewing positions are presented on the display (102, 202, 302, 402) as folders that indicate the perceptual interest.

16. The device (100) of claim 15, wherein the folders are recommended sets of images of the plurality of images (218-1,..., 218-N, 318-1,..., 318-N) to discard.

Images