Image positioning based on perceptual interest and display location
By combining perceived interest and display position, and utilizing image sensors and controllers, images are dynamically allocated and repositioned, solving the problem of inaccurate image grouping in existing technologies and achieving more efficient image management and user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- MICRON TECHNOLOGY INC
- Filing Date
- 2021-08-18
- Publication Date
- 2026-07-28
AI Technical Summary
In the prior art, the image grouping method of computing devices cannot accurately reflect the user's subjective interests, resulting in chaotic image viewing and positioning on the display. Users need to frequently search for specific images, wasting time and resources.
By combining perceived interest and display position, images are dynamically allocated and repositioned using image sensors and controllers, making user-preferred images visible on the display. Based on changes in display position and facial recognition input, images are automatically categorized into different viewing positions.
It improves the accuracy and efficiency of image grouping, reduces the complexity of user operations, saves resources and computing power, and simplifies the user experience.
Smart Images

Figure CN114077684B_ABST
Abstract
Description
Technical Field
[0001] This disclosure generally relates to devices, non-transitory machine-readable media, and methods for image localization based on perceived interest and display position. Background Technology
[0002] Images can be viewed on a computing device. A computing device is a mechanical or electrical device that transmits or modifies energy for performing or assisting in the performance of artificial tasks. Examples include thin clients, personal computers, printing devices, laptops, mobile devices (e.g., e-readers, tablets, smartphones, etc.), Internet of Things (IoT) enabled devices, and game consoles. IoT enabled devices can refer to devices embedded with electronics, software, sensors, actuators, and / or network connections that enable such devices to connect to networks and / or exchange data. Examples of IoT enabled devices include mobile phones, smartphones, tablets, phablets, computing devices, implantable devices, vehicles, home appliances, smart home devices, monitoring devices, wearable devices, devices supporting smart shopping systems, and other cyber-physical systems.
[0003] The computing device may include a display for viewing images and / or text. The display may be a touchscreen display used as an input device. When the touchscreen display is touched by a finger, digital pen (e.g., stylus), or other input mechanism, relevant data can be received by the computing device. The touchscreen display may contain images and / or text, as well as other content that the user can touch to interact with the device. Summary of the Invention
[0004] A method is described. In some instances, the method may include: assigning a perceptual interest to an image among a plurality of images by a processor coupled to a memory device, wherein the perceptual interest is assigned in part based on a change in the position of the display when the image is viewable on a display coupled to the memory device; selecting the image from an initial viewing position on the display in response to the assigned perceptual interest; and transferring the image to a different viewing position, wherein the initial viewing position and the different viewing positions are visible on the display.
[0005] A non-transitory machine-readable medium is described. In some instances, the non-transitory machine-readable medium may store instructions executable to: determine, by a controller coupled to a mobile device containing a plurality of images, that the position of a display changes when one or more of the plurality of images are viewable on a display coupled to the mobile device; assign a corresponding perceptual interest to each of the plurality of images, wherein each corresponding perceptual interest is based in part on whether the respective plurality of images were already viewable on the display when the position of the display changes; and classify the respective plurality of images into a plurality of viewing locations based on the assigned corresponding perceptual interest, wherein the plurality of viewing locations are visible on the display of the mobile device.
[0006] A device is described. In some instances, the device may include: a memory device coupled to a display; an image sensor coupled to the display; and a controller coupled to the memory device, wherein the controller is configured to: select an image from a plurality of images that will be viewed on the display; receive input from the image sensor when the image from the plurality of images is visible on the display; and assign perceptual interest to the image based at least in part on the input received from the image sensor. Attached Figure Description
[0007] Figure 1 This is a functional block diagram of a device having a display, an image sensor, a memory device, and a controller, according to several embodiments of the present disclosure.
[0008] Figure 2 This is a diagram illustrating an example of a computing device including a display having a visible image, according to several embodiments of the present disclosure.
[0009] Figures 3A-3B This is a diagram illustrating an example display containing a visible image according to several embodiments of the present disclosure.
[0010] Figure 4 A functional diagram is shown illustrating an example computing device for image localization based on perceived interest and display position according to several embodiments of the present disclosure.
[0011] Figure 5 This is a block diagram illustrating examples of image localization based on perceived interest and display position according to several embodiments of the present disclosure.
[0012] Figure 6 This is a flowchart illustrating an example method for image localization based on perceived interest and display position according to several embodiments of the present disclosure.
[0013] Figure 7 This is a functional diagram illustrating a processing resource communicating with a memory resource according to several embodiments of the present disclosure, the memory resource having instructions written on it for image localization based on perceived interest and display position. Detailed Implementation
[0014] Devices, machine-readable media, and methods related to image positioning based on perceived interest and display position are provided. A computing device display (e.g., a monitor, mobile device screen, laptop screen, etc.) can be used to view images (e.g., still images, video images, and / or text) on the display. Images can be received by the computing device from another device and / or generated by the computing device. A user of the computing device may prefer some images over others and categorize these images into various viewing positions on the display (e.g., viewing positions). For the user's convenience, the computing device can organize images into viewing positions. For example, the computing device may include a controller and a memory device for organizing images based on user preferences. The preferences may be based on the user's perceived interest in the images. In an example, the method may include: assigning a perceived interest to an image among a plurality of images by a controller coupled to the memory device, wherein the perceived interest is assigned in part based on a change in the position of the display when the image is viewable on a display coupled to the memory device; selecting the image from an initial viewing position on the display in response to the assigned perceived interest; and transferring the image to a different viewing position, wherein the initial viewing position and the different viewing positions are visible on the display.
[0015] As used herein, the term "view location" refers to a location that is visible on the display of a computing device. The display may be part of a user interface for the computing device, where the user interface allows the user to receive information from the computing device and provide input to the computing device. The view location may be selected by the user of the computing device. For example, a user may select a view location visible on the display to view an image assigned to that view location. Images assigned to a particular view location may share common perceptual interests.
[0016] As used herein, the term "perceived interest" refers to the level of importance an image is determined to possess. For example, perceived interest in an image can be an assignment corresponding to a user's subjective interest in the image. For instance, a user can generate an image using a computing device such as a mobile device (e.g., a smartphone) equipped with an image sensor (e.g., a camera). In other instances, the computing device can receive images from the Internet, email, text messages, or other transmissions. Additionally, the computing device can generate groups of images based on criteria to attempt to correlate perceived interest in the grouped images.
[0017] The computing device can group images without requiring user input. For example, some methods for generating image groups without user input from the computing device include grouping images by geolocation (e.g., GPS) of the generation and / or reception of the images, by facial recognition of objects in the images (e.g., grouping images based on people / objects contained in the images), and / or by time (e.g., time of day, month, year, and / or season).
[0018] However, images grouped by a computing device using location, facial recognition of objects in the image, and / or time may be inaccurate and fail to capture a user's subjective perception of interest in the image. For example, grouping images may not represent images that a user subjectively (e.g., actually) perceives as interesting, but may instead group repetitive, poor-quality, uninteresting, or otherwise unwanted images. Inaccurate image grouping can lead to confusion in image viewing on the computing device's display and result in users frequently searching for specific images. This can lead to frustration, wasted time, resources, and computing power (e.g., battery life).
[0019] When a user of a computing device determines that an image is interesting, the user can show the image to another person. In some instances, the act of showing an image to another person on a computing device involves moving the display of the computing device so that the display is at an angle from which the other person can view the image. In other instances, the act of showing an image to another person on a computing device involves different people being close enough to the display to be at an angle from which the person can view the image. For example, a person can position himself or her next to or behind the user so that the display of the computing device is visible to both the user and the person.
[0020] Examples of this disclosure can alleviate frustration, clutter, and conserve resources and / or computing power by grouping images that share a user's perceived interest together. In example embodiments, perceived interest can be assigned to an image based on a change in the position of the display when the image, generated, received, and / or otherwise obtained by a computing device (e.g., a smartphone), is viewable on the display of the computing device. In other words, if a user positions an image so that it is visible on the display, and moves the display to a suitable angle so that different people can view the image, the computing device can assign perceived interest to the image corresponding to desired preferences.
[0021] In another example embodiment, when an image generated, received, and / or otherwise acquired by a computing device (e.g., a smartphone camera) is visible on a display, a perceptual interest can be assigned to the image based on input received from an image sensor coupled to the display. In other words, if a person other than the user is at an angle that makes the image visible on the display (the person is standing next to or behind the user), the image sensor coupled to the display can transmit facial recognition data. The computing device can assign a perceptual interest to the image corresponding to a desired preference. The embodiments described herein involve the computing device transferring (e.g., copying) images with shared perceptual interest to viewing locations on the display, allowing the user to easily find images that are frequently presented and / or viewed by others. As used herein, the term "transfer" means moving an image and / or creating a copy of an image and moving it from an initial viewing location to a different viewing location. In some instances, the corresponding viewing location may contain other images sharing a common perceptual interest.
[0022] Furthermore, the computing device can group images based on received facial recognition input corresponding to the person viewing the image. In other embodiments, unwanted images generated by the computing device can be identified and made available on the display, allowing the user to review and discard the images, thereby eliminating clutter.
[0023] For example, images generated by a computing device that are not visible on the display and / or not available for another person to view when the display position changes can be assigned a perceptual interest corresponding to an undesirable preference (e.g., lack of perceptual interest), and moving to a viewing location allows the user to examine and discard the images. In other words, sometimes a user may capture, receive, and / or otherwise obtain images, duplicate images, etc., on a computing device (e.g., a smartphone) that may not necessarily be important to the user. These infrequently viewed images can be grouped together, and the computing device can prompt the user to discard the images.
[0024] In the following detailed description of this disclosure, reference is made to the accompanying drawings, which form a part of the detailed description, and in which one or more embodiments of the disclosure are illustrated by way of illustration. The description of these embodiments is detailed enough to enable those skilled in the art to practice the embodiments of the disclosure, and it should be understood that other embodiments can be utilized, and process, electrical, and structural changes can be made without departing from the scope of the disclosure.
[0025] As used herein, indicators such as “N”, “M”, and especially with respect to reference numerals in the accompanying drawings, indicate that a number of such specific features may be included. It should also be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be restrictive. As used herein, unless the context clearly indicates otherwise, the singular forms “a,” “an,” and “the” may include both singular and plural references. Additionally, “several,” “at least one,” and “one or more” (e.g., several memory devices) may refer to one or more memory devices; however, “more” is intended to refer to more than one such item. Furthermore, throughout this application, the words “can” and “may” are used in a permissive (i.e., possible, able) rather than a mandatory (i.e., required) meaning. The term “include” and its derivatives mean “including but not limited to.” The terms “coupled” and “coupling” refer to a direct or indirect connection, either physically or for the purpose of accessing and moving (transmitting) commands and / or data, as the case may be. The terms “data” and “data value” are used interchangeably herein and may have the same meaning, as the case may be.
[0026] The accompanying drawings follow a numbering convention, wherein one or more first digits correspond to the drawing number, and the remaining digits identify elements or components in the drawings. Similar elements or components may be identified between different drawings by using similar digits. As will be understood, elements shown in the various embodiments herein may be added, interchanged, and / or eliminated to provide several other embodiments of this disclosure. Furthermore, the scale and / or relative dimensions of the elements provided in the drawings are intended to illustrate certain embodiments of this disclosure and should not be taken in a limiting sense.
[0027] Figure 1This is a functional block diagram of a computing system including device 100 according to several embodiments of the present disclosure, the device having a display 102, a memory device 106, and a controller 108 (e.g., a processor, control circuitry, hardware, firmware, and / or software). In some embodiments, the memory device 106 may include non-transitory machine-readable media (MRM), and / or may be similar to [the aforementioned...]. Figure 7 The described memory resource is 792.
[0028] Device 100 may be a computing device; for example, display 102 may be a touchscreen display of a mobile device such as a smartphone. Controller 108 may be communicatively coupled to memory device 106 and / or display 102. As used herein, "communically coupled" may include coupling via various wired and / or wireless connections between devices, enabling data to be transmitted in all directions between the devices. Coupling need not be a direct connection, and in some instances, it may be an indirect connection.
[0029] Memory device 106 may include non-volatile or volatile memory. For example, non-volatile memory can provide persistent data by retaining written data when power is off, and non-volatile memory types may include NAND flash memory, NOR flash memory, read-only memory (ROM), electrically erasable programmable ROM (EEPROM), erasable programmable ROM (EPROM), and memory-class memory (SCM) that may include resistive variable memory, such as phase-change random access memory (PCRAM) and three-dimensional crosspoint memory (e.g., 3D XPoint). TM Resistive random access memory (RRAM), ferroelectric random access memory (FeRAM), magnetoresistive random access memory (MRAM), and programmable conductive memory, as well as other types of memory, are examples. Volatile memory may require power to maintain its data and may include random access memory (RAM), dynamic random access memory (DRAM), and static random access memory (SRAM), etc.
[0030] In other embodiments, such as Figure 1 As shown, the memory device 106 may include one or more types of memory media. Figure 1Non-limiting examples of various memory media types are shown, including a DRAM 112 with a control circuitry system 113, an SCM 114 with a control circuitry system 115, and a NAND 116 with a control circuitry system 117. Although three memory media types (e.g., DRAM 112, SCM 114, and NAND 116) are shown, the embodiments are not limited to this, and more or fewer memory media types may exist. Furthermore, the type of memory media is not limited to... Figure 1 The three types specifically shown (e.g., DRAM 112, SCM 114, and / or NAND 116) can be considered for other types of volatile and / or non-volatile memory media. In several embodiments, the controller 108, memory media DRAM 112, SCM 114, and / or NAND 116 may be physically located on a single die or within a single package (e.g., in managed memory applications). Moreover, in several embodiments, multiple memory media (e.g., DRAM 112, SCM 114, and NAND 116) may be contained on a single memory device.
[0031] The computing device may include an image sensor (e.g., a camera) 103. The image sensor 103 may generate images (video, text, etc.) visible on the display 102. Additionally, the image sensor 103 may capture and / or receive input from objects, people, items, etc., and transmit said input to the controller 108 for analysis. In some instances, the image sensor 103 is a camera and may provide input to the controller 108 as facial recognition input. For example, the display 102 may be part of a mobile device (e.g., a smartphone) that includes a camera.
[0032] Images generated by image sensor 103 can be written to (e.g., stored) on memory device 106. Controller 108 can display images on display 102 in response to selections made by the user on display 102. For example, the user can select images to be viewed on display 102 via menus displayed on display 102 (e.g., a "Settings" menu, an "Image" or "Picture" menu, etc.). Such menus can give the user options regarding what images they want to view and / or allow the user to manually select images and customize them into groups. For example, the user can create a group of images selected as "favorite images" and group other "favorite images" together to create albums and / or folders that can be labeled as desired by the user.
[0033] Manually selecting images as "favorite images" can be tedious, and as mentioned above, grouping images without user input (e.g., by geolocation, facial recognition, etc.) can be inaccurate and contain unwanted duplicate images, thus requiring users to manually search and select desired images. Grouping images by assigning them to the user's perceived interests can increase the grouping accuracy and efficiency of the computing device and / or memory device 106.
[0034] Perceptual interest can be assigned to an image by determining whether an image is visible on the display when the display's position changes and / or by receiving input (e.g., facial recognition input) from the image sensor 103. A change in the position of the display 102 includes changing the display 102 from an initial position to a subsequent position. An example of a change in the position of the display 102 may involve rotating the display 102 by a certain degree from the perspective of a user viewing the display 102, such that the display can be viewed by another person, animal, and / or device. Selecting an image to be visible on the display 102 and changing the position of the display while the image is visible on the display 102 can indicate that the image is perceived as interesting by the user. In other words, a user viewing an image on the display 102 and rotating the display 102 to show it to another person can indicate that the user has a preference for the image.
[0035] In a non-limiting embodiment, controller 108 may be configured to assign a perceived interest to an image among a plurality of images via controller 108 coupled to memory device 106, wherein the perceived interest is assigned in part based on a change in the position of display 102 when the image is viewable on display 102 coupled to memory device 106. For example, a user may be viewing an image on display 102 of a smartphone and rotate the smartphone so that display 102 is viewable to a different person. In response to the change in position, controller 108 may assign a perceived interest to an image that is viewable on display 102. Controller 108 may be configured to select an image from an initial viewing location on display 102 in response to the assigned perceived interest; and transfer the image to a different viewing location, wherein the initial viewing location and the different viewing locations are visible on display 102. In this example, controller 108 may copy an image from the initial viewing location (e.g., a default album or folder) and transfer a copy to a different viewing location (e.g., for an image that has been detected to contain a perceived interest).
[0036] In some instances, controller 108 may be configured to include a threshold amount for changes in the position of display 102 when an image is visible on display 102. A threshold determined by the user can prevent unintentional assignment of perceptual interest to an image due to unintended changes in the position of display 102. For example, a user may use settings on a computing device to set a threshold for the number of times the position of display 102 changes, three or more times, and then assign perceptual interest corresponding to a desired preference to the image and / or prompt the computing device (e.g., the user) to confirm the perceptual interest and / or the new viewing location on display 102. Although the number three is used herein, the threshold number may be more or less than three. Using this method, the user would need to change the position of the display three or more times when an image is visible on the display before the computing device assigns a perceptual interest corresponding to the desired preference. In some instances, the computing device may assign perceptual interest by receiving input from image sensor 103.
[0037] For example, device 100 may be a computing device and include a memory device 106 coupled to display 102 via controller 108. Image sensor 103 may be directly or indirectly coupled to display 102 via controller 108. To group images to viewing locations on the display based on perceived interest, controller 108 may be configured to select images from a plurality of images that will be viewed on display 102. Images may be selected from initial viewing locations on display 102 (e.g., default photo albums and / or folders), generated by image sensor 103, received (via text or email from another computing device), and / or otherwise obtained by the computing device. When an image is visible on the display, a user may expect to show the image to another person.
[0038] Controller 108 can be configured to receive input from image sensor 103 when one of a plurality of images is visible on display 102. Display 102 may undergo a change of position and / or display 102 may be in the field of view of another person (e.g., standing near the user). The input received by controller 108 from image sensor 103 may be facial recognition input associated with the person viewing the image. Controller 108 can assign perceptual interest to an image based at least in part on the input received from image sensor 103. Controller 108 can transfer an image from an initial viewing position on the display to a different viewing position on the display in response to the assigned perceptual interest.
[0039] In a non-limiting example, the computing device may be a smartphone, the image sensor 103 may be the smartphone's camera, and the user may configure the camera settings to capture facial recognition input when the camera is positioned such that it can collect facial data of people, animals, etc. In this example, the camera may capture facial recognition data while the image is visible on the display 102. A controller 108 coupled to the camera (e.g., image sensor 103) may generate a new viewing location based on the facial recognition input and prompt the smartphone (e.g., the smartphone user) to confirm the new viewing location. The controller 108 may be configured to group subsequent images that have a shared perceptual interest corresponding to the facial recognition input together.
[0040] For example, if a user selects an image on their smartphone to show to their mother (or any other person), the smartphone's camera can receive facial recognition data from the mother, and controller 108 can prompt the user to generate a new folder labeled "Mother" (e.g., a new viewing location). The user can then select different images to show to their mother, and controller 108 can add different pictures to the "Mother" folder as facial data is collected. This can be done without user input. In other instances, controller 108 can determine that one or more images have perceived interest corresponding to the user's dislike, indifference, or undesirable preferences.
[0041] Controller 108 can assign perceived interests corresponding to unwanted preferences. This could be a response to an image on display 102 without changing its position while the image is visible on display 102. Additionally, other images that the user has not yet selected and / or that are not viewable on display 102 when the display changes position can be grouped together based on perceived interests corresponding to unwanted preferences. Grouped images with unwanted preferences can be sent to a folder the user wishes to check for disposal. For example, controller 108 can send images to a specific viewing location on display 102. In some instances, controller 108 can write image data corresponding to an image at a viewing location on display 102 to various memory types.
[0042] In an example embodiment, controller 108 may be coupled to multiple memory media types (e.g., DRAM 112, SCM 114, and / or NAND 116), wherein an image in an initial viewing position may be written to a first memory media type (e.g., DRAM 112) and images in the different viewing positions may be written to a second memory media type (e.g., NAND 116). For example, the different viewing positions on display 102 may include images written to a memory media type that is more secure and / or more suitable for long-term storage on the computing device. Thus, viewing positions written to a corresponding memory media type (e.g., DRAM 112, SCM 114, and / or NAND 116) may include other images that have been selected by controller 108 based on corresponding perceptual interests.
[0043] Figure 2 This is a diagram illustrating an example of a computing device 210 including a display 202 having a visible image 218, according to several embodiments of the present disclosure. Figure 2 A computing device 210 is shown, such as a mobile device, which includes components similar to... Figure 1 Image sensor 103, image sensor 203 and similar Figure 1 The display 102 and the display 202. The computing device 210 further includes a display similar to the display 102 and the display 202. Figure 1 The memory device 106 and the memory device 206. The memory device 206 can be coupled to a device that can be similar to... Figure 1 The controller 108 and the controller 208. Figure 2 The display 202 is shown as containing a plurality of images 218-1, 218-2, 218-3, 218-4 and 218-N, which may be referred to herein as images 218.
[0044] Figure 2 Non-limiting examples of a specific image 218-3 represented by a star and other images 218-1, 218-2, 218-4, and 218-N represented by circles are shown. Other squares shown in display 202 are similar to image 218, but are not labeled herein to avoid confusion with the examples of this disclosure.
[0045] Display 202 contains multiple images 218. In some instances, the multiple images 218 may be included in an initial viewing position on display 202 and presented in chronological order. In other words, the multiple images 218 may be the content of the initial viewing position. For example, the multiple images 218 may be images presented to the user in the order they have been generated by image sensor 203 (e.g., camera) and / or received, transmitted, or otherwise obtained by computing device 210. The user may use an appendage (e.g., finger) or device (e.g., stylus, digital pen, etc.) to select one or more images 218-1, 218-2, 218-3, 218-4, 218-N from the multiple images 218. Selecting a particular image 218-3 instead of other images 218-1, 218-2, 218-4, and / or 218-N may indicate a perceived interest corresponding to the user's desired preferences.
[0046] The controller 208 can use various methods to assign perceptual interest to the image 218. For example, the controller 208 can assign perceptual interest based on selecting a specific image 218-3 such that image 218-3 is visible on the display 202 when the display 202 changes position, such as by combining... Figures 3A-3B As described herein, when a specific image 218-3 is selected, the image can be magnified such that it covers all or most of the display 202. A user can configure computing device 210 (e.g., controller 208) to assign perceptual interest to an image (e.g., image 218-3) corresponding to the user's desired preference, selected from a set of images 218, when the image becomes visible on the display after the display position changes three or more times. Although three or more times is used as an example herein, the number of times the display needs to change position can be greater than or less than three. Computing device 210 can store metadata containing metadata values associated with the image that can indicate the perceptual interest in the image, the image's location on the display, the grouping of images, and other information that can be included in the metadata associated with the image. Eliminating the requirement for the user to manually represent images as "favorite images" can reduce the clutter and frustration of the user experience of computing device 210.
[0047] In another non-limiting example, when image 218 is shown to another person and image sensor 203 can collect facial recognition data, controller 208 can assign perceptual interest to one or more images 218. For example, when a particular image 218-3 is selected and positioned on display 202 so that another person (e.g., and / or animal or device) can view the image, controller 208 can assign perceptual interest corresponding to a desired preference to the image.
[0048] In some instances, computing device 210 and / or controller 208 may be configured (e.g., by settings, etc.) to generate a new viewing location corresponding to the collected facial recognition data without user input. In other instances, computing device 210 and / or controller 208 may be configured to prompt the user for confirmation before generating a new viewing location corresponding to the collected facial recognition data.
[0049] In a non-limiting example, a user can position themselves in front of computing device 210, making display 202 visible to the user, while a specific image 218-3 is visible on display 202. Different people can position themselves next to and / or behind the user, allowing that person to also view display 202 and the specific image 218-3. When image sensor 203 detects that another person has been positioned to view the specific image 218-3, controller 208 can assign a perceptual interest corresponding to the user's desired preference to image 218-3. Image sensor 203 can collect facial recognition data from people, and controller 208 can generate a new viewing position corresponding to the person to transmit image 218-3.
[0050] In another non-limiting example, a user may position themselves in front of computing device 210 such that display 202 is visible to the user, and a specific image 218-3 is visible on display 202. The user may change the position of display 202 so that different people may also view display 202 and the specific image 218-3. When image sensor 203 detects that another person has been positioned to view the specific image 218-3 and / or when display 202 changes from an initial position to a subsequent position, controller 208 may assign a perceptual interest corresponding to the user's desired preference to image 218-3. Image sensor 203 may collect facial recognition data from people, and controller 208 may generate a new viewing position on display 202 corresponding to the person.
[0051] In some instances, perceived interests can be assigned to images 218 that have not been selected, viewed by another person, and / or are not visible on display 202 when the position of display 202 changes from its initial position to a subsequent position. For example, suppose that images 218-1, 218-2, 218-4, and 218-N have not been selected, viewed by another person, and / or are not visible on display 202 when the position of display 202 changes from its initial position to a subsequent position. In this instance, controller 208 can assign perceived interests corresponding to images that the user does not want. In this instance, images with perceived interests reflecting user disinterest can be categorized and transmitted to different viewing positions on display 202. In some instances, this viewing position can be used to prompt the user to discard these images to alleviate clutter and memory space on memory device 206.
[0052] In some embodiments, the controller 208 may change the perceptual interest in image 218. For example, image 218-1 may be assigned a perceptual interest corresponding to an unwanted preference of the user of computing device 210. Subsequently, in response to image 218-1 being selected, viewed by another person, and / or becoming visible on display 202 when the position of display 202 changes from an initial position to a subsequent position, the controller 208 may assign a new perceptual interest corresponding to the user's desired preference.
[0053] If combined Figure 4 As discussed, controller 208 can classify multiple images 218 by grouping them based on perceptual interest. This can be done without user input (e.g., controller 208 can be configured with user preferences when setting up computing device 210) or the user can choose to be prompted whether the classification and / or grouping is a preference. For example, when loading an application, controller 208 determines that the user may want to include perceptual interest in a particular image 218 and can prompt the user for confirmation. Alternatively, controller 208 can determine that the user may want to include perceptual interest in images that have not been selected, viewed by another person, and / or are not visible on display 202 when the position of display 202 changes from its initial position to a subsequent position.
[0054] Figures 3A-3B This is a diagram illustrating an example display 302 containing a visible image 318 according to several embodiments of the present disclosure. Figures 3A-3B Each displayed something similar Figure 1 and 2 Displays 102 and 202, and display 302. Display 302 may be a computing device (e.g., Figure 2 The computing device 210) is part of and coupled to the controller (e.g., Figure 2 The controller 208) and the memory device (e.g., Figure 2 (Memory device 206). Figures 3A-3B Each contains something similar to Figure 2 Image 218 and image 318. Figures 3A-3B It also showcased person 321. Despite Figures 3A-3B It is displayed as containing a single person, but it can also contain more than one person. Furthermore, although... Figures 3A-3B The depiction may include human figures, but may use any animal or device.
[0055] Figure 3A A display 302 showing a visible image 318 is shown. Figure 3A In the demonstration, the computing device 310 is positioned so that the user (not shown) may be facing the display 302, making the image 318 visible to the user. For example... Figure 3A As shown, person 321 is not in the position used to view image 318. Figure 3B An example is shown of a display 302 coupled to computing device 310 in a subsequent position. In this example, display 302 has been... Figure 3A The initial position shown is changed to the position. Figure 3B The subsequent positions shown. Although Figure 3A and 3B The subsequent position of person 321 is on the right side of computing device 310, but person 321 may face to the left side of computing device 310, in front of computing device 310 and / or anywhere in between.
[0056] exist Figure 3B In the subsequent positions shown, image 318 is visible to person 321. The controller of computing device 310 can determine the position of display 302 based on the position of the person. Figure 3A The initial position of ( ) changed to ( Figure 3B The image 318 is then made visible on the display 302 when the image 318 is in a subsequent position to assign a perceptual interest corresponding to the desired preference for the image 318. In another example, when the display 302 is in a subsequent position, the controller of the computing device 310 may receive input from the image sensor 303 coupled to the controller; and based on the input received from the image sensor, the image 318 may be transferred to the new viewing position.
[0057] In other words, a subsequent position changes the angle of the display so that person 321 can view image 318. Image sensor 303 can collect input (e.g., facial recognition input) and generate a new viewing position to transmit image 318 (and / or a copy of image 318). In this example, the new viewing position may correspond to person 321, and other subsequent images shown to person 321 can be transmitted to the new viewing position on display 302. This can be done without user input. For example, upon receiving a subsequent image, the controller can determine that the facial recognition input is from person 321 and transmit the subsequent image to the new viewing position without user prompting, or the user may choose to ask if this is a preferred prompt. For example, upon receiving a subsequent image, the controller can determine based on the facial recognition input corresponding to person 321 that the user may want the image transmitted to the new viewing position and may prompt the user for confirmation. In some instances, the controller of computing device 310 can avoid transmitting image 318 to the new viewing position.
[0058] In another non-limiting example, when the display 302 is in a subsequent position, the controller of the computing device 310 may receive input from the image sensor 303 coupled to the controller; and based on the input received from the image sensor, avoid transmitting image 318 to the new viewing location. For example, the image sensor 303 may collect input (e.g., facial recognition input) and the controller 308 may generate a new viewing location based on the input received from the image sensor 303 to transmit image 318 (and / or a copy of image 318). The controller may prompt the user to confirm the creation of the new viewing location. Person 321 may be unknown to the user (e.g., rarely encountered, etc.), and the user may not want to dedicate the new viewing location to an unknown person 321.
[0059] In the example above, when person 321 is unknown to the user, the controller can assign a perceived interest corresponding to an unwanted preference to image 318. In this example, the controller can further transmit a prompt to computing device 310 and / or the user to discard image 318 based on the perceived interest being an unwanted preference.
[0060] Figure 4 A functional diagram is shown illustrating a computing device 410 for image localization on a display 402 based on image localization based on perceived interest and display position, according to several embodiments of the present disclosure. Figure 4 Showing with Figure 1 , 2 Similar to monitors 102, 202, and 302 of 3A-3B, monitor 402 and... Figure 2 and 3A Images 218 and 318 of -3B are similar and can be referred to herein as images 418-1 to 418-N. Display 402 can be similar to... Figure 2 The computing device 210 is a part of the computing device 410 and is coupled to a device that can be similar to Figure 1 and 2 Controllers 108 and 208 and controller 408 can be similar to Figure 1 and 2 The memory devices 106 and 206 and the memory device 406.
[0061] Figure 4 Images 418-1 to 418-N, contained in the initial viewing location 424-1, are shown. Figure 4An image viewing location visible on display 402 is shown. Initial viewing location 424-1 may include each of a plurality of images 418. Images 418 may be the default image viewing location, viewed sequentially in initial viewing location 424-1 and / or generated, received, or otherwise obtained by computing device 410. Another viewing location may be a preferred image viewing location 424-2, where the images to be viewed may include images that have been (by controller 408) assigned with perceived interest corresponding to the user's desired preferences.
[0062] Discarding a viewing location 424-3 may contain images that have been (assigned by controller 408) to images corresponding to a user's unwanted preferences. Discarding a viewing location 424-3 may contain images that the user may not want to retain because the images have not been frequently viewed or shown to another person. Controller 408 may prompt the user to examine the images contained in discarding a viewing location 424-3 and discard the images from computing device 410. Another viewing location may contain images corresponding to facial recognition input collected by image sensor 403. Facial recognition viewing location 424-M may contain images that have already been viewed by a person (e.g., Figure 3A The image is viewed by person 321. The image 418 can be grouped and transmitted to viewing locations on display 402, at least in part, based on the perceived interest assigned by controller 408. As described herein, transmitting image 418 may involve generating a copy of image 418 and transmitting the copy to different viewing locations 424. In other words, controller 408 can be further configured to generate a copy of image 418 and transmit copies of image 418 from initial viewing location 424-1 to different viewing locations 424-2, 424-3, 424-4, 424-M.
[0063] like Figure 4 As shown, controller 408 can be configured to assign a perceptual interest to each of the plurality of images 418. For example, controller 408 can be further configured to determine the assigned perceptual interest for each of the plurality of images 418, and as... Figure 4 As shown, multiple images 418 are classified into multiple groups based on assigned perceptual interests. For example, images 418-1, 418-3, 418-5, 418-8, 418-9, and 418-N, represented by stars and triangles, can be included in the first group. Images 418-2, 418-4, 418-6, and 418-7, represented by circles, can be included in the second group.
[0064] In the non-limiting example above, each image 418-1, 418-3, 418-5, 418-8, 418-9, and 418-N contained in the first group of the plurality of groups contains an image with an assigned perceptual interest corresponding to a desired preference. Images 418-1, 418-3, 418-5, 418-8, 418-9, and 418-N may have already been assigned a perceptual interest corresponding to a desired preference because the images are shown to another person, or are visible on display 402 when display 402 changes position from an initial position to a subsequent position, or a combination thereof.
[0065] Furthermore, in the non-limiting example above, each image 418-2, 418-4, 418-6, and 418-7 contained in the second group of the plurality of groups contains an image with a perceived interest assigned corresponding to an undesirable preference. Images 418-2, 418-4, 418-6, and 418-7 may have been assigned a perceived interest corresponding to an undesirable preference because the images were not shown to another person, were not viewable on display 402 when display 402 changed position from an initial position to a subsequent position, or a combination thereof. Controller 408 may be further configured to transmit a prompt to computing device 410 to discard the second group of images.
[0066] As described above, controller 408 can group and classify images 418 based on perceived interests. Controller 408 can further be based on... Figure 4 The perceived interest assigned at frame 422 transmits the image to viewing location 424. In some instances, image 418 may exist in multiple viewing locations 424.
[0067] For example, all images 418-1 to 418-N are viewable in the initial viewing location 424-1. The controller 408 can assign (at 422) perceptual interests corresponding to desired preferences to images 418-1, 418-3, 418-5, 418-8, 418-9, and 418-N and transfer the images to the preferred viewing location 424-2, so that the images are now viewable in both the initial viewing location 424-1 and the preferred viewing location 424-2.
[0068] Furthermore, the images 418-9 and 418-N, represented by triangles, can correspond to inputs from the image sensor corresponding to the person who has viewed images 418-9 and 418-N and are transmitted to the face recognition viewing location 424-M. In this example, the images 418-9 and 418-N, represented by triangles, can be viewed in the initial viewing location 424-1, the preferred viewing location 424-2, and the face recognition viewing location 424-M.
[0069] Images 418-2, 418-4, 418-6, and 418-7 (at 422) may have been assigned perceptual interests corresponding to undesirable preferences because the images are not shown to another person, are not viewable on display 402 when display 402 changes position from initial position to subsequent position, or combinations thereof. These images may be viewable in initial viewing position 424-1 and discarded viewing position 424-3, allowing the user to check discarded viewing position 424-3 and discard the image as needed. In some instances, discarding an image from any of the multiple viewing positions 424 may be achieved by discarding the image from computing device 410.
[0070] Figure 5 This is a block diagram 539 illustrating an example of image localization based on perceived interest and display position according to several embodiments of the present disclosure. Figure 5 The computing device (e.g.) is described Figure 4 The computing device 410 is equipped with a camera for generating images and a controller for receiving, transmitting, or otherwise acquiring images (e.g., ...). Figure 1 (Controller 108). At box 540, the computing device can generate (e.g., or receive, etc.) an image and the controller can receive the image. The image can be saved to the initial viewing location (e.g., Figure 4 Initial viewing positioning 424-1). At box 542, the controller can determine that the position of the display of the mobile device has changed.
[0071] For example, the controller can determine when the display is in an initial position and a subsequent position, where the change in the display's position includes moving the display from the initial position to the subsequent position. At box 544, the controller can assign a perceptual interest to an image. If the image is not visible on the display when the display changes position from the initial position to the subsequent position, the controller can assign a perceptual interest corresponding to an unwanted preference. If the image is visible on the display when the display changes position from the initial position to the subsequent position, the controller can assign a perceptual interest corresponding to a desired preference.
[0072] At box 546, the controller can transfer the image from the initial viewing position on the display (e.g., initial viewing position 424-1) to different viewing positions on the display (e.g., ...). Figure 4 (Preferred viewing position 424-2 or discarded viewing position 424-3). At box 548, the controller can receive facial recognition input from an input sensor (e.g., a camera on a mobile device). Facial recognition input can come from the person showing the image to the user as the image visible on the display changes position from an initial position to a subsequent position.
[0073] At box 550, the controller can assign a new perceptual interest to the image. For example, the controller can assign a new perceptual interest and / or at 558 avoid sending the image to the viewing location corresponding to the facial recognition input. In this example, the user has already rejected the prompt used to generate the viewing location corresponding to the person. In another example, at 556, the controller can send the image to the viewing location corresponding to the facial recognition input. Although “preferred viewing location,” “discarded viewing location,” and “initial viewing location” have been discussed, other and / or different viewing locations can be used, such as “edited viewing location,” “frequently sending viewing locations via email and / or SMS,” etc.
[0074] In a non-limiting instance, the mobile device may be configured by the user to include a threshold. The user may have already configured settings on the mobile device to set a threshold that requires the display to move from an initial position before assigning a perceived interest corresponding to the user's desired preferences on the computing device. Figure 3A ) to subsequent positions ( Figure 3B The change occurs three or more times.
[0075] In a non-limiting instance, the controller can (at 542) determine when the display is in an initial position and a subsequent position, wherein a change in the display's position includes the display moving from an initial position to a subsequent position, and multiple viewing positions include discarding a viewing position, and in response to corresponding multiple images (e.g., using...). Figure 4 A subset of the image (represented by the circle 418) is already viewable on the display, but the display is less than a threshold number of times it is in a subsequent position, and the subset is classified into the discarded view location.
[0076] In another non-limiting instance, the controller may determine (at 542) when the display is in an initial position and a subsequent position, wherein the change in the position of the display includes the display moving from the initial position to the subsequent position, and multiple viewing positions include a preferred viewing position, and the corresponding multiple images classified into the preferred viewing position when the display is in the subsequent position more than a threshold number of times are already available for viewing on the display.
[0077] Figure 6 This is a flowchart illustrating an example method 680 for image localization based on perceived interest and display position according to several embodiments of the present disclosure. At 682, method 680 includes a processor coupled to a memory device assigning perceived interest to an image among a plurality of images, wherein the perceived interest is assigned in part based on a change in the position of the display when the image can be viewed on a display coupled to the memory device.
[0078] For example, a change in the position of a display includes moving the display from an initial position to a subsequent position. In other instances, perceptual interest can be assigned based on input received by a computing device via an image sensor.
[0079] At 684, method 680 includes selecting an image from an initial viewing location on the display in response to an assigned perceived interest. The perceived interest may correspond to an unwanted preference of a user of the computing device, and the image may be transferred from the initial viewing location to a discarded viewing location. In other instances, the perceived interest may correspond to an expected preference of a user of the computing device, and the image may be transferred from the initial viewing location to a preferred viewing location.
[0080] In other words, at 686, method 680 may include transmitting an image to different viewing positions, wherein the initial viewing position and the different viewing positions are visible on the display.
[0081] In several embodiments, the method according to this disclosure may include: identifying data of an image displayed through a user interface; determining the relative position of the user interface or input from a sensor, or both, when the image is displayed on the user interface; and writing metadata associated with the data of the image to a memory coupled to the user interface, based at least in part on the relative position of the user interface or input from the sensor.
[0082] Embodiments of this disclosure may also include reading metadata from memory and displaying an image at a location on the user interface or for a certain duration, or both, based at least in part on the value of the metadata.
[0083] Embodiments of this disclosure may also include reading metadata from memory and writing image data to different addresses in memory or external storage devices, at least in part based on the values of the metadata.
[0084] Embodiments of this disclosure may also include reading metadata from memory and modifying image data based at least in part on the values of the metadata.
[0085] Figure 7 This is a functional diagram illustrating a processing resource 791 communicating with a memory resource 792 according to several embodiments of the present disclosure, on which instructions 794, 796, 798 for image localization based on perceived interest and display position are written. In some embodiments, the memory resource 792 may be similar to... Figure 1 The described memory device 106. In some instances, processing resource 791 may be similar to that described above. Figure 1 The controller 108 described.
[0086] System 790 may be a server or computing device (etc.) and may include processing resources 791. System 790 may further include memory resources 792 (e.g., non-transitory MRM), on which instructions such as instructions 794, 796, and 798 may be stored. Although the following description relates to processing resources and memory resources, the description is also applicable to systems having multiple processing resources and multiple memory resources. In such instances, instructions may be distributed (e.g., stored) across multiple memory resources and instructions may be distributed (e.g., executed) across multiple processing resources.
[0087] Memory resource 792 can be an electronic, magnetic, optical, or other physical storage device storing executable instructions. Therefore, memory resource 792 can be a non-transitory MRM, such as random access memory (RAM), electrically erasable programmable ROM (EEPROM), memory drives, optical discs, etc. Memory resource 792 can be housed within a controller and / or computing device. In this example, executable instructions 794, 796, and 798 can be "mounted" on the device. Additionally and / or alternatively, memory resource 792 can be, for example, a portable, external, or remote storage medium that allows system 790 to download instructions 794, 796, and 798 from a portable / external / remote storage medium. In this case, the executable instructions can be part of an "installation package." As described herein, memory resource 792 can be encoded with executable instructions for image localization based on perceived interests.
[0088] When instruction 794 is executed by a processing resource such as processing resource 791, the instruction may include instructions for determining, by a controller coupled to a mobile device containing multiple images, that the position of the display changes when one or more of the multiple images are viewable on a display coupled to the mobile device. In some instances mentioned herein, the computing device may be configured by a user to include a threshold. In a non-limiting instance, the user may have already configured settings on the computing device to set a threshold that requires the display to change position from an initial position (…) before assigning a perceptual interest corresponding to the user's desired preference for the computing device. Figure 3A ) to subsequent positions ( Figure 3B The change occurs three or more times.
[0089] When instruction 796 is executed by a processing resource such as processing resource 791, the instruction may include instructions to assign a corresponding perceptual interest to each of a plurality of images, wherein each corresponding perceptual interest is based in part on whether the plurality of images are already viewable on the display when the position of the display changes. The plurality of images may be assigned different perceptual interests. In some instances, one or more images may correspond to a person who has already viewed the image (e.g., via facial recognition data received by a computing device).
[0090] When instruction 798 is executed by a processing resource such as processing resource 791, the instruction may include instructions for classifying a plurality of images into a plurality of viewing locations based on assigned corresponding perceptual interests, wherein the plurality of viewing locations are visible on the display of the mobile device. The plurality of viewing locations may include discarded viewing locations, preferred viewing locations, and / or facial recognition viewing locations.
[0091] Although specific embodiments have been shown and described herein, those skilled in the art will understand that arrangements intended to achieve the same results may be substituted for the specific embodiments shown. This disclosure is intended to cover adaptations or variations of one or more embodiments of this disclosure. It should be understood that the above description is illustrative rather than restrictive. After reading the above description, combinations of the above embodiments and other embodiments not specifically described herein will be apparent to those skilled in the art. The scope of one or more embodiments of this disclosure includes other applications in which the above structures and processes are used. Therefore, the scope of one or more embodiments of this disclosure should be determined with reference to the appended claims, together with the full scope of their equivalents.
[0092] In the above specific embodiments, for the purpose of simplifying this disclosure, some features are grouped together in a single embodiment. This approach of the disclosure should not be construed as reflecting an intention that the disclosed embodiments of the disclosure must use more features than those expressly referenced in each claim. Rather, as reflected in the following claims, the subject matter of the invention lies in fewer than all the features of a single disclosed embodiment. Therefore, the following claims are thus incorporated into the specific embodiments, wherein each claim exists independently as a separate embodiment.
Claims
1. A method for image localization based on perceived interest, the method comprising: Images from a first folder stored in the memory of the computing device (210, 310, 410) are displayed on the display (202, 402) of the computing device; The processor of the computing device uses input from the image sensor of the computing device to determine the change in the position of the display; The processor of the computing device assigns perceptual interest corresponding to the user's expected preferences to the image based in part on the change in the position of the display; as well as In response to the assigned perceived interest, the image is transferred from the first folder to a second folder stored in the memory of the computing device.
2. The method of claim 1, further comprising grouping the image with a plurality of images based on the assigned perceptual interest of the image.
3. The method of claim 1, wherein the change in position of the display includes the display changing from an initial position to a subsequent position.
4. The method of claim 3, further comprising: When the display is in the initial position, the first part of the input is received from the image sensor.
5. The method of claim 3, further comprising: When the display is in the subsequent position, the second part of the input is received from the image sensor.
6. The method of claim 1, further comprising prompting the user to discard the image based on assigned perceptual interests.
7. The method of claim 1, further comprising: Determine the assigned perceptual interest for each of the multiple images; as well as The multiple images are classified into multiple groups based on the perceptual interest assigned to each image.
8. The method according to claim 7, wherein: Each image in the first group of the plurality of groups contains an image with an assigned perceptual interest corresponding to the desired preference; as well as Each image in the second group, which is included in the plurality of groups, contains an image with an assigned perceptual interest corresponding to an undesirable preference.
9. The method of claim 8, further comprising prompting the user to discard the second set of images.
10. A non-transitory machine-readable medium, the medium comprising instructions for image localization based on perceived interest, the instructions being capable of performing the following: Images from a first folder stored in the mobile device's memory are displayed on the mobile device's display (202, 402); The processor of the mobile device uses input from the image sensor of the mobile device to determine the change in the position of the display; The processor of the mobile device assigns perceptual interest corresponding to the user's expected preferences to the image based in part on the change in the position of the display; and In response to the assigned perceived interest, the image is transferred from the first folder to a second folder stored in the memory of the mobile device.
11. The media of claim 10, further comprising instructions capable of performing the following: Determine when the display is in an initial position and a subsequent position, wherein the position change of the display includes the display moving from the initial position to the subsequent position; and The portion of the input received from the image sensor when the display is in the subsequent position.
12. The media of claim 10, further comprising instructions capable of executing to generate a new viewing location based on the input from the image sensor.
13. The media of claim 10, further comprising instructions capable of executing to avoid generating new viewing locations based on the input from the image sensor.
14. The media of claim 10, further comprising instructions capable of executing to determine when the display is in an initial position and a subsequent position, wherein: The change in the position of the display includes the display moving from the initial position to the subsequent position; Multiple location viewing options include discarding location viewing; and In response to the fact that the image has been viewable on the mobile device but the display is in the subsequent position less than a threshold number of times, the image is classified into the discarded viewing location.
15. The media of claim 10, further comprising instructions capable of executing to determine when the display is in an initial position and a subsequent position, wherein: The change in the position of the display includes the display moving from the initial position to the subsequent position; Multiple viewing locations include preferred viewing locations; and In response to the fact that the image is already viewable on the mobile device but the display is in the subsequent position more than a threshold number of times, the image is classified into the preferred viewing location.
16. An apparatus for image localization based on perceived interest, the apparatus comprising: A memory device coupled to a display (202, 402); Image sensors (103, 203, 303) are coupled to the display; as well as Controllers (108, 208, 308, 408), the controllers being coupled to the memory device, wherein the controllers are configured to: Images from a first folder stored in the storage device are displayed on the display; The position change of the display is determined using input from the image sensor; Perceptual interest corresponding to the user's expected preferences is assigned to the image, at least in part, based on the change in the position of the display. and In response to the assigned perceived interest, the image is transferred from the first folder to a second folder stored in the storage device.
17. The device of claim 16, wherein the image sensor is a camera for providing the input in the form of facial recognition input.
18. The device of claim 17, wherein the controller is further configured to: A new viewing location is generated based on the facial recognition input; and The device is prompted to confirm the newly viewed location.
19. The device of claim 18, wherein the controller is further configured to group subsequent images having a shared perceptual interest corresponding to the facial recognition input.
20. The device of claim 16, wherein the controller is further configured to generate a copy of the image and transmit the copy of the image from an initial viewing location to a different viewing location.