System

Abstract

A system is provided.SOLUTION: The system of claim 1, wherein the AI module is further configured to determine whether the photo is an unnecessary photo based on the content and the metadata of the photo, wherein the AI module is further configured to determine whether the photo is an unnecessary photo based on the content and the metadata of the photo, wherein the analysis module is further configured to determine whether the photo is an unnecessary photo based on the content and the metadata of the photo, wherein the analysis module is further configured to determine whether the photo is an unnecessary photo based on the content and the metadata of the photo, and wherein the analysis module is further configured to determine whether the photo is an unnecessary photo based on the content and the metadata of the photo.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] With conventional smartphones and cloud storage services, storage capacity tends to become insufficient as users continue to take photos. In particular, accidentally taken screenshots and similar photos often fill up albums, increasing the burden on users to manually organize their photos. The cost of purchasing additional storage space is also a significant issue. Therefore, there is a need for a method to efficiently manage smartphone storage capacity and reduce user effort by automatically identifying and deleting unnecessary photos. [Means for solving the problem]

[0005] The present invention solves the above problem by providing a system including: means for sending photo data from a terminal to a cloud server; means for the cloud server to receive the photo data and analyze the photos using an AI module; means for the AI ​​module to identify unnecessary photos based on the photo content and metadata; means for deleting the unnecessary photos from the cloud server; means for the cloud server to send a deletion instruction to the terminal for the identified unnecessary photos; means for the terminal to delete the unnecessary photos from the terminal based on the deletion instruction; and means for the terminal to move the deleted photos to a temporary storage location, allowing the user to restore them within a certain period of time.

[0006] Furthermore, by including a means for users to set criteria for deleting unnecessary photos, flexible management tailored to the user's needs is possible. Also, by including a synchronization means for the device to send new photo data to the cloud server, the latest photo data is always efficiently managed. This significantly reduces the effort required for users to manually organize photos and optimizes smartphone storage capacity.

[0007] "Terminal" refers to a digital device that has the ability to take photos and send data to a cloud server.

[0008] "Cloud server" refers to a remote server accessible via the Internet that has the functionality to receive, store, and perform AI analysis of photo data.

[0009] "Photo data" refers to still image files taken by a device and their associated metadata (e.g., date and time of shooting, GPS information, etc.).

[0010] "AI Module" refers to a software module that uses machine learning or artificial intelligence technology to analyze the content and metadata of photos and identify unwanted photos.

[0011] "Metadata" refers to information that accompanies photo data, such as the date and time of the photo, the location where the photo was taken, and the file format.

[0012] "Unnecessary photos" refers to photo data that the AI ​​module has determined does not need to be retained based on certain criteria, such as duplicates or photos taken by mistake.

[0013] A "deletion instruction" is a command sent from the cloud server to the terminal, requesting that unnecessary photos be deleted from the terminal's storage.

[0014] A "temporary storage location" is an area where photo data that has been determined to be unnecessary and deleted is stored for a certain period of time, and is kept in a state where it can be accessed again if the user wishes to restore it.

[0015] "Recovery" refers to the act of a user retrieving deleted photo data from a temporary storage location and relocating it to the device's photo gallery.

[0016] "Synchronization means" refers to software and network functions that allow a device to periodically connect to a cloud server and upload new photo data. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] This invention is a system for efficiently managing smartphone storage capacity. In this system, the device sends photo data to a cloud server, and an AI module on the cloud server identifies unnecessary photos and automatically deletes them. The following describes the details of the program processing of this system and a specific example.

[0039] Explanation of program processing

[0040] 1. Send photo data from your device

[0041] When a user takes a photo with their smartphone, the photo data is saved in the device's photo gallery.

[0042] The device periodically connects to the cloud server and uploads newly taken photos to the server, along with any metadata associated with the photos (e.g., photo date and time, GPS information, etc.).

[0043] 2. Receiving and analyzing photo data on the cloud server

[0044] The cloud server receives the photo data and stores it in a temporary storage area.

[0045] The AI ​​module on the server analyzes the received photo data and identifies unwanted photos based on content and metadata, including image similarity analysis, automatic screenshot detection, and algorithms to select the best photos from a series of photos.

[0046] 3. Instructions for deleting unnecessary photos

[0047] The AI ​​module generates a list of photos that it determines are unnecessary, and the cloud server uses this list to send deletion instructions to the device.

[0048] On the other hand, the cloud server temporarily stores photo data that is determined to be unnecessary for a certain period of time (e.g., three months) rather than immediately, allowing users to recover photos that have been accidentally deleted.

[0049] 4. Delete unnecessary photos on your device

[0050] The device receives a deletion instruction from the cloud server and deletes the corresponding unnecessary photos from the photo gallery.

[0051] Deleted photo data is moved to a temporary storage area on the device. By accessing this area, users can recover deleted photos within three months.

[0052] 5. User Verification and Recovery Options

[0053] When a user opens the "Clean Data Box" app, a list of deleted photos is displayed.

[0054] If the user wants to review the deleted photos and restore a specific photo, they can select it from this list and press the restore button to restore the photo to the device's photo gallery.

[0055] Specific examples

[0056] 1. Users take lots of photos while traveling

[0057] Users take many photos with their smartphones while traveling, and sometimes take multiple photos of the same scenery from slightly different angles.

[0058] 2. Send new photo data from the device to the server

[0059] After returning home from a trip, the device automatically connects to the cloud server and uploads new photo data, including all photos taken during the trip and their metadata.

[0060] 3. AI analysis on a cloud server

[0061] Based on the photo data received by the cloud server, AI analyzes the content of the photos and distinguishes between highly similar photos, unclear photos, accidentally taken screenshots, etc. For example, if 10 photos of a night view have been taken, the AI ​​will keep only the one it judges to be the best quality and discard the other nine.

[0062] 4. Instructions for deleting unnecessary photos

[0063] The cloud server generates a list of photos that are determined to be unnecessary, and based on this, sends an instruction to delete the photos to the terminal.

[0064] 5. The user can confirm the photo deletion in the app and restore it if necessary.

[0065] When users open the "Clean Data Box" app, they can see a list of deleted photos. They can then select the photos they need from this list and restore them to their photo gallery.

[0066] Through the above-described embodiment, the system can automatically delete unnecessary photos, effectively manage smartphone storage capacity, and save users the trouble of manually organizing photos, reducing the risk of losing important photos.

[0067] The processing flow will be explained below.

[0068] Step 1:

[0069] A user takes a photo with their smartphone.

[0070] When a user takes a photo using the camera app, the photo data is automatically saved to the device's photo gallery.

[0071] Step 2:

[0072] The device connects to the cloud server.

[0073] Your device periodically connects to the cloud server to check the latest synchronization status. This connection occurs in the background and does not require user interaction.

[0074] Step 3:

[0075] The device will upload the new photo data.

[0076] The device detects new photos in the photo gallery and uploads them to the cloud server, including metadata such as the date and time the photo was taken and GPS information.

[0077] Step 4:

[0078] The server receives the photo data.

[0079] The cloud server receives the photo data sent from the terminal and stores it in a temporary storage area.

[0080] Step 5:

[0081] The server's AI module analyzes the photo.

[0082] The AI ​​module in the server analyzes the received photo data. The AI ​​evaluates the similarity of each photo and detects screenshots and rapid-fire photos. Specifically, the AI ​​compares pixel patterns and metadata of the images and groups unwanted photos using cluster analysis.

[0083] Step 6:

[0084] The server's AI module identifies unnecessary photos.

[0085] The AI ​​uses different criteria (e.g. similarity, image quality, metadata) to select the best photo from multiple photos and discard the rest, taking into account the user's custom settings.

[0086] Step 7:

[0087] The server generates a list of unwanted photos.

[0088] The AI ​​generates a list of unwanted photos on the server, which includes photos to be deleted and their associated metadata.

[0089] Step 8:

[0090] The server sends a deletion instruction to the terminal.

[0091] The server sends a deletion command to the device based on the list of unnecessary photos, including the ID and location information of the specific photo data.

[0092] Step 9:

[0093] The terminal receives the deletion instruction.

[0094] The device receives the deletion instruction from the cloud server and automatically deletes the photo from the photo gallery without user intervention.

[0095] Step 10:

[0096] Your device will move the deleted photos to a temporary storage location.

[0097] The device will move the deleted photo data to a temporary storage area, where it will be stored for a certain period of time and can be restored by the user if necessary.

[0098] Step 11:

[0099] The user checks the list of deleted photos.

[0100] When a user opens the "Clean Data Box" app, they are presented with a list of deleted photos, including thumbnails of the photos and the date and time of their deletion.

[0101] Step 12:

[0102] Users can restore photos as needed.

[0103] When the user selects the photos they want to restore from the deleted list and presses the restore button, the photo data is resent from the cloud server and relocated to the device's photo gallery.

[0104] This series of steps allows users to efficiently manage their smartphone storage, saving only the important photos without cluttering it with unnecessary ones.

[0105] Example 1

[0106] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0107] Since smartphones have limited storage capacity, it is necessary to efficiently manage storage and reduce the time and effort required for users to manually organize unnecessary photos. It is also important to reduce the risk of accidentally deleting important photos.

[0108] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0109] In this invention, the server includes a means for transmitting photo data from the terminal to the cloud server, a means for the cloud server to receive the photo data and analyze the photos using an AI module, and a means for the AI ​​module to identify unnecessary photos based on the photo content and metadata, thereby enabling automatic deletion of unnecessary photo data and simplifying recovery by the user.

[0110] "Terminal" refers to a mobile device owned by a user, such as a smartphone or tablet.

[0111] A "cloud server" refers to a server system that stores and processes data remotely via the Internet.

[0112] "Photo data" refers to image data taken by a user and associated metadata (e.g., date and time of photo, GPS information, etc.).

[0113] "AI module" refers to a software component that uses artificial intelligence to analyze photo data and identify unnecessary photos.

[0114] "Metadata" refers to auxiliary information that accompanies photo data (e.g., photo date and time, GPS information, etc.).

[0115] "Unnecessary photos" refers to photo data that has been determined to be unnecessary for the user based on the analysis results of the AI ​​module.

[0116] The "deletion instruction" refers to instruction information sent by the cloud server to the terminal to delete unnecessary photos.

[0117] "Temporary storage location" refers to a storage area where deleted photo data is stored for a certain period of time (e.g., three months) so that users can recover it.

[0118] "Recovery" refers to the action of a user returning deleted photo data stored in a temporary storage location to the device's photo gallery.

[0119] "Synchronization means" refers to a function that enables a terminal to periodically synchronize data with a cloud server.

[0120] "Similarity analysis" refers to the process by which an AI module evaluates the degree of image correspondence and similarity between multiple photo data.

[0121] "Screenshot detection" refers to the process by which an AI module automatically identifies screenshots from photo data.

[0122] "Best selection of burst photos" refers to the process in which the AI ​​module selects the best photo from a series of photos.

[0123] "Application" refers to a software program that a user can run on a smartphone or tablet.

[0124] "Deleted photo list" refers to a list that can be used by a user to check deleted photo data and restore them.

[0125] The present invention is a system for efficiently managing smartphone storage capacity. In this system, the device sends photo data to a cloud server, and an AI module on the cloud server identifies unnecessary photos and automatically deletes them. A specific embodiment of this system is described below.

[0126] System hardware and software configuration

[0127] Device: A mobile device such as a smartphone or tablet on which the "Photo Uploader" and "Clean Data Box" apps will be installed.

[0128] Cloud server: A server system that stores and processes data remotely and is equipped with AI modules.

[0129] AI module: A software component deployed on a cloud server that performs image analysis and identifies unnecessary photos.

[0130] Example of operation

[0131] 1. Sending photo data from the device to the cloud server

[0132] When a user takes a photo with their smartphone, the photo data is saved in the device's photo gallery.

[0133] The device's "Photo Uploader" app automatically uploads newly taken photos to the cloud server at regular intervals, along with any metadata associated with the photos (e.g., photo date and time, GPS information, etc.).

[0134] 2. Receiving and analyzing photo data on the cloud server

[0135] The cloud server stores the received photo data in a temporary storage area.

[0136] An AI module on the cloud server analyzes the received photo data, using algorithms to analyze image similarities, detect screenshots, and select the best photo from a series of photos.

[0137] For example, if 10 photos of a night view are taken, the AI ​​will keep only the one it judges to be of the best quality and determine the other nine as unnecessary.

[0138] 3. Instructions for deleting unnecessary photos and how to respond

[0139] The AI ​​module generates a list of photos that it determines are unnecessary, and the cloud server sends a deletion instruction to the device.

[0140] The cloud server does not immediately delete the identified unnecessary photos, but stores them in a temporary storage area for a certain period of time (e.g., three months) so that users can restore the deleted photos.

[0141] 4. Delete unwanted photos on your device and recover them with options

[0142] The device receives a deletion instruction from the cloud server and deletes the corresponding unnecessary photos from the photo gallery.

[0143] Deleted photo data is moved to a temporary storage area on the device, and users can recover deleted photos within three months through the "Clean Data Box" app.

[0144] When a user opens the "Clean Data Box" app, a list of deleted photos is displayed, and the user can select the photos they need and restore them. For example, they can use the "Clean Data Box" app to check photos taken during a trip and restore one that was accidentally deleted.

[0145] This process allows users to efficiently manage their smartphone storage space, eliminates the need for manual organizing by automatically deleting unnecessary photos, and reduces the risk of accidentally deleting important photos.

[0146] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0147] Step 1:

[0148] The device sends the photo data to the cloud server.

[0149] Details: When a user takes a photo with their smartphone, the photo data is saved in the photo gallery. The device's "Photo Uploader" app periodically uploads this saved photo data and metadata (such as the date and time of the photo, GPS information, etc.) to a cloud server.

[0150] Input: Photo data and metadata taken by the user on the device

[0151] Output: Photo data uploaded to the cloud server

[0152] Step 2:

[0153] The cloud server receives the photo data and stores it in a temporary storage area.

[0154] Details: The cloud server receives new photo data sent from the device and stores it in a temporary storage area. At that time, the metadata is also stored in the temporary storage area along with the photo data.

[0155] Input: Photo data and metadata sent from the device

[0156] Output: Photo data stored in temporary storage area

[0157] Step 3:

[0158] The AI ​​module on the cloud server analyzes the received photo data and identifies unnecessary photos.

[0159] Details: An AI module on a cloud server analyzes photo data using algorithms that analyze image similarity, detect screenshots, and select the best shot from a series of photos. Based on this, it identifies unwanted photos and generates a list of them.

[0160] Input: Photo data and metadata stored in temporary storage area

[0161] Output: A list of unwanted photos

[0162] Step 4:

[0163] The cloud server sends a deletion instruction to the terminal based on a list of photos that have been determined to be unnecessary.

[0164] Details: After the cloud server generates a list of unnecessary photos, it sends a deletion instruction to the device based on that list. This deletion instruction includes information about the specific photo data.

[0165] Input: A list of unwanted photos

[0166] Output: Delete instructions to the terminal

[0167] Step 5:

[0168] The terminal receives a deletion instruction from the cloud server and deletes unnecessary photos from the photo gallery.

[0169] Details: When the device receives a deletion command, it deletes the target photo data from the device's photo gallery. The deleted photo data is moved to the device's temporary storage area.

[0170] Input: Deletion instructions from cloud server

[0171] Output: Deleted photos from Photo Gallery and moved to temporary storage area

[0172] Step 6:

[0173] Users can use the "Clean Data Box" app to check deleted photos and restore them if necessary.

[0174] Details: When a user opens the "Clean Data Box" app, a list of deleted photos is displayed. The user selects the photos they need from the list and presses the restore button, which places them back in the photo gallery.

[0175] Input: Deleted photo data stored in temporary storage area

[0176] Output: Recovered photos in Photo Gallery

[0177] (Application example 1)

[0178] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0179] In order to streamline inventory management and picking operations at logistics centers, it is important to efficiently manage photo data of inventory items taken by workers. However, the storage capacity of smart glasses and other devices is limited, and the accumulation of unnecessary photos can hinder speedy work. Another problem is that blurry or duplicate photos make it difficult to grasp accurate inventory information. To solve these issues, a system is needed that manages photo data in the cloud and automatically identifies and deletes unnecessary photos.

[0180] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0181] In this invention, the server includes: means for transmitting photo data and metadata from the terminal to the cloud server; means for the cloud server to receive the photo data and metadata and analyze the photos using an AI module; means for the AI ​​module to identify unnecessary photos based on the photo content and metadata; means for deleting unnecessary photos from the cloud server; means for the cloud server to send a delete instruction to the terminal for the identified unnecessary photos; means for the terminal to delete the unnecessary photos based on the delete instruction; means for the warehouse management eyeglass terminal to send inventory photo data to the cloud server; means for the cloud server to receive the inventory photo data and identify and delete unnecessary photos using the AI ​​module; and means for the terminal to move the deleted photos to a temporary storage location so that the user can restore them within a certain period of time. This enables more efficient inventory management and picking work and optimal management of storage capacity.

[0182] "Terminal" refers to eyeglass terminals and other devices worn by workers at logistics centers.

[0183] A "cloud server" refers to a server system that connects to devices via the Internet and receives and sends photo data and metadata.

[0184] "Photo data" refers to image information captured by the device's camera.

[0185] "Metadata" refers to supplementary information such as the date and time of the photo being taken and the shelf number that accompanies the photo data.

[0186] "AI module" refers to an artificial intelligence algorithm or program that analyzes photo data and metadata on a cloud server and identifies unnecessary photos.

[0187] "Unnecessary photos" refer to photos that, after analysis, have been determined not to need to be saved, such as duplicate images or blurry images.

[0188] A "deletion instruction" refers to a command from the cloud server to the terminal prompting the terminal to delete unnecessary photos.

[0189] "Deleted photos" refers to photo data that has been determined to be unnecessary on the cloud server and on the device and has been deleted.

[0190] "Temporary storage location" refers to a location where deleted photos are stored for a certain period of time, and indicates an area where users can recover photos that have been accidentally deleted.

[0191] An "eyeglass terminal for warehouse management" refers to an eyeglass-type device equipped with a camera and communication functions that is used for inventory management and picking operations at logistics centers.

[0192] This invention is a system for improving the efficiency of inventory management and picking work at logistics centers. This system sends photo data of inventory items taken by eyeglass-type devices worn by workers to a cloud server, and an AI module on the server identifies unnecessary photos and automatically deletes them. Details of the program processing of this system and specific examples are described below.

[0193] System configuration

[0194] The system mainly uses the following hardware and software:

[0195] Hardware: Glasses-type device and cloud server

[0196] Software: Smart inventory management app with image analysis AI module, cloud storage, deletion instruction program, and recovery options

[0197] Program processing description

[0198] 1. Sending photo data and metadata from your device

[0199] A worker wears a glasses-type device and takes photos of inventory items. The device periodically connects to a cloud server and transmits the captured photo data and metadata (e.g., photo date and time, shelf number, etc.).

[0200] 2. Data reception and analysis on the cloud server

[0201] The cloud server receives the photo data and metadata and stores them in a temporary storage area. An AI module on the server analyzes the data and identifies unwanted photos. The criteria include similarity analysis, blur detection, and a duplicate photo removal algorithm.

[0202] 3. Instructions for deleting unnecessary photos and their execution

[0203] The cloud server creates a list of unnecessary photos and sends a deletion instruction to the device, which then deletes the unnecessary photos from the device based on this instruction.

[0204] 4. Temporarily save and restore photo data

[0205] The deleted photo data will be moved to a temporary storage location on the device. Users can use the "Smart Inventory Management App" to check the list of deleted photos and restore them within a certain period of time if necessary.

[0206] Specific examples

[0207] 1. Inventory taking by workers

[0208] When workers take inventory, they often take many photos of inventory items using eyeglasses, and sometimes they take multiple photos of inventory items on the same shelf.

[0209] 2. Data transmission and AI analysis

[0210] During or after a photo is taken, the glasses connect to a cloud server and upload the new photo data and metadata. An AI module on the server analyzes this data, identifying similar or unclear photos and deciding they are unnecessary.

[0211] 3. Instructions for deleting unnecessary photos

[0212] The AI ​​module creates a list of photos that it has determined are unnecessary, and the cloud server sends deletion instructions to the device. The device then deletes the photos in accordance with the received instructions.

[0213] 4. Recovery operations by the user

[0214] Users can open the "Smart Inventory Management App" to check the list of deleted photos, and within a certain period of time, they can select and relocate the photos they need.

[0215] Prompt Sentence Examples

[0216] Design a system in which workers at a logistics center use smart glasses to manage inventory. The smart glasses take photos of inventory items and send the images to a cloud server, where AI on the server automatically deletes and manages unnecessary images, optimizing storage capacity. Please also explain the hardware (smart glasses, cloud server) and software (image analysis AI, smart inventory management app) used.

[0217] In this way, the present invention makes it possible to improve the efficiency of inventory management in a logistics center and to optimally manage the storage capacity of terminals.

[0218] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0219] Step 1:

[0220] The terminal takes and acquires photographic data and metadata of inventory items. The input is the image taken by the worker with the camera on the eyeglass terminal and the metadata associated with the image (e.g., date and time of photo, shelf number). The terminal stores this photographed data.

[0221] Step 2:

[0222] The device periodically connects to the cloud server and uploads the captured photo data and metadata. The input is the photo data and metadata stored in the device. The data is then sent from the device to the cloud server.

[0223] Step 3:

[0224] The cloud server receives the photo data and metadata and stores them in a temporary storage area. The input is the photo data and metadata sent from the device. The server saves them in a temporary storage location.

[0225] Step 4:

[0226] The AI ​​module on the cloud server analyzes the received photo data and metadata. The input is the photo data and metadata stored in the temporary storage area. The AI ​​module uses an image recognition algorithm to analyze the content of the photo and performs data processing and calculations to identify unnecessary photos.

[0227] Step 5:

[0228] The AI ​​module identifies unwanted photos and generates a list of them. The output is a list of unwanted photos. The AI ​​module performs similarity analysis and blur detection, and lists the identified unwanted photos.

[0229] Step 6:

[0230] The cloud server sends deletion instructions to the device based on the list of unnecessary photos. The input is the list of unnecessary photos generated by the AI ​​module. The server sends instructions to the device to delete unnecessary photos based on this list.

[0231] Step 7:

[0232] The device receives a deletion instruction from the cloud server and deletes the corresponding unnecessary photos from the device. The input is the deletion instruction sent from the cloud server. The device follows this instruction and deletes the unnecessary photos.

[0233] Step 8:

[0234] The deleted photo data is moved to a temporary storage location on the device. The input is the photo data deleted based on the deletion instruction. The device moves this to a temporary storage area and stores it in this area for a certain period of time.

[0235] Step 9:

[0236] The user opens the "Smart Inventory Management App" to see a list of deleted photos. The input is the list of deleted photos in the temporary storage area. The app displays this to the user.

[0237] Step 10:

[0238] The user selects the photos they need and performs the recovery operation. The input is the photos the user selected in the app. The app recovers the selected photo data and saves it back to the device's main storage.

[0239] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0240] This invention relates to a system for efficiently managing smartphone storage capacity. In particular, by combining it with an emotion engine that recognizes user emotions, it provides a method for more accurately determining the value of photos and automatically deleting unnecessary photos. An example of this system is described in detail below, with a program process explained in natural language and specific examples included.

[0241] Explanation of program processing

[0242] 1. Send photo data from your device

[0243] When a user takes a photo using the camera app on their smartphone, the photo data is saved in the device's photo gallery. The device periodically connects to the cloud server and uploads the latest photo data to the server. At this time, metadata associated with the photo (e.g., the date and time the photo was taken, GPS information, etc.) is also sent.

[0244] 2. Emotion Engine Data Collection

[0245] When taking a photo, the emotion engine analyzes the user's facial expressions and voice to generate emotion data, including emotions such as "smile," "surprise," "dissatisfaction," and "sadness."

[0246] 3. Receiving and analyzing data on the server

[0247] The cloud server receives the photo data and emotion data sent from the terminal and stores them in a temporary storage area.

[0248] The AI ​​module analyzes the received photo data and emotional data, and evaluates the importance of each photo based on the content of the photo and the user's emotional data.

[0249] 4. Identify unwanted photos

[0250] The AI ​​module identifies unwanted photos based on both the content and emotional data of the photo. For example, photos in which the user expressed negative emotions when taking the photo will be prioritized as unwanted.

[0251] 5. Generating removal instructions

[0252] The AI ​​module on the cloud server generates a list of photos that it has determined are unnecessary and sends a deletion instruction to the device, which includes the ID and location information of the photo data.

[0253] 6. Deleting photos on your device

[0254] The device receives the deletion command from the cloud server and deletes the photo from the photo gallery. The deleted photo is moved to a temporary storage area on the device.

[0255] 7. User Verification and Recovery

[0256] When a user opens the "Clean Data Box" app, a list of deleted photos is displayed. The user can select a specific photo from this list and press the restore button, which will place the photo back in the photo gallery.

[0257] Specific examples

[0258] 1. Users take lots of photos while traveling

[0259] When a user takes many photos with their smartphone while traveling, the emotion engine analyzes the user's facial expressions and voice and tags them with positive emotions (e.g., smiling) or negative emotions (e.g., dissatisfaction).

[0260] 2. Send data from the device to the server

[0261] After returning home from a trip, the device automatically connects to the cloud server and uploads new photo data and corresponding emotion data.

[0262] 3. AI analysis on a cloud server

[0263] Based on the photo data received by the cloud server, the AI ​​module analyzes the emotional data and image content. Among multiple photos of the same scene taken from slightly different angles, photos in which the user is smiling are prioritized and saved, while other photos are deemed unnecessary.

[0264] 4. Instructions for deleting unnecessary photos

[0265] The cloud server generates a list of photos that are deemed unnecessary and sends a deletion instruction to the device, which then receives the instruction and deletes the photos from its photo gallery.

[0266] 5. User can check and recover photos in the app

[0267] When a user opens the "Clean Data Box" app, a list of deleted photos is displayed. From this list, the user can select a specific photo and press the restore button to restore it to the photo gallery.

[0268] This embodiment allows users to efficiently manage smartphone storage by effectively saving only high-quality photos and automatically deleting unnecessary photos. In addition, by combining emotion data, photo management can be more in line with the user's intentions.

[0269] The processing flow will be explained below.

[0270] Step 1:

[0271] A user takes a photo with their smartphone.

[0272] When a user takes a photo using the camera app, the photo data is automatically saved to the device's photo gallery. The emotion engine immediately starts working, analyzing the user's facial expressions and voice to generate emotion data. This emotion data includes information such as "smile" or "sadness."

[0273] Step 2:

[0274] The device connects to the cloud server.

[0275] The device automatically connects to the cloud server at regular intervals to check the latest synchronization status.

[0276] Step 3:

[0277] The device uploads new photo data and emotion data.

[0278] The device detects new photos in the photo gallery and the corresponding emotion data, and uploads them to the cloud server, including metadata such as the date and time of the photo and GPS information.

[0279] Step 4:

[0280] The server receives the photo data.

[0281] The cloud server receives the photo data and emotion data sent from the terminal and stores them in a temporary storage area.

[0282] Step 5:

[0283] The server's AI module analyzes the photo.

[0284] The AI ​​module on the server analyzes the received photo data and emotional data. The AI ​​evaluates the similarity of each photo and detects screenshots and rapid-fire photos. Based on the emotional data, it prioritizes saving photos that show positive emotions.

[0285] Step 6:

[0286] The server's AI module identifies unnecessary photos.

[0287] AI uses image similarity assessments, metadata, and emotional data to identify unwanted photos. For example, it will keep photos in which the user is smiling, but discard photos that show negative emotions or photos with nearly identical content.

[0288] Step 7:

[0289] The server generates a list of unwanted photos.

[0290] The AI ​​generates a list of unwanted photos on the server, which includes photos to be deleted and their associated metadata.

[0291] Step 8:

[0292] The server sends a deletion instruction to the terminal.

[0293] The server sends a deletion command to the device based on the list of unnecessary photos, including the ID and location information of the specific photo data.

[0294] Step 9:

[0295] The terminal receives the deletion instruction.

[0296] The device receives the deletion instruction from the cloud server and automatically deletes the photo from the photo gallery without user intervention.

[0297] Step 10:

[0298] Your device will move the deleted photos to a temporary storage location.

[0299] The device will move the deleted photo data to a temporary storage area, where it will be stored for a certain period of time and can be restored by the user if necessary.

[0300] Step 11:

[0301] The user checks the list of deleted photos.

[0302] When a user opens the "Clean Data Box" app, they are presented with a list of deleted photos, including thumbnails of the photos and the date and time of their deletion.

[0303] Step 12:

[0304] Users can restore photos as needed.

[0305] When the user selects the photos they want to restore from the deleted list and presses the restore button, the photo data is resent from the cloud server and relocated to the device's photo gallery.

[0306] This series of steps allows users to efficiently manage their smartphone storage and leverage emotional data to identify and retain important photos.

[0307] Example 2

[0308] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0309] Conventional smartphone storage management systems have had difficulty automatically determining the value of photos and efficiently deleting unnecessary ones. In particular, methods for determining unnecessary photos that rely on simple metadata or image analysis without considering the user's intentions or emotions tend to result in unintended deletion of photos. Furthermore, managing unnecessary photos is a time-consuming task for users, resulting in wasteful storage.

[0310] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0311] In this invention, the server includes a means for transmitting photo data from the terminal to the cloud server, a means for the cloud server to receive the photo data and generate emotion data using an emotion engine, and a means for the cloud server to analyze the photo data and emotion data using an AI module. This makes it possible to comprehensively evaluate the content, metadata, and emotion data of photos and identify and delete unnecessary photos. This allows for efficient storage management in line with the user's intentions and reduces the effort required to delete unnecessary photos.

[0312] "Terminal" refers to a portable communication device such as a smartphone or tablet.

[0313] "Cloud server" refers to a remote server for storing and managing data via the Internet.

[0314] "Photo data" refers to digital data of still images taken with a smartphone or tablet.

[0315] An "emotion engine" is a software module that analyzes a user's facial expressions and voice to estimate their emotional state at that time.

[0316] "Emotion Data" refers to digital data that indicates the user's emotional state as analyzed by the emotion engine.

[0317] "AI module" refers to a software component that uses artificial intelligence technology to analyze photo data and emotional data and make specific decisions.

[0318] "Metadata" refers to information that accompanies photo data, such as the date and time the photo was taken and GPS information.

[0319] "Unnecessary photos" refer to photo data that is determined to be of low importance to the user.

[0320] A "delete instruction" refers to a digital signal sent from the cloud server to a device instructing it to delete a specific photo.

[0321] "Temporary storage location" refers to the area where deleted photo data is temporarily stored on the device.

[0322] This invention relates to a system that allows users to send photo data taken using devices such as smartphones and tablets to a cloud server, and automatically evaluates and determines the value of the photos using an AI module and emotion engine.

[0323] System Configuration

[0324] The system consists of a terminal, a cloud server, and various software components such as an AI module, an emotion engine, a photo gallery app, and a "Clean Data Box" app.

[0325] The device is installed with a camera app for taking photos and saving them to a photo gallery, and software including an emotion engine. The cloud server is equipped with an AI module for analyzing photo data and emotion data. The cloud server also has a function to set up a temporary storage area for each user and temporarily store deleted photo data.

[0326] Data transmission and analysis

[0327] When a user takes a photo using their smartphone's camera app, the photo data and its metadata (such as the date and time of the photo and GPS information) are saved in the device's photo gallery. The emotion engine analyzes the user's facial expressions and voice when the photo is taken, generates emotion data, and saves it on the device. The device then periodically connects to the cloud server to upload new photo data and emotion data.

[0328] Once the cloud server receives this data, it stores it in a temporary storage area. Next, the AI ​​module analyzes the photo's content, metadata, and emotional data to evaluate and determine the importance of each photo. By taking into account the emotions expressed by the user when taking the photo (e.g., smile, surprise, dissatisfaction, etc.), the value of the photo can be determined more accurately.

[0329] Identify and delete unwanted photos

[0330] Once the AI ​​module identifies unnecessary photos based on their content and emotional data, the cloud server creates a list and sends deletion instructions to the device. The device then deletes the photos from the photo gallery and places them in a temporary storage area, allowing users to restore the deleted photos within a certain period of time.

[0331] When users open the "Clean Data Box" app, a list of deleted photos is displayed and they can select specific photos to restore, making it easy to recover photos that have been accidentally deleted.

[0332] Specific examples

[0333] When a user takes many photos with their smartphone while traveling, the emotion engine analyzes the user's facial expressions and voice to generate emotion data such as "smile," "surprise," or "dissatisfaction." After returning home, the device automatically connects to the cloud server and uploads new photo data and emotion data. The cloud server's AI module analyzes this data, identifies unnecessary photos, and sends deletion instructions to the device. Based on the deletion instructions, the device deletes the photos from the photo gallery and moves them to a temporary storage area. The user can use the "Clean Data Box" app to check the deleted photos and restore them if necessary.

[0334] Prompt Sentence Examples

[0335] "Please explain in detail each processing step of a system that automatically identifies and deletes unnecessary photos in order to efficiently manage the storage of the many photos taken on a smartphone while traveling. Please also include a method for using an emotion engine to recognize the user's emotions and evaluate the value of the photos based on that information."

[0336] This system allows users to efficiently manage smartphone storage capacity by effectively saving only high-quality photos and automatically deleting unnecessary photos. By combining this with emotional data, photo management can be achieved in line with the user's intentions.

[0337] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0338] Step 1:

[0339] Send photo data from your device

[0340] Device: A user takes a photo using the smartphone's camera app. At this time, the captured photo data is automatically saved in the device's photo gallery. The device then periodically connects to the cloud server and uploads the latest photo data in the photo gallery to the cloud server.

[0341] Input: Photo data (and metadata) stored in the photo gallery

[0342] Output: Sending photo data and metadata to a cloud server

[0343] What it does: The photo gallery app runs in the background and automatically detects new photos when connected to Wi-Fi and uploads them to the cloud server.

[0344] Step 2:

[0345] Generating emotion data

[0346] On device: When a photo is taken, the emotion engine analyzes the user's facial expressions and voice to generate emotion data, which is linked to the photo and stored on the device.

[0347] Input: User's facial expressions, voice, and photo data

[0348] Output: Generated emotion data (e.g., smile, surprise, dissatisfaction, etc.)

[0349] Specific operation: The camera app works in conjunction with the emotion engine to analyze the user's facial recognition and voice data in real time and generate data with emotion labels.

[0350] Step 3:

[0351] Data reception and analysis on the server

[0352] Server: The cloud server receives the photo data and emotion data sent from the device and stores them in a temporary storage area.The AI ​​module then analyzes the photo content, metadata, and emotion data.

[0353] Input: Photo data, metadata, and emotion data uploaded to the cloud server.

[0354] Output: Analysis results (importance rating for each photo)

[0355] Specific operation: The cloud server stores all received data immediately after receiving it, and then the AI ​​module analyzes the photos and emotion data in batch processing to evaluate their importance.

[0356] Step 4:

[0357] Identifying unwanted photos

[0358] Server: The AI ​​module determines unnecessary photos based on the evaluation results. For example, photos with low evaluations (photos with negative emotions, similar photos, etc.) are determined to be unnecessary.

[0359] Input: AI photo evaluation results

[0360] Output: A list of unwanted photos

[0361] How it works: The AI ​​module generates a score for each photo and creates a list of unwanted photos based on that score.

[0362] Step 5:

[0363] Generate removal instructions

[0364] Server: The cloud server generates and sends deletion instructions to the device based on the list of unnecessary photos identified.

[0365] Input: List of unwanted photos

[0366] Output: Delete instructions (including photo ID and location information)

[0367] Specific operation: The cloud server generates a deletion instruction including the photo ID and location information and sends it to the device.

[0368] Step 6:

[0369] Deleting photos on your device

[0370] Device: Based on the deletion instruction received by the device, the device will delete the target photos from the photo gallery. The deleted photos will be moved to a temporary storage location.

[0371] Input: Delete instruction received from the cloud server

[0372] Output: Deleted photo data, moved to temporary storage area

[0373] Specific operation: The photo gallery app receives the deletion command, deletes the specified photo, and moves it to a temporary storage area.

[0374] Step 7:

[0375] User confirmation and recovery

[0376] User: When the user opens the "Clean Data Box" app, a list of deleted photos will be displayed. The user can select a specific photo from this list and press the restore button to restore the photo to the photo gallery.

[0377] Input: list of deleted photos

[0378] Output: Recovered photos in Photo Gallery

[0379] Specific behavior: The user operates the app to check the deleted photos and taps the restore button to return the selected photos to the photo gallery.

[0380] (Application example 2)

[0381] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0382] Conventional smartphone storage management systems place a burden on users to identify and delete unnecessary photos, making efficient management difficult. Furthermore, the subjective value judgment of photos is also dependent on the user, making it difficult to organize photos appropriately. To address this issue, a method is needed to utilize user emotional data and automate photo evaluation.

[0383] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for transmitting photo data from the terminal to the cloud server; means for the cloud server to receive the photo data and analyze the photos using an AI module; means for the AI ​​module to identify unnecessary photos based on the photo content and metadata; means for deleting unnecessary photos from the cloud server; means for the cloud server to send a delete instruction to the terminal for the identified unnecessary photos; means for the terminal to delete the unnecessary photos from the terminal based on the delete instruction; means for the terminal to move the deleted photos to a temporary storage location so that the user can restore them within a certain period of time; means for the cloud server to evaluate the photo data using an emotion engine that analyzes the user's emotions; and means for the AI ​​module to evaluate the photos based on the user's emotion data and execute a recommendation algorithm. This allows photos to be automatically organized and evaluated based on the user's emotion data, enabling more efficient and intuitive storage management.

[0384] A "terminal" is a device operated by a user, which takes, saves, and transmits photo data.

[0385] A "cloud server" is a remote server that stores and analyzes data via the Internet, and is a computer system that receives and processes photo data and related information.

[0386] "Photo data" refers to digital data that includes image files taken by a user on a terminal and their metadata (such as the date and time of the photo, GPS information, etc.).

[0387] An "AI module" is a combination of software and hardware that uses artificial intelligence to analyze, evaluate, and learn from data.

[0388] The "emotion engine" is a system that analyzes emotions from a user's facial expressions and voice and generates the results as data.

[0389] "Metadata" refers to additional information included in photo data, and mainly includes the date and time of shooting, location information, camera setting information, and the like.

[0390] A "deletion instruction" is a signal that the cloud server issues to the terminal to instruct it to delete unnecessary photos.

[0391] The "temporary storage location" is a storage area that stores deleted photo data for a certain period of time so that the user can restore it if necessary.

[0392] A "recommendation algorithm" is a program that suggests appropriate content and products to users based on their past data and emotional data.

[0393] This invention is a system that efficiently manages smartphone photo data using an emotion engine that analyzes user emotions. In particular, in a food delivery application, it organizes and evaluates food photos and information based on the user's emotion data, and realizes a function to recommend the most suitable dishes to the user.

[0394] Hardware and software used

[0395] This system is realized mainly using the following hardware and software.

[0396] Smartphone (terminal): A device that allows users to take photos of food and collect emotion data.

[0397] Cloud server: A remote server for storing and analyzing data via the Internet, which receives and analyzes photo data and emotion data.

[0398] EmotionRecognizer module: Software for analyzing the user's facial expressions and recognizing emotions, built using TensorFlow and OpenCV.

[0399] RecommendationEngine module: Software for recommending appropriate dishes and restaurants based on users' past data and emotional data, developed using Scikit-learn and Pandas.

[0400] REST API: A communication method used to exchange data between a device and a cloud server.

[0401] Data processing and calculation procedures

[0402] The device collects photo data of food taken by the user and simultaneously generates emotion data from the user's facial expressions using an emotion engine. The photo data and emotion data are then uploaded to a cloud server. At this time, the generated emotion data and metadata (such as the date and time of the photo and information about the ordered food) are also sent.

[0403] The cloud server receives this data and stores it in a temporary storage area. The AI ​​module analyzes this data and rates the photos based on the user's emotional data and the content of the photos. As a result, the AI ​​module classifies highly rated food photos as "favorites" and identifies low-rated or unnecessary photos and marks them as candidates for deletion.

[0404] By running a recommendation algorithm, the system creates a list of the most suitable dishes and restaurants for the user and sends it to the device, taking into account the user's past emotional data and other users' evaluation data.

[0405] Specific examples

[0406] A user orders a pizza and takes a photo of themselves satisfied

[0407] A user orders a pizza, eats it, and then takes a photo with a satisfied expression. This photo is then uploaded to a cloud server along with a positive emotion (e.g., a smile).

[0408] Create a rating list based on emotion data on a cloud server

[0409] Photos and emotional data are analyzed on a cloud server, and dishes that users rate highly are automatically added to their "favorites."

[0410] User confirmation and next order

[0411] The next time users open the app, their "favorites" list will display dishes that they have previously rated highly, allowing them to refer to them the next time they order.

[0412] An example prompt would be, "Take a photo of a pizza and analyze the photo for satisfaction. If the emotion is positive, upload the data."

[0413] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0414] Step 1:

[0415] A user takes a photo of a dish with their smartphone. The smartphone (device) saves the captured photo data to its photo gallery. At the same time, the device also records the photo's metadata (date and time of the photo, GPS information, etc.). The input is the photo data and metadata, and the output is the saved photo file.

[0416] Step 2:

[0417] The device's emotion engine analyzes the user's facial expressions and voice while taking a photo. The device uses the emotion engine to generate emotion data. At this time, data collected using the smartphone's camera and microphone is the input, and the user's emotion data (e.g., satisfaction, surprise, dissatisfaction) is obtained as the output.

[0418] Step 3:

[0419] After a user takes a photo, the device periodically connects to the cloud server and uploads the latest photo data and corresponding emotion data to the cloud server. The input is the photo data, metadata, and emotion data, and the output is the data sent to the cloud server.

[0420] Step 4:

[0421] The cloud server receives the photo data and emotion data sent from the device and stores them in a temporary storage area. The server updates the database based on the stored photo data, metadata, and emotion data. The input is the various data sent, and the output is the data stored in the cloud storage.

[0422] Step 5:

[0423] The AI ​​module on the cloud server analyzes the received photo data and emotion data. The AI ​​module evaluates the importance of each photo based on the photo's content and emotion data. The input is the photo data and emotion data stored in the cloud, and the output is the analysis results (e.g., photo rating score and emotion tag).

[0424] Step 6:

[0425] The AI ​​module on the cloud server determines unnecessary photos based on the photo evaluation results. The server detects photos that users have indicated are unsatisfactory or are duplicates, and lists them for deletion. The input is the AI ​​evaluation results, and the output is a list of photos to delete.

[0426] Step 7:

[0427] The cloud server sends a deletion instruction to the device for the identified unnecessary photos. This deletion instruction includes the ID and location information of the photo data to be deleted. The input is a list of deletion candidates, and the output is the deletion instruction sent to the device.

[0428] Step 8:

[0429] The device receives a deletion command from the cloud server and deletes the corresponding photo from the photo gallery. The deleted photo is moved to a temporary storage area on the device. The input is the deletion command, and the output is the photo deleted from the gallery and moved to the temporary storage area.

[0430] Step 9:

[0431] When a user opens the "Clean Data Box" app, a list of deleted photos is displayed. The user can select a specific photo from this list and press the restore button to place the photo back in the photo gallery. The input is the list of deleted photos and the user's actions, and the output is the restored photo.

[0432] Step 10:

[0433] The recommendation algorithm on the cloud server uses the user's emotional data to create a list of the best dishes and restaurants for the next order and sends it to the device. The input is the user's emotional data and past order data, and the output is a list of recommended dishes and restaurants.

[0434] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0435] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0436] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0437] [Second embodiment]

[0438] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0439] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0440] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0441] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0442] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0443] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0444] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0445] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0446] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0447] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0448] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0449] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0450] This invention is a system for efficiently managing smartphone storage capacity. In this system, the device sends photo data to a cloud server, and an AI module on the cloud server identifies unnecessary photos and automatically deletes them. The following describes the details of the program processing of this system and a specific example.

[0451] Explanation of program processing

[0452] 1. Send photo data from your device

[0453] When a user takes a photo with their smartphone, the photo data is saved in the device's photo gallery.

[0454] The device periodically connects to the cloud server and uploads newly taken photos to the server, along with any metadata associated with the photos (e.g., photo date and time, GPS information, etc.).

[0455] 2. Receiving and analyzing photo data on the cloud server

[0456] The cloud server receives the photo data and stores it in a temporary storage area.

[0457] The AI ​​module on the server analyzes the received photo data and identifies unwanted photos based on content and metadata, including image similarity analysis, automatic screenshot detection, and algorithms to select the best photos from a series of photos.

[0458] 3. Instructions for deleting unnecessary photos

[0459] The AI ​​module generates a list of photos that it determines are unnecessary, and the cloud server uses this list to send deletion instructions to the device.

[0460] On the other hand, the cloud server temporarily stores photo data that is determined to be unnecessary for a certain period of time (e.g., three months) rather than immediately, allowing users to recover photos that have been accidentally deleted.

[0461] 4. Delete unnecessary photos on your device

[0462] The device receives a deletion instruction from the cloud server and deletes the corresponding unnecessary photos from the photo gallery.

[0463] Deleted photo data is moved to a temporary storage area on the device. By accessing this area, users can recover deleted photos within three months.

[0464] 5. User Verification and Recovery Options

[0465] When a user opens the "Clean Data Box" app, a list of deleted photos is displayed.

[0466] If the user wants to review the deleted photos and restore a specific photo, they can select it from this list and press the restore button to restore the photo to the device's photo gallery.

[0467] Specific examples

[0468] 1. Users take lots of photos while traveling

[0469] Users take many photos with their smartphones while traveling, and sometimes take multiple photos of the same scenery from slightly different angles.

[0470] 2. Send new photo data from the device to the server

[0471] After returning home from a trip, the device automatically connects to the cloud server and uploads new photo data, including all photos taken during the trip and their metadata.

[0472] 3. AI analysis on a cloud server

[0473] Based on the photo data received by the cloud server, AI analyzes the content of the photos and distinguishes between highly similar photos, unclear photos, accidentally taken screenshots, etc. For example, if 10 photos of a night view have been taken, the AI ​​will keep only the one it judges to be the best quality and discard the other nine.

[0474] 4. Instructions for deleting unnecessary photos

[0475] The cloud server generates a list of photos that are determined to be unnecessary, and based on this, sends an instruction to delete the photos to the terminal.

[0476] 5. The user can confirm the photo deletion in the app and restore it if necessary.

[0477] When users open the "Clean Data Box" app, they can see a list of deleted photos. They can then select the photos they need from this list and restore them to their photo gallery.

[0478] Through the above-described embodiment, the system can automatically delete unnecessary photos, effectively manage smartphone storage capacity, and save users the trouble of manually organizing photos, reducing the risk of losing important photos.

[0479] The processing flow will be explained below.

[0480] Step 1:

[0481] A user takes a photo with their smartphone.

[0482] When a user takes a photo using the camera app, the photo data is automatically saved to the device's photo gallery.

[0483] Step 2:

[0484] The device connects to the cloud server.

[0485] Your device periodically connects to the cloud server to check the latest synchronization status. This connection occurs in the background and does not require user interaction.

[0486] Step 3:

[0487] The device will upload the new photo data.

[0488] The device detects new photos in the photo gallery and uploads them to the cloud server, including metadata such as the date and time the photo was taken and GPS information.

[0489] Step 4:

[0490] The server receives the photo data.

[0491] The cloud server receives the photo data sent from the terminal and stores it in a temporary storage area.

[0492] Step 5:

[0493] The server's AI module analyzes the photo.

[0494] The AI ​​module in the server analyzes the received photo data. The AI ​​evaluates the similarity of each photo and detects screenshots and rapid-fire photos. Specifically, the AI ​​compares pixel patterns and metadata of the images and groups unwanted photos using cluster analysis.

[0495] Step 6:

[0496] The server's AI module identifies unnecessary photos.

[0497] The AI ​​uses different criteria (e.g. similarity, image quality, metadata) to select the best photo from multiple photos and discard the rest, taking into account the user's custom settings.

[0498] Step 7:

[0499] The server generates a list of unwanted photos.

[0500] The AI ​​generates a list of unwanted photos on the server, which includes photos to be deleted and their associated metadata.

[0501] Step 8:

[0502] The server sends a deletion instruction to the terminal.

[0503] The server sends a deletion command to the device based on the list of unnecessary photos, including the ID and location information of the specific photo data.

[0504] Step 9:

[0505] The terminal receives the deletion instruction.

[0506] The device receives the deletion instruction from the cloud server and automatically deletes the photo from the photo gallery without user intervention.

[0507] Step 10:

[0508] Your device will move the deleted photos to a temporary storage location.

[0509] The device will move the deleted photo data to a temporary storage area, where it will be stored for a certain period of time and can be restored by the user if necessary.

[0510] Step 11:

[0511] The user checks the list of deleted photos.

[0512] When a user opens the "Clean Data Box" app, they are presented with a list of deleted photos, including thumbnails of the photos and the date and time of their deletion.

[0513] Step 12:

[0514] Users can restore photos as needed.

[0515] When the user selects the photos they want to restore from the deleted list and presses the restore button, the photo data is resent from the cloud server and relocated to the device's photo gallery.

[0516] This series of steps allows users to efficiently manage their smartphone storage, saving only the important photos without cluttering it with unnecessary ones.

[0517] Example 1

[0518] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0519] Since smartphones have limited storage capacity, it is necessary to efficiently manage storage and reduce the time and effort required for users to manually organize unnecessary photos. It is also important to reduce the risk of accidentally deleting important photos.

[0520] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0521] In this invention, the server includes a means for transmitting photo data from the terminal to the cloud server, a means for the cloud server to receive the photo data and analyze the photos using an AI module, and a means for the AI ​​module to identify unnecessary photos based on the photo content and metadata, thereby enabling automatic deletion of unnecessary photo data and simplifying recovery by the user.

[0522] "Terminal" refers to a mobile device owned by a user, such as a smartphone or tablet.

[0523] A "cloud server" refers to a server system that stores and processes data remotely via the Internet.

[0524] "Photo data" refers to image data taken by a user and associated metadata (e.g., date and time of photo, GPS information, etc.).

[0525] "AI module" refers to a software component that uses artificial intelligence to analyze photo data and identify unnecessary photos.

[0526] "Metadata" refers to auxiliary information that accompanies photo data (e.g., photo date and time, GPS information, etc.).

[0527] "Unnecessary photos" refers to photo data that has been determined to be unnecessary for the user based on the analysis results of the AI ​​module.

[0528] The "deletion instruction" refers to instruction information sent by the cloud server to the terminal to delete unnecessary photos.

[0529] "Temporary storage location" refers to a storage area where deleted photo data is stored for a certain period of time (e.g., three months) so that users can recover it.

[0530] "Recovery" refers to the action of a user returning deleted photo data stored in a temporary storage location to the device's photo gallery.

[0531] "Synchronization means" refers to a function that enables a terminal to periodically synchronize data with a cloud server.

[0532] "Similarity analysis" refers to the process by which an AI module evaluates the degree of image correspondence and similarity between multiple photo data.

[0533] "Screenshot detection" refers to the process by which an AI module automatically identifies screenshots from photo data.

[0534] "Best selection of burst photos" refers to the process in which the AI ​​module selects the best photo from a series of photos.

[0535] "Application" refers to a software program that a user can run on a smartphone or tablet.

[0536] "Deleted photo list" refers to a list that can be used by a user to check deleted photo data and restore them.

[0537] The present invention is a system for efficiently managing smartphone storage capacity. In this system, the device sends photo data to a cloud server, and an AI module on the cloud server identifies unnecessary photos and automatically deletes them. A specific embodiment of this system is described below.

[0538] System hardware and software configuration

[0539] Device: A mobile device such as a smartphone or tablet on which the "Photo Uploader" and "Clean Data Box" apps will be installed.

[0540] Cloud server: A server system that stores and processes data remotely and is equipped with AI modules.

[0541] AI module: A software component deployed on a cloud server that performs image analysis and identifies unnecessary photos.

[0542] Example of operation

[0543] 1. Sending photo data from the device to the cloud server

[0544] When a user takes a photo with their smartphone, the photo data is saved in the device's photo gallery.

[0545] The device's "Photo Uploader" app automatically uploads newly taken photos to the cloud server at regular intervals, along with any metadata associated with the photos (e.g., photo date and time, GPS information, etc.).

[0546] 2. Receiving and analyzing photo data on the cloud server

[0547] The cloud server stores the received photo data in a temporary storage area.

[0548] An AI module on the cloud server analyzes the received photo data, using algorithms to analyze image similarities, detect screenshots, and select the best photo from a series of photos.

[0549] For example, if 10 photos of a night view are taken, the AI ​​will keep only the one it judges to be of the best quality and determine the other nine as unnecessary.

[0550] 3. Instructions for deleting unnecessary photos and how to respond

[0551] The AI ​​module generates a list of photos that it determines are unnecessary, and the cloud server sends a deletion instruction to the device.

[0552] The cloud server does not immediately delete the identified unnecessary photos, but stores them in a temporary storage area for a certain period of time (e.g., three months) so that users can restore the deleted photos.

[0553] 4. Delete unwanted photos on your device and recover them with options

[0554] The device receives a deletion instruction from the cloud server and deletes the corresponding unnecessary photos from the photo gallery.

[0555] Deleted photo data is moved to a temporary storage area on the device, and users can recover deleted photos within three months through the "Clean Data Box" app.

[0556] When a user opens the "Clean Data Box" app, a list of deleted photos is displayed, and the user can select the photos they need and restore them. For example, they can use the "Clean Data Box" app to check photos taken during a trip and restore one that was accidentally deleted.

[0557] This process allows users to efficiently manage their smartphone storage space, eliminates the need for manual organizing by automatically deleting unnecessary photos, and reduces the risk of accidentally deleting important photos.

[0558] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0559] Step 1:

[0560] The device sends the photo data to the cloud server.

[0561] Details: When a user takes a photo with their smartphone, the photo data is saved in the photo gallery. The device's "Photo Uploader" app periodically uploads this saved photo data and metadata (such as the date and time of the photo, GPS information, etc.) to a cloud server.

[0562] Input: Photo data and metadata taken by the user on the device

[0563] Output: Photo data uploaded to the cloud server

[0564] Step 2:

[0565] The cloud server receives the photo data and stores it in a temporary storage area.

[0566] Details: The cloud server receives new photo data sent from the device and stores it in a temporary storage area. At that time, the metadata is also stored in the temporary storage area along with the photo data.

[0567] Input: Photo data and metadata sent from the device

[0568] Output: Photo data stored in temporary storage area

[0569] Step 3:

[0570] The AI ​​module on the cloud server analyzes the received photo data and identifies unnecessary photos.

[0571] Details: An AI module on a cloud server analyzes photo data using algorithms that analyze image similarity, detect screenshots, and select the best shot from a series of photos. Based on this, it identifies unwanted photos and generates a list of them.

[0572] Input: Photo data and metadata stored in temporary storage area

[0573] Output: A list of unwanted photos

[0574] Step 4:

[0575] The cloud server sends a deletion instruction to the terminal based on a list of photos that have been determined to be unnecessary.

[0576] Details: After the cloud server generates a list of unnecessary photos, it sends a deletion instruction to the device based on that list. This deletion instruction includes information about the specific photo data.

[0577] Input: A list of unwanted photos

[0578] Output: Delete instructions to the terminal

[0579] Step 5:

[0580] The terminal receives a deletion instruction from the cloud server and deletes unnecessary photos from the photo gallery.

[0581] Details: When the device receives a deletion command, it deletes the target photo data from the device's photo gallery. The deleted photo data is moved to the device's temporary storage area.

[0582] Input: Deletion instructions from cloud server

[0583] Output: Deleted photos from Photo Gallery and moved to temporary storage area

[0584] Step 6:

[0585] Users can use the "Clean Data Box" app to check deleted photos and restore them if necessary.

[0586] Details: When a user opens the "Clean Data Box" app, a list of deleted photos is displayed. The user selects the photos they need from the list and presses the restore button, which places them back in the photo gallery.

[0587] Input: Deleted photo data stored in temporary storage area

[0588] Output: Recovered photos in Photo Gallery

[0589] (Application example 1)

[0590] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0591] In order to streamline inventory management and picking operations at logistics centers, it is important to efficiently manage photo data of inventory items taken by workers. However, the storage capacity of smart glasses and other devices is limited, and the accumulation of unnecessary photos can hinder speedy work. Another problem is that blurry or duplicate photos make it difficult to grasp accurate inventory information. To solve these issues, a system is needed that manages photo data in the cloud and automatically identifies and deletes unnecessary photos.

[0592] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0593] In this invention, the server includes: means for transmitting photo data and metadata from the terminal to the cloud server; means for the cloud server to receive the photo data and metadata and analyze the photos using an AI module; means for the AI ​​module to identify unnecessary photos based on the photo content and metadata; means for deleting unnecessary photos from the cloud server; means for the cloud server to send a delete instruction to the terminal for the identified unnecessary photos; means for the terminal to delete the unnecessary photos based on the delete instruction; means for the warehouse management eyeglass terminal to send inventory photo data to the cloud server; means for the cloud server to receive the inventory photo data and identify and delete unnecessary photos using the AI ​​module; and means for the terminal to move the deleted photos to a temporary storage location so that the user can restore them within a certain period of time. This enables more efficient inventory management and picking work and optimal management of storage capacity.

[0594] "Terminal" refers to eyeglass terminals and other devices worn by workers at logistics centers.

[0595] A "cloud server" refers to a server system that connects to devices via the Internet and receives and sends photo data and metadata.

[0596] "Photo data" refers to image information captured by the device's camera.

[0597] "Metadata" refers to supplementary information such as the date and time of the photo being taken and the shelf number that accompanies the photo data.

[0598] "AI module" refers to an artificial intelligence algorithm or program that analyzes photo data and metadata on a cloud server and identifies unnecessary photos.

[0599] "Unnecessary photos" refer to photos that, after analysis, have been determined not to need to be saved, such as duplicate images or blurry images.

[0600] A "deletion instruction" refers to a command from the cloud server to the terminal prompting the terminal to delete unnecessary photos.

[0601] "Deleted photos" refers to photo data that has been determined to be unnecessary on the cloud server and on the device and has been deleted.

[0602] "Temporary storage location" refers to a location where deleted photos are stored for a certain period of time, and indicates an area where users can recover photos that have been accidentally deleted.

[0603] An "eyeglass terminal for warehouse management" refers to an eyeglass-type device equipped with a camera and communication functions that is used for inventory management and picking operations at logistics centers.

[0604] This invention is a system for improving the efficiency of inventory management and picking work at logistics centers. This system sends photo data of inventory items taken by eyeglass-type devices worn by workers to a cloud server, and an AI module on the server identifies unnecessary photos and automatically deletes them. Details of the program processing of this system and specific examples are described below.

[0605] System configuration

[0606] The system mainly uses the following hardware and software:

[0607] Hardware: Glasses-type device and cloud server

[0608] Software: Smart inventory management app with image analysis AI module, cloud storage, deletion instruction program, and recovery options

[0609] Program processing description

[0610] 1. Sending photo data and metadata from your device

[0611] A worker wears a glasses-type device and takes photos of inventory items. The device periodically connects to a cloud server and transmits the captured photo data and metadata (e.g., photo date and time, shelf number, etc.).

[0612] 2. Data reception and analysis on the cloud server

[0613] The cloud server receives the photo data and metadata and stores them in a temporary storage area. An AI module on the server analyzes the data and identifies unwanted photos. The criteria include similarity analysis, blur detection, and a duplicate photo removal algorithm.

[0614] 3. Instructions for deleting unnecessary photos and their execution

[0615] The cloud server creates a list of unnecessary photos and sends a deletion instruction to the device, which then deletes the unnecessary photos from the device based on this instruction.

[0616] 4. Temporarily save and restore photo data

[0617] The deleted photo data will be moved to a temporary storage location on the device. Users can use the "Smart Inventory Management App" to check the list of deleted photos and restore them within a certain period of time if necessary.

[0618] Specific examples

[0619] 1. Inventory taking by workers

[0620] When workers take inventory, they often take many photos of inventory items using eyeglasses, and sometimes they take multiple photos of inventory items on the same shelf.

[0621] 2. Data transmission and AI analysis

[0622] During or after a photo is taken, the glasses connect to a cloud server and upload the new photo data and metadata. An AI module on the server analyzes this data, identifying similar or unclear photos and deciding they are unnecessary.

[0623] 3. Instructions for deleting unnecessary photos

[0624] The AI ​​module creates a list of photos that it has determined are unnecessary, and the cloud server sends deletion instructions to the device. The device then deletes the photos in accordance with the received instructions.

[0625] 4. Recovery operations by the user

[0626] Users can open the "Smart Inventory Management App" to check the list of deleted photos, and within a certain period of time, they can select and relocate the photos they need.

[0627] Prompt Sentence Examples

[0628] Design a system in which workers at a logistics center use smart glasses to manage inventory. The smart glasses take photos of inventory items and send the images to a cloud server, where AI on the server automatically deletes and manages unnecessary images, optimizing storage capacity. Please also explain the hardware (smart glasses, cloud server) and software (image analysis AI, smart inventory management app) used.

[0629] In this way, the present invention makes it possible to improve the efficiency of inventory management in a logistics center and to optimally manage the storage capacity of terminals.

[0630] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0631] Step 1:

[0632] The terminal takes and acquires photographic data and metadata of inventory items. The input is the image taken by the worker with the camera on the eyeglass terminal and the metadata associated with the image (e.g., date and time of photo, shelf number). The terminal stores this photographed data.

[0633] Step 2:

[0634] The device periodically connects to the cloud server and uploads the captured photo data and metadata. The input is the photo data and metadata stored in the device. The data is then sent from the device to the cloud server.

[0635] Step 3:

[0636] The cloud server receives the photo data and metadata and stores them in a temporary storage area. The input is the photo data and metadata sent from the device. The server saves them in a temporary storage location.

[0637] Step 4:

[0638] The AI ​​module on the cloud server analyzes the received photo data and metadata. The input is the photo data and metadata stored in the temporary storage area. The AI ​​module uses an image recognition algorithm to analyze the content of the photo and performs data processing and calculations to identify unnecessary photos.

[0639] Step 5:

[0640] The AI ​​module identifies unwanted photos and generates a list of them. The output is a list of unwanted photos. The AI ​​module performs similarity analysis and blur detection, and lists the identified unwanted photos.

[0641] Step 6:

[0642] The cloud server sends deletion instructions to the device based on the list of unnecessary photos. The input is the list of unnecessary photos generated by the AI ​​module. The server sends instructions to the device to delete unnecessary photos based on this list.

[0643] Step 7:

[0644] The device receives a deletion instruction from the cloud server and deletes the corresponding unnecessary photos from the device. The input is the deletion instruction sent from the cloud server. The device follows this instruction and deletes the unnecessary photos.

[0645] Step 8:

[0646] The deleted photo data is moved to a temporary storage location on the device. The input is the photo data deleted based on the deletion instruction. The device moves this to a temporary storage area and stores it in this area for a certain period of time.

[0647] Step 9:

[0648] The user opens the "Smart Inventory Management App" to see a list of deleted photos. The input is the list of deleted photos in the temporary storage area. The app displays this to the user.

[0649] Step 10:

[0650] The user selects the photos they need and performs the recovery operation. The input is the photos the user selected in the app. The app recovers the selected photo data and saves it back to the device's main storage.

[0651] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0652] This invention relates to a system for efficiently managing smartphone storage capacity. In particular, by combining it with an emotion engine that recognizes user emotions, it provides a method for more accurately determining the value of photos and automatically deleting unnecessary photos. An example of this system is described in detail below, with a program process explained in natural language and specific examples included.

[0653] Explanation of program processing

[0654] 1. Send photo data from your device

[0655] When a user takes a photo using the camera app on their smartphone, the photo data is saved in the device's photo gallery. The device periodically connects to the cloud server and uploads the latest photo data to the server. At this time, metadata associated with the photo (e.g., the date and time the photo was taken, GPS information, etc.) is also sent.

[0656] 2. Emotion Engine Data Collection

[0657] When taking a photo, the emotion engine analyzes the user's facial expressions and voice to generate emotion data, including emotions such as "smile," "surprise," "dissatisfaction," and "sadness."

[0658] 3. Receiving and analyzing data on the server

[0659] The cloud server receives the photo data and emotion data sent from the terminal and stores them in a temporary storage area.

[0660] The AI ​​module analyzes the received photo data and emotional data, and evaluates the importance of each photo based on the content of the photo and the user's emotional data.

[0661] 4. Identify unwanted photos

[0662] The AI ​​module identifies unwanted photos based on both the content and emotional data of the photo. For example, photos in which the user expressed negative emotions when taking the photo will be prioritized as unwanted.

[0663] 5. Generating removal instructions

[0664] The AI ​​module on the cloud server generates a list of photos that it has determined are unnecessary and sends a deletion instruction to the device, which includes the ID and location information of the photo data.

[0665] 6. Deleting photos on your device

[0666] The device receives the deletion command from the cloud server and deletes the photo from the photo gallery. The deleted photo is moved to a temporary storage area on the device.

[0667] 7. User Verification and Recovery

[0668] When a user opens the "Clean Data Box" app, a list of deleted photos is displayed. The user can select a specific photo from this list and press the restore button, which will place the photo back in the photo gallery.

[0669] Specific examples

[0670] 1. Users take lots of photos while traveling

[0671] When a user takes many photos with their smartphone while traveling, the emotion engine analyzes the user's facial expressions and voice and tags them with positive emotions (e.g., smiling) or negative emotions (e.g., dissatisfaction).

[0672] 2. Send data from the device to the server

[0673] After returning home from a trip, the device automatically connects to the cloud server and uploads new photo data and corresponding emotion data.

[0674] 3. AI analysis on a cloud server

[0675] Based on the photo data received by the cloud server, the AI ​​module analyzes the emotional data and image content. Among multiple photos of the same scene taken from slightly different angles, photos in which the user is smiling are prioritized and saved, while other photos are deemed unnecessary.

[0676] 4. Instructions for deleting unnecessary photos

[0677] The cloud server generates a list of photos that are deemed unnecessary and sends a deletion instruction to the device, which then receives the instruction and deletes the photos from its photo gallery.

[0678] 5. User can check and recover photos in the app

[0679] When a user opens the "Clean Data Box" app, a list of deleted photos is displayed. From this list, the user can select a specific photo and press the restore button to restore it to the photo gallery.

[0680] This embodiment allows users to efficiently manage smartphone storage by effectively saving only high-quality photos and automatically deleting unnecessary photos. In addition, by combining emotion data, photo management can be more in line with the user's intentions.

[0681] The processing flow will be explained below.

[0682] Step 1:

[0683] A user takes a photo with their smartphone.

[0684] When a user takes a photo using the camera app, the photo data is automatically saved to the device's photo gallery. The emotion engine immediately starts working, analyzing the user's facial expressions and voice to generate emotion data. This emotion data includes information such as "smile" or "sadness."

[0685] Step 2:

[0686] The device connects to the cloud server.

[0687] The device automatically connects to the cloud server at regular intervals to check the latest synchronization status.

[0688] Step 3:

[0689] The device uploads new photo data and emotion data.

[0690] The device detects new photos in the photo gallery and the corresponding emotion data, and uploads them to the cloud server, including metadata such as the date and time of the photo and GPS information.

[0691] Step 4:

[0692] The server receives the photo data.

[0693] The cloud server receives the photo data and emotion data sent from the terminal and stores them in a temporary storage area.

[0694] Step 5:

[0695] The server's AI module analyzes the photo.

[0696] The AI ​​module on the server analyzes the received photo data and emotional data. The AI ​​evaluates the similarity of each photo and detects screenshots and rapid-fire photos. Based on the emotional data, it prioritizes saving photos that show positive emotions.

[0697] Step 6:

[0698] The server's AI module identifies unnecessary photos.

[0699] AI uses image similarity assessments, metadata, and emotional data to identify unwanted photos. For example, it will keep photos in which the user is smiling, but discard photos that show negative emotions or photos with nearly identical content.

[0700] Step 7:

[0701] The server generates a list of unwanted photos.

[0702] The AI ​​generates a list of unwanted photos on the server, which includes photos to be deleted and their associated metadata.

[0703] Step 8:

[0704] The server sends a deletion instruction to the terminal.

[0705] The server sends a deletion command to the device based on the list of unnecessary photos, including the ID and location information of the specific photo data.

[0706] Step 9:

[0707] The terminal receives the deletion instruction.

[0708] The device receives the deletion instruction from the cloud server and automatically deletes the photo from the photo gallery without user intervention.

[0709] Step 10:

[0710] Your device will move the deleted photos to a temporary storage location.

[0711] The device will move the deleted photo data to a temporary storage area, where it will be stored for a certain period of time and can be restored by the user if necessary.

[0712] Step 11:

[0713] The user checks the list of deleted photos.

[0714] When a user opens the "Clean Data Box" app, they are presented with a list of deleted photos, including thumbnails of the photos and the date and time of their deletion.

[0715] Step 12:

[0716] Users can restore photos as needed.

[0717] When the user selects the photos they want to restore from the deleted list and presses the restore button, the photo data is resent from the cloud server and relocated to the device's photo gallery.

[0718] This series of steps allows users to efficiently manage their smartphone storage and leverage emotional data to identify and retain important photos.

[0719] Example 2

[0720] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0721] Conventional smartphone storage management systems have had difficulty automatically determining the value of photos and efficiently deleting unnecessary ones. In particular, methods for determining unnecessary photos that rely on simple metadata or image analysis without considering the user's intentions or emotions tend to result in unintended deletion of photos. Furthermore, managing unnecessary photos is a time-consuming task for users, resulting in wasteful storage.

[0722] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0723] In this invention, the server includes a means for transmitting photo data from the terminal to the cloud server, a means for the cloud server to receive the photo data and generate emotion data using an emotion engine, and a means for the cloud server to analyze the photo data and emotion data using an AI module. This makes it possible to comprehensively evaluate the content, metadata, and emotion data of photos and identify and delete unnecessary photos. This allows for efficient storage management in line with the user's intentions and reduces the effort required to delete unnecessary photos.

[0724] "Terminal" refers to a portable communication device such as a smartphone or tablet.

[0725] "Cloud server" refers to a remote server for storing and managing data via the Internet.

[0726] "Photo data" refers to digital data of still images taken with a smartphone or tablet.

[0727] An "emotion engine" is a software module that analyzes a user's facial expressions and voice to estimate their emotional state at that time.

[0728] "Emotion Data" refers to digital data that indicates the user's emotional state as analyzed by the emotion engine.

[0729] "AI module" refers to a software component that uses artificial intelligence technology to analyze photo data and emotional data and make specific decisions.

[0730] "Metadata" refers to information that accompanies photo data, such as the date and time the photo was taken and GPS information.

[0731] "Unnecessary photos" refer to photo data that is determined to be of low importance to the user.

[0732] A "delete instruction" refers to a digital signal sent from the cloud server to a device instructing it to delete a specific photo.

[0733] "Temporary storage location" refers to the area where deleted photo data is temporarily stored on the device.

[0734] This invention relates to a system that allows users to send photo data taken using devices such as smartphones and tablets to a cloud server, and automatically evaluates and determines the value of the photos using an AI module and emotion engine.

[0735] System Configuration

[0736] The system consists of a terminal, a cloud server, and various software components such as an AI module, an emotion engine, a photo gallery app, and a "Clean Data Box" app.

[0737] The device is installed with a camera app for taking photos and saving them to a photo gallery, and software including an emotion engine. The cloud server is equipped with an AI module for analyzing photo data and emotion data. The cloud server also has a function to set up a temporary storage area for each user and temporarily store deleted photo data.

[0738] Data transmission and analysis

[0739] When a user takes a photo using their smartphone's camera app, the photo data and its metadata (such as the date and time of the photo and GPS information) are saved in the device's photo gallery. The emotion engine analyzes the user's facial expressions and voice when the photo is taken, generates emotion data, and saves it on the device. The device then periodically connects to the cloud server to upload new photo data and emotion data.

[0740] Once the cloud server receives this data, it stores it in a temporary storage area. Next, the AI ​​module analyzes the photo's content, metadata, and emotional data to evaluate and determine the importance of each photo. By taking into account the emotions expressed by the user when taking the photo (e.g., smile, surprise, dissatisfaction, etc.), the value of the photo can be determined more accurately.

[0741] Identify and delete unwanted photos

[0742] Once the AI ​​module identifies unnecessary photos based on their content and emotional data, the cloud server creates a list and sends deletion instructions to the device. The device then deletes the photos from the photo gallery and places them in a temporary storage area, allowing users to restore the deleted photos within a certain period of time.

[0743] When users open the "Clean Data Box" app, a list of deleted photos is displayed and they can select specific photos to restore, making it easy to recover photos that have been accidentally deleted.

[0744] Specific examples

[0745] When a user takes many photos with their smartphone while traveling, the emotion engine analyzes the user's facial expressions and voice to generate emotion data such as "smile," "surprise," or "dissatisfaction." After returning home, the device automatically connects to the cloud server and uploads new photo data and emotion data. The cloud server's AI module analyzes this data, identifies unnecessary photos, and sends deletion instructions to the device. Based on the deletion instructions, the device deletes the photos from the photo gallery and moves them to a temporary storage area. The user can use the "Clean Data Box" app to check the deleted photos and restore them if necessary.

[0746] Prompt Sentence Examples

[0747] "Please explain in detail each processing step of a system that automatically identifies and deletes unnecessary photos in order to efficiently manage the storage of the many photos taken on a smartphone while traveling. Please also include a method for using an emotion engine to recognize the user's emotions and evaluate the value of the photos based on that information."

[0748] This system allows users to efficiently manage smartphone storage capacity by effectively saving only high-quality photos and automatically deleting unnecessary photos. By combining this with emotional data, photo management can be achieved in line with the user's intentions.

[0749] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0750] Step 1:

[0751] Send photo data from your device

[0752] Device: A user takes a photo using the smartphone's camera app. At this time, the captured photo data is automatically saved in the device's photo gallery. The device then periodically connects to the cloud server and uploads the latest photo data in the photo gallery to the cloud server.

[0753] Input: Photo data (and metadata) stored in the photo gallery

[0754] Output: Sending photo data and metadata to a cloud server

[0755] What it does: The photo gallery app runs in the background and automatically detects new photos when connected to Wi-Fi and uploads them to the cloud server.

[0756] Step 2:

[0757] Generating emotion data

[0758] On device: When a photo is taken, the emotion engine analyzes the user's facial expressions and voice to generate emotion data, which is linked to the photo and stored on the device.

[0759] Input: User's facial expressions, voice, and photo data

[0760] Output: Generated emotion data (e.g., smile, surprise, dissatisfaction, etc.)

[0761] Specific operation: The camera app works in conjunction with the emotion engine to analyze the user's facial recognition and voice data in real time and generate data with emotion labels.

[0762] Step 3:

[0763] Data reception and analysis on the server

[0764] Server: The cloud server receives the photo data and emotion data sent from the device and stores them in a temporary storage area.The AI ​​module then analyzes the photo content, metadata, and emotion data.

[0765] Input: Photo data, metadata, and emotion data uploaded to the cloud server.

[0766] Output: Analysis results (importance rating for each photo)

[0767] Specific operation: The cloud server stores all received data immediately after receiving it, and then the AI ​​module analyzes the photos and emotion data in batch processing to evaluate their importance.

[0768] Step 4:

[0769] Identifying unwanted photos

[0770] Server: The AI ​​module determines unnecessary photos based on the evaluation results. For example, photos with low evaluations (photos with negative emotions, similar photos, etc.) are determined to be unnecessary.

[0771] Input: AI photo evaluation results

[0772] Output: A list of unwanted photos

[0773] How it works: The AI ​​module generates a score for each photo and creates a list of unwanted photos based on that score.

[0774] Step 5:

[0775] Generate removal instructions

[0776] Server: The cloud server generates and sends deletion instructions to the device based on the list of unnecessary photos identified.

[0777] Input: List of unwanted photos

[0778] Output: Delete instructions (including photo ID and location information)

[0779] Specific operation: The cloud server generates a deletion instruction including the photo ID and location information and sends it to the device.

[0780] Step 6:

[0781] Deleting photos on your device

[0782] Device: Based on the deletion instruction received by the device, the device will delete the target photos from the photo gallery. The deleted photos will be moved to a temporary storage location.

[0783] Input: Delete instruction received from the cloud server

[0784] Output: Deleted photo data, moved to temporary storage area

[0785] Specific operation: The photo gallery app receives the deletion command, deletes the specified photo, and moves it to a temporary storage area.

[0786] Step 7:

[0787] User confirmation and recovery

[0788] User: When the user opens the "Clean Data Box" app, a list of deleted photos will be displayed. The user can select a specific photo from this list and press the restore button to restore the photo to the photo gallery.

[0789] Input: list of deleted photos

[0790] Output: Recovered photos in Photo Gallery

[0791] Specific behavior: The user operates the app to check the deleted photos and taps the restore button to return the selected photos to the photo gallery.

[0792] (Application example 2)

[0793] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0794] Conventional smartphone storage management systems place a burden on users to identify and delete unnecessary photos, making efficient management difficult. Furthermore, the subjective value judgment of photos is also dependent on the user, making it difficult to organize photos appropriately. To address this issue, a method is needed to utilize user emotional data and automate photo evaluation.

[0795] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for transmitting photo data from the terminal to the cloud server; means for the cloud server to receive the photo data and analyze the photos using an AI module; means for the AI ​​module to identify unnecessary photos based on the photo content and metadata; means for deleting unnecessary photos from the cloud server; means for the cloud server to send a delete instruction to the terminal for the identified unnecessary photos; means for the terminal to delete the unnecessary photos from the terminal based on the delete instruction; means for the terminal to move the deleted photos to a temporary storage location so that the user can restore them within a certain period of time; means for the cloud server to evaluate the photo data using an emotion engine that analyzes the user's emotions; and means for the AI ​​module to evaluate the photos based on the user's emotion data and execute a recommendation algorithm. This allows photos to be automatically organized and evaluated based on the user's emotion data, enabling more efficient and intuitive storage management.

[0796] A "terminal" is a device operated by a user, which takes, saves, and transmits photo data.

[0797] A "cloud server" is a remote server that stores and analyzes data via the Internet, and is a computer system that receives and processes photo data and related information.

[0798] "Photo data" refers to digital data that includes image files taken by a user on a terminal and their metadata (such as the date and time of the photo, GPS information, etc.).

[0799] An "AI module" is a combination of software and hardware that uses artificial intelligence to analyze, evaluate, and learn from data.

[0800] The "emotion engine" is a system that analyzes emotions from a user's facial expressions and voice and generates the results as data.

[0801] "Metadata" refers to additional information included in photo data, and mainly includes the date and time of shooting, location information, camera setting information, and the like.

[0802] A "deletion instruction" is a signal that the cloud server issues to the terminal to instruct it to delete unnecessary photos.

[0803] The "temporary storage location" is a storage area that stores deleted photo data for a certain period of time so that the user can restore it if necessary.

[0804] A "recommendation algorithm" is a program that suggests appropriate content and products to users based on their past data and emotional data.

[0805] This invention is a system that efficiently manages smartphone photo data using an emotion engine that analyzes user emotions. In particular, in a food delivery application, it organizes and evaluates food photos and information based on the user's emotion data, and realizes a function to recommend the most suitable dishes to the user.

[0806] Hardware and software used

[0807] This system is realized mainly using the following hardware and software.

[0808] Smartphone (terminal): A device that allows users to take photos of food and collect emotion data.

[0809] Cloud server: A remote server for storing and analyzing data via the Internet, which receives and analyzes photo data and emotion data.

[0810] EmotionRecognizer module: Software for analyzing the user's facial expressions and recognizing emotions, built using TensorFlow and OpenCV.

[0811] RecommendationEngine module: Software for recommending appropriate dishes and restaurants based on users' past data and emotional data, developed using Scikit-learn and Pandas.

[0812] REST API: A communication method used to exchange data between a device and a cloud server.

[0813] Data processing and calculation procedures

[0814] The device collects photo data of food taken by the user and simultaneously generates emotion data from the user's facial expressions using an emotion engine. The photo data and emotion data are then uploaded to a cloud server. At this time, the generated emotion data and metadata (such as the date and time of the photo and information about the ordered food) are also sent.

[0815] The cloud server receives this data and stores it in a temporary storage area. The AI ​​module analyzes this data and rates the photos based on the user's emotional data and the content of the photos. As a result, the AI ​​module classifies highly rated food photos as "favorites" and identifies low-rated or unnecessary photos and marks them as candidates for deletion.

[0816] By running a recommendation algorithm, the system creates a list of the most suitable dishes and restaurants for the user and sends it to the device, taking into account the user's past emotional data and other users' evaluation data.

[0817] Specific examples

[0818] A user orders a pizza and takes a photo of themselves satisfied

[0819] A user orders a pizza, eats it, and then takes a photo with a satisfied expression. This photo is then uploaded to a cloud server along with a positive emotion (e.g., a smile).

[0820] Create a rating list based on emotion data on a cloud server

[0821] Photos and emotional data are analyzed on a cloud server, and dishes that users rate highly are automatically added to their "favorites."

[0822] User confirmation and next order

[0823] The next time users open the app, their "favorites" list will display dishes that they have previously rated highly, allowing them to refer to them the next time they order.

[0824] An example prompt would be, "Take a photo of a pizza and analyze the photo for satisfaction. If the emotion is positive, upload the data."

[0825] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0826] Step 1:

[0827] A user takes a photo of a dish with their smartphone. The smartphone (device) saves the captured photo data to its photo gallery. At the same time, the device also records the photo's metadata (date and time of the photo, GPS information, etc.). The input is the photo data and metadata, and the output is the saved photo file.

[0828] Step 2:

[0829] The device's emotion engine analyzes the user's facial expressions and voice while taking a photo. The device uses the emotion engine to generate emotion data. At this time, data collected using the smartphone's camera and microphone is the input, and the user's emotion data (e.g., satisfaction, surprise, dissatisfaction) is obtained as the output.

[0830] Step 3:

[0831] After a user takes a photo, the device periodically connects to the cloud server and uploads the latest photo data and corresponding emotion data to the cloud server. The input is the photo data, metadata, and emotion data, and the output is the data sent to the cloud server.

[0832] Step 4:

[0833] The cloud server receives the photo data and emotion data sent from the device and stores them in a temporary storage area. The server updates the database based on the stored photo data, metadata, and emotion data. The input is the various data sent, and the output is the data stored in the cloud storage.

[0834] Step 5:

[0835] The AI ​​module on the cloud server analyzes the received photo data and emotion data. The AI ​​module evaluates the importance of each photo based on the photo's content and emotion data. The input is the photo data and emotion data stored in the cloud, and the output is the analysis results (e.g., photo rating score and emotion tag).

[0836] Step 6:

[0837] The AI ​​module on the cloud server determines unnecessary photos based on the photo evaluation results. The server detects photos that users have indicated are unsatisfactory or are duplicates, and lists them for deletion. The input is the AI ​​evaluation results, and the output is a list of photos to delete.

[0838] Step 7:

[0839] The cloud server sends a deletion instruction to the device for the identified unnecessary photos. This deletion instruction includes the ID and location information of the photo data to be deleted. The input is a list of deletion candidates, and the output is the deletion instruction sent to the device.

[0840] Step 8:

[0841] The device receives a deletion command from the cloud server and deletes the corresponding photo from the photo gallery. The deleted photo is moved to a temporary storage area on the device. The input is the deletion command, and the output is the photo deleted from the gallery and moved to the temporary storage area.

[0842] Step 9:

[0843] When a user opens the "Clean Data Box" app, a list of deleted photos is displayed. The user can select a specific photo from this list and press the restore button to place the photo back in the photo gallery. The input is the list of deleted photos and the user's actions, and the output is the restored photo.

[0844] Step 10:

[0845] The recommendation algorithm on the cloud server uses the user's emotional data to create a list of the best dishes and restaurants for the next order and sends it to the device. The input is the user's emotional data and past order data, and the output is a list of recommended dishes and restaurants.

[0846] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0847] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0848] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0849] [Third embodiment]

[0850] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0851] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0852] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0853] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0854] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0855] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0856] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0857] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0858] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0859] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0860] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0861] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0862] This invention is a system for efficiently managing smartphone storage capacity. In this system, the device sends photo data to a cloud server, and an AI module on the cloud server identifies unnecessary photos and automatically deletes them. The following describes the details of the program processing of this system and a specific example.

[0863] Explanation of program processing

[0864] 1. Send photo data from your device

[0865] When a user takes a photo with their smartphone, the photo data is saved in the device's photo gallery.

[0866] The device periodically connects to the cloud server and uploads newly taken photos to the server, along with any metadata associated with the photos (e.g., photo date and time, GPS information, etc.).

[0867] 2. Receiving and analyzing photo data on the cloud server

[0868] The cloud server receives the photo data and stores it in a temporary storage area.

[0869] The AI ​​module on the server analyzes the received photo data and identifies unwanted photos based on content and metadata, including image similarity analysis, automatic screenshot detection, and algorithms to select the best photos from a series of photos.

[0870] 3. Instructions for deleting unnecessary photos

[0871] The AI ​​module generates a list of photos that it determines are unnecessary, and the cloud server uses this list to send deletion instructions to the device.

[0872] On the other hand, the cloud server temporarily stores photo data that is determined to be unnecessary for a certain period of time (e.g., three months) rather than immediately, allowing users to recover photos that have been accidentally deleted.

[0873] 4. Delete unnecessary photos on your device

[0874] The device receives a deletion instruction from the cloud server and deletes the corresponding unnecessary photos from the photo gallery.

[0875] Deleted photo data is moved to a temporary storage area on the device. By accessing this area, users can recover deleted photos within three months.

[0876] 5. User Verification and Recovery Options

[0877] When a user opens the "Clean Data Box" app, a list of deleted photos is displayed.

[0878] If the user wants to review the deleted photos and restore a specific photo, they can select it from this list and press the restore button to restore the photo to the device's photo gallery.

[0879] Specific examples

[0880] 1. Users take lots of photos while traveling

[0881] Users take many photos with their smartphones while traveling, and sometimes take multiple photos of the same scenery from slightly different angles.

[0882] 2. Send new photo data from the device to the server

[0883] After returning home from a trip, the device automatically connects to the cloud server and uploads new photo data, including all photos taken during the trip and their metadata.

[0884] 3. AI analysis on a cloud server

[0885] Based on the photo data received by the cloud server, AI analyzes the content of the photos and distinguishes between highly similar photos, unclear photos, accidentally taken screenshots, etc. For example, if 10 photos of a night view have been taken, the AI ​​will keep only the one it judges to be the best quality and discard the other nine.

[0886] 4. Instructions for deleting unnecessary photos

[0887] The cloud server generates a list of photos that are determined to be unnecessary, and based on this, sends an instruction to delete the photos to the terminal.

[0888] 5. The user can confirm the photo deletion in the app and restore it if necessary.

[0889] When users open the "Clean Data Box" app, they can see a list of deleted photos. They can then select the photos they need from this list and restore them to their photo gallery.

[0890] Through the above-described embodiment, the system can automatically delete unnecessary photos, effectively manage smartphone storage capacity, and save users the trouble of manually organizing photos, reducing the risk of losing important photos.

[0891] The processing flow will be explained below.

[0892] Step 1:

[0893] A user takes a photo with their smartphone.

[0894] When a user takes a photo using the camera app, the photo data is automatically saved to the device's photo gallery.

[0895] Step 2:

[0896] The device connects to the cloud server.

[0897] Your device periodically connects to the cloud server to check the latest synchronization status. This connection occurs in the background and does not require user interaction.

[0898] Step 3:

[0899] The device will upload the new photo data.

[0900] The device detects new photos in the photo gallery and uploads them to the cloud server, including metadata such as the date and time the photo was taken and GPS information.

[0901] Step 4:

[0902] The server receives the photo data.

[0903] The cloud server receives the photo data sent from the terminal and stores it in a temporary storage area.

[0904] Step 5:

[0905] The server's AI module analyzes the photo.

[0906] The AI ​​module in the server analyzes the received photo data. The AI ​​evaluates the similarity of each photo and detects screenshots and rapid-fire photos. Specifically, the AI ​​compares pixel patterns and metadata of the images and groups unwanted photos using cluster analysis.

[0907] Step 6:

[0908] The server's AI module identifies unnecessary photos.

[0909] The AI ​​uses different criteria (e.g. similarity, image quality, metadata) to select the best photo from multiple photos and discard the rest, taking into account the user's custom settings.

[0910] Step 7:

[0911] The server generates a list of unwanted photos.

[0912] The AI ​​generates a list of unwanted photos on the server, which includes photos to be deleted and their associated metadata.

[0913] Step 8:

[0914] The server sends a deletion instruction to the terminal.

[0915] The server sends a deletion command to the device based on the list of unnecessary photos, including the ID and location information of the specific photo data.

[0916] Step 9:

[0917] The terminal receives the deletion instruction.

[0918] The device receives the deletion instruction from the cloud server and automatically deletes the photo from the photo gallery without user intervention.

[0919] Step 10:

[0920] Your device will move the deleted photos to a temporary storage location.

[0921] The device will move the deleted photo data to a temporary storage area, where it will be stored for a certain period of time and can be restored by the user if necessary.

[0922] Step 11:

[0923] The user checks the list of deleted photos.

[0924] When a user opens the "Clean Data Box" app, they are presented with a list of deleted photos, including thumbnails of the photos and the date and time of their deletion.

[0925] Step 12:

[0926] Users can restore photos as needed.

[0927] When the user selects the photos they want to restore from the deleted list and presses the restore button, the photo data is resent from the cloud server and relocated to the device's photo gallery.

[0928] This series of steps allows users to efficiently manage their smartphone storage, saving only the important photos without cluttering it with unnecessary ones.

[0929] Example 1

[0930] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0931] Since smartphones have limited storage capacity, it is necessary to efficiently manage storage and reduce the time and effort required for users to manually organize unnecessary photos. It is also important to reduce the risk of accidentally deleting important photos.

[0932] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0933] In this invention, the server includes a means for transmitting photo data from the terminal to the cloud server, a means for the cloud server to receive the photo data and analyze the photos using an AI module, and a means for the AI ​​module to identify unnecessary photos based on the photo content and metadata, thereby enabling automatic deletion of unnecessary photo data and simplifying recovery by the user.

[0934] "Terminal" refers to a mobile device owned by a user, such as a smartphone or tablet.

[0935] A "cloud server" refers to a server system that stores and processes data remotely via the Internet.

[0936] "Photo data" refers to image data taken by a user and associated metadata (e.g., date and time of photo, GPS information, etc.).

[0937] "AI module" refers to a software component that uses artificial intelligence to analyze photo data and identify unnecessary photos.

[0938] "Metadata" refers to auxiliary information that accompanies photo data (e.g., photo date and time, GPS information, etc.).

[0939] "Unnecessary photos" refers to photo data that has been determined to be unnecessary for the user based on the analysis results of the AI ​​module.

[0940] The "deletion instruction" refers to instruction information sent by the cloud server to the terminal to delete unnecessary photos.

[0941] "Temporary storage location" refers to a storage area where deleted photo data is stored for a certain period of time (e.g., three months) so that users can recover it.

[0942] "Recovery" refers to the action of a user returning deleted photo data stored in a temporary storage location to the device's photo gallery.

[0943] "Synchronization means" refers to a function that enables a terminal to periodically synchronize data with a cloud server.

[0944] "Similarity analysis" refers to the process by which an AI module evaluates the degree of image correspondence and similarity between multiple photo data.

[0945] "Screenshot detection" refers to the process by which an AI module automatically identifies screenshots from photo data.

[0946] "Best selection of burst photos" refers to the process in which the AI ​​module selects the best photo from a series of photos.

[0947] "Application" refers to a software program that a user can run on a smartphone or tablet.

[0948] "Deleted photo list" refers to a list that can be used by a user to check deleted photo data and restore them.

[0949] The present invention is a system for efficiently managing smartphone storage capacity. In this system, the device sends photo data to a cloud server, and an AI module on the cloud server identifies unnecessary photos and automatically deletes them. A specific embodiment of this system is described below.

[0950] System hardware and software configuration

[0951] Device: A mobile device such as a smartphone or tablet on which the "Photo Uploader" and "Clean Data Box" apps will be installed.

[0952] Cloud server: A server system that stores and processes data remotely and is equipped with AI modules.

[0953] AI module: A software component deployed on a cloud server that performs image analysis and identifies unnecessary photos.

[0954] Example of operation

[0955] 1. Sending photo data from the device to the cloud server

[0956] When a user takes a photo with their smartphone, the photo data is saved in the device's photo gallery.

[0957] The device's "Photo Uploader" app automatically uploads newly taken photos to the cloud server at regular intervals, along with any metadata associated with the photos (e.g., photo date and time, GPS information, etc.).

[0958] 2. Receiving and analyzing photo data on the cloud server

[0959] The cloud server stores the received photo data in a temporary storage area.

[0960] An AI module on the cloud server analyzes the received photo data, using algorithms to analyze image similarities, detect screenshots, and select the best photo from a series of photos.

[0961] For example, if 10 photos of a night view are taken, the AI ​​will keep only the one it judges to be of the best quality and determine the other nine as unnecessary.

[0962] 3. Instructions for deleting unnecessary photos and how to respond

[0963] The AI ​​module generates a list of photos that it determines are unnecessary, and the cloud server sends a deletion instruction to the device.

[0964] The cloud server does not immediately delete the identified unnecessary photos, but stores them in a temporary storage area for a certain period of time (e.g., three months) so that users can restore the deleted photos.

[0965] 4. Delete unwanted photos on your device and recover them with options

[0966] The device receives a deletion instruction from the cloud server and deletes the corresponding unnecessary photos from the photo gallery.

[0967] Deleted photo data is moved to a temporary storage area on the device, and users can recover deleted photos within three months through the "Clean Data Box" app.

[0968] When a user opens the "Clean Data Box" app, a list of deleted photos is displayed, and the user can select the photos they need and restore them. For example, they can use the "Clean Data Box" app to check photos taken during a trip and restore one that was accidentally deleted.

[0969] This process allows users to efficiently manage their smartphone storage space, eliminates the need for manual organizing by automatically deleting unnecessary photos, and reduces the risk of accidentally deleting important photos.

[0970] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0971] Step 1:

[0972] The device sends the photo data to the cloud server.

[0973] Details: When a user takes a photo with their smartphone, the photo data is saved in the photo gallery. The device's "Photo Uploader" app periodically uploads this saved photo data and metadata (such as the date and time of the photo, GPS information, etc.) to a cloud server.

[0974] Input: Photo data and metadata taken by the user on the device

[0975] Output: Photo data uploaded to the cloud server

[0976] Step 2:

[0977] The cloud server receives the photo data and stores it in a temporary storage area.

[0978] Details: The cloud server receives new photo data sent from the device and stores it in a temporary storage area. At that time, the metadata is also stored in the temporary storage area along with the photo data.

[0979] Input: Photo data and metadata sent from the device

[0980] Output: Photo data stored in temporary storage area

[0981] Step 3:

[0982] The AI ​​module on the cloud server analyzes the received photo data and identifies unnecessary photos.

[0983] Details: An AI module on a cloud server analyzes photo data using algorithms that analyze image similarity, detect screenshots, and select the best shot from a series of photos. Based on this, it identifies unwanted photos and generates a list of them.

[0984] Input: Photo data and metadata stored in temporary storage area

[0985] Output: A list of unwanted photos

[0986] Step 4:

[0987] The cloud server sends a deletion instruction to the terminal based on a list of photos that have been determined to be unnecessary.

[0988] Details: After the cloud server generates a list of unnecessary photos, it sends a deletion instruction to the device based on that list. This deletion instruction includes information about the specific photo data.

[0989] Input: A list of unwanted photos

[0990] Output: Delete instructions to the terminal

[0991] Step 5:

[0992] The terminal receives a deletion instruction from the cloud server and deletes unnecessary photos from the photo gallery.

[0993] Details: When the device receives a deletion command, it deletes the target photo data from the device's photo gallery. The deleted photo data is moved to the device's temporary storage area.

[0994] Input: Deletion instructions from cloud server

[0995] Output: Deleted photos from Photo Gallery and moved to temporary storage area

[0996] Step 6:

[0997] Users can use the "Clean Data Box" app to check deleted photos and restore them if necessary.

[0998] Details: When a user opens the "Clean Data Box" app, a list of deleted photos is displayed. The user selects the photos they need from the list and presses the restore button, which places them back in the photo gallery.

[0999] Input: Deleted photo data stored in temporary storage area

[1000] Output: Recovered photos in Photo Gallery

[1001] (Application example 1)

[1002] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1003] In order to streamline inventory management and picking operations at logistics centers, it is important to efficiently manage photo data of inventory items taken by workers. However, the storage capacity of smart glasses and other devices is limited, and the accumulation of unnecessary photos can hinder speedy work. Another problem is that blurry or duplicate photos make it difficult to grasp accurate inventory information. To solve these issues, a system is needed that manages photo data in the cloud and automatically identifies and deletes unnecessary photos.

[1004] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1005] In this invention, the server includes: means for transmitting photo data and metadata from the terminal to the cloud server; means for the cloud server to receive the photo data and metadata and analyze the photos using an AI module; means for the AI ​​module to identify unnecessary photos based on the photo content and metadata; means for deleting unnecessary photos from the cloud server; means for the cloud server to send a delete instruction to the terminal for the identified unnecessary photos; means for the terminal to delete the unnecessary photos based on the delete instruction; means for the warehouse management eyeglass terminal to send inventory photo data to the cloud server; means for the cloud server to receive the inventory photo data and identify and delete unnecessary photos using the AI ​​module; and means for the terminal to move the deleted photos to a temporary storage location so that the user can restore them within a certain period of time. This enables more efficient inventory management and picking work and optimal management of storage capacity.

[1006] "Terminal" refers to eyeglass terminals and other devices worn by workers at logistics centers.

[1007] A "cloud server" refers to a server system that connects to devices via the Internet and receives and sends photo data and metadata.

[1008] "Photo data" refers to image information captured by the device's camera.

[1009] "Metadata" refers to supplementary information such as the date and time of the photo being taken and the shelf number that accompanies the photo data.

[1010] "AI module" refers to an artificial intelligence algorithm or program that analyzes photo data and metadata on a cloud server and identifies unnecessary photos.

[1011] "Unnecessary photos" refer to photos that, after analysis, have been determined not to need to be saved, such as duplicate images or blurry images.

[1012] A "deletion instruction" refers to a command from the cloud server to the terminal prompting the terminal to delete unnecessary photos.

[1013] "Deleted photos" refers to photo data that has been determined to be unnecessary on the cloud server and on the device and has been deleted.

[1014] "Temporary storage location" refers to a location where deleted photos are stored for a certain period of time, and indicates an area where users can recover photos that have been accidentally deleted.

[1015] An "eyeglass terminal for warehouse management" refers to an eyeglass-type device equipped with a camera and communication functions that is used for inventory management and picking operations at logistics centers.

[1016] This invention is a system for improving the efficiency of inventory management and picking work at logistics centers. This system sends photo data of inventory items taken by eyeglass-type devices worn by workers to a cloud server, and an AI module on the server identifies unnecessary photos and automatically deletes them. Details of the program processing of this system and specific examples are described below.

[1017] System configuration

[1018] The system mainly uses the following hardware and software:

[1019] Hardware: Glasses-type device and cloud server

[1020] Software: Smart inventory management app with image analysis AI module, cloud storage, deletion instruction program, and recovery options

[1021] Program processing description

[1022] 1. Sending photo data and metadata from your device

[1023] A worker wears a glasses-type device and takes photos of inventory items. The device periodically connects to a cloud server and transmits the captured photo data and metadata (e.g., photo date and time, shelf number, etc.).

[1024] 2. Data reception and analysis on the cloud server

[1025] The cloud server receives the photo data and metadata and stores them in a temporary storage area. An AI module on the server analyzes the data and identifies unwanted photos. The criteria include similarity analysis, blur detection, and a duplicate photo removal algorithm.

[1026] 3. Instructions for deleting unnecessary photos and their execution

[1027] The cloud server creates a list of unnecessary photos and sends a deletion instruction to the device, which then deletes the unnecessary photos from the device based on this instruction.

[1028] 4. Temporarily save and restore photo data

[1029] The deleted photo data will be moved to a temporary storage location on the device. Users can use the "Smart Inventory Management App" to check the list of deleted photos and restore them within a certain period of time if necessary.

[1030] Specific examples

[1031] 1. Inventory taking by workers

[1032] When workers take inventory, they often take many photos of inventory items using eyeglasses, and sometimes they take multiple photos of inventory items on the same shelf.

[1033] 2. Data transmission and AI analysis

[1034] During or after a photo is taken, the glasses connect to a cloud server and upload the new photo data and metadata. An AI module on the server analyzes this data, identifying similar or unclear photos and deciding they are unnecessary.

[1035] 3. Instructions for deleting unnecessary photos

[1036] The AI ​​module creates a list of photos that it has determined are unnecessary, and the cloud server sends deletion instructions to the device. The device then deletes the photos in accordance with the received instructions.

[1037] 4. Recovery operations by the user

[1038] Users can open the "Smart Inventory Management App" to check the list of deleted photos, and within a certain period of time, they can select and relocate the photos they need.

[1039] Prompt Sentence Examples

[1040] Design a system in which workers at a logistics center use smart glasses to manage inventory. The smart glasses take photos of inventory items and send the images to a cloud server, where AI on the server automatically deletes and manages unnecessary images, optimizing storage capacity. Please also explain the hardware (smart glasses, cloud server) and software (image analysis AI, smart inventory management app) used.

[1041] In this way, the present invention makes it possible to improve the efficiency of inventory management in a logistics center and to optimally manage the storage capacity of terminals.

[1042] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1043] Step 1:

[1044] The terminal takes and acquires photographic data and metadata of inventory items. The input is the image taken by the worker with the camera on the eyeglass terminal and the metadata associated with the image (e.g., date and time of photo, shelf number). The terminal stores this photographed data.

[1045] Step 2:

[1046] The device periodically connects to the cloud server and uploads the captured photo data and metadata. The input is the photo data and metadata stored in the device. The data is then sent from the device to the cloud server.

[1047] Step 3:

[1048] The cloud server receives the photo data and metadata and stores them in a temporary storage area. The input is the photo data and metadata sent from the device. The server saves them in a temporary storage location.

[1049] Step 4:

[1050] The AI ​​module on the cloud server analyzes the received photo data and metadata. The input is the photo data and metadata stored in the temporary storage area. The AI ​​module uses an image recognition algorithm to analyze the content of the photo and performs data processing and calculations to identify unnecessary photos.

[1051] Step 5:

[1052] The AI ​​module identifies unwanted photos and generates a list of them. The output is a list of unwanted photos. The AI ​​module performs similarity analysis and blur detection, and lists the identified unwanted photos.

[1053] Step 6:

[1054] The cloud server sends deletion instructions to the device based on the list of unnecessary photos. The input is the list of unnecessary photos generated by the AI ​​module. The server sends instructions to the device to delete unnecessary photos based on this list.

[1055] Step 7:

[1056] The device receives a deletion instruction from the cloud server and deletes the corresponding unnecessary photos from the device. The input is the deletion instruction sent from the cloud server. The device follows this instruction and deletes the unnecessary photos.

[1057] Step 8:

[1058] The deleted photo data is moved to a temporary storage location on the device. The input is the photo data deleted based on the deletion instruction. The device moves this to a temporary storage area and stores it in this area for a certain period of time.

[1059] Step 9:

[1060] The user opens the "Smart Inventory Management App" to see a list of deleted photos. The input is the list of deleted photos in the temporary storage area. The app displays this to the user.

[1061] Step 10:

[1062] The user selects the photos they need and performs the recovery operation. The input is the photos the user selected in the app. The app recovers the selected photo data and saves it back to the device's main storage.

[1063] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1064] This invention relates to a system for efficiently managing smartphone storage capacity. In particular, by combining it with an emotion engine that recognizes user emotions, it provides a method for more accurately determining the value of photos and automatically deleting unnecessary photos. An example of this system is described in detail below, with a program process explained in natural language and specific examples included.

[1065] Explanation of program processing

[1066] 1. Send photo data from your device

[1067] When a user takes a photo using the camera app on their smartphone, the photo data is saved in the device's photo gallery. The device periodically connects to the cloud server and uploads the latest photo data to the server. At this time, metadata associated with the photo (e.g., the date and time the photo was taken, GPS information, etc.) is also sent.

[1068] 2. Emotion Engine Data Collection

[1069] When taking a photo, the emotion engine analyzes the user's facial expressions and voice to generate emotion data, including emotions such as "smile," "surprise," "dissatisfaction," and "sadness."

[1070] 3. Receiving and analyzing data on the server

[1071] The cloud server receives the photo data and emotion data sent from the terminal and stores them in a temporary storage area.

[1072] The AI ​​module analyzes the received photo data and emotional data, and evaluates the importance of each photo based on the content of the photo and the user's emotional data.

[1073] 4. Identify unwanted photos

[1074] The AI ​​module identifies unwanted photos based on both the content and emotional data of the photo. For example, photos in which the user expressed negative emotions when taking the photo will be prioritized as unwanted.

[1075] 5. Generating removal instructions

[1076] The AI ​​module on the cloud server generates a list of photos that it has determined are unnecessary and sends a deletion instruction to the device, which includes the ID and location information of the photo data.

[1077] 6. Deleting photos on your device

[1078] The device receives the deletion command from the cloud server and deletes the photo from the photo gallery. The deleted photo is moved to a temporary storage area on the device.

[1079] 7. User Verification and Recovery

[1080] When a user opens the "Clean Data Box" app, a list of deleted photos is displayed. The user can select a specific photo from this list and press the restore button, which will place the photo back in the photo gallery.

[1081] Specific examples

[1082] 1. Users take lots of photos while traveling

[1083] When a user takes many photos with their smartphone while traveling, the emotion engine analyzes the user's facial expressions and voice and tags them with positive emotions (e.g., smiling) or negative emotions (e.g., dissatisfaction).

[1084] 2. Send data from the device to the server

[1085] After returning home from a trip, the device automatically connects to the cloud server and uploads new photo data and corresponding emotion data.

[1086] 3. AI analysis on a cloud server

[1087] Based on the photo data received by the cloud server, the AI ​​module analyzes the emotional data and image content. Among multiple photos of the same scene taken from slightly different angles, photos in which the user is smiling are prioritized and saved, while other photos are deemed unnecessary.

[1088] 4. Instructions for deleting unnecessary photos

[1089] The cloud server generates a list of photos that are deemed unnecessary and sends a deletion instruction to the device, which then receives the instruction and deletes the photos from its photo gallery.

[1090] 5. User can check and recover photos in the app

[1091] When a user opens the "Clean Data Box" app, a list of deleted photos is displayed. From this list, the user can select a specific photo and press the restore button to restore it to the photo gallery.

[1092] This embodiment allows users to efficiently manage smartphone storage by effectively saving only high-quality photos and automatically deleting unnecessary photos. In addition, by combining emotion data, photo management can be more in line with the user's intentions.

[1093] The processing flow will be explained below.

[1094] Step 1:

[1095] A user takes a photo with their smartphone.

[1096] When a user takes a photo using the camera app, the photo data is automatically saved to the device's photo gallery. The emotion engine immediately starts working, analyzing the user's facial expressions and voice to generate emotion data. This emotion data includes information such as "smile" or "sadness."

[1097] Step 2:

[1098] The device connects to the cloud server.

[1099] The device automatically connects to the cloud server at regular intervals to check the latest synchronization status.

[1100] Step 3:

[1101] The device uploads new photo data and emotion data.

[1102] The device detects new photos in the photo gallery and the corresponding emotion data, and uploads them to the cloud server, including metadata such as the date and time of the photo and GPS information.

[1103] Step 4:

[1104] The server receives the photo data.

[1105] The cloud server receives the photo data and emotion data sent from the terminal and stores them in a temporary storage area.

[1106] Step 5:

[1107] The server's AI module analyzes the photo.

[1108] The AI ​​module on the server analyzes the received photo data and emotional data. The AI ​​evaluates the similarity of each photo and detects screenshots and rapid-fire photos. Based on the emotional data, it prioritizes saving photos that show positive emotions.

[1109] Step 6:

[1110] The server's AI module identifies unnecessary photos.

[1111] AI uses image similarity assessments, metadata, and emotional data to identify unwanted photos. For example, it will keep photos in which the user is smiling, but discard photos that show negative emotions or photos with nearly identical content.

[1112] Step 7:

[1113] The server generates a list of unwanted photos.

[1114] The AI ​​generates a list of unwanted photos on the server, which includes photos to be deleted and their associated metadata.

[1115] Step 8:

[1116] The server sends a deletion instruction to the terminal.

[1117] The server sends a deletion command to the device based on the list of unnecessary photos, including the ID and location information of the specific photo data.

[1118] Step 9:

[1119] The terminal receives the deletion instruction.

[1120] The device receives the deletion instruction from the cloud server and automatically deletes the photo from the photo gallery without user intervention.

[1121] Step 10:

[1122] Your device will move the deleted photos to a temporary storage location.

[1123] The device will move the deleted photo data to a temporary storage area, where it will be stored for a certain period of time and can be restored by the user if necessary.

[1124] Step 11:

[1125] The user checks the list of deleted photos.

[1126] When a user opens the "Clean Data Box" app, they are presented with a list of deleted photos, including thumbnails of the photos and the date and time of their deletion.

[1127] Step 12:

[1128] Users can restore photos as needed.

[1129] When the user selects the photos they want to restore from the deleted list and presses the restore button, the photo data is resent from the cloud server and relocated to the device's photo gallery.

[1130] This series of steps allows users to efficiently manage their smartphone storage and leverage emotional data to identify and retain important photos.

[1131] Example 2

[1132] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1133] Conventional smartphone storage management systems have had difficulty automatically determining the value of photos and efficiently deleting unnecessary ones. In particular, methods for determining unnecessary photos that rely on simple metadata or image analysis without considering the user's intentions or emotions tend to result in unintended deletion of photos. Furthermore, managing unnecessary photos is a time-consuming task for users, resulting in wasteful storage.

[1134] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1135] In this invention, the server includes a means for transmitting photo data from the terminal to the cloud server, a means for the cloud server to receive the photo data and generate emotion data using an emotion engine, and a means for the cloud server to analyze the photo data and emotion data using an AI module. This makes it possible to comprehensively evaluate the content, metadata, and emotion data of photos and identify and delete unnecessary photos. This allows for efficient storage management in line with the user's intentions and reduces the effort required to delete unnecessary photos.

[1136] "Terminal" refers to a portable communication device such as a smartphone or tablet.

[1137] "Cloud server" refers to a remote server for storing and managing data via the Internet.

[1138] "Photo data" refers to digital data of still images taken with a smartphone or tablet.

[1139] An "emotion engine" is a software module that analyzes a user's facial expressions and voice to estimate their emotional state at that time.

[1140] "Emotion Data" refers to digital data that indicates the user's emotional state as analyzed by the emotion engine.

[1141] "AI module" refers to a software component that uses artificial intelligence technology to analyze photo data and emotional data and make specific decisions.

[1142] "Metadata" refers to information that accompanies photo data, such as the date and time the photo was taken and GPS information.

[1143] "Unnecessary photos" refer to photo data that is determined to be of low importance to the user.

[1144] A "delete instruction" refers to a digital signal sent from the cloud server to a device instructing it to delete a specific photo.

[1145] "Temporary storage location" refers to the area where deleted photo data is temporarily stored on the device.

[1146] This invention relates to a system that allows users to send photo data taken using devices such as smartphones and tablets to a cloud server, and automatically evaluates and determines the value of the photos using an AI module and emotion engine.

[1147] System Configuration

[1148] The system consists of a terminal, a cloud server, and various software components such as an AI module, an emotion engine, a photo gallery app, and a "Clean Data Box" app.

[1149] The device is installed with a camera app for taking photos and saving them to a photo gallery, and software including an emotion engine. The cloud server is equipped with an AI module for analyzing photo data and emotion data. The cloud server also has a function to set up a temporary storage area for each user and temporarily store deleted photo data.

[1150] Data transmission and analysis

[1151] When a user takes a photo using their smartphone's camera app, the photo data and its metadata (such as the date and time of the photo and GPS information) are saved in the device's photo gallery. The emotion engine analyzes the user's facial expressions and voice when the photo is taken, generates emotion data, and saves it on the device. The device then periodically connects to the cloud server to upload new photo data and emotion data.

[1152] Once the cloud server receives this data, it stores it in a temporary storage area. Next, the AI ​​module analyzes the photo's content, metadata, and emotional data to evaluate and determine the importance of each photo. By taking into account the emotions expressed by the user when taking the photo (e.g., smile, surprise, dissatisfaction, etc.), the value of the photo can be determined more accurately.

[1153] Identify and delete unwanted photos

[1154] Once the AI ​​module identifies unnecessary photos based on their content and emotional data, the cloud server creates a list and sends deletion instructions to the device. The device then deletes the photos from the photo gallery and places them in a temporary storage area, allowing users to restore the deleted photos within a certain period of time.

[1155] When users open the "Clean Data Box" app, a list of deleted photos is displayed and they can select specific photos to restore, making it easy to recover photos that have been accidentally deleted.

[1156] Specific examples

[1157] When a user takes many photos with their smartphone while traveling, the emotion engine analyzes the user's facial expressions and voice to generate emotion data such as "smile," "surprise," or "dissatisfaction." After returning home, the device automatically connects to the cloud server and uploads new photo data and emotion data. The cloud server's AI module analyzes this data, identifies unnecessary photos, and sends deletion instructions to the device. Based on the deletion instructions, the device deletes the photos from the photo gallery and moves them to a temporary storage area. The user can use the "Clean Data Box" app to check the deleted photos and restore them if necessary.

[1158] Prompt Sentence Examples

[1159] "Please explain in detail each processing step of a system that automatically identifies and deletes unnecessary photos in order to efficiently manage the storage of the many photos taken on a smartphone while traveling. Please also include a method for using an emotion engine to recognize the user's emotions and evaluate the value of the photos based on that information."

[1160] This system allows users to efficiently manage smartphone storage capacity by effectively saving only high-quality photos and automatically deleting unnecessary photos. By combining this with emotional data, photo management can be achieved in line with the user's intentions.

[1161] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1162] Step 1:

[1163] Send photo data from your device

[1164] Device: A user takes a photo using the smartphone's camera app. At this time, the captured photo data is automatically saved in the device's photo gallery. The device then periodically connects to the cloud server and uploads the latest photo data in the photo gallery to the cloud server.

[1165] Input: Photo data (and metadata) stored in the photo gallery

[1166] Output: Sending photo data and metadata to a cloud server

[1167] What it does: The photo gallery app runs in the background and automatically detects new photos when connected to Wi-Fi and uploads them to the cloud server.

[1168] Step 2:

[1169] Generating emotion data

[1170] On device: When a photo is taken, the emotion engine analyzes the user's facial expressions and voice to generate emotion data, which is linked to the photo and stored on the device.

[1171] Input: User's facial expressions, voice, and photo data

[1172] Output: Generated emotion data (e.g., smile, surprise, dissatisfaction, etc.)

[1173] Specific operation: The camera app works in conjunction with the emotion engine to analyze the user's facial recognition and voice data in real time and generate data with emotion labels.

[1174] Step 3:

[1175] Data reception and analysis on the server

[1176] Server: The cloud server receives the photo data and emotion data sent from the device and stores them in a temporary storage area.The AI ​​module then analyzes the photo content, metadata, and emotion data.

[1177] Input: Photo data, metadata, and emotion data uploaded to the cloud server.

[1178] Output: Analysis results (importance rating for each photo)

[1179] Specific operation: The cloud server stores all received data immediately after receiving it, and then the AI ​​module analyzes the photos and emotion data in batch processing to evaluate their importance.

[1180] Step 4:

[1181] Identifying unwanted photos

[1182] Server: The AI ​​module determines unnecessary photos based on the evaluation results. For example, photos with low evaluations (photos with negative emotions, similar photos, etc.) are determined to be unnecessary.

[1183] Input: AI photo evaluation results

[1184] Output: A list of unwanted photos

[1185] How it works: The AI ​​module generates a score for each photo and creates a list of unwanted photos based on that score.

[1186] Step 5:

[1187] Generate removal instructions

[1188] Server: The cloud server generates and sends deletion instructions to the device based on the list of unnecessary photos identified.

[1189] Input: List of unwanted photos

[1190] Output: Delete instructions (including photo ID and location information)

[1191] Specific operation: The cloud server generates a deletion instruction including the photo ID and location information and sends it to the device.

[1192] Step 6:

[1193] Deleting photos on your device

[1194] Device: Based on the deletion instruction received by the device, the device will delete the target photos from the photo gallery. The deleted photos will be moved to a temporary storage location.

[1195] Input: Delete instruction received from the cloud server

[1196] Output: Deleted photo data, moved to temporary storage area

[1197] Specific operation: The photo gallery app receives the deletion command, deletes the specified photo, and moves it to a temporary storage area.

[1198] Step 7:

[1199] User confirmation and recovery

[1200] User: When the user opens the "Clean Data Box" app, a list of deleted photos will be displayed. The user can select a specific photo from this list and press the restore button to restore the photo to the photo gallery.

[1201] Input: list of deleted photos

[1202] Output: Recovered photos in Photo Gallery

[1203] Specific behavior: The user operates the app to check the deleted photos and taps the restore button to return the selected photos to the photo gallery.

[1204] (Application example 2)

[1205] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1206] Conventional smartphone storage management systems place a burden on users to identify and delete unnecessary photos, making efficient management difficult. Furthermore, the subjective value judgment of photos is also dependent on the user, making it difficult to organize photos appropriately. To address this issue, a method is needed to utilize user emotional data and automate photo evaluation.

[1207] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for transmitting photo data from the terminal to the cloud server; means for the cloud server to receive the photo data and analyze the photos using an AI module; means for the AI ​​module to identify unnecessary photos based on the photo content and metadata; means for deleting unnecessary photos from the cloud server; means for the cloud server to send a delete instruction to the terminal for the identified unnecessary photos; means for the terminal to delete the unnecessary photos from the terminal based on the delete instruction; means for the terminal to move the deleted photos to a temporary storage location so that the user can restore them within a certain period of time; means for the cloud server to evaluate the photo data using an emotion engine that analyzes the user's emotions; and means for the AI ​​module to evaluate the photos based on the user's emotion data and execute a recommendation algorithm. This allows photos to be automatically organized and evaluated based on the user's emotion data, enabling more efficient and intuitive storage management.

[1208] A "terminal" is a device operated by a user, which takes, saves, and transmits photo data.

[1209] A "cloud server" is a remote server that stores and analyzes data via the Internet, and is a computer system that receives and processes photo data and related information.

[1210] "Photo data" refers to digital data that includes image files taken by a user on a terminal and their metadata (such as the date and time of the photo, GPS information, etc.).

[1211] An "AI module" is a combination of software and hardware that uses artificial intelligence to analyze, evaluate, and learn from data.

[1212] The "emotion engine" is a system that analyzes emotions from a user's facial expressions and voice and generates the results as data.

[1213] "Metadata" refers to additional information included in photo data, and mainly includes the date and time of shooting, location information, camera setting information, and the like.

[1214] A "deletion instruction" is a signal that the cloud server issues to the terminal to instruct it to delete unnecessary photos.

[1215] The "temporary storage location" is a storage area that stores deleted photo data for a certain period of time so that the user can restore it if necessary.

[1216] A "recommendation algorithm" is a program that suggests appropriate content and products to users based on their past data and emotional data.

[1217] This invention is a system that efficiently manages smartphone photo data using an emotion engine that analyzes user emotions. In particular, in a food delivery application, it organizes and evaluates food photos and information based on the user's emotion data, and realizes a function to recommend the most suitable dishes to the user.

[1218] Hardware and software used

[1219] This system is realized mainly using the following hardware and software.

[1220] Smartphone (terminal): A device that allows users to take photos of food and collect emotion data.

[1221] Cloud server: A remote server for storing and analyzing data via the Internet, which receives and analyzes photo data and emotion data.

[1222] EmotionRecognizer module: Software for analyzing the user's facial expressions and recognizing emotions, built using TensorFlow and OpenCV.

[1223] RecommendationEngine module: Software for recommending appropriate dishes and restaurants based on users' past data and emotional data, developed using Scikit-learn and Pandas.

[1224] REST API: A communication method used to exchange data between a device and a cloud server.

[1225] Data processing and calculation procedures

[1226] The device collects photo data of food taken by the user and simultaneously generates emotion data from the user's facial expressions using an emotion engine. The photo data and emotion data are then uploaded to a cloud server. At this time, the generated emotion data and metadata (such as the date and time of the photo and information about the ordered food) are also sent.

[1227] The cloud server receives this data and stores it in a temporary storage area. The AI ​​module analyzes this data and rates the photos based on the user's emotional data and the content of the photos. As a result, the AI ​​module classifies highly rated food photos as "favorites" and identifies low-rated or unnecessary photos and marks them as candidates for deletion.

[1228] By running a recommendation algorithm, the system creates a list of the most suitable dishes and restaurants for the user and sends it to the device, taking into account the user's past emotional data and other users' evaluation data.

[1229] Specific examples

[1230] A user orders a pizza and takes a photo of themselves satisfied

[1231] A user orders a pizza, eats it, and then takes a photo with a satisfied expression. This photo is then uploaded to a cloud server along with a positive emotion (e.g., a smile).

[1232] Create a rating list based on emotion data on a cloud server

[1233] Photos and emotional data are analyzed on a cloud server, and dishes that users rate highly are automatically added to their "favorites."

[1234] User confirmation and next order

[1235] The next time users open the app, their "favorites" list will display dishes that they have previously rated highly, allowing them to refer to them the next time they order.

[1236] An example prompt would be, "Take a photo of a pizza and analyze the photo for satisfaction. If the emotion is positive, upload the data."

[1237] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1238] Step 1:

[1239] A user takes a photo of a dish with their smartphone. The smartphone (device) saves the captured photo data to its photo gallery. At the same time, the device also records the photo's metadata (date and time of the photo, GPS information, etc.). The input is the photo data and metadata, and the output is the saved photo file.

[1240] Step 2:

[1241] The device's emotion engine analyzes the user's facial expressions and voice while taking a photo. The device uses the emotion engine to generate emotion data. At this time, data collected using the smartphone's camera and microphone is the input, and the user's emotion data (e.g., satisfaction, surprise, dissatisfaction) is obtained as the output.

[1242] Step 3:

[1243] After a user takes a photo, the device periodically connects to the cloud server and uploads the latest photo data and corresponding emotion data to the cloud server. The input is the photo data, metadata, and emotion data, and the output is the data sent to the cloud server.

[1244] Step 4:

[1245] The cloud server receives the photo data and emotion data sent from the device and stores them in a temporary storage area. The server updates the database based on the stored photo data, metadata, and emotion data. The input is the various data sent, and the output is the data stored in the cloud storage.

[1246] Step 5:

[1247] The AI ​​module on the cloud server analyzes the received photo data and emotion data. The AI ​​module evaluates the importance of each photo based on the photo's content and emotion data. The input is the photo data and emotion data stored in the cloud, and the output is the analysis results (e.g., photo rating score and emotion tag).

[1248] Step 6:

[1249] The AI ​​module on the cloud server determines unnecessary photos based on the photo evaluation results. The server detects photos that users have indicated are unsatisfactory or are duplicates, and lists them for deletion. The input is the AI ​​evaluation results, and the output is a list of photos to delete.

[1250] Step 7:

[1251] The cloud server sends a deletion instruction to the device for the identified unnecessary photos. This deletion instruction includes the ID and location information of the photo data to be deleted. The input is a list of deletion candidates, and the output is the deletion instruction sent to the device.

[1252] Step 8:

[1253] The device receives a deletion command from the cloud server and deletes the corresponding photo from the photo gallery. The deleted photo is moved to a temporary storage area on the device. The input is the deletion command, and the output is the photo deleted from the gallery and moved to the temporary storage area.

[1254] Step 9:

[1255] When a user opens the "Clean Data Box" app, a list of deleted photos is displayed. The user can select a specific photo from this list and press the restore button to place the photo back in the photo gallery. The input is the list of deleted photos and the user's actions, and the output is the restored photo.

[1256] Step 10:

[1257] The recommendation algorithm on the cloud server uses the user's emotional data to create a list of the best dishes and restaurants for the next order and sends it to the device. The input is the user's emotional data and past order data, and the output is a list of recommended dishes and restaurants.

[1258] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1259] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1260] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1261] [Fourth embodiment]

[1262] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1263] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1264] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1265] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1266] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1267] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1268] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1269] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1270] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1271] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1272] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1273] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1274] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1275] This invention is a system for efficiently managing smartphone storage capacity. In this system, the device sends photo data to a cloud server, and an AI module on the cloud server identifies unnecessary photos and automatically deletes them. The following describes the details of the program processing of this system and a specific example.

[1276] Explanation of program processing

[1277] 1. Send photo data from your device

[1278] When a user takes a photo with their smartphone, the photo data is saved in the device's photo gallery.

[1279] The device periodically connects to the cloud server and uploads newly taken photos to the server, along with any metadata associated with the photos (e.g., photo date and time, GPS information, etc.).

[1280] 2. Receiving and analyzing photo data on the cloud server

[1281] The cloud server receives the photo data and stores it in a temporary storage area.

[1282] The AI ​​module on the server analyzes the received photo data and identifies unwanted photos based on content and metadata, including image similarity analysis, automatic screenshot detection, and algorithms to select the best photos from a series of photos.

[1283] 3. Instructions for deleting unnecessary photos

[1284] The AI ​​module generates a list of photos that it determines are unnecessary, and the cloud server uses this list to send deletion instructions to the device.

[1285] On the other hand, the cloud server temporarily stores photo data that is determined to be unnecessary for a certain period of time (e.g., three months) rather than immediately, allowing users to recover photos that have been accidentally deleted.

[1286] 4. Delete unnecessary photos on your device

[1287] The device receives a deletion instruction from the cloud server and deletes the corresponding unnecessary photos from the photo gallery.

[1288] Deleted photo data is moved to a temporary storage area on the device. By accessing this area, users can recover deleted photos within three months.

[1289] 5. User Verification and Recovery Options

[1290] When a user opens the "Clean Data Box" app, a list of deleted photos is displayed.

[1291] If the user wants to review the deleted photos and restore a specific photo, they can select it from this list and press the restore button to restore the photo to the device's photo gallery.

[1292] Specific examples

[1293] 1. Users take lots of photos while traveling

[1294] Users take many photos with their smartphones while traveling, and sometimes take multiple photos of the same scenery from slightly different angles.

[1295] 2. Send new photo data from the device to the server

[1296] After returning home from a trip, the device automatically connects to the cloud server and uploads new photo data, including all photos taken during the trip and their metadata.

[1297] 3. AI analysis on a cloud server

[1298] Based on the photo data received by the cloud server, AI analyzes the content of the photos and distinguishes between highly similar photos, unclear photos, accidentally taken screenshots, etc. For example, if 10 photos of a night view have been taken, the AI ​​will keep only the one it judges to be the best quality and discard the other nine.

[1299] 4. Instructions for deleting unnecessary photos

[1300] The cloud server generates a list of photos that are determined to be unnecessary, and based on this, sends an instruction to delete the photos to the terminal.

[1301] 5. The user can confirm the photo deletion in the app and restore it if necessary.

[1302] When users open the "Clean Data Box" app, they can see a list of deleted photos. They can then select the photos they need from this list and restore them to their photo gallery.

[1303] Through the above-described embodiment, the system can automatically delete unnecessary photos, effectively manage smartphone storage capacity, and save users the trouble of manually organizing photos, reducing the risk of losing important photos.

[1304] The processing flow will be explained below.

[1305] Step 1:

[1306] A user takes a photo with their smartphone.

[1307] When a user takes a photo using the camera app, the photo data is automatically saved to the device's photo gallery.

[1308] Step 2:

[1309] The device connects to the cloud server.

[1310] Your device periodically connects to the cloud server to check the latest synchronization status. This connection occurs in the background and does not require user interaction.

[1311] Step 3:

[1312] The device will upload the new photo data.

[1313] The device detects new photos in the photo gallery and uploads them to the cloud server, including metadata such as the date and time the photo was taken and GPS information.

[1314] Step 4:

[1315] The server receives the photo data.

[1316] The cloud server receives the photo data sent from the terminal and stores it in a temporary storage area.

[1317] Step 5:

[1318] The server's AI module analyzes the photo.

[1319] The AI ​​module in the server analyzes the received photo data. The AI ​​evaluates the similarity of each photo and detects screenshots and rapid-fire photos. Specifically, the AI ​​compares pixel patterns and metadata of the images and groups unwanted photos using cluster analysis.

[1320] Step 6:

[1321] The server's AI module identifies unnecessary photos.

[1322] The AI ​​uses different criteria (e.g. similarity, image quality, metadata) to select the best photo from multiple photos and discard the rest, taking into account the user's custom settings.

[1323] Step 7:

[1324] The server generates a list of unwanted photos.

[1325] The AI ​​generates a list of unwanted photos on the server, which includes photos to be deleted and their associated metadata.

[1326] Step 8:

[1327] The server sends a deletion instruction to the terminal.

[1328] The server sends a deletion command to the device based on the list of unnecessary photos, including the ID and location information of the specific photo data.

[1329] Step 9:

[1330] The terminal receives the deletion instruction.

[1331] The device receives the deletion instruction from the cloud server and automatically deletes the photo from the photo gallery without user intervention.

[1332] Step 10:

[1333] Your device will move the deleted photos to a temporary storage location.

[1334] The device will move the deleted photo data to a temporary storage area, where it will be stored for a certain period of time and can be restored by the user if necessary.

[1335] Step 11:

[1336] The user checks the list of deleted photos.

[1337] When a user opens the "Clean Data Box" app, they are presented with a list of deleted photos, including thumbnails of the photos and the date and time of their deletion.

[1338] Step 12:

[1339] Users can restore photos as needed.

[1340] When the user selects the photos they want to restore from the deleted list and presses the restore button, the photo data is resent from the cloud server and relocated to the device's photo gallery.

[1341] This series of steps allows users to efficiently manage their smartphone storage, saving only the important photos without cluttering it with unnecessary ones.

[1342] Example 1

[1343] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1344] Since smartphones have limited storage capacity, it is necessary to efficiently manage storage and reduce the time and effort required for users to manually organize unnecessary photos. It is also important to reduce the risk of accidentally deleting important photos.

[1345] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1346] In this invention, the server includes a means for transmitting photo data from the terminal to the cloud server, a means for the cloud server to receive the photo data and analyze the photos using an AI module, and a means for the AI ​​module to identify unnecessary photos based on the photo content and metadata, thereby enabling automatic deletion of unnecessary photo data and simplifying recovery by the user.

[1347] "Terminal" refers to a mobile device owned by a user, such as a smartphone or tablet.

[1348] A "cloud server" refers to a server system that stores and processes data remotely via the Internet.

[1349] "Photo data" refers to image data taken by a user and associated metadata (e.g., date and time of photo, GPS information, etc.).

[1350] "AI module" refers to a software component that uses artificial intelligence to analyze photo data and identify unnecessary photos.

[1351] "Metadata" refers to auxiliary information that accompanies photo data (e.g., photo date and time, GPS information, etc.).

[1352] "Unnecessary photos" refers to photo data that has been determined to be unnecessary for the user based on the analysis results of the AI ​​module.

[1353] The "deletion instruction" refers to instruction information sent by the cloud server to the terminal to delete unnecessary photos.

[1354] "Temporary storage location" refers to a storage area where deleted photo data is stored for a certain period of time (e.g., three months) so that users can recover it.

[1355] "Recovery" refers to the action of a user returning deleted photo data stored in a temporary storage location to the device's photo gallery.

[1356] "Synchronization means" refers to a function that enables a terminal to periodically synchronize data with a cloud server.

[1357] "Similarity analysis" refers to the process by which an AI module evaluates the degree of image correspondence and similarity between multiple photo data.

[1358] "Screenshot detection" refers to the process by which an AI module automatically identifies screenshots from photo data.

[1359] "Best selection of burst photos" refers to the process in which the AI ​​module selects the best photo from a series of photos.

[1360] "Application" refers to a software program that a user can run on a smartphone or tablet.

[1361] "Deleted photo list" refers to a list that can be used by a user to check deleted photo data and restore them.

[1362] The present invention is a system for efficiently managing smartphone storage capacity. In this system, the device sends photo data to a cloud server, and an AI module on the cloud server identifies unnecessary photos and automatically deletes them. A specific embodiment of this system is described below.

[1363] System hardware and software configuration

[1364] Device: A mobile device such as a smartphone or tablet on which the "Photo Uploader" and "Clean Data Box" apps will be installed.

[1365] Cloud server: A server system that stores and processes data remotely and is equipped with AI modules.

[1366] AI module: A software component deployed on a cloud server that performs image analysis and identifies unnecessary photos.

[1367] Example of operation

[1368] 1. Sending photo data from the device to the cloud server

[1369] When a user takes a photo with their smartphone, the photo data is saved in the device's photo gallery.

[1370] The device's "Photo Uploader" app automatically uploads newly taken photos to the cloud server at regular intervals, along with any metadata associated with the photos (e.g., photo date and time, GPS information, etc.).

[1371] 2. Receiving and analyzing photo data on the cloud server

[1372] The cloud server stores the received photo data in a temporary storage area.

[1373] An AI module on the cloud server analyzes the received photo data, using algorithms to analyze image similarities, detect screenshots, and select the best photo from a series of photos.

[1374] For example, if 10 photos of a night view are taken, the AI ​​will keep only the one it judges to be of the best quality and determine the other nine as unnecessary.

[1375] 3. Instructions for deleting unnecessary photos and how to respond

[1376] The AI ​​module generates a list of photos that it determines are unnecessary, and the cloud server sends a deletion instruction to the device.

[1377] The cloud server does not immediately delete the identified unnecessary photos, but stores them in a temporary storage area for a certain period of time (e.g., three months) so that users can restore the deleted photos.

[1378] 4. Delete unwanted photos on your device and recover them with options

[1379] The device receives a deletion instruction from the cloud server and deletes the corresponding unnecessary photos from the photo gallery.

[1380] Deleted photo data is moved to a temporary storage area on the device, and users can recover deleted photos within three months through the "Clean Data Box" app.

[1381] When a user opens the "Clean Data Box" app, a list of deleted photos is displayed, and the user can select the photos they need and restore them. For example, they can use the "Clean Data Box" app to check photos taken during a trip and restore one that was accidentally deleted.

[1382] This process allows users to efficiently manage their smartphone storage space, eliminates the need for manual organizing by automatically deleting unnecessary photos, and reduces the risk of accidentally deleting important photos.

[1383] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1384] Step 1:

[1385] The device sends the photo data to the cloud server.

[1386] Details: When a user takes a photo with their smartphone, the photo data is saved in the photo gallery. The device's "Photo Uploader" app periodically uploads this saved photo data and metadata (such as the date and time of the photo, GPS information, etc.) to a cloud server.

[1387] Input: Photo data and metadata taken by the user on the device

[1388] Output: Photo data uploaded to the cloud server

[1389] Step 2:

[1390] The cloud server receives the photo data and stores it in a temporary storage area.

[1391] Details: The cloud server receives new photo data sent from the device and stores it in a temporary storage area. At that time, the metadata is also stored in the temporary storage area along with the photo data.

[1392] Input: Photo data and metadata sent from the device

[1393] Output: Photo data stored in temporary storage area

[1394] Step 3:

[1395] The AI ​​module on the cloud server analyzes the received photo data and identifies unnecessary photos.

[1396] Details: An AI module on a cloud server analyzes photo data using algorithms that analyze image similarity, detect screenshots, and select the best shot from a series of photos. Based on this, it identifies unwanted photos and generates a list of them.

[1397] Input: Photo data and metadata stored in temporary storage area

[1398] Output: A list of unwanted photos

[1399] Step 4:

[1400] The cloud server sends a deletion instruction to the terminal based on a list of photos that have been determined to be unnecessary.

[1401] Details: After the cloud server generates a list of unnecessary photos, it sends a deletion instruction to the device based on that list. This deletion instruction includes information about the specific photo data.

[1402] Input: A list of unwanted photos

[1403] Output: Delete instructions to the terminal

[1404] Step 5:

[1405] The terminal receives a deletion instruction from the cloud server and deletes unnecessary photos from the photo gallery.

[1406] Details: When the device receives a deletion command, it deletes the target photo data from the device's photo gallery. The deleted photo data is moved to the device's temporary storage area.

[1407] Input: Deletion instructions from cloud server

[1408] Output: Deleted photos from Photo Gallery and moved to temporary storage area

[1409] Step 6:

[1410] Users can use the "Clean Data Box" app to check deleted photos and restore them if necessary.

[1411] Details: When a user opens the "Clean Data Box" app, a list of deleted photos is displayed. The user selects the photos they need from the list and presses the restore button, which places them back in the photo gallery.

[1412] Input: Deleted photo data stored in temporary storage area

[1413] Output: Recovered photos in Photo Gallery

[1414] (Application example 1)

[1415] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1416] In order to streamline inventory management and picking operations at logistics centers, it is important to efficiently manage photo data of inventory items taken by workers. However, the storage capacity of smart glasses and other devices is limited, and the accumulation of unnecessary photos can hinder speedy work. Another problem is that blurry or duplicate photos make it difficult to grasp accurate inventory information. To solve these issues, a system is needed that manages photo data in the cloud and automatically identifies and deletes unnecessary photos.

[1417] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1418] In this invention, the server includes: means for transmitting photo data and metadata from the terminal to the cloud server; means for the cloud server to receive the photo data and metadata and analyze the photos using an AI module; means for the AI ​​module to identify unnecessary photos based on the photo content and metadata; means for deleting unnecessary photos from the cloud server; means for the cloud server to send a delete instruction to the terminal for the identified unnecessary photos; means for the terminal to delete the unnecessary photos based on the delete instruction; means for the warehouse management eyeglass terminal to send inventory photo data to the cloud server; means for the cloud server to receive the inventory photo data and identify and delete unnecessary photos using the AI ​​module; and means for the terminal to move the deleted photos to a temporary storage location so that the user can restore them within a certain period of time. This enables more efficient inventory management and picking work and optimal management of storage capacity.

[1419] "Terminal" refers to eyeglass terminals and other devices worn by workers at logistics centers.

[1420] A "cloud server" refers to a server system that connects to devices via the Internet and receives and sends photo data and metadata.

[1421] "Photo data" refers to image information captured by the device's camera.

[1422] "Metadata" refers to supplementary information such as the date and time of the photo being taken and the shelf number that accompanies the photo data.

[1423] "AI module" refers to an artificial intelligence algorithm or program that analyzes photo data and metadata on a cloud server and identifies unnecessary photos.

[1424] "Unnecessary photos" refer to photos that, after analysis, have been determined not to need to be saved, such as duplicate images or blurry images.

[1425] A "deletion instruction" refers to a command from the cloud server to the terminal prompting the terminal to delete unnecessary photos.

[1426] "Deleted photos" refers to photo data that has been determined to be unnecessary on the cloud server and on the device and has been deleted.

[1427] "Temporary storage location" refers to a location where deleted photos are stored for a certain period of time, and indicates an area where users can recover photos that have been accidentally deleted.

[1428] An "eyeglass terminal for warehouse management" refers to an eyeglass-type device equipped with a camera and communication functions that is used for inventory management and picking operations at logistics centers.

[1429] This invention is a system for improving the efficiency of inventory management and picking work at logistics centers. This system sends photo data of inventory items taken by eyeglass-type devices worn by workers to a cloud server, and an AI module on the server identifies unnecessary photos and automatically deletes them. Details of the program processing of this system and specific examples are described below.

[1430] System configuration

[1431] The system mainly uses the following hardware and software:

[1432] Hardware: Glasses-type device and cloud server

[1433] Software: Smart inventory management app with image analysis AI module, cloud storage, deletion instruction program, and recovery options

[1434] Program processing description

[1435] 1. Sending photo data and metadata from your device

[1436] A worker wears a glasses-type device and takes photos of inventory items. The device periodically connects to a cloud server and transmits the captured photo data and metadata (e.g., photo date and time, shelf number, etc.).

[1437] 2. Data reception and analysis on the cloud server

[1438] The cloud server receives the photo data and metadata and stores them in a temporary storage area. An AI module on the server analyzes the data and identifies unwanted photos. The criteria include similarity analysis, blur detection, and a duplicate photo removal algorithm.

[1439] 3. Instructions for deleting unnecessary photos and their execution

[1440] The cloud server creates a list of unnecessary photos and sends a deletion instruction to the device, which then deletes the unnecessary photos from the device based on this instruction.

[1441] 4. Temporarily save and restore photo data

[1442] The deleted photo data will be moved to a temporary storage location on the device. Users can use the "Smart Inventory Management App" to check the list of deleted photos and restore them within a certain period of time if necessary.

[1443] Specific examples

[1444] 1. Inventory taking by workers

[1445] When workers take inventory, they often take many photos of inventory items using eyeglasses, and sometimes they take multiple photos of inventory items on the same shelf.

[1446] 2. Data transmission and AI analysis

[1447] During or after a photo is taken, the glasses connect to a cloud server and upload the new photo data and metadata. An AI module on the server analyzes this data, identifying similar or unclear photos and deciding they are unnecessary.

[1448] 3. Instructions for deleting unnecessary photos

[1449] The AI ​​module creates a list of photos that it has determined are unnecessary, and the cloud server sends deletion instructions to the device. The device then deletes the photos in accordance with the received instructions.

[1450] 4. Recovery operations by the user

[1451] Users can open the "Smart Inventory Management App" to check the list of deleted photos, and within a certain period of time, they can select and relocate the photos they need.

[1452] Prompt Sentence Examples

[1453] Design a system in which workers at a logistics center use smart glasses to manage inventory. The smart glasses take photos of inventory items and send the images to a cloud server, where AI on the server automatically deletes and manages unnecessary images, optimizing storage capacity. Please also explain the hardware (smart glasses, cloud server) and software (image analysis AI, smart inventory management app) used.

[1454] In this way, the present invention makes it possible to improve the efficiency of inventory management in a logistics center and to optimally manage the storage capacity of terminals.

[1455] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1456] Step 1:

[1457] The terminal takes and acquires photographic data and metadata of inventory items. The input is the image taken by the worker with the camera on the eyeglass terminal and the metadata associated with the image (e.g., date and time of photo, shelf number). The terminal stores this photographed data.

[1458] Step 2:

[1459] The device periodically connects to the cloud server and uploads the captured photo data and metadata. The input is the photo data and metadata stored in the device. The data is then sent from the device to the cloud server.

[1460] Step 3:

[1461] The cloud server receives the photo data and metadata and stores them in a temporary storage area. The input is the photo data and metadata sent from the device. The server saves them in a temporary storage location.

[1462] Step 4:

[1463] The AI ​​module on the cloud server analyzes the received photo data and metadata. The input is the photo data and metadata stored in the temporary storage area. The AI ​​module uses an image recognition algorithm to analyze the content of the photo and performs data processing and calculations to identify unnecessary photos.

[1464] Step 5:

[1465] The AI ​​module identifies unwanted photos and generates a list of them. The output is a list of unwanted photos. The AI ​​module performs similarity analysis and blur detection, and lists the identified unwanted photos.

[1466] Step 6:

[1467] The cloud server sends deletion instructions to the device based on the list of unnecessary photos. The input is the list of unnecessary photos generated by the AI ​​module. The server sends instructions to the device to delete unnecessary photos based on this list.

[1468] Step 7:

[1469] The device receives a deletion instruction from the cloud server and deletes the corresponding unnecessary photos from the device. The input is the deletion instruction sent from the cloud server. The device follows this instruction and deletes the unnecessary photos.

[1470] Step 8:

[1471] The deleted photo data is moved to a temporary storage location on the device. The input is the photo data deleted based on the deletion instruction. The device moves this to a temporary storage area and stores it in this area for a certain period of time.

[1472] Step 9:

[1473] The user opens the "Smart Inventory Management App" to see a list of deleted photos. The input is the list of deleted photos in the temporary storage area. The app displays this to the user.

[1474] Step 10:

[1475] The user selects the photos they need and performs the recovery operation. The input is the photos the user selected in the app. The app recovers the selected photo data and saves it back to the device's main storage.

[1476] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1477] This invention relates to a system for efficiently managing smartphone storage capacity. In particular, by combining it with an emotion engine that recognizes user emotions, it provides a method for more accurately determining the value of photos and automatically deleting unnecessary photos. An example of this system is described in detail below, with a program process explained in natural language and specific examples included.

[1478] Explanation of program processing

[1479] 1. Send photo data from your device

[1480] When a user takes a photo using the camera app on their smartphone, the photo data is saved in the device's photo gallery. The device periodically connects to the cloud server and uploads the latest photo data to the server. At this time, metadata associated with the photo (e.g., the date and time the photo was taken, GPS information, etc.) is also sent.

[1481] 2. Emotion Engine Data Collection

[1482] When taking a photo, the emotion engine analyzes the user's facial expressions and voice to generate emotion data, including emotions such as "smile," "surprise," "dissatisfaction," and "sadness."

[1483] 3. Receiving and analyzing data on the server

[1484] The cloud server receives the photo data and emotion data sent from the terminal and stores them in a temporary storage area.

[1485] The AI ​​module analyzes the received photo data and emotional data, and evaluates the importance of each photo based on the content of the photo and the user's emotional data.

[1486] 4. Identify unwanted photos

[1487] The AI ​​module identifies unwanted photos based on both the content and emotional data of the photo. For example, photos in which the user expressed negative emotions when taking the photo will be prioritized as unwanted.

[1488] 5. Generating removal instructions

[1489] The AI ​​module on the cloud server generates a list of photos that it has determined are unnecessary and sends a deletion instruction to the device, which includes the ID and location information of the photo data.

[1490] 6. Deleting photos on your device

[1491] The device receives the deletion command from the cloud server and deletes the photo from the photo gallery. The deleted photo is moved to a temporary storage area on the device.

[1492] 7. User Verification and Recovery

[1493] When a user opens the "Clean Data Box" app, a list of deleted photos is displayed. The user can select a specific photo from this list and press the restore button, which will place the photo back in the photo gallery.

[1494] Specific examples

[1495] 1. Users take lots of photos while traveling

[1496] When a user takes many photos with their smartphone while traveling, the emotion engine analyzes the user's facial expressions and voice and tags them with positive emotions (e.g., smiling) or negative emotions (e.g., dissatisfaction).

[1497] 2. Send data from the device to the server

[1498] After returning home from a trip, the device automatically connects to the cloud server and uploads new photo data and corresponding emotion data.

[1499] 3. AI analysis on a cloud server

[1500] Based on the photo data received by the cloud server, the AI ​​module analyzes the emotional data and image content. Among multiple photos of the same scene taken from slightly different angles, photos in which the user is smiling are prioritized and saved, while other photos are deemed unnecessary.

[1501] 4. Instructions for deleting unnecessary photos

[1502] The cloud server generates a list of photos that are deemed unnecessary and sends a deletion instruction to the device, which then receives the instruction and deletes the photos from its photo gallery.

[1503] 5. User can check and recover photos in the app

[1504] When a user opens the "Clean Data Box" app, a list of deleted photos is displayed. From this list, the user can select a specific photo and press the restore button to restore it to the photo gallery.

[1505] This embodiment allows users to efficiently manage smartphone storage by effectively saving only high-quality photos and automatically deleting unnecessary photos. In addition, by combining emotion data, photo management can be more in line with the user's intentions.

[1506] The processing flow will be explained below.

[1507] Step 1:

[1508] A user takes a photo with their smartphone.

[1509] When a user takes a photo using the camera app, the photo data is automatically saved to the device's photo gallery. The emotion engine immediately starts working, analyzing the user's facial expressions and voice to generate emotion data. This emotion data includes information such as "smile" or "sadness."

[1510] Step 2:

[1511] The device connects to the cloud server.

[1512] The device automatically connects to the cloud server at regular intervals to check the latest synchronization status.

[1513] Step 3:

[1514] The device uploads new photo data and emotion data.

[1515] The device detects new photos in the photo gallery and the corresponding emotion data, and uploads them to the cloud server, including metadata such as the date and time of the photo and GPS information.

[1516] Step 4:

[1517] The server receives the photo data.

[1518] The cloud server receives the photo data and emotion data sent from the terminal and stores them in a temporary storage area.

[1519] Step 5:

[1520] The server's AI module analyzes the photo.

[1521] The AI ​​module on the server analyzes the received photo data and emotional data. The AI ​​evaluates the similarity of each photo and detects screenshots and rapid-fire photos. Based on the emotional data, it prioritizes saving photos that show positive emotions.

[1522] Step 6:

[1523] The server's AI module identifies unnecessary photos.

[1524] AI uses image similarity assessments, metadata, and emotional data to identify unwanted photos. For example, it will keep photos in which the user is smiling, but discard photos that show negative emotions or photos with nearly identical content.

[1525] Step 7:

[1526] The server generates a list of unwanted photos.

[1527] The AI ​​generates a list of unwanted photos on the server, which includes photos to be deleted and their associated metadata.

[1528] Step 8:

[1529] The server sends a deletion instruction to the terminal.

[1530] The server sends a deletion command to the device based on the list of unnecessary photos, including the ID and location information of the specific photo data.

[1531] Step 9:

[1532] The terminal receives the deletion instruction.

[1533] The device receives the deletion instruction from the cloud server and automatically deletes the photo from the photo gallery without user intervention.

[1534] Step 10:

[1535] Your device will move the deleted photos to a temporary storage location.

[1536] The device will move the deleted photo data to a temporary storage area, where it will be stored for a certain period of time and can be restored by the user if necessary.

[1537] Step 11:

[1538] The user checks the list of deleted photos.

[1539] When a user opens the "Clean Data Box" app, they are presented with a list of deleted photos, including thumbnails of the photos and the date and time of their deletion.

[1540] Step 12:

[1541] Users can restore photos as needed.

[1542] When the user selects the photos they want to restore from the deleted list and presses the restore button, the photo data is resent from the cloud server and relocated to the device's photo gallery.

[1543] This series of steps allows users to efficiently manage their smartphone storage and leverage emotional data to identify and retain important photos.

[1544] Example 2

[1545] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1546] Conventional smartphone storage management systems have had difficulty automatically determining the value of photos and efficiently deleting unnecessary ones. In particular, methods for determining unnecessary photos that rely on simple metadata or image analysis without considering the user's intentions or emotions tend to result in unintended deletion of photos. Furthermore, managing unnecessary photos is a time-consuming task for users, resulting in wasteful storage.

[1547] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1548] In this invention, the server includes a means for transmitting photo data from the terminal to the cloud server, a means for the cloud server to receive the photo data and generate emotion data using an emotion engine, and a means for the cloud server to analyze the photo data and emotion data using an AI module. This makes it possible to comprehensively evaluate the content, metadata, and emotion data of photos and identify and delete unnecessary photos. This allows for efficient storage management in line with the user's intentions and reduces the effort required to delete unnecessary photos.

[1549] "Terminal" refers to a portable communication device such as a smartphone or tablet.

[1550] "Cloud server" refers to a remote server for storing and managing data via the Internet.

[1551] "Photo data" refers to digital data of still images taken with a smartphone or tablet.

[1552] An "emotion engine" is a software module that analyzes a user's facial expressions and voice to estimate their emotional state at that time.

[1553] "Emotion Data" refers to digital data that indicates the user's emotional state as analyzed by the emotion engine.

[1554] "AI module" refers to a software component that uses artificial intelligence technology to analyze photo data and emotional data and make specific decisions.

[1555] "Metadata" refers to information that accompanies photo data, such as the date and time the photo was taken and GPS information.

[1556] "Unnecessary photos" refer to photo data that is determined to be of low importance to the user.

[1557] A "delete instruction" refers to a digital signal sent from the cloud server to a device instructing it to delete a specific photo.

[1558] "Temporary storage location" refers to the area where deleted photo data is temporarily stored on the device.

[1559] This invention relates to a system that allows users to send photo data taken using devices such as smartphones and tablets to a cloud server, and automatically evaluates and determines the value of the photos using an AI module and emotion engine.

[1560] System Configuration

[1561] The system consists of a terminal, a cloud server, and various software components such as an AI module, an emotion engine, a photo gallery app, and a "Clean Data Box" app.

[1562] The device is installed with a camera app for taking photos and saving them to a photo gallery, and software including an emotion engine. The cloud server is equipped with an AI module for analyzing photo data and emotion data. The cloud server also has a function to set up a temporary storage area for each user and temporarily store deleted photo data.

[1563] Data transmission and analysis

[1564] When a user takes a photo using their smartphone's camera app, the photo data and its metadata (such as the date and time of the photo and GPS information) are saved in the device's photo gallery. The emotion engine analyzes the user's facial expressions and voice when the photo is taken, generates emotion data, and saves it on the device. The device then periodically connects to the cloud server to upload new photo data and emotion data.

[1565] Once the cloud server receives this data, it stores it in a temporary storage area. Next, the AI ​​module analyzes the photo's content, metadata, and emotional data to evaluate and determine the importance of each photo. By taking into account the emotions expressed by the user when taking the photo (e.g., smile, surprise, dissatisfaction, etc.), the value of the photo can be determined more accurately.

[1566] Identify and delete unwanted photos

[1567] Once the AI ​​module identifies unnecessary photos based on their content and emotional data, the cloud server creates a list and sends deletion instructions to the device. The device then deletes the photos from the photo gallery and places them in a temporary storage area, allowing users to restore the deleted photos within a certain period of time.

[1568] When users open the "Clean Data Box" app, a list of deleted photos is displayed and they can select specific photos to restore, making it easy to recover photos that have been accidentally deleted.

[1569] Specific examples

[1570] When a user takes many photos with their smartphone while traveling, the emotion engine analyzes the user's facial expressions and voice to generate emotion data such as "smile," "surprise," or "dissatisfaction." After returning home, the device automatically connects to the cloud server and uploads new photo data and emotion data. The cloud server's AI module analyzes this data, identifies unnecessary photos, and sends deletion instructions to the device. Based on the deletion instructions, the device deletes the photos from the photo gallery and moves them to a temporary storage area. The user can use the "Clean Data Box" app to check the deleted photos and restore them if necessary.

[1571] Prompt Sentence Examples

[1572] "Please explain in detail each processing step of a system that automatically identifies and deletes unnecessary photos in order to efficiently manage the storage of the many photos taken on a smartphone while traveling. Please also include a method for using an emotion engine to recognize the user's emotions and evaluate the value of the photos based on that information."

[1573] This system allows users to efficiently manage smartphone storage capacity by effectively saving only high-quality photos and automatically deleting unnecessary photos. By combining this with emotional data, photo management can be achieved in line with the user's intentions.

[1574] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1575] Step 1:

[1576] Send photo data from your device

[1577] Device: A user takes a photo using the smartphone's camera app. At this time, the captured photo data is automatically saved in the device's photo gallery. The device then periodically connects to the cloud server and uploads the latest photo data in the photo gallery to the cloud server.

[1578] Input: Photo data (and metadata) stored in the photo gallery

[1579] Output: Sending photo data and metadata to a cloud server

[1580] What it does: The photo gallery app runs in the background and automatically detects new photos when connected to Wi-Fi and uploads them to the cloud server.

[1581] Step 2:

[1582] Generating emotion data

[1583] On device: When a photo is taken, the emotion engine analyzes the user's facial expressions and voice to generate emotion data, which is linked to the photo and stored on the device.

[1584] Input: User's facial expressions, voice, and photo data

[1585] Output: Generated emotion data (e.g., smile, surprise, dissatisfaction, etc.)

[1586] Specific operation: The camera app works in conjunction with the emotion engine to analyze the user's facial recognition and voice data in real time and generate data with emotion labels.

[1587] Step 3:

[1588] Data reception and analysis on the server

[1589] Server: The cloud server receives the photo data and emotion data sent from the device and stores them in a temporary storage area.The AI ​​module then analyzes the photo content, metadata, and emotion data.

[1590] Input: Photo data, metadata, and emotion data uploaded to the cloud server.

[1591] Output: Analysis results (importance rating for each photo)

[1592] Specific operation: The cloud server stores all received data immediately after receiving it, and then the AI ​​module analyzes the photos and emotion data in batch processing to evaluate their importance.

[1593] Step 4:

[1594] Identifying unwanted photos

[1595] Server: The AI ​​module determines unnecessary photos based on the evaluation results. For example, photos with low evaluations (photos with negative emotions, similar photos, etc.) are determined to be unnecessary.

[1596] Input: AI photo evaluation results

[1597] Output: A list of unwanted photos

[1598] How it works: The AI ​​module generates a score for each photo and creates a list of unwanted photos based on that score.

[1599] Step 5:

[1600] Generate removal instructions

[1601] Server: The cloud server generates and sends deletion instructions to the device based on the list of unnecessary photos identified.

[1602] Input: List of unwanted photos

[1603] Output: Delete instructions (including photo ID and location information)

[1604] Specific operation: The cloud server generates a deletion instruction including the photo ID and location information and sends it to the device.

[1605] Step 6:

[1606] Deleting photos on your device

[1607] Device: Based on the deletion instruction received by the device, the device will delete the target photos from the photo gallery. The deleted photos will be moved to a temporary storage location.

[1608] Input: Delete instruction received from the cloud server

[1609] Output: Deleted photo data, moved to temporary storage area

[1610] Specific operation: The photo gallery app receives the deletion command, deletes the specified photo, and moves it to a temporary storage area.

[1611] Step 7:

[1612] User confirmation and recovery

[1613] User: When the user opens the "Clean Data Box" app, a list of deleted photos will be displayed. The user can select a specific photo from this list and press the restore button to restore the photo to the photo gallery.

[1614] Input: list of deleted photos

[1615] Output: Recovered photos in Photo Gallery

[1616] Specific behavior: The user operates the app to check the deleted photos and taps the restore button to return the selected photos to the photo gallery.

[1617] (Application example 2)

[1618] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1619] Conventional smartphone storage management systems place a burden on users to identify and delete unnecessary photos, making efficient management difficult. Furthermore, the subjective value judgment of photos is also dependent on the user, making it difficult to organize photos appropriately. To address this issue, a method is needed to utilize user emotional data and automate photo evaluation.

[1620] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for transmitting photo data from the terminal to the cloud server; means for the cloud server to receive the photo data and analyze the photos using an AI module; means for the AI ​​module to identify unnecessary photos based on the photo content and metadata; means for deleting unnecessary photos from the cloud server; means for the cloud server to send a delete instruction to the terminal for the identified unnecessary photos; means for the terminal to delete the unnecessary photos from the terminal based on the delete instruction; means for the terminal to move the deleted photos to a temporary storage location so that the user can restore them within a certain period of time; means for the cloud server to evaluate the photo data using an emotion engine that analyzes the user's emotions; and means for the AI ​​module to evaluate the photos based on the user's emotion data and execute a recommendation algorithm. This allows photos to be automatically organized and evaluated based on the user's emotion data, enabling more efficient and intuitive storage management.

[1621] A "terminal" is a device operated by a user, which takes, saves, and transmits photo data.

[1622] A "cloud server" is a remote server that stores and analyzes data via the Internet, and is a computer system that receives and processes photo data and related information.

[1623] "Photo data" refers to digital data that includes image files taken by a user on a terminal and their metadata (such as the date and time of the photo, GPS information, etc.).

[1624] An "AI module" is a combination of software and hardware that uses artificial intelligence to analyze, evaluate, and learn from data.

[1625] The "emotion engine" is a system that analyzes emotions from a user's facial expressions and voice and generates the results as data.

[1626] "Metadata" refers to additional information included in photo data, and mainly includes the date and time of shooting, location information, camera setting information, and the like.

[1627] A "deletion instruction" is a signal that the cloud server issues to the terminal to instruct it to delete unnecessary photos.

[1628] The "temporary storage location" is a storage area that stores deleted photo data for a certain period of time so that the user can restore it if necessary.

[1629] A "recommendation algorithm" is a program that suggests appropriate content and products to users based on their past data and emotional data.

[1630] This invention is a system that efficiently manages smartphone photo data using an emotion engine that analyzes user emotions. In particular, in a food delivery application, it organizes and evaluates food photos and information based on the user's emotion data, and realizes a function to recommend the most suitable dishes to the user.

[1631] Hardware and software used

[1632] This system is realized mainly using the following hardware and software.

[1633] Smartphone (terminal): A device that allows users to take photos of food and collect emotion data.

[1634] Cloud server: A remote server for storing and analyzing data via the Internet, which receives and analyzes photo data and emotion data.

[1635] EmotionRecognizer module: Software for analyzing the user's facial expressions and recognizing emotions, built using TensorFlow and OpenCV.

[1636] RecommendationEngine module: Software for recommending appropriate dishes and restaurants based on users' past data and emotional data, developed using Scikit-learn and Pandas.

[1637] REST API: A communication method used to exchange data between a device and a cloud server.

[1638] Data processing and calculation procedures

[1639] The device collects photo data of food taken by the user and simultaneously generates emotion data from the user's facial expressions using an emotion engine. The photo data and emotion data are then uploaded to a cloud server. At this time, the generated emotion data and metadata (such as the date and time of the photo and information about the ordered food) are also sent.

[1640] The cloud server receives this data and stores it in a temporary storage area. The AI ​​module analyzes this data and rates the photos based on the user's emotional data and the content of the photos. As a result, the AI ​​module classifies highly rated food photos as "favorites" and identifies low-rated or unnecessary photos and marks them as candidates for deletion.

[1641] By running a recommendation algorithm, the system creates a list of the most suitable dishes and restaurants for the user and sends it to the device, taking into account the user's past emotional data and other users' evaluation data.

[1642] Specific examples

[1643] A user orders a pizza and takes a photo of themselves satisfied

[1644] A user orders a pizza, eats it, and then takes a photo with a satisfied expression. This photo is then uploaded to a cloud server along with a positive emotion (e.g., a smile).

[1645] Create a rating list based on emotion data on a cloud server

[1646] Photos and emotional data are analyzed on a cloud server, and dishes that users rate highly are automatically added to their "favorites."

[1647] User confirmation and next order

[1648] The next time users open the app, their "favorites" list will display dishes that they have previously rated highly, allowing them to refer to them the next time they order.

[1649] An example prompt would be, "Take a photo of a pizza and analyze the photo for satisfaction. If the emotion is positive, upload the data."

[1650] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1651] Step 1:

[1652] A user takes a photo of a dish with their smartphone. The smartphone (device) saves the captured photo data to its photo gallery. At the same time, the device also records the photo's metadata (date and time of the photo, GPS information, etc.). The input is the photo data and metadata, and the output is the saved photo file.

[1653] Step 2:

[1654] The device's emotion engine analyzes the user's facial expressions and voice while taking a photo. The device uses the emotion engine to generate emotion data. At this time, data collected using the smartphone's camera and microphone is the input, and the user's emotion data (e.g., satisfaction, surprise, dissatisfaction) is obtained as the output.

[1655] Step 3:

[1656] After a user takes a photo, the device periodically connects to the cloud server and uploads the latest photo data and corresponding emotion data to the cloud server. The input is the photo data, metadata, and emotion data, and the output is the data sent to the cloud server.

[1657] Step 4:

[1658] The cloud server receives the photo data and emotion data sent from the device and stores them in a temporary storage area. The server updates the database based on the stored photo data, metadata, and emotion data. The input is the various data sent, and the output is the data stored in the cloud storage.

[1659] Step 5:

[1660] The AI ​​module on the cloud server analyzes the received photo data and emotion data. The AI ​​module evaluates the importance of each photo based on the photo's content and emotion data. The input is the photo data and emotion data stored in the cloud, and the output is the analysis results (e.g., photo rating score and emotion tag).

[1661] Step 6:

[1662] The AI ​​module on the cloud server determines unnecessary photos based on the photo evaluation results. The server detects photos that users have indicated are unsatisfactory or are duplicates, and lists them for deletion. The input is the AI ​​evaluation results, and the output is a list of photos to delete.

[1663] Step 7:

[1664] The cloud server sends a deletion instruction to the device for the identified unnecessary photos. This deletion instruction includes the ID and location information of the photo data to be deleted. The input is a list of deletion candidates, and the output is the deletion instruction sent to the device.

[1665] Step 8:

[1666] The device receives a deletion command from the cloud server and deletes the corresponding photo from the photo gallery. The deleted photo is moved to a temporary storage area on the device. The input is the deletion command, and the output is the photo deleted from the gallery and moved to the temporary storage area.

[1667] Step 9:

[1668] When a user opens the "Clean Data Box" app, a list of deleted photos is displayed. The user can select a specific photo from this list and press the restore button to place the photo back in the photo gallery. The input is the list of deleted photos and the user's actions, and the output is the restored photo.

[1669] Step 10:

[1670] The recommendation algorithm on the cloud server uses the user's emotional data to create a list of the best dishes and restaurants for the next order and sends it to the device. The input is the user's emotional data and past order data, and the output is a list of recommended dishes and restaurants.

[1671] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1672] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1673] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1674] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1675] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1676] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1677] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1678] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1679] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1680] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1681] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1682] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1683] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1684] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1685] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1686] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1687] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1688] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1689] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1690] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1691] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1692] The following is further disclosed regarding the above embodiment.

[1693] (Claim 1)

[1694] A means for transmitting photo data from the terminal to a cloud server;

[1695] a cloud server receiving the photo data and analyzing the photo using an AI module;

[1696] A means for the AI ​​module to identify unwanted photos based on their content and metadata; and

[1697] A way to delete unnecessary photos from the cloud server,

[1698] A means for transmitting a deletion instruction to the terminal for the unnecessary photos determined by the cloud server;

[1699] A means for the terminal to delete unnecessary photos from the terminal based on a deletion instruction;

[1700] The device moves deleted photos to a temporary storage location, allowing the user to recover them within a certain period of time.

[1701] A system including:

[1702] (Claim 2)

[1703] 2. The system according to claim 1, wherein the cloud server further comprises means for allowing a user to set criteria for deleting unnecessary photos.

[1704] (Claim 3)

[1705] 10. The system of claim 1, wherein the terminal further comprises a synchronization means for transmitting new photo data to the cloud server.

[1706] "Example 1"

[1707] (Claim 1)

[1708] A means for transmitting photo data from the terminal to a cloud server;

[1709] a cloud server receiving the photo data and analyzing the photo using an AI module;

[1710] A means for the AI ​​module to identify unwanted photos based on their content and metadata; and

[1711] A means for transmitting a deletion instruction to the terminal for the unnecessary photos determined by the cloud server;

[1712] A means for the terminal to delete unnecessary photos from the terminal based on a deletion instruction;

[1713] The device moves deleted photos to a temporary storage location, allowing the user to recover them within a certain period of time.

[1714] A means for the cloud server to store unnecessary photos for a certain period in a temporary storage area;

[1715] A means for the device to periodically connect to a cloud server and upload newly taken photo data;

[1716] The AI ​​module on the cloud server analyzes the similarity of images, detects screenshots, and selects the best burst photos.

[1717] A means for users to use the application to view and recover deleted photos;

[1718] A system including:

[1719] (Claim 2)

[1720] 2. The system according to claim 1, wherein the cloud server further comprises means for allowing a user to set criteria for deleting unnecessary photos.

[1721] (Claim 3)

[1722] 10. The system of claim 1, wherein the terminal further comprises a synchronization means for transmitting new photo data to the cloud server.

[1723] "Application Example 1"

[1724] (Claim 1)

[1725] means for transmitting photo data and metadata from the terminal to a cloud server;

[1726] a cloud server receiving the photo data and metadata and analyzing the photo using an AI module;

[1727] A means for the AI ​​module to identify unwanted photos based on their content and metadata; and

[1728] A way to delete unnecessary photos from the cloud server,

[1729] A means for transmitting a deletion instruction to the terminal for the unnecessary photos determined by the cloud server;

[1730] A means for the terminal to delete unnecessary photos from the terminal based on a deletion instruction;

[1731] A means for a warehouse management eyeglass terminal to transmit photo data of inventory items to a cloud server;

[1732] A cloud server receives photo data of inventory items and uses an AI module to identify and delete unnecessary photos;

[1733] The device moves deleted photos to a temporary storage location, allowing the user to recover them within a certain period of time.

[1734] A system including:

[1735] (Claim 2)

[1736] 2. The system according to claim 1, wherein the cloud server further comprises means for allowing a user to set criteria for deleting unnecessary photos.

[1737] (Claim 3)

[1738] 10. The system of claim 1, wherein the terminal further comprises a synchronization means for transmitting new photo data to the cloud server.

[1739] "Example 2: Combining Emotion Engines"

[1740] (Claim 1)

[1741] A means for transmitting photo data from the terminal to a cloud server;

[1742] A cloud server receives the photo data and generates emotion data using an emotion engine;

[1743] A means for the cloud server to analyze the photo data and emotion data using an AI module;

[1744] A means for the AI ​​module to identify unwanted photos based on the content, metadata, and emotional data of the photos;

[1745] A means for transmitting a deletion instruction to the terminal for the unnecessary photos determined by the cloud server;

[1746] A means for the terminal to delete unnecessary photos from the terminal based on a deletion instruction;

[1747] The device moves deleted photos to a temporary storage location, allowing the user to recover them within a certain period of time.

[1748] A system including:

[1749] (Claim 2)

[1750] 2. The system according to claim 1, wherein the cloud server further comprises means for allowing a user to set criteria for deleting unnecessary photos.

[1751] (Claim 3)

[1752] 10. The system of claim 1, wherein the terminal further comprises a synchronization means for transmitting new photo data to the cloud server.

[1753] "Application example 2 when combining emotion engines"

[1754] (Claim 1)

[1755] A means for transmitting photo data from the terminal to a cloud server;

[1756] a cloud server receiving the photo data and analyzing the photo using an AI module;

[1757] A means for the AI ​​module to identify unwanted photos based on their content and metadata; and

[1758] A way to delete unnecessary photos from the cloud server,

[1759] A means for transmitting a deletion instruction to the terminal for the unnecessary photos determined by the cloud server;

[1760] A means for the terminal to delete unnecessary photos from the terminal based on a deletion instruction;

[1761] The device moves deleted photos to a temporary storage location, allowing the user to recover them within a certain period of time.

[1762] A cloud server evaluates the photo data using an emotion engine that analyzes the user's emotions;

[1763] The AI ​​module evaluates photos based on the user's emotional data and executes the recommendation algorithm;

[1764] A system including:

[1765] (Claim 2)

[1766] 2. The system according to claim 1, wherein the cloud server further comprises means for allowing a user to set criteria for determining whether to delete unnecessary photos and criteria for evaluating the photos.

[1767] (Claim 3)

[1768] 10. The system of claim 1, wherein the terminal further comprises a synchronization means for transmitting new photo data to the cloud server. [Explanation of symbols]

[1769] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. A means for transmitting photo data from the terminal to a cloud server; a cloud server receiving the photo data and analyzing the photo using an AI module; A means for the AI ​​module to identify unwanted photos based on their content and metadata; and A way to delete unnecessary photos from the cloud server, A means for transmitting a deletion instruction to the terminal for the unnecessary photos determined by the cloud server; A means for the terminal to delete unnecessary photos from the terminal based on a deletion instruction; The device moves deleted photos to a temporary storage location, allowing the user to recover them within a certain period of time. A system including:

2. The system according to claim 1 , wherein the cloud server further comprises means for allowing a user to set criteria for deleting unnecessary photos.

3. The system of claim 1 , wherein the terminal further comprises a synchronization means for transmitting new photo data to the cloud server.

Images