system

Abstract

A system is provided.SOLUTION: The system includes a means for capturing a resume or basic information by direct input and generating a chronology, a means for capturing a photograph or data of a social networking service (SNS) and analyzing a date and time, a place, and the like, a means for generating an album on the basis of the captured data and setting browsing authority to share the album, and a means for leaving a comment on the album and sharing the album with other users.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Effectively and emotionally preserving and sharing memories of the deceased is an important issue for many families. However, existing methods make it difficult to centrally organize information and integrate diverse personal data (such as resumes, photos, and social media posts) into albums. Furthermore, there are limited ways to easily share this data with family and friends and reminisce together. This has led to a demand for a more comprehensive way to preserve and share memories of the deceased. [Means for solving the problem]

[0005] The present invention provides a system that includes a means for importing basic information from a resume or via direct input and generating a timeline; a means for importing data from photos and social networking services (SNS) and analyzing the date, time, location, etc.; a means for creating an album based on the imported data, setting viewing permissions, and sharing the album; and a means for leaving comments on the album and sharing it with other users. This allows for centralized organization and storage of various information about the deceased, and further allows family and friends to easily access and share the information and reminisce about the deceased. Specifically, the system includes a means for extracting basic information from resume image data using character recognition technology and a means for analyzing date, time, and location information from photo EXIF ​​data and SNS posting data. This system solves the problem of richly preserving and sharing memories of the deceased.

[0006] "Basic information" refers to an individual's basic career and profile information, such as name, date of birth, educational background, and work history.

[0007] A "timeline" is a table that lists an individual's important events and career history in chronological order.

[0008] "Photograph" refers to a still image taken with a camera or other photographic device.

[0009] "Social networking service (SNS)" refers to a platform for users to communicate with each other online, including data such as posts and images.

[0010] "EXIF data" is metadata contained in photo files taken with a digital camera, and includes information such as the date and time the photo was taken and its location.

[0011] An "album" refers to a digital storage medium that collects personal memories and events, and includes photos, text, etc.

[0012] "Viewing authority" refers to permission for a specific user to view the contents of an album.

[0013] "Comment" refers to the act of adding thoughts, opinions, and memories to an album in text format.

[0014] "Optical Character Recognition Technology (OCR)" refers to the technology that converts images or handwritten characters into digital text. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] This invention relates to a system for centrally storing memories of the deceased and sharing them with family and friends. This system includes the following various means: a means for generating a timeline by importing basic information from a resume or manually entered data, a means for importing data from photos and social networking services (SNS) and analyzing the date, time, location, etc., a means for generating an album based on the imported data, setting viewing permissions, and sharing it, and a means for leaving comments on the album and sharing it with other users.

[0037] Obtaining basic information and generating a timeline

[0038] When a user uploads a resume, the resume file is sent from the device to the server. The server analyzes the received resume file and uses optical character recognition (OCR) to extract basic information such as name, date of birth, educational background, and work history. This basic information is stored in a database, and the server automatically generates a timeline based on this information.

[0039] Specific examples

[0040] The user uploads a resume and the device sends it to the server.

[0041] The server receives the image data of the resume and extracts the text data using OCR technology.

[0042] The server extracts names, dates of birth, educational background, and work history and stores them in a database, automatically generating a timeline.

[0043] Import and analyze photos and social media data

[0044] When a user uploads a photo or connects to a social media account, the device sends it to the server. The server analyzes the photo's EXIF ​​data to obtain the date and time the photo was taken and the location information. It also uses the social media API to obtain the user's posted data, analyzes it, and extracts the date, time, location, and tag information. This data is also stored in the database.

[0045] Specific examples

[0046] The user uploads photos from their trip and the device sends the photo files to the server.

[0047] The server analyzes the photo's EXIF ​​data to determine the date, time and location of the photo.

[0048] When a social media account is linked, the server retrieves the social media post data, analyzes it, and extracts the necessary information.

[0049] Album Creation

[0050] The server automatically generates album pages based on the acquired basic information, photos, and social media data. The generated albums are organized based on a timeline, photo dates, and locations, and users can edit and add to them from their devices. This allows memories of the deceased to be stored in a centralized location.

[0051] Specific examples

[0052] The server collects the information stored in the database and automatically generates an album page.

[0053] Users can view album pages from their devices and edit and add photos and text.

[0054] The server reflects the edited and added information in the database and updates the album.

[0055] Viewing permission management and sharing

[0056] Users can set viewing permissions for albums for specific family and friends. When a user enters the email addresses of people to whom they want to grant viewing permissions from their device, the server sets the viewing permissions based on this information and generates a shared link. People who receive the shared link can view the album with specific access permissions.

[0057] Specific examples

[0058] The user enters the email addresses of family and friends and sets viewing permissions.

[0059] The server sets viewing permissions for the specified email address and generates a shared link.

[0060] Family and friends who receive the shared link can access and view the album.

[0061] Comment function

[0062] When a user enters a comment on an album, the comment is sent from the device to the server, which stores the comment in a database and makes the information available to other viewers in real time. This allows family and friends to share and discuss memories on the album.

[0063] Specific examples

[0064] The user enters a comment on a specific page of the album and presses the send button.

[0065] The server receives the comments and stores them in a database.

[0066] Other users with viewing permissions can view the comments in real time from their devices.

[0067] The above is a specific embodiment of the present invention. By using this system, it is possible to preserve rich memories of the deceased and easily share them with family and friends.

[0068] The processing flow will be explained below.

[0069] Obtaining basic information and generating a timeline

[0070] Step 1:

[0071] A user uploads a resume.

[0072] The user selects a resume file from the terminal and presses the upload button.

[0073] The device receives the file and sends it to the server.

[0074] Step 2:

[0075] The server receives the resume.

[0076] The server receives and stores the uploaded resume file.

[0077] Step 3:

[0078] The server extracts basic information.

[0079] The server uses optical character recognition (OCR) technology to extract information such as name, date of birth, educational background, and work history from the resume.

[0080] Step 4:

[0081] The server stores it in a database.

[0082] The server stores the extracted information in a database.

[0083] Step 5:

[0084] The server generates the timeline.

[0085] The server generates an initial timeline based on the date of birth and adds information such as educational background and work history to the timeline.

[0086] Import and analyze photos and social media data

[0087] Step 1:

[0088] The user uploads a photo.

[0089] The user selects a photo from the device and presses the upload button.

[0090] The device receives the photo file and sends it to the server.

[0091] Step 2:

[0092] The server receives the photo.

[0093] The server receives and stores the uploaded photo files.

[0094] Step 3:

[0095] The server parses the EXIF ​​data of the photo.

[0096] The server reads the EXIF ​​data of the photo and extracts the date and time the photo was taken and the location information.

[0097] Step 4:

[0098] The user links their social media account.

[0099] The user enters the authentication information for their SNS account and presses the link button.

[0100] The device sends the SNS authentication information to the server.

[0101] Step 5:

[0102] The server retrieves the social networking data.

[0103] The server uses the SNS API to obtain the user's posting data (date, time, location, tags, etc.).

[0104] Step 6:

[0105] The server stores it in a database.

[0106] The server stores the acquired social media data and photo information in a database.

[0107] Album Creation

[0108] Step 1:

[0109] The server collects the data.

[0110] The server collects basic information, photos, and social media data from the database.

[0111] Step 2:

[0112] The server generates the album page.

[0113] The server automatically generates an album page based on the collected data.

[0114] Step 3:

[0115] The user checks the album.

[0116] The user browses the created album from the terminal and checks the contents.

[0117] Step 4:

[0118] Users edit and add.

[0119] The user adds to or edits the contents of the album and sends the changes to the server.

[0120] The server saves the changes to the database and updates the album.

[0121] Viewing permission management and sharing

[0122] Step 1:

[0123] The user accesses the View Permissions Settings page.

[0124] The user accesses the viewing permission settings page from the device.

[0125] Step 2:

[0126] The user sets the viewing permissions.

[0127] The user enters the email addresses of family and friends and sets viewing permissions.

[0128] The terminal sends the setting information to the server.

[0129] Step 3:

[0130] The server sets the viewing permissions.

[0131] The server sets the viewing authority for the specified email address.

[0132] Step 4:

[0133] The server generates a sharing link.

[0134] The server will generate a sharing link for the album and send it to the specified email address.

[0135] Comment function

[0136] Step 1:

[0137] The user enters a comment.

[0138] The user opens the album page from the terminal and enters a comment in the comment input form.

[0139] Step 2:

[0140] A user submits a comment.

[0141] The user presses the send button and sends the comment to the server.

[0142] Step 3:

[0143] The server receives the comment.

[0144] The server receives the submitted comments.

[0145] Step 4:

[0146] The server stores the comments.

[0147] The server stores the comments in a database.

[0148] Step 5:

[0149] The server displays the comments in real time.

[0150] The server transmits the comments in real time to the terminals of other users who have viewing authority and displays them on the album page.

[0151] Example 1

[0152] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0153] In modern society, many memories and records are stored as digital data. However, this data is scattered across various devices and platforms, making it difficult to manage it centrally. In particular, to share memories and records of deceased people with family and friends, a system is needed to effectively aggregate, organize, and display this data appropriately. Furthermore, from a privacy perspective, it is necessary to set detailed access permissions for data viewing, and a function is also required for users to share memories and exchange opinions.

[0154] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0155] In this invention, the server includes a means for importing basic information from a resume or through direct input and generating a timeline, a means for extracting basic information from image data using character recognition technology, a means for importing photos and data from social networking services and analyzing the date, time, location, etc., a means for automatically generating an album based on the acquired basic information, photos, and data from social networking services, setting viewing permissions for the album, and sharing it with other users, and a means for entering comments into the album and sharing it with other users. This allows memories of the deceased to be centrally stored and safely and easily shared with family and friends. It also promotes communication between users, allowing them to share and discuss memories of the deceased.

[0156] "Basic information" refers to information such as name, date of birth, educational background, and work history obtained from a resume or by manually entering the information.

[0157] A "chronology" is a table that is created based on the acquired basic information and that chronologically organizes the events and career history of the user's life.

[0158] "Image data" refers to visual data stored in digital format, such as photographs or scanned documents.

[0159] "Character recognition technology" is a technology that uses optical character recognition (OCR) technology to extract character information from image data as digital text.

[0160] "Social networking service" refers to an online platform that enables users to interact with others over the Internet, including blogs, microblogs, and photo sharing.

[0161] "EXIF data" is additional information included in digital photos, including the date and time the photo was taken, location information, camera settings, and so on.

[0162] "Analysis" is the process of examining data in detail to understand its structure, meaning, and patterns.

[0163] An "album" is content that is automatically generated based on acquired basic information, photos, and data from social networking services, and is used to organize and display a user's memories.

[0164] "Viewing authority" is an access control function that allows a specific user to access specific data or content.

[0165] "Entering a comment" refers to the act of a user adding a text message to an album.

[0166] A "database" is a system for efficiently storing and managing digital data, including basic information, photos, social media data, and comments.

[0167] "Server" refers to a computer system that provides functions such as data processing, storage, and network communication.

[0168] This invention relates to a system for centrally storing memories of the deceased and sharing them with family and friends. This system includes a means for generating a timeline by importing basic information from a resume or manually inputting it, a means for importing data from photos and social networking services (SNS) and analyzing the date, time, location, etc., a means for generating an album based on the imported data, setting viewing permissions, and sharing it, and a means for leaving comments on the album and sharing it with other users.

[0169] Obtaining basic information and generating a timeline

[0170] When a user uploads a resume, the resume file is sent from the device to the server. The server analyzes the received resume file and uses character recognition technology (e.g., Google Cloud Vision or Tesseract) to extract basic information such as name, date of birth, educational background, and work history. This basic information is stored in a database, and the server automatically generates a timeline based on it. This timeline will then be used as the basic information for the album that is created.

[0171] Specific examples

[0172] The user uploads a resume and the device sends it to the server.

[0173] The server receives the image data of the resume and extracts the text data using OCR technology.

[0174] The server extracts names, dates of birth, educational background, and work history and stores them in a database, automatically generating a timeline.

[0175] Example prompt:

[0176] "Please upload an image of your resume."

[0177] "Use Google Cloud Vision to extract name, date of birth, education history, and employment history."

[0178] Import and analyze photos and social media data

[0179] When a user uploads a photo or connects to a social media account, the device sends it to the server. The server analyzes the photo's EXIF ​​data to obtain the date and time the photo was taken and the location information. It also uses the social media API (e.g., Facebook Graph API) to obtain the user's posting data and analyzes it to extract date, time, location, and tag information. This data is also stored in the database and used when creating albums.

[0180] Specific examples

[0181] The user uploads photos from their trip and the device sends the photo files to the server.

[0182] The server analyzes the photo's EXIF ​​data to determine the date, time and location of the photo.

[0183] When a social media account is linked, the server retrieves the social media post data, analyzes it, and extracts the necessary information.

[0184] Example prompt:

[0185] "Upload your travel photos."

[0186] "Link your Facebook account to retrieve post data and extract information."

[0187] Album Creation

[0188] The server automatically generates album pages based on the acquired basic information, photos, and social media data. The generated albums are organized based on a timeline, photo dates, and locations, and users can edit and add to them from their devices. This allows memories of the deceased to be stored in a centralized location.

[0189] Specific examples

[0190] The server collects the information stored in the database and automatically generates an album page.

[0191] Users can view album pages from their devices and edit and add photos and text.

[0192] Example prompt:

[0193] "Automatically generate album pages based on the retrieved data."

[0194] "Allow album pages to be edited and added to."

[0195] Viewing permission management and sharing

[0196] Users can set viewing permissions for albums for specific family and friends. When a user enters the email addresses of people to whom they want to grant viewing permissions from their device, the server sets the viewing permissions based on this information and generates a shared link. People who receive the shared link can view the album with specific access permissions.

[0197] Specific examples

[0198] The user enters the email addresses of family and friends and sets viewing permissions.

[0199] The server sets viewing permissions for the specified email address and generates a shared link.

[0200] Family and friends who receive the shared link can access and view the album.

[0201] Example prompt:

[0202] "Enter the email address you want to set album viewing permissions for."

[0203] "Send the shared link to the address provided."

[0204] Comment function

[0205] When a user enters a comment on an album, the comment is sent from the device to the server, which stores the comment in a database and makes the information available to other viewers in real time. This allows family and friends to share and discuss memories on the album.

[0206] Specific examples

[0207] The user enters a comment on a specific page of the album and presses the send button.

[0208] The server receives the comments and stores them in a database.

[0209] Other users with viewing permissions can view the comments in real time from their devices.

[0210] Example prompt:

[0211] "Please enter a comment on the album page."

[0212] "Submitted comments are saved and displayed to other users in real time."

[0213] The above is a specific embodiment of the present invention. By using this system, it is possible to preserve rich memories of the deceased and easily share them with family and friends.

[0214] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0215] Step 1: Get some basic information

[0216] The user uploads a resume and the device sends it to the server.

[0217] Input: Resume file (PDF or image format)

[0218] Specific operation: The user opens the file selection dialog of the web browser, selects the resume file, and clicks the upload button. The terminal sends the selected file to the server via an HTTP request.

[0219] Output: The server receives the resume file.

[0220] Step 2: Resume Analysis

[0221] The server receives the image data of the resume and extracts the text information using OCR technology.

[0222] Input: Resume file (output of Step 1)

[0223] How it works: The server reads the resume file and calls the Google Cloud Vision API or the Tesseract OCR engine to perform character recognition. From the recognized text, information such as name, date of birth, educational background, and work history is extracted.

[0224] Output: Extracted text data of name, date of birth, educational background, and work history

[0225] Step 3: Save basic information and generate a timeline

[0226] The server stores the extracted information in a database and automatically generates a timeline.

[0227] Input: Extracted basic information (output of step 2)

[0228] Specific operation: The server saves the extracted information in a database using an SQL query. Based on the saved data, a timeline is automatically generated by organizing birth dates and educational history information in chronological order.

[0229] Output: Basic information stored in the database and an automatically generated timeline

[0230] Step 4: Upload and analyze photos

[0231] A user uploads a photo, and the device sends the photo file to the server, which analyzes the EXIF ​​data to obtain the date and time the photo was taken and the location.

[0232] Input: Photo file

[0233] Specific operation: The user opens the file selection dialog, selects a photo file, and clicks the upload button. The device sends the selected photo file to the server. The server analyzes the EXIF ​​data of the received photo and extracts the shooting date and location information.

[0234] Output: Extracted photo date and location information

[0235] Step 5: Link your social media accounts and collect data

[0236] The user enters authentication information to link their SNS account to the server. The server uses the SNS API to retrieve and analyze the user's posted data.

[0237] Input: Social media account credentials

[0238] Specific operation: The user clicks the SNS link button and enters their SNS login information in the displayed authentication information input form. The server saves the SNS account information and calls the SNS API (e.g., Facebook Graph API) to retrieve the posted data. The retrieved data is then analyzed to extract date, time, location, and tag information.

[0239] Output: Date, time, location, and tag information of extracted social media posts

[0240] Step 6: Create an album

[0241] The album page is automatically generated based on the basic information, photos, and SNS data obtained by the server.

[0242] Input: Basic information (output from Step 3), photo data (output from Step 4), social media data (output from Step 5)

[0243] Specific operation: The server retrieves basic information, photo data, and SNS data from the database, and embeds the data into the album page template. The album page is automatically generated, allowing users to easily view and edit it.

[0244] Output: Auto-generated album page

[0245] Step 7: Edit and add albums

[0246] Users view album pages from their devices and edit or add photos or text. The server reflects the edited or added information in the database and updates the album.

[0247] Input: User edits and additions

[0248] Specific operation: A user accesses an album page from a web browser, selects the photos and text they want to edit, and then edits, deletes, or adds them. The server receives the user's edits, saves them in the database, and updates the album.

[0249] Output: Updated album page

[0250] Step 8: Set viewing permissions and share

[0251] The user enters the email addresses of family and friends and sets viewing permissions. The server generates a shared link and sends it to the specified email addresses.

[0252] Input: Email address

[0253] Specific operation: The user enters an email address in the viewing permission setting form and clicks the submit button. The server saves the email address in the database and generates a token for setting viewing permissions. A shared link containing the generated token is sent via email.

[0254] Output: Email containing the shared link

[0255] Step 9: Browse your album

[0256] Family and friends who receive the shared link can view the album with specific access permissions.

[0257] Input: Shared Link

[0258] Specific operation: Click the received link, and the web browser will automatically redirect to the album page. The server will verify the token and confirm the viewing privileges before displaying the album page.

[0259] Output: Album page with confirmed viewing permissions

[0260] Step 10: Comment and share

[0261] A user enters a comment on a specific page of an album and presses the submit button. The server saves the comment in a database and makes the information available to other viewers in real time.

[0262] Input: Comment content

[0263] Specific operation: A user enters a comment in the comment input form and clicks the submit button. The server saves the received comment in a database and updates it so that it can be displayed to other viewers in real time.

[0264] Output: Saved comments and real-time updated album page

[0265] (Application example 1)

[0266] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0267] In modern factories, it is extremely important to properly manage robot operation and maintenance histories and quickly share necessary information. However, current systems manage this information in a decentralized manner, making it difficult to centralize the information and check and share it in real time. For this reason, there is a need for a system that can improve the operational efficiency of factory robots and respond quickly.

[0268] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0269] In this invention, the server includes means for importing basic information through historical information or direct input and generating a timeline, means for importing image data or data from social networking services (SNS) and analyzing the date, time, location, etc., means for generating an information collection page based on the imported data and setting viewing permissions for sharing, means for leaving comments on the information collection page and sharing it with other users, means for acquiring, saving, and checking the operation history and maintenance history of the factory robot in real time, and means for uploading and viewing the operation history via an application installed on a smartphone or tablet. This enables centralized management and real-time sharing of the operation history and maintenance history of the factory robot.

[0270] "History information" is a general term for data about the past activities or events of an individual or device.

[0271] "Basic information" refers to the main attribute information about an individual or device, including data such as name, date of birth, educational background, work history, device ID, name, and model.

[0272] A "timeline" is a list of events or occurrences organized by date, and is data presented in chronological order.

[0273] "Image data" is a form of visual data such as photographs or images captured with a digital camera.

[0274] A "social networking service (SNS)" is a platform that allows users to communicate with each other online.

[0275] "Means of analysis" refers to the process of capturing data, analyzing its contents using specific algorithms or techniques, and extracting or evaluating specific information.

[0276] An "information aggregation page" is a web page or digital document that centrally displays and manages information collected from multiple data sources.

[0277] "Viewing authority" refers to a control setting that allows access to or viewing of specific information or content.

[0278] "Leaving a comment" is the act of writing down opinions or thoughts about specific information or content.

[0279] A "factory robot" is an industrial robot designed to perform automated operations or tasks.

[0280] "Operation history" is a record of specific actions and operations performed by a device or robot.

[0281] "Maintenance history" is a detailed record of the maintenance and repairs that machines, equipment, etc. have undergone.

[0282] "Real-time review" refers to the process of obtaining data and information almost instantly and reviewing it in the present.

[0283] A "smartphone" is a highly functional mobile phone that can connect to the Internet and use applications.

[0284] A "tablet" is a portable electronic device with a touchscreen that can connect to the Internet and use applications.

[0285] An "application" is a software program designed to perform a specific task or function.

[0286] The system to realize this application example is a platform that integrates multiple means to centrally manage the operation and maintenance history of factory robots and share information in real time. This system consists of hardware such as servers, smartphones, tablets, and factory robots, as well as software using Flask.

[0287] Program processing

[0288] Obtaining basic information and generating a timeline

[0289] Users input historical information from their smartphones or tablets and send it to the server. The server analyzes the received information, incorporates basic information from the historical information or manually input, and automatically generates a timeline. This creates a basic operational record of the factory robot.

[0290] Importing and analyzing image data and social media data

[0291] When a user links image data or a social media account, the server receives it and analyzes the EXIF ​​information of the image data and the data posted on the social media. The server identifies the date, time, and location information and stores it in a database.

[0292] Creating an information aggregation page

[0293] The server automatically generates an information aggregation page based on the acquired basic information, image data, and social media data. The generated page is organized based on timeline, photo date and time, and location, and users can edit and add to it from their smartphones or tablets. This allows the operation history and maintenance history of factory robots to be stored in a centralized location.

[0294] Viewing permission management and sharing

[0295] Users can set viewing permissions for the information collection page from their smartphones or tablets. The server sets the viewing permissions based on the entered email address and generates a shared link. Engineers and administrators who receive the shared link can view the information collection page with specific access permissions.

[0296] Comment function

[0297] When a user enters a comment on an information collection page, the comment is sent to the server, which stores the comment in a database and makes the information available to other users in real time. This facilitates smooth communication between engineers and administrators.

[0298] Managing the operation and maintenance history of factory robots

[0299] When a factory robot completes a task, it sends its operation history (task date and time, content, results, etc.) to a server via smartphone or tablet. The server then stores the received operation history in a database, making it possible to check it in real time. This makes it possible to obtain and manage the latest information on the operating status and maintenance status of factory robots.

[0300] Specific examples

[0301] A user registers a new factory robot, enters its basic information and sends it to the server.

[0302] After regular maintenance is completed at the factory, operation and maintenance history is uploaded to a server from a smartphone.

[0303] Administrators can check the operation history of specific robots in real time from their smartphones and determine the next maintenance schedule.

[0304] Prompt Sentence Examples

[0305] Add basic information for a new factory robot. Enter the ID, name, and model.

[0306] Upload the history after the operation is completed. Please enter the robot ID, operation date and time, and operation content.

[0307] Get the operation history of a specific robot. Specify the robot ID.

[0308] This will enable centralized management and real-time sharing of factory robot operation and maintenance histories.

[0309] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0310] Step 1: Obtaining basic information and generating a timeline

[0311] The user enters historical information from a smartphone or tablet and sends it to the server. The server analyzes the received historical information and extracts basic information (ID, name, model, etc.). The server stores the extracted information in a database and generates a timeline based on this. The input is the information entered by the user, and the output is the basic information stored in the database and the generated timeline.

[0312] Step 2: Import and analyze image data and social media data

[0313] When a user links image data or a social media account, the device sends this to a server. The server analyzes the EXIF ​​information of the received image data and the data posted on the social media to identify the date, time, and location information. The server stores this information in a database. The input is the image data or social media data, and the output is the analyzed date, time, and location information.

[0314] Step 3: Create an information aggregation page

[0315] The server automatically generates information aggregation pages based on basic information, image data, and social media data. The generated pages are organized based on timeline, photo date and time, and location. Users can edit and add to these pages from their smartphones or tablets. The input is the information stored in the database, and the output is the generated information aggregation page.

[0316] Step 4: Manage viewing permissions and share

[0317] When a user enters the email addresses of people for whom they want to set viewing permissions from their smartphone or tablet, the server sets the viewing permissions based on this information and generates a shared link. The server sets viewing permissions for the specified email addresses and provides the shared link to the user. The input is the email addresses to which viewing permissions are granted, and the output is the set viewing permissions and the shared link.

[0318] Step 5: Commenting

[0319] The user enters a comment on the information collection page and presses the send button. The device sends the comment to the server. The server saves the comment in a database and makes the information available to other users in real time. The input is the user's comment, and the output is the comment saved in the database and an information collection page updated in real time.

[0320] Step 6: Managing the operation and maintenance history of factory robots

[0321] When a factory robot completes a task, it sends its operation history (task date and time, content, results, etc.) to a server via smartphone or tablet. The server stores the received operation history in a database so that managers and engineers can check it in real time. The input is the operation history and maintenance history, and the output is the history information stored in the database and a management screen updated in real time.

[0322] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0323] This invention relates to a system for preserving and sharing memories of the deceased, which is combined with an emotion engine that recognizes the user's emotions. This system includes the following various means: a means for generating a chronology by importing basic information from a resume or manually entered data, a means for importing data from photos and social networking services (SNS) and analyzing the date, time, location, etc., a means for generating an album based on the acquired data, setting viewing permissions, and sharing it, a means for leaving comments on the album and sharing it with other users, and an emotion engine that recognizes the user's emotions.

[0324] Obtaining basic information and generating a timeline

[0325] When a user uploads a resume, the device sends the resume file to the server. The server analyzes the received resume file and uses optical character recognition (OCR) to extract basic information such as name, date of birth, educational background, and work history. This basic information is stored in a database, and the server automatically generates a timeline based on it.

[0326] Specific examples

[0327] The user uploads a resume and the device sends it to the server.

[0328] The server receives the image data of the resume and extracts the text data using OCR technology.

[0329] The server extracts names, dates of birth, educational background, and work history and stores them in a database, automatically generating a timeline.

[0330] Import and analyze photos and social media data

[0331] When a user uploads a photo or connects to a social media account, the device sends it to the server. The server analyzes the photo's EXIF ​​data to obtain the date and time the photo was taken and the location information. It also uses the social media API to obtain the user's posted data, analyzes it, and extracts the date, time, location, and tag information. This data is also stored in the database.

[0332] Specific examples

[0333] The user uploads photos from their trip and the device sends the photo files to the server.

[0334] The server analyzes the photo's EXIF ​​data to determine the date, time and location of the photo.

[0335] When a social media account is linked, the server retrieves the social media post data, analyzes it, and extracts the necessary information.

[0336] Album Creation

[0337] The server automatically generates album pages based on the acquired basic information, photos, and social media data. The generated albums are organized based on a timeline, photo dates, and locations, and users can edit and add to them from their devices. This allows memories of the deceased to be stored in a centralized location.

[0338] Specific examples

[0339] The server collects the information stored in the database and automatically generates an album page.

[0340] Users can view album pages from their devices and edit and add photos and text.

[0341] The server reflects the edited and added information in the database and updates the album.

[0342] Viewing permission management and sharing

[0343] Users can set viewing permissions for albums for specific family and friends. When a user enters the email addresses of people to whom they want to grant viewing permissions from their device, the server sets the viewing permissions based on this information and generates a shared link. People who receive the shared link can view the album with specific access permissions.

[0344] Specific examples

[0345] The user enters the email addresses of family and friends and sets viewing permissions.

[0346] The server sets viewing permissions for the specified email address and generates a shared link.

[0347] Family and friends who receive the shared link can access and view the album.

[0348] Comment function

[0349] When a user enters a comment on an album, the comment is sent from the device to the server, which stores the comment in a database and makes the information available to other viewers in real time. This allows family and friends to share and discuss memories on the album.

[0350] Specific examples

[0351] The user enters a comment on a specific page of the album and presses the send button.

[0352] The server receives the comments and stores them in a database.

[0353] Other users with viewing permissions can view the comments in real time from their devices.

[0354] Emotion engine integration

[0355] The emotion engine analyzes user emotions based on user reactions to text input, comments, photos, and social media posts. Based on this, the emotion engine dynamically adjusts the album structure and display method. It is also possible to dynamically adjust individual viewing permissions based on emotions.

[0356] Specific examples

[0357] When a user enters a comment on an album, an emotion engine analyzes the user's emotions from the text.

[0358] The server dynamically adjusts the album page layout based on the analysis results.

[0359] Depending on the user's emotions, the server dynamically adjusts the viewing authority and displays only specific content.

[0360] The above is a specific embodiment of the present invention. By using this system, memories of the deceased can be richly preserved and flexibly shared based on emotions.

[0361] The processing flow will be explained below.

[0362] Obtaining basic information and generating a timeline

[0363] Step 1:

[0364] A user uploads a resume.

[0365] The user selects a resume file from the terminal and presses the upload button.

[0366] The device receives the file and sends it to the server.

[0367] Step 2:

[0368] The server receives the resume.

[0369] The server receives and stores the uploaded resume file.

[0370] Step 3:

[0371] The server extracts basic information.

[0372] The server uses optical character recognition (OCR) technology to extract information such as name, date of birth, educational background, and work history from the resume.

[0373] Step 4:

[0374] The server stores it in a database.

[0375] The server stores the extracted information in a database.

[0376] Step 5:

[0377] The server generates the timeline.

[0378] The server generates an initial timeline based on the date of birth and adds information such as educational background and work history to the timeline.

[0379] Import and analyze photos and social media data

[0380] Step 1:

[0381] The user uploads a photo.

[0382] The user selects a photo from the device and presses the upload button.

[0383] The device receives the photo file and sends it to the server.

[0384] Step 2:

[0385] The server receives the photo.

[0386] The server receives and stores the uploaded photo files.

[0387] Step 3:

[0388] The server parses the EXIF ​​data of the photo.

[0389] The server reads the EXIF ​​data of the photo and extracts the date and time the photo was taken and the location information.

[0390] Step 4:

[0391] The user links their social media account.

[0392] The user enters the authentication information for their SNS account and presses the link button.

[0393] The device sends the SNS authentication information to the server.

[0394] Step 5:

[0395] The server retrieves the social networking data.

[0396] The server uses the SNS API to obtain the user's posting data (date, time, location, tags, etc.).

[0397] Step 6:

[0398] The server stores it in a database.

[0399] The server stores the acquired social media data and photo information in a database.

[0400] Album Creation

[0401] Step 1:

[0402] The server collects the data.

[0403] The server collects basic information, photos, and social media data from the database.

[0404] Step 2:

[0405] The server generates the album page.

[0406] The server automatically generates an album page based on the collected data.

[0407] Step 3:

[0408] The user checks the album.

[0409] The user browses the created album from the terminal and checks the contents.

[0410] Step 4:

[0411] Users edit and add.

[0412] The user adds to or edits the contents of the album and sends the changes to the server.

[0413] The server saves the changes to the database and updates the album.

[0414] Viewing permission management and sharing

[0415] Step 1:

[0416] The user accesses the View Permissions Settings page.

[0417] The user accesses the viewing permission settings page from the device.

[0418] Step 2:

[0419] The user sets the viewing permissions.

[0420] The user enters the email addresses of family and friends and sets viewing permissions.

[0421] The terminal sends the setting information to the server.

[0422] Step 3:

[0423] The server sets the viewing permissions.

[0424] The server sets the viewing authority for the specified email address.

[0425] Step 4:

[0426] The server generates a sharing link.

[0427] The server will generate a sharing link for the album and send it to the specified email address.

[0428] Comment function

[0429] Step 1:

[0430] The user enters a comment.

[0431] The user opens the album page from the terminal and enters a comment in the comment input form.

[0432] Step 2:

[0433] A user submits a comment.

[0434] The user presses the send button and sends the comment to the server.

[0435] Step 3:

[0436] The server receives the comment.

[0437] The server receives the submitted comments.

[0438] Step 4:

[0439] The server stores the comments.

[0440] The server stores the comments in a database.

[0441] Step 5:

[0442] The server displays the comments in real time.

[0443] The server transmits the comments in real time to the terminals of other users who have viewing authority and displays them on the album page.

[0444] Emotion engine integration

[0445] Step 1:

[0446] Analyze user sentiment.

[0447] The server sends the text and comments entered by the user to the emotion engine.

[0448] The emotion engine analyzes the text and identifies the user's emotion.

[0449] Step 2:

[0450] Tailor your album based on emotion.

[0451] The server dynamically adjusts the page layout and display method of the album based on the emotional information obtained by the emotion engine.

[0452] Step 3:

[0453] Dynamically adjust viewing permissions.

[0454] The server dynamically adjusts viewing permissions according to the user's emotions based on the analysis results of the emotion engine.

[0455] Specific examples

[0456] When a user enters a comment on an album, an emotion engine analyzes the user's emotions from the text.

[0457] The server dynamically adjusts the album page layout based on the analysis results.

[0458] Depending on the user's emotions, the server dynamically adjusts the viewing authority and displays only specific content.

[0459] This system allows for rich preservation of memories of the deceased and flexible sharing based on emotions.

[0460] Example 2

[0461] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0462] Conventional systems for storing and sharing memories of the deceased require users to manually organize and manage information, and they have problems with creating flexible albums based on emotions and dynamically adjusting viewing permissions. This has led to issues with efficiently sharing memories and displaying appropriate information based on individual emotions.

[0463] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0464] In this invention, the server includes a means for importing basic information from a resume or through direct input and generating a timeline, a means for importing photos and data from social networking services (SNS) and analyzing the date, time, location, etc., a means for creating an album based on the imported data, setting viewing permissions for sharing, and integrating an emotion engine that analyzes the user's emotions to dynamically adjust the album configuration and display method. This allows for efficient organization and preservation of memories of the deceased, and enables flexible album configuration and dynamic adjustment of viewing permissions based on emotions.

[0465] "Basic information" refers to personal information such as the user's name, date of birth, educational background, and work history.

[0466] A "chronology" is a table generated from basic information that chronologically organizes the events and careers of a user's life.

[0467] "Photo" refers to image data uploaded by a user, including metadata and EXIF ​​information.

[0468] A "social networking service (SNS)" is a web service that allows users to interact with others online and share information.

[0469] "Data" is a general term for information collected by the system, such as background information, photos, and social media posting data uploaded or linked by users.

[0470] "Analysis" refers to the process of extracting and organizing details such as date, time, location, and tag information contained in the data.

[0471] An "album" is a digital record of a user's memories that is generated based on the captured data.

[0472] "Viewing authority" refers to access control that can be set to allow specific users to view the album.

[0473] "Sharing" refers to providing an album via a link or the like so that users with set viewing permissions can access the album.

[0474] A "comment" is a text message that a user enters for an album and shares with other users.

[0475] An "emotion engine" is a computer program or algorithm that analyzes emotions based on user input and behavior and reflects the results.

[0476] "Dynamic adjustment" refers to the process of changing settings and displays in real time based on acquired information and analysis results.

[0477] This invention relates to a system for preserving and sharing memories of the deceased, which is combined with an emotion engine that recognizes the user's emotions. This system includes a means for generating a chronology by importing basic information from a resume or manually entered data, a means for importing data from photos and social networking services (SNS) and analyzing the date, time, location, etc., a means for generating an album based on the acquired data, setting viewing permissions, and sharing the album, a means for leaving comments on the album and sharing it with other users, and an emotion engine that recognizes the user's emotions.

[0478] Obtaining basic information and generating a timeline

[0479] When a user uploads a resume, the device sends the resume file to the server. The server analyzes the received resume file and uses optical character recognition (OCR) to extract basic information such as name, date of birth, educational background, and work history. This basic information is stored in a database, and the server automatically generates a timeline based on it.

[0480] Specific examples

[0481] The user uploads a resume and the device sends it to the server.

[0482] The server extracts the character data using OCR technology.

[0483] The server extracts names, dates of birth, educational background, and work history and stores them in a database, automatically generating a timeline.

[0484] Import and analyze photos and social media data

[0485] When a user uploads a photo or connects to a social media account, the device sends it to the server. The server analyzes the photo's EXIF ​​data to obtain the date and time the photo was taken and the location information. It also uses the social media API to obtain the user's posted data, analyzes it, and extracts the date, time, location, and tag information. This data is also stored in the database.

[0486] Specific examples

[0487] The user uploads photos from their trip and the device sends the photo files to the server.

[0488] The server analyzes the photo's EXIF ​​data to determine the date, time and location of the photo.

[0489] The server retrieves the social media post data, analyzes it, and extracts the necessary information.

[0490] Album Creation

[0491] The server automatically generates album pages based on the acquired basic information, photos, and social media data. The generated albums are organized based on a timeline, photo dates, and locations, and users can edit and add to them from their devices. This allows memories of the deceased to be stored in a centralized location.

[0492] Specific examples

[0493] The server collects the information stored in the database and automatically generates an album page.

[0494] Users can view album pages from their devices and edit and add photos and text.

[0495] The server reflects the edited and added information in the database and updates the album.

[0496] Viewing permission management and sharing

[0497] Users can set viewing permissions for albums for specific family and friends. When a user enters the email addresses of the people to whom they want to grant viewing permissions from their device, the server sets the viewing permissions based on this information and generates a shared link. People who receive the shared link can view the album with specific access permissions.

[0498] Specific examples

[0499] The user enters the email addresses of family and friends and sets viewing permissions.

[0500] The server sets viewing permissions for the specified email address and generates a shared link.

[0501] Family and friends who receive the shared link can access and view the album.

[0502] Comment function

[0503] When a user enters a comment on an album, the comment is sent from the device to the server, which stores the comment in a database and makes the information available to other viewers in real time. This allows family and friends to share and discuss memories on the album.

[0504] Specific examples

[0505] The user enters a comment on a specific page of the album and presses the send button.

[0506] The server receives the comments and stores them in a database.

[0507] Other users with viewing permissions can view the comments in real time from their devices.

[0508] Emotion engine integration

[0509] The emotion engine analyzes user emotions based on user reactions to text input, comments, photos, and social media posts. Based on this, the emotion engine dynamically adjusts the album structure and display method. It is also possible to dynamically adjust individual viewing permissions based on emotions.

[0510] Specific examples

[0511] When a user enters a comment on an album, an emotion engine analyzes the user's emotions from the text.

[0512] The server dynamically adjusts the album page layout based on the analysis results.

[0513] Depending on the user's emotions, the server dynamically adjusts the viewing authority and displays only specific content.

[0514] Prompt Sentence Examples

[0515] Resume upload prompt: "Please upload your resume. The system will automatically extract your name, date of birth, education, and work history information to create a timeline."

[0516] Social media account linking prompt: "Please link your social media accounts. We will analyze your past posts and automatically add them to your memories album."

[0517] Comment prompt: "Please enter your memories or comments about this photo."

[0518] The above is a specific embodiment of the present invention. By using this system, memories of the deceased can be richly preserved and flexibly shared based on emotions.

[0519] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0520] Step 1:

[0521] The user uploads a resume file.

[0522] Input: A resume file (PDF or image format) specified by the user.

[0523] Specific actions: The user opens a file selection dialog through the web interface, selects a resume file, and clicks the "Upload" button.

[0524] Output: The selected resume file will be saved on your device.

[0525] Step 2:

[0526] The terminal sends the uploaded resume file to the server.

[0527] Input: A resume file uploaded by the user.

[0528] Specific operation: The terminal sends the resume file to the server using an HTTP POST request.

[0529] Output: The resume file arrives on the server.

[0530] Step 3:

[0531] The server extracts character data from the received resume file using OCR technology.

[0532] Input: The resume file that arrives on the server.

[0533] Specific operation: The server calls an OCR API (specifically, Google Cloud Vision API, etc.) to extract text data from the file.

[0534] Output: Text data such as name, date of birth, educational background, and work history is extracted.

[0535] Step 4:

[0536] The server extracts basic information, stores it in a database, and automatically generates a timeline.

[0537] Input: Extracted text data such as name, date of birth, educational background, and work history.

[0538] Specific operation: The server maps these data to each field and stores them in the database. It then executes the timeline generation algorithm to automatically generate a timeline.

[0539] Output: Basic information stored in a database and an automatically generated timeline.

[0540] Step 5:

[0541] Users can upload photos or connect their social media accounts.

[0542] Input: Photo file selected by the user or social media account information.

[0543] Specific operation: The user selects and uploads a photo file in the web interface, or clicks the SNS link button and enters authentication information.

[0544] Output: The selected photo files are saved to the device or the social networking credentials are obtained.

[0545] Step 6:

[0546] The device sends the uploaded photo files and social media authentication information to the server.

[0547] Input: A photo file selected by the user or social networking credentials.

[0548] Specific operation: The device sends a photo file to the server using an HTTP POST request, or sends an OAuth token for the SNS to the server.

[0549] Output: Photo file or authentication information arrives at the server.

[0550] Step 7:

[0551] The server analyzes the EXIF ​​data of the photo to obtain the date and time of the photo and location information. It also uses the SNS API to obtain user posted data and extracts the date, time, location, and tag information.

[0552] Input: Photo files and social networking credentials received on the server.

[0553] Specific operation: The server uses an image processing library to parse the EXIF ​​data, sends a request to the SNS API, and retrieves the post data.

[0554] Output: The shooting date and time, location information, and social media posting data are analyzed.

[0555] Step 8:

[0556] The server saves the retrieved data in the database.

[0557] Input: Analyzed photo date and time, location information, and social media posting data.

[0558] Specific operation: The server inserts these data into the corresponding database tables.

[0559] Output: Photo date and time, location information, and social media posting data stored in a database.

[0560] Step 9:

[0561] The server automatically generates an album page based on the stored information.

[0562] Input: Basic information stored in the database, photo date and time, location information, and social media posting data.

[0563] What happens: The server queries the stored data and applies the data to the album template to generate the page.

[0564] Output: Auto-generated album page.

[0565] Step 10:

[0566] Users can view album pages and edit and add photos and text.

[0567] Input: Generated album page and information stored in database.

[0568] Specific operation: A user accesses an album page through a web interface, places the cursor over the part they want to edit, and makes edits or adds.

[0569] Output: Edited and added album page.

[0570] Step 11:

[0571] The server reflects the user's edited and added information in the database and updates the album.

[0572] Input: Information edited or added by the user.

[0573] Specific operation: The server receives the form data and performs processing to update the database fields.

[0574] Output: The updated album page.

[0575] Step 12:

[0576] The user sets the viewing authority of the album for family and friends.

[0577] Input: Email addresses of family and friends specified by the user.

[0578] Specific actions: Enter an email address in the web interface and click the "Share" button.

[0579] Output: The email address information entered.

[0580] Step 13:

[0581] The server sets viewing permissions for the specified email address and generates a shared link.

[0582] Input: The email address provided by the user.

[0583] Specific operation: The server sets viewing permissions based on the email address and generates a unique sharing link.

[0584] Output: The generated sharing link.

[0585] Step 14:

[0586] The server will send the shared link to the specified email address.

[0587] Inputs: The generated sharing link and the email address provided.

[0588] Specific operation: The server uses an email sending service to send an email containing a link.

[0589] Output: The email sent.

[0590] Step 15:

[0591] The user enters a comment on a specific page of the album and presses the send button.

[0592] Input: The text entered in the comment input field.

[0593] Specific action: Enter text into the comment field in the web interface and click the "Submit" button.

[0594] Output: The comment text entered.

[0595] Step 16:

[0596] The server receives the comments and stores them in a database.

[0597] Input: Comment text submitted by user.

[0598] Specific operation: The server receives the comment data and inserts it into the corresponding table in the database.

[0599] Output: The comment stored in the database.

[0600] Step 17:

[0601] The server reflects the comments in real time to other users who have viewing authority.

[0602] Input: Comments stored in the database.

[0603] Specific operation: Comments are instantly displayed on other viewers' screens using WebSocket and real-time communication protocols.

[0604] Output: Comments screen updated in real time.

[0605] Step 18:

[0606] The server sends comments and text to the emotion engine, which analyzes the user's emotions.

[0607] Input: Comments and text entered by the user.

[0608] Specific operation: The server sends comment data to the sentiment analysis API and obtains sentiment tags.

[0609] Output: Sentiment analysis results (sentiment tags).

[0610] Step 19:

[0611] The server dynamically adjusts the album page layout based on the analysis results.

[0612] Input: Sentiment analysis results (sentiment tags).

[0613] Specific operation: Executes a script to dynamically generate a layout template.

[0614] Output: A dynamically adjusted album page.

[0615] Step 20:

[0616] The server dynamically adjusts viewing privileges according to the user's emotions and displays only specific content.

[0617] Input: Sentiment analysis results (sentiment tags).

[0618] Specific operation: Execute and apply a process to update viewing permissions based on emotion tags.

[0619] Output: Dynamically adjusted viewing permissions and displayed content.

[0620] (Application example 2)

[0621] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0622] When preserving and sharing memories of the deceased, it is difficult to provide a personalized experience that is appropriately adjusted based on the user's emotions. Another issue is that simple album generation systems cannot reflect changes in the user's emotions as they share their memories.

[0623] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for importing basic information from a resume or by direct input and generating a timeline; means for importing photos and data from social networking services (SNS) and analyzing the date, time, location, etc.; means for creating an album based on the imported data, setting viewing permissions, and sharing the album; means for leaving comments on the album and sharing it with other users; means for dynamically adjusting the content and display method of the album using an emotion engine that analyzes the user's emotions; and means for dynamically adjusting viewing permissions based on the user's emotions. This allows users to more individually preserve memories of the deceased and share them in a flexible and personalized manner based on emotions.

[0624] A "resume" is a document that lists an individual's educational background, work history, skills, and other basic information.

[0625] "Direct entry" is a method in which the user manually enters basic information in digital form.

[0626] "Basic information" refers to important information for identifying an individual, such as the user's name, date of birth, educational background, and work history.

[0627] A "chronology" is a table of data organized over time based on acquired basic information.

[0628] A "photo" is a still image taken with a camera or other device.

[0629] A "social networking service (SNS)" is an online platform that allows individuals to share information and communicate via the Internet.

[0630] "Data" refers to a collection of information that the system can capture, such as photos or social media posts.

[0631] A "date and time" is a specific date and time when a particular event occurred.

[0632] A "place" is a geographic location to which a particular event or piece of data is associated.

[0633] An "album" is a digital collection of captured photos and data.

[0634] "Viewing permissions" refers to the scope and conditions under which a user has the authority to access albums and data.

[0635] "Sharing" means making certain information or data accessible to other users.

[0636] A "comment" is a text message that a user leaves for a particular piece of content within an album.

[0637] An "emotion engine" refers to a technology that analyzes emotions from user input text and reactions, and uses the results to adjust the system's behavior.

[0638] "Dynamic adjustment" means changing the system's display and functionality in real time based on the results of sentiment analysis.

[0639] This invention relates to a system for preserving and sharing memories of the deceased, which combines an emotion engine that recognizes the user's emotions. This system includes a means for generating a chronology by importing basic information from a resume or manually entered data, a means for importing data from photos and social networking services (SNS) and analyzing the date, time, location, etc., a means for creating an album based on the acquired data, setting viewing permissions, and sharing it, a means for leaving comments on the album and sharing it with other users, and an emotion engine that recognizes the user's emotions.

[0640] Obtaining basic information and generating a timeline

[0641] First, the user uploads their resume. The device sends this resume file to the server, which then analyzes it. Using optical character recognition (OCR), basic information such as name, date of birth, educational background, and work history is extracted, and this basic information is stored in a database. The server then automatically generates a timeline based on this information.

[0642] Import and analyze photos and social media data

[0643] Next, the user uploads a photo or connects to a social media account. The device sends the photo to the server, which analyzes the photo's EXIF ​​data to obtain the date and time the photo was taken and the location. The server also uses the social media API to obtain the user's posted data and analyzes it to extract the date, time, location, and tag information. This data is also stored in the database.

[0644] Album Creation

[0645] The server automatically generates album pages based on the acquired basic information, photos, and social media data. The generated albums are organized based on a timeline, photo dates, and locations, and users can edit and add to them from their devices. This allows memories of the deceased to be stored in a centralized location.

[0646] Viewing permission management and sharing

[0647] Users can set viewing permissions for albums for specific family and friends. When a user enters the email addresses of people to whom they want to grant viewing permissions from their device, the server sets the viewing permissions based on this information and generates a shared link. People who receive the shared link can view the album with specific access permissions.

[0648] Comment function

[0649] When a user enters a comment on an album, the comment is sent from the device to the server, which stores the comment in a database and makes the information available to other viewers in real time. This allows family and friends to share and discuss memories on the album.

[0650] Emotion engine integration

[0651] The emotion engine analyzes user emotions based on user reactions to text input, comments, photos, and social media posts. Based on this, the emotion engine dynamically adjusts the album structure and display method. It is also possible to dynamically adjust individual viewing permissions based on emotions.

[0652] Hardware / Software used

[0653] The system is implemented using the following hardware and software:

[0654] Hardware:

[0655] Server (cloud or on-premise): Hosts the database and application server.

[0656] User terminal: A device such as a PC or smartphone that a user uses to input and view data.

[0657] software:

[0658] Python: A whole-program scripting language.

[0659] Flask: A web application framework.

[0660] pytesseract: A library for OCR (Optical Character Recognition).

[0661] OpenCV: A library for image processing.

[0662] scikit-learn: A library for sentiment analysis.

[0663] Specific examples

[0664] For example, suppose a user wants to create an album of memories of their mother and share them with their grandmother. The user uploads a photo taken on Mother's Day and attaches a comment such as, "I loved my mother because she always had a kind smile." The emotion engine interprets this comment as "positive," highlighting parts of the album and automatically recommending other positive memories.

[0665] Example prompt sentence:

[0666] I want to create an album with photos taken on Mother's Day and thank you messages. I want the app to analyze the positive emotions in the photo uploads and comments and display related memories.

[0667] This allows users to preserve memories of the deceased more individually and share them in a flexible and personalized way based on their emotions.

[0668] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0669] Step 1:

[0670] A user uploads a resume from their device. The resume file is sent from the device to the server. The server receives the file and uses OCR technology to extract the resume's text data. The input is a scanned resume image, and the output is basic information such as name, date of birth, educational background, and work history.

[0671] Step 2:

[0672] The server saves the extracted basic information in a database. At this time, the basic information is indexed to manage the information in a chronological table format. The input is the extracted basic information, and the output is the basic information in a chronological table format stored in the database.

[0673] Step 3:

[0674] A user uploads a photo from their device. The photo file is sent from the device to the server, and the server receives it. The server uses OpenCV to analyze the EXIF ​​data of the photo and obtains the date and time of the photo and location information. The input is the uploaded photo data, and the output is the date and time of the photo and location information.

[0675] Step 4:

[0676] A user links their SNS account, and the server retrieves the user's posted data via the SNS's API. The server analyzes the retrieved data and extracts the posting date and time, location, and tag information. The input is the posting data retrieved from the SNS, and the output is the analyzed date, time, location, and tag information.

[0677] Step 5:

[0678] Album pages are automatically generated based on the basic information acquired by the server, the photo's EXIF ​​data, and the data posted on social media. Album pages are organized based on chronology, shooting date and location, and users can edit and add to them from their devices. The input is all the collected data, and the output is the generated album page.

[0679] Step 6:

[0680] The user sets viewing permissions for specific family and friends from their device. The server then sets the viewing permissions based on this and generates a shared link. The input is the email addresses of the people to whom viewing permissions are to be granted, and the output is the set viewing permissions and the generated shared link.

[0681] Step 7:

[0682] When a user enters a comment on an album, the comment is sent from the device to the server, which saves the comment in a database. The comment information saved by the server is reflected in real time to other viewers. The input is the user's comment, and the output is the comment stored in the database and its real-time reflection.

[0683] Step 8:

[0684] The emotion engine analyzes user text input, comments, and reactions to photos and social media posts. The server dynamically adjusts the album structure and display method based on the analysis results. The input is data for analyzing emotions, and the output is the dynamically adjusted album layout and display.

[0685] Step 9:

[0686] Depending on the user's emotions, the server dynamically adjusts the viewing privileges so that only specific content is displayed. The input is the result of emotion analysis, and the output is the dynamically adjusted viewing privileges.

[0687] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0688] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0689] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0690] [Second embodiment]

[0691] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0692] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0693] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0694] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0695] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0696] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0697] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0698] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0699] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0700] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0701] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0702] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0703] This invention relates to a system for centrally storing memories of the deceased and sharing them with family and friends. This system includes the following various means: a means for generating a timeline by importing basic information from a resume or manually entered data, a means for importing data from photos and social networking services (SNS) and analyzing the date, time, location, etc., a means for generating an album based on the imported data, setting viewing permissions, and sharing it, and a means for leaving comments on the album and sharing it with other users.

[0704] Obtaining basic information and generating a timeline

[0705] When a user uploads a resume, the resume file is sent from the device to the server. The server analyzes the received resume file and uses optical character recognition (OCR) to extract basic information such as name, date of birth, educational background, and work history. This basic information is stored in a database, and the server automatically generates a timeline based on this information.

[0706] Specific examples

[0707] The user uploads a resume and the device sends it to the server.

[0708] The server receives the image data of the resume and extracts the text data using OCR technology.

[0709] The server extracts names, dates of birth, educational background, and work history and stores them in a database, automatically generating a timeline.

[0710] Import and analyze photos and social media data

[0711] When a user uploads a photo or connects to a social media account, the device sends it to the server. The server analyzes the photo's EXIF ​​data to obtain the date and time the photo was taken and the location information. It also uses the social media API to obtain the user's posted data, analyzes it, and extracts the date, time, location, and tag information. This data is also stored in the database.

[0712] Specific examples

[0713] The user uploads photos from their trip and the device sends the photo files to the server.

[0714] The server analyzes the photo's EXIF ​​data to determine the date, time and location of the photo.

[0715] When a social media account is linked, the server retrieves the social media post data, analyzes it, and extracts the necessary information.

[0716] Album Creation

[0717] The server automatically generates album pages based on the acquired basic information, photos, and social media data. The generated albums are organized based on a timeline, photo dates, and locations, and users can edit and add to them from their devices. This allows memories of the deceased to be stored in a centralized location.

[0718] Specific examples

[0719] The server collects the information stored in the database and automatically generates an album page.

[0720] Users can view album pages from their devices and edit and add photos and text.

[0721] The server reflects the edited and added information in the database and updates the album.

[0722] Viewing permission management and sharing

[0723] Users can set viewing permissions for albums for specific family and friends. When a user enters the email addresses of people to whom they want to grant viewing permissions from their device, the server sets the viewing permissions based on this information and generates a shared link. People who receive the shared link can view the album with specific access permissions.

[0724] Specific examples

[0725] The user enters the email addresses of family and friends and sets viewing permissions.

[0726] The server sets viewing permissions for the specified email address and generates a shared link.

[0727] Family and friends who receive the shared link can access and view the album.

[0728] Comment function

[0729] When a user enters a comment on an album, the comment is sent from the device to the server, which stores the comment in a database and makes the information available to other viewers in real time. This allows family and friends to share and discuss memories on the album.

[0730] Specific examples

[0731] The user enters a comment on a specific page of the album and presses the send button.

[0732] The server receives the comments and stores them in a database.

[0733] Other users with viewing permissions can view the comments in real time from their devices.

[0734] The above is a specific embodiment of the present invention. By using this system, it is possible to preserve rich memories of the deceased and easily share them with family and friends.

[0735] The processing flow will be explained below.

[0736] Obtaining basic information and generating a timeline

[0737] Step 1:

[0738] A user uploads a resume.

[0739] The user selects a resume file from the terminal and presses the upload button.

[0740] The device receives the file and sends it to the server.

[0741] Step 2:

[0742] The server receives the resume.

[0743] The server receives and stores the uploaded resume file.

[0744] Step 3:

[0745] The server extracts basic information.

[0746] The server uses optical character recognition (OCR) technology to extract information such as name, date of birth, educational background, and work history from the resume.

[0747] Step 4:

[0748] The server stores it in a database.

[0749] The server stores the extracted information in a database.

[0750] Step 5:

[0751] The server generates the timeline.

[0752] The server generates an initial timeline based on the date of birth and adds information such as educational background and work history to the timeline.

[0753] Import and analyze photos and social media data

[0754] Step 1:

[0755] The user uploads a photo.

[0756] The user selects a photo from the device and presses the upload button.

[0757] The device receives the photo file and sends it to the server.

[0758] Step 2:

[0759] The server receives the photo.

[0760] The server receives and stores the uploaded photo files.

[0761] Step 3:

[0762] The server parses the EXIF ​​data of the photo.

[0763] The server reads the EXIF ​​data of the photo and extracts the date and time the photo was taken and the location information.

[0764] Step 4:

[0765] The user links their social media account.

[0766] The user enters the authentication information for their SNS account and presses the link button.

[0767] The device sends the SNS authentication information to the server.

[0768] Step 5:

[0769] The server retrieves the social networking data.

[0770] The server uses the SNS API to obtain the user's posting data (date, time, location, tags, etc.).

[0771] Step 6:

[0772] The server stores it in a database.

[0773] The server stores the acquired social media data and photo information in a database.

[0774] Album Creation

[0775] Step 1:

[0776] The server collects the data.

[0777] The server collects basic information, photos, and social media data from the database.

[0778] Step 2:

[0779] The server generates the album page.

[0780] The server automatically generates an album page based on the collected data.

[0781] Step 3:

[0782] The user checks the album.

[0783] The user browses the created album from the terminal and checks the contents.

[0784] Step 4:

[0785] Users edit and add.

[0786] The user adds to or edits the contents of the album and sends the changes to the server.

[0787] The server saves the changes to the database and updates the album.

[0788] Viewing permission management and sharing

[0789] Step 1:

[0790] The user accesses the View Permissions Settings page.

[0791] The user accesses the viewing permission settings page from the device.

[0792] Step 2:

[0793] The user sets the viewing permissions.

[0794] The user enters the email addresses of family and friends and sets viewing permissions.

[0795] The terminal sends the setting information to the server.

[0796] Step 3:

[0797] The server sets the viewing permissions.

[0798] The server sets the viewing authority for the specified email address.

[0799] Step 4:

[0800] The server generates a sharing link.

[0801] The server will generate a sharing link for the album and send it to the specified email address.

[0802] Comment function

[0803] Step 1:

[0804] The user enters a comment.

[0805] The user opens the album page from the terminal and enters a comment in the comment input form.

[0806] Step 2:

[0807] A user submits a comment.

[0808] The user presses the send button and sends the comment to the server.

[0809] Step 3:

[0810] The server receives the comment.

[0811] The server receives the submitted comments.

[0812] Step 4:

[0813] The server stores the comments.

[0814] The server stores the comments in a database.

[0815] Step 5:

[0816] The server displays the comments in real time.

[0817] The server transmits the comments in real time to the terminals of other users who have viewing authority and displays them on the album page.

[0818] Example 1

[0819] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0820] In modern society, many memories and records are stored as digital data. However, this data is scattered across various devices and platforms, making it difficult to manage it centrally. In particular, to share memories and records of deceased people with family and friends, a system is needed to effectively aggregate, organize, and display this data appropriately. Furthermore, from a privacy perspective, it is necessary to set detailed access permissions for data viewing, and a function is also required for users to share memories and exchange opinions.

[0821] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0822] In this invention, the server includes a means for importing basic information from a resume or through direct input and generating a timeline, a means for extracting basic information from image data using character recognition technology, a means for importing photos and data from social networking services and analyzing the date, time, location, etc., a means for automatically generating an album based on the acquired basic information, photos, and data from social networking services, setting viewing permissions for the album, and sharing it with other users, and a means for entering comments into the album and sharing it with other users. This allows memories of the deceased to be centrally stored and safely and easily shared with family and friends. It also promotes communication between users, allowing them to share and discuss memories of the deceased.

[0823] "Basic information" refers to information such as name, date of birth, educational background, and work history obtained from a resume or by manually entering the information.

[0824] A "chronology" is a table that is created based on the acquired basic information and that chronologically organizes the events and career history of the user's life.

[0825] "Image data" refers to visual data stored in digital format, such as photographs or scanned documents.

[0826] "Character recognition technology" is a technology that uses optical character recognition (OCR) technology to extract character information from image data as digital text.

[0827] "Social networking service" refers to an online platform that enables users to interact with others over the Internet, including blogs, microblogs, and photo sharing.

[0828] "EXIF data" is additional information included in digital photos, including the date and time the photo was taken, location information, camera settings, and so on.

[0829] "Analysis" is the process of examining data in detail to understand its structure, meaning, and patterns.

[0830] An "album" is content that is automatically generated based on acquired basic information, photos, and data from social networking services, and is used to organize and display a user's memories.

[0831] "Viewing authority" is an access control function that allows a specific user to access specific data or content.

[0832] "Entering a comment" refers to the act of a user adding a text message to an album.

[0833] A "database" is a system for efficiently storing and managing digital data, including basic information, photos, social media data, and comments.

[0834] "Server" refers to a computer system that provides functions such as data processing, storage, and network communication.

[0835] This invention relates to a system for centrally storing memories of the deceased and sharing them with family and friends. This system includes a means for generating a timeline by importing basic information from a resume or manually inputting it, a means for importing data from photos and social networking services (SNS) and analyzing the date, time, location, etc., a means for generating an album based on the imported data, setting viewing permissions, and sharing it, and a means for leaving comments on the album and sharing it with other users.

[0836] Obtaining basic information and generating a timeline

[0837] When a user uploads a resume, the resume file is sent from the device to the server. The server analyzes the received resume file and uses character recognition technology (e.g., Google Cloud Vision or Tesseract) to extract basic information such as name, date of birth, educational background, and work history. This basic information is stored in a database, and the server automatically generates a timeline based on it. This timeline will then be used as the basic information for the album that is created.

[0838] Specific examples

[0839] The user uploads a resume and the device sends it to the server.

[0840] The server receives the image data of the resume and extracts the text data using OCR technology.

[0841] The server extracts names, dates of birth, educational background, and work history and stores them in a database, automatically generating a timeline.

[0842] Example prompt:

[0843] "Please upload an image of your resume."

[0844] "Use Google Cloud Vision to extract name, date of birth, education history, and employment history."

[0845] Import and analyze photos and social media data

[0846] When a user uploads a photo or connects to a social media account, the device sends it to the server. The server analyzes the photo's EXIF ​​data to obtain the date and time the photo was taken and the location information. It also uses the social media API (e.g., Facebook Graph API) to obtain the user's posting data and analyzes it to extract date, time, location, and tag information. This data is also stored in the database and used when creating albums.

[0847] Specific examples

[0848] The user uploads photos from their trip and the device sends the photo files to the server.

[0849] The server analyzes the photo's EXIF ​​data to determine the date, time and location of the photo.

[0850] When a social media account is linked, the server retrieves the social media post data, analyzes it, and extracts the necessary information.

[0851] Example prompt:

[0852] "Upload your travel photos."

[0853] "Link your Facebook account to retrieve post data and extract information."

[0854] Album Creation

[0855] The server automatically generates album pages based on the acquired basic information, photos, and social media data. The generated albums are organized based on a timeline, photo dates, and locations, and users can edit and add to them from their devices. This allows memories of the deceased to be stored in a centralized location.

[0856] Specific examples

[0857] The server collects the information stored in the database and automatically generates an album page.

[0858] Users can view album pages from their devices and edit and add photos and text.

[0859] Example prompt:

[0860] "Automatically generate album pages based on the retrieved data."

[0861] "Allow album pages to be edited and added to."

[0862] Viewing permission management and sharing

[0863] Users can set viewing permissions for albums for specific family and friends. When a user enters the email addresses of people to whom they want to grant viewing permissions from their device, the server sets the viewing permissions based on this information and generates a shared link. People who receive the shared link can view the album with specific access permissions.

[0864] Specific examples

[0865] The user enters the email addresses of family and friends and sets viewing permissions.

[0866] The server sets viewing permissions for the specified email address and generates a shared link.

[0867] Family and friends who receive the shared link can access and view the album.

[0868] Example prompt:

[0869] "Enter the email address you want to set album viewing permissions for."

[0870] "Send the shared link to the address provided."

[0871] Comment function

[0872] When a user enters a comment on an album, the comment is sent from the device to the server, which stores the comment in a database and makes the information available to other viewers in real time. This allows family and friends to share and discuss memories on the album.

[0873] Specific examples

[0874] The user enters a comment on a specific page of the album and presses the send button.

[0875] The server receives the comments and stores them in a database.

[0876] Other users with viewing permissions can view the comments in real time from their devices.

[0877] Example prompt:

[0878] "Please enter a comment on the album page."

[0879] "Submitted comments are saved and displayed to other users in real time."

[0880] The above is a specific embodiment of the present invention. By using this system, it is possible to preserve rich memories of the deceased and easily share them with family and friends.

[0881] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0882] Step 1: Get some basic information

[0883] The user uploads a resume and the device sends it to the server.

[0884] Input: Resume file (PDF or image format)

[0885] Specific operation: The user opens the file selection dialog of the web browser, selects the resume file, and clicks the upload button. The terminal sends the selected file to the server via an HTTP request.

[0886] Output: The server receives the resume file.

[0887] Step 2: Resume Analysis

[0888] The server receives the image data of the resume and extracts the text information using OCR technology.

[0889] Input: Resume file (output of Step 1)

[0890] How it works: The server reads the resume file and calls the Google Cloud Vision API or the Tesseract OCR engine to perform character recognition. From the recognized text, information such as name, date of birth, educational background, and work history is extracted.

[0891] Output: Extracted text data of name, date of birth, educational background, and work history

[0892] Step 3: Save basic information and generate a timeline

[0893] The server stores the extracted information in a database and automatically generates a timeline.

[0894] Input: Extracted basic information (output of step 2)

[0895] Specific operation: The server saves the extracted information in a database using an SQL query. Based on the saved data, a timeline is automatically generated by organizing birth dates and educational history information in chronological order.

[0896] Output: Basic information stored in the database and an automatically generated timeline

[0897] Step 4: Upload and analyze photos

[0898] A user uploads a photo, and the device sends the photo file to the server, which analyzes the EXIF ​​data to obtain the date and time the photo was taken and the location.

[0899] Input: Photo file

[0900] Specific operation: The user opens the file selection dialog, selects a photo file, and clicks the upload button. The device sends the selected photo file to the server. The server analyzes the EXIF ​​data of the received photo and extracts the shooting date and location information.

[0901] Output: Extracted photo date and location information

[0902] Step 5: Link your social media accounts and collect data

[0903] The user enters authentication information to link their SNS account to the server. The server uses the SNS API to retrieve and analyze the user's posted data.

[0904] Input: Social media account credentials

[0905] Specific operation: The user clicks the SNS link button and enters their SNS login information in the displayed authentication information input form. The server saves the SNS account information and calls the SNS API (e.g., Facebook Graph API) to retrieve the posted data. The retrieved data is then analyzed to extract date, time, location, and tag information.

[0906] Output: Date, time, location, and tag information of extracted social media posts

[0907] Step 6: Create an album

[0908] The album page is automatically generated based on the basic information, photos, and SNS data obtained by the server.

[0909] Input: Basic information (output from Step 3), photo data (output from Step 4), social media data (output from Step 5)

[0910] Specific operation: The server retrieves basic information, photo data, and SNS data from the database, and embeds the data into the album page template. The album page is automatically generated, allowing users to easily view and edit it.

[0911] Output: Auto-generated album page

[0912] Step 7: Edit and add albums

[0913] Users view album pages from their devices and edit or add photos or text. The server reflects the edited or added information in the database and updates the album.

[0914] Input: User edits and additions

[0915] Specific operation: A user accesses an album page from a web browser, selects the photos and text they want to edit, and then edits, deletes, or adds them. The server receives the user's edits, saves them in the database, and updates the album.

[0916] Output: Updated album page

[0917] Step 8: Set viewing permissions and share

[0918] The user enters the email addresses of family and friends and sets viewing permissions. The server generates a shared link and sends it to the specified email addresses.

[0919] Input: Email address

[0920] Specific operation: The user enters an email address in the viewing permission setting form and clicks the submit button. The server saves the email address in the database and generates a token for setting viewing permissions. A shared link containing the generated token is sent via email.

[0921] Output: Email containing the shared link

[0922] Step 9: Browse your album

[0923] Family and friends who receive the shared link can view the album with specific access permissions.

[0924] Input: Shared Link

[0925] Specific operation: Click the received link, and the web browser will automatically redirect to the album page. The server will verify the token and confirm the viewing privileges before displaying the album page.

[0926] Output: Album page with confirmed viewing permissions

[0927] Step 10: Comment and share

[0928] A user enters a comment on a specific page of an album and presses the submit button. The server saves the comment in a database and makes the information available to other viewers in real time.

[0929] Input: Comment content

[0930] Specific operation: A user enters a comment in the comment input form and clicks the submit button. The server saves the received comment in a database and updates it so that it can be displayed to other viewers in real time.

[0931] Output: Saved comments and real-time updated album page

[0932] (Application example 1)

[0933] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0934] In modern factories, it is extremely important to properly manage robot operation and maintenance histories and quickly share necessary information. However, current systems manage this information in a decentralized manner, making it difficult to centralize the information and check and share it in real time. For this reason, there is a need for a system that can improve the operational efficiency of factory robots and respond quickly.

[0935] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0936] In this invention, the server includes means for importing basic information through historical information or direct input and generating a timeline, means for importing image data or data from social networking services (SNS) and analyzing the date, time, location, etc., means for generating an information collection page based on the imported data and setting viewing permissions for sharing, means for leaving comments on the information collection page and sharing it with other users, means for acquiring, saving, and checking the operation history and maintenance history of the factory robot in real time, and means for uploading and viewing the operation history via an application installed on a smartphone or tablet. This enables centralized management and real-time sharing of the operation history and maintenance history of the factory robot.

[0937] "History information" is a general term for data about the past activities or events of an individual or device.

[0938] "Basic information" refers to the main attribute information about an individual or device, including data such as name, date of birth, educational background, work history, device ID, name, and model.

[0939] A "timeline" is a list of events or occurrences organized by date, and is data presented in chronological order.

[0940] "Image data" is a form of visual data such as photographs or images captured with a digital camera.

[0941] A "social networking service (SNS)" is a platform that allows users to communicate with each other online.

[0942] "Means of analysis" refers to the process of capturing data, analyzing its contents using specific algorithms or techniques, and extracting or evaluating specific information.

[0943] An "information aggregation page" is a web page or digital document that centrally displays and manages information collected from multiple data sources.

[0944] "Viewing authority" refers to a control setting that allows access to or viewing of specific information or content.

[0945] "Leaving a comment" is the act of writing down opinions or thoughts about specific information or content.

[0946] A "factory robot" is an industrial robot designed to perform automated operations or tasks.

[0947] "Operation history" is a record of specific actions and operations performed by a device or robot.

[0948] "Maintenance history" is a detailed record of the maintenance and repairs that machines, equipment, etc. have undergone.

[0949] "Real-time review" refers to the process of obtaining data and information almost instantly and reviewing it in the present.

[0950] A "smartphone" is a highly functional mobile phone that can connect to the Internet and use applications.

[0951] A "tablet" is a portable electronic device with a touchscreen that can connect to the Internet and use applications.

[0952] An "application" is a software program designed to perform a specific task or function.

[0953] The system to realize this application example is a platform that integrates multiple means to centrally manage the operation and maintenance history of factory robots and share information in real time. This system consists of hardware such as servers, smartphones, tablets, and factory robots, as well as software using Flask.

[0954] Program processing

[0955] Obtaining basic information and generating a timeline

[0956] Users input historical information from their smartphones or tablets and send it to the server. The server analyzes the received information, incorporates basic information from the historical information or manually input, and automatically generates a timeline. This creates a basic operational record of the factory robot.

[0957] Importing and analyzing image data and social media data

[0958] When a user links image data or a social media account, the server receives it and analyzes the EXIF ​​information of the image data and the data posted on the social media. The server identifies the date, time, and location information and stores it in a database.

[0959] Creating an information aggregation page

[0960] The server automatically generates an information aggregation page based on the acquired basic information, image data, and social media data. The generated page is organized based on timeline, photo date and time, and location, and users can edit and add to it from their smartphones or tablets. This allows the operation history and maintenance history of factory robots to be stored in a centralized location.

[0961] Viewing permission management and sharing

[0962] Users can set viewing permissions for the information collection page from their smartphones or tablets. The server sets the viewing permissions based on the entered email address and generates a shared link. Engineers and administrators who receive the shared link can view the information collection page with specific access permissions.

[0963] Comment function

[0964] When a user enters a comment on an information collection page, the comment is sent to the server, which stores the comment in a database and makes the information available to other users in real time. This facilitates smooth communication between engineers and administrators.

[0965] Managing the operation and maintenance history of factory robots

[0966] When a factory robot completes a task, it sends its operation history (task date and time, content, results, etc.) to a server via smartphone or tablet. The server then stores the received operation history in a database, making it possible to check it in real time. This makes it possible to obtain and manage the latest information on the operating status and maintenance status of factory robots.

[0967] Specific examples

[0968] A user registers a new factory robot, enters its basic information and sends it to the server.

[0969] After regular maintenance is completed at the factory, operation and maintenance history is uploaded to a server from a smartphone.

[0970] Administrators can check the operation history of specific robots in real time from their smartphones and determine the next maintenance schedule.

[0971] Prompt Sentence Examples

[0972] Add basic information for a new factory robot. Enter the ID, name, and model.

[0973] Upload the history after the operation is completed. Please enter the robot ID, operation date and time, and operation content.

[0974] Get the operation history of a specific robot. Specify the robot ID.

[0975] This will enable centralized management and real-time sharing of factory robot operation and maintenance histories.

[0976] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0977] Step 1: Obtaining basic information and generating a timeline

[0978] The user enters historical information from a smartphone or tablet and sends it to the server. The server analyzes the received historical information and extracts basic information (ID, name, model, etc.). The server stores the extracted information in a database and generates a timeline based on this. The input is the information entered by the user, and the output is the basic information stored in the database and the generated timeline.

[0979] Step 2: Import and analyze image data and social media data

[0980] When a user links image data or a social media account, the device sends this to a server. The server analyzes the EXIF ​​information of the received image data and the data posted on the social media to identify the date, time, and location information. The server stores this information in a database. The input is the image data or social media data, and the output is the analyzed date, time, and location information.

[0981] Step 3: Create an information aggregation page

[0982] The server automatically generates information aggregation pages based on basic information, image data, and social media data. The generated pages are organized based on timeline, photo date and time, and location. Users can edit and add to these pages from their smartphones or tablets. The input is the information stored in the database, and the output is the generated information aggregation page.

[0983] Step 4: Manage viewing permissions and share

[0984] When a user enters the email addresses of people for whom they want to set viewing permissions from their smartphone or tablet, the server sets the viewing permissions based on this information and generates a shared link. The server sets viewing permissions for the specified email addresses and provides the shared link to the user. The input is the email addresses to which viewing permissions are granted, and the output is the set viewing permissions and the shared link.

[0985] Step 5: Commenting

[0986] The user enters a comment on the information collection page and presses the send button. The device sends the comment to the server. The server saves the comment in a database and makes the information available to other users in real time. The input is the user's comment, and the output is the comment saved in the database and an information collection page updated in real time.

[0987] Step 6: Managing the operation and maintenance history of factory robots

[0988] When a factory robot completes a task, it sends its operation history (task date and time, content, results, etc.) to a server via smartphone or tablet. The server stores the received operation history in a database so that managers and engineers can check it in real time. The input is the operation history and maintenance history, and the output is the history information stored in the database and a management screen updated in real time.

[0989] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0990] This invention relates to a system for preserving and sharing memories of the deceased, which is combined with an emotion engine that recognizes the user's emotions. This system includes the following various means: a means for generating a chronology by importing basic information from a resume or manually entered data, a means for importing data from photos and social networking services (SNS) and analyzing the date, time, location, etc., a means for generating an album based on the acquired data, setting viewing permissions, and sharing it, a means for leaving comments on the album and sharing it with other users, and an emotion engine that recognizes the user's emotions.

[0991] Obtaining basic information and generating a timeline

[0992] When a user uploads a resume, the device sends the resume file to the server. The server analyzes the received resume file and uses optical character recognition (OCR) to extract basic information such as name, date of birth, educational background, and work history. This basic information is stored in a database, and the server automatically generates a timeline based on it.

[0993] Specific examples

[0994] The user uploads a resume and the device sends it to the server.

[0995] The server receives the image data of the resume and extracts the text data using OCR technology.

[0996] The server extracts names, dates of birth, educational background, and work history and stores them in a database, automatically generating a timeline.

[0997] Import and analyze photos and social media data

[0998] When a user uploads a photo or connects to a social media account, the device sends it to the server. The server analyzes the photo's EXIF ​​data to obtain the date and time the photo was taken and the location information. It also uses the social media API to obtain the user's posted data, analyzes it, and extracts the date, time, location, and tag information. This data is also stored in the database.

[0999] Specific examples

[1000] The user uploads photos from their trip and the device sends the photo files to the server.

[1001] The server analyzes the photo's EXIF ​​data to determine the date, time and location of the photo.

[1002] When a social media account is linked, the server retrieves the social media post data, analyzes it, and extracts the necessary information.

[1003] Album Creation

[1004] The server automatically generates album pages based on the acquired basic information, photos, and social media data. The generated albums are organized based on a timeline, photo dates, and locations, and users can edit and add to them from their devices. This allows memories of the deceased to be stored in a centralized location.

[1005] Specific examples

[1006] The server collects the information stored in the database and automatically generates an album page.

[1007] Users can view album pages from their devices and edit and add photos and text.

[1008] The server reflects the edited and added information in the database and updates the album.

[1009] Viewing permission management and sharing

[1010] Users can set viewing permissions for albums for specific family and friends. When a user enters the email addresses of people to whom they want to grant viewing permissions from their device, the server sets the viewing permissions based on this information and generates a shared link. People who receive the shared link can view the album with specific access permissions.

[1011] Specific examples

[1012] The user enters the email addresses of family and friends and sets viewing permissions.

[1013] The server sets viewing permissions for the specified email address and generates a shared link.

[1014] Family and friends who receive the shared link can access and view the album.

[1015] Comment function

[1016] When a user enters a comment on an album, the comment is sent from the device to the server, which stores the comment in a database and makes the information available to other viewers in real time. This allows family and friends to share and discuss memories on the album.

[1017] Specific examples

[1018] The user enters a comment on a specific page of the album and presses the send button.

[1019] The server receives the comments and stores them in a database.

[1020] Other users with viewing permissions can view the comments in real time from their devices.

[1021] Emotion engine integration

[1022] The emotion engine analyzes user emotions based on user reactions to text input, comments, photos, and social media posts. Based on this, the emotion engine dynamically adjusts the album structure and display method. It is also possible to dynamically adjust individual viewing permissions based on emotions.

[1023] Specific examples

[1024] When a user enters a comment on an album, an emotion engine analyzes the user's emotions from the text.

[1025] The server dynamically adjusts the album page layout based on the analysis results.

[1026] Depending on the user's emotions, the server dynamically adjusts the viewing authority and displays only specific content.

[1027] The above is a specific embodiment of the present invention. By using this system, memories of the deceased can be richly preserved and flexibly shared based on emotions.

[1028] The processing flow will be explained below.

[1029] Obtaining basic information and generating a timeline

[1030] Step 1:

[1031] A user uploads a resume.

[1032] The user selects a resume file from the terminal and presses the upload button.

[1033] The device receives the file and sends it to the server.

[1034] Step 2:

[1035] The server receives the resume.

[1036] The server receives and stores the uploaded resume file.

[1037] Step 3:

[1038] The server extracts basic information.

[1039] The server uses optical character recognition (OCR) technology to extract information such as name, date of birth, educational background, and work history from the resume.

[1040] Step 4:

[1041] The server stores it in a database.

[1042] The server stores the extracted information in a database.

[1043] Step 5:

[1044] The server generates the timeline.

[1045] The server generates an initial timeline based on the date of birth and adds information such as educational background and work history to the timeline.

[1046] Import and analyze photos and social media data

[1047] Step 1:

[1048] The user uploads a photo.

[1049] The user selects a photo from the device and presses the upload button.

[1050] The device receives the photo file and sends it to the server.

[1051] Step 2:

[1052] The server receives the photo.

[1053] The server receives and stores the uploaded photo files.

[1054] Step 3:

[1055] The server parses the EXIF ​​data of the photo.

[1056] The server reads the EXIF ​​data of the photo and extracts the date and time the photo was taken and the location information.

[1057] Step 4:

[1058] The user links their social media account.

[1059] The user enters the authentication information for their SNS account and presses the link button.

[1060] The device sends the SNS authentication information to the server.

[1061] Step 5:

[1062] The server retrieves the social networking data.

[1063] The server uses the SNS API to obtain the user's posting data (date, time, location, tags, etc.).

[1064] Step 6:

[1065] The server stores it in a database.

[1066] The server stores the acquired social media data and photo information in a database.

[1067] Album Creation

[1068] Step 1:

[1069] The server collects the data.

[1070] The server collects basic information, photos, and social media data from the database.

[1071] Step 2:

[1072] The server generates the album page.

[1073] The server automatically generates an album page based on the collected data.

[1074] Step 3:

[1075] The user checks the album.

[1076] The user browses the created album from the terminal and checks the contents.

[1077] Step 4:

[1078] Users edit and add.

[1079] The user adds to or edits the contents of the album and sends the changes to the server.

[1080] The server saves the changes to the database and updates the album.

[1081] Viewing permission management and sharing

[1082] Step 1:

[1083] The user accesses the View Permissions Settings page.

[1084] The user accesses the viewing permission settings page from the device.

[1085] Step 2:

[1086] The user sets the viewing permissions.

[1087] The user enters the email addresses of family and friends and sets viewing permissions.

[1088] The terminal sends the setting information to the server.

[1089] Step 3:

[1090] The server sets the viewing permissions.

[1091] The server sets the viewing authority for the specified email address.

[1092] Step 4:

[1093] The server generates a sharing link.

[1094] The server will generate a sharing link for the album and send it to the specified email address.

[1095] Comment function

[1096] Step 1:

[1097] The user enters a comment.

[1098] The user opens the album page from the terminal and enters a comment in the comment input form.

[1099] Step 2:

[1100] A user submits a comment.

[1101] The user presses the send button and sends the comment to the server.

[1102] Step 3:

[1103] The server receives the comment.

[1104] The server receives the submitted comments.

[1105] Step 4:

[1106] The server stores the comments.

[1107] The server stores the comments in a database.

[1108] Step 5:

[1109] The server displays the comments in real time.

[1110] The server transmits the comments in real time to the terminals of other users who have viewing authority and displays them on the album page.

[1111] Emotion engine integration

[1112] Step 1:

[1113] Analyze user sentiment.

[1114] The server sends the text and comments entered by the user to the emotion engine.

[1115] The emotion engine analyzes the text and identifies the user's emotion.

[1116] Step 2:

[1117] Tailor your album based on emotion.

[1118] The server dynamically adjusts the page layout and display method of the album based on the emotional information obtained by the emotion engine.

[1119] Step 3:

[1120] Dynamically adjust viewing permissions.

[1121] The server dynamically adjusts viewing permissions according to the user's emotions based on the analysis results of the emotion engine.

[1122] Specific examples

[1123] When a user enters a comment on an album, an emotion engine analyzes the user's emotions from the text.

[1124] The server dynamically adjusts the album page layout based on the analysis results.

[1125] Depending on the user's emotions, the server dynamically adjusts the viewing authority and displays only specific content.

[1126] This system allows for rich preservation of memories of the deceased and flexible sharing based on emotions.

[1127] Example 2

[1128] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1129] Conventional systems for storing and sharing memories of the deceased require users to manually organize and manage information, and they have problems with creating flexible albums based on emotions and dynamically adjusting viewing permissions. This has led to issues with efficiently sharing memories and displaying appropriate information based on individual emotions.

[1130] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1131] In this invention, the server includes a means for importing basic information from a resume or through direct input and generating a timeline, a means for importing photos and data from social networking services (SNS) and analyzing the date, time, location, etc., a means for creating an album based on the imported data, setting viewing permissions for sharing, and integrating an emotion engine that analyzes the user's emotions to dynamically adjust the album configuration and display method. This allows for efficient organization and preservation of memories of the deceased, and enables flexible album configuration and dynamic adjustment of viewing permissions based on emotions.

[1132] "Basic information" refers to personal information such as the user's name, date of birth, educational background, and work history.

[1133] A "chronology" is a table generated from basic information that chronologically organizes the events and careers of a user's life.

[1134] "Photo" refers to image data uploaded by a user, including metadata and EXIF ​​information.

[1135] A "social networking service (SNS)" is a web service that allows users to interact with others online and share information.

[1136] "Data" is a general term for information collected by the system, such as background information, photos, and social media posting data uploaded or linked by users.

[1137] "Analysis" refers to the process of extracting and organizing details such as date, time, location, and tag information contained in the data.

[1138] An "album" is a digital record of a user's memories that is generated based on the captured data.

[1139] "Viewing authority" refers to access control that can be set to allow specific users to view the album.

[1140] "Sharing" refers to providing an album via a link or the like so that users with set viewing permissions can access the album.

[1141] A "comment" is a text message that a user enters for an album and shares with other users.

[1142] An "emotion engine" is a computer program or algorithm that analyzes emotions based on user input and behavior and reflects the results.

[1143] "Dynamic adjustment" refers to the process of changing settings and displays in real time based on acquired information and analysis results.

[1144] This invention relates to a system for preserving and sharing memories of the deceased, which is combined with an emotion engine that recognizes the user's emotions. This system includes a means for generating a chronology by importing basic information from a resume or manually entered data, a means for importing data from photos and social networking services (SNS) and analyzing the date, time, location, etc., a means for generating an album based on the acquired data, setting viewing permissions, and sharing the album, a means for leaving comments on the album and sharing it with other users, and an emotion engine that recognizes the user's emotions.

[1145] Obtaining basic information and generating a timeline

[1146] When a user uploads a resume, the device sends the resume file to the server. The server analyzes the received resume file and uses optical character recognition (OCR) to extract basic information such as name, date of birth, educational background, and work history. This basic information is stored in a database, and the server automatically generates a timeline based on it.

[1147] Specific examples

[1148] The user uploads a resume and the device sends it to the server.

[1149] The server extracts the character data using OCR technology.

[1150] The server extracts names, dates of birth, educational background, and work history and stores them in a database, automatically generating a timeline.

[1151] Import and analyze photos and social media data

[1152] When a user uploads a photo or connects to a social media account, the device sends it to the server. The server analyzes the photo's EXIF ​​data to obtain the date and time the photo was taken and the location information. It also uses the social media API to obtain the user's posted data, analyzes it, and extracts the date, time, location, and tag information. This data is also stored in the database.

[1153] Specific examples

[1154] The user uploads photos from their trip and the device sends the photo files to the server.

[1155] The server analyzes the photo's EXIF ​​data to determine the date, time and location of the photo.

[1156] The server retrieves the social media post data, analyzes it, and extracts the necessary information.

[1157] Album Creation

[1158] The server automatically generates album pages based on the acquired basic information, photos, and social media data. The generated albums are organized based on a timeline, photo dates, and locations, and users can edit and add to them from their devices. This allows memories of the deceased to be stored in a centralized location.

[1159] Specific examples

[1160] The server collects the information stored in the database and automatically generates an album page.

[1161] Users can view album pages from their devices and edit and add photos and text.

[1162] The server reflects the edited and added information in the database and updates the album.

[1163] Viewing permission management and sharing

[1164] Users can set viewing permissions for albums for specific family and friends. When a user enters the email addresses of the people to whom they want to grant viewing permissions from their device, the server sets the viewing permissions based on this information and generates a shared link. People who receive the shared link can view the album with specific access permissions.

[1165] Specific examples

[1166] The user enters the email addresses of family and friends and sets viewing permissions.

[1167] The server sets viewing permissions for the specified email address and generates a shared link.

[1168] Family and friends who receive the shared link can access and view the album.

[1169] Comment function

[1170] When a user enters a comment on an album, the comment is sent from the device to the server, which stores the comment in a database and makes the information available to other viewers in real time. This allows family and friends to share and discuss memories on the album.

[1171] Specific examples

[1172] The user enters a comment on a specific page of the album and presses the send button.

[1173] The server receives the comments and stores them in a database.

[1174] Other users with viewing permissions can view the comments in real time from their devices.

[1175] Emotion engine integration

[1176] The emotion engine analyzes user emotions based on user reactions to text input, comments, photos, and social media posts. Based on this, the emotion engine dynamically adjusts the album structure and display method. It is also possible to dynamically adjust individual viewing permissions based on emotions.

[1177] Specific examples

[1178] When a user enters a comment on an album, an emotion engine analyzes the user's emotions from the text.

[1179] The server dynamically adjusts the album page layout based on the analysis results.

[1180] Depending on the user's emotions, the server dynamically adjusts the viewing authority and displays only specific content.

[1181] Prompt Sentence Examples

[1182] Resume upload prompt: "Please upload your resume. The system will automatically extract your name, date of birth, education, and work history information to create a timeline."

[1183] Social media account linking prompt: "Please link your social media accounts. We will analyze your past posts and automatically add them to your memories album."

[1184] Comment prompt: "Please enter your memories or comments about this photo."

[1185] The above is a specific embodiment of the present invention. By using this system, memories of the deceased can be richly preserved and flexibly shared based on emotions.

[1186] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1187] Step 1:

[1188] The user uploads a resume file.

[1189] Input: A resume file (PDF or image format) specified by the user.

[1190] Specific actions: The user opens a file selection dialog through the web interface, selects a resume file, and clicks the "Upload" button.

[1191] Output: The selected resume file will be saved on your device.

[1192] Step 2:

[1193] The terminal sends the uploaded resume file to the server.

[1194] Input: A resume file uploaded by the user.

[1195] Specific operation: The terminal sends the resume file to the server using an HTTP POST request.

[1196] Output: The resume file arrives on the server.

[1197] Step 3:

[1198] The server extracts character data from the received resume file using OCR technology.

[1199] Input: The resume file that arrives on the server.

[1200] Specific operation: The server calls an OCR API (specifically, Google Cloud Vision API, etc.) to extract text data from the file.

[1201] Output: Text data such as name, date of birth, educational background, and work history is extracted.

[1202] Step 4:

[1203] The server extracts basic information, stores it in a database, and automatically generates a timeline.

[1204] Input: Extracted text data such as name, date of birth, educational background, and work history.

[1205] Specific operation: The server maps these data to each field and stores them in the database. It then executes the timeline generation algorithm to automatically generate a timeline.

[1206] Output: Basic information stored in a database and an automatically generated timeline.

[1207] Step 5:

[1208] Users can upload photos or connect their social media accounts.

[1209] Input: Photo file selected by the user or social media account information.

[1210] Specific operation: The user selects and uploads a photo file in the web interface, or clicks the SNS link button and enters authentication information.

[1211] Output: The selected photo files are saved to the device or the social networking credentials are obtained.

[1212] Step 6:

[1213] The device sends the uploaded photo files and social media authentication information to the server.

[1214] Input: A photo file selected by the user or social networking credentials.

[1215] Specific operation: The device sends a photo file to the server using an HTTP POST request, or sends an OAuth token for the SNS to the server.

[1216] Output: Photo file or authentication information arrives at the server.

[1217] Step 7:

[1218] The server analyzes the EXIF ​​data of the photo to obtain the date and time of the photo and location information. It also uses the SNS API to obtain user posted data and extracts the date, time, location, and tag information.

[1219] Input: Photo files and social networking credentials received on the server.

[1220] Specific operation: The server uses an image processing library to parse the EXIF ​​data, sends a request to the SNS API, and retrieves the post data.

[1221] Output: The shooting date and time, location information, and social media posting data are analyzed.

[1222] Step 8:

[1223] The server saves the retrieved data in the database.

[1224] Input: Analyzed photo date and time, location information, and social media posting data.

[1225] Specific operation: The server inserts these data into the corresponding database tables.

[1226] Output: Photo date and time, location information, and social media posting data stored in a database.

[1227] Step 9:

[1228] The server automatically generates an album page based on the stored information.

[1229] Input: Basic information stored in the database, photo date and time, location information, and social media posting data.

[1230] What happens: The server queries the stored data and applies the data to the album template to generate the page.

[1231] Output: Auto-generated album page.

[1232] Step 10:

[1233] Users can view album pages and edit and add photos and text.

[1234] Input: Generated album page and information stored in database.

[1235] Specific operation: A user accesses an album page through a web interface, places the cursor over the part they want to edit, and makes edits or adds.

[1236] Output: Edited and added album page.

[1237] Step 11:

[1238] The server reflects the user's edited and added information in the database and updates the album.

[1239] Input: Information edited or added by the user.

[1240] Specific operation: The server receives the form data and performs processing to update the database fields.

[1241] Output: The updated album page.

[1242] Step 12:

[1243] The user sets the viewing authority of the album for family and friends.

[1244] Input: Email addresses of family and friends specified by the user.

[1245] Specific actions: Enter an email address in the web interface and click the "Share" button.

[1246] Output: The email address information entered.

[1247] Step 13:

[1248] The server sets viewing permissions for the specified email address and generates a shared link.

[1249] Input: The email address provided by the user.

[1250] Specific operation: The server sets viewing permissions based on the email address and generates a unique sharing link.

[1251] Output: The generated sharing link.

[1252] Step 14:

[1253] The server will send the shared link to the specified email address.

[1254] Inputs: The generated sharing link and the email address provided.

[1255] Specific operation: The server uses an email sending service to send an email containing a link.

[1256] Output: The email sent.

[1257] Step 15:

[1258] The user enters a comment on a specific page of the album and presses the send button.

[1259] Input: The text entered in the comment input field.

[1260] Specific action: Enter text into the comment field in the web interface and click the "Submit" button.

[1261] Output: The comment text entered.

[1262] Step 16:

[1263] The server receives the comments and stores them in a database.

[1264] Input: Comment text submitted by user.

[1265] Specific operation: The server receives the comment data and inserts it into the corresponding table in the database.

[1266] Output: The comment stored in the database.

[1267] Step 17:

[1268] The server reflects the comments in real time to other users who have viewing authority.

[1269] Input: Comments stored in the database.

[1270] Specific operation: Comments are instantly displayed on other viewers' screens using WebSocket and real-time communication protocols.

[1271] Output: Comments screen updated in real time.

[1272] Step 18:

[1273] The server sends comments and text to the emotion engine, which analyzes the user's emotions.

[1274] Input: Comments and text entered by the user.

[1275] Specific operation: The server sends comment data to the sentiment analysis API and obtains sentiment tags.

[1276] Output: Sentiment analysis results (sentiment tags).

[1277] Step 19:

[1278] The server dynamically adjusts the album page layout based on the analysis results.

[1279] Input: Sentiment analysis results (sentiment tags).

[1280] Specific operation: Executes a script to dynamically generate a layout template.

[1281] Output: A dynamically adjusted album page.

[1282] Step 20:

[1283] The server dynamically adjusts viewing privileges according to the user's emotions and displays only specific content.

[1284] Input: Sentiment analysis results (sentiment tags).

[1285] Specific operation: Execute and apply a process to update viewing permissions based on emotion tags.

[1286] Output: Dynamically adjusted viewing permissions and displayed content.

[1287] (Application example 2)

[1288] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1289] When preserving and sharing memories of the deceased, it is difficult to provide a personalized experience that is appropriately adjusted based on the user's emotions. Another issue is that simple album generation systems cannot reflect changes in the user's emotions as they share their memories.

[1290] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for importing basic information from a resume or by direct input and generating a timeline; means for importing photos and data from social networking services (SNS) and analyzing the date, time, location, etc.; means for creating an album based on the imported data, setting viewing permissions, and sharing the album; means for leaving comments on the album and sharing it with other users; means for dynamically adjusting the content and display method of the album using an emotion engine that analyzes the user's emotions; and means for dynamically adjusting viewing permissions based on the user's emotions. This allows users to more individually preserve memories of the deceased and share them in a flexible and personalized manner based on emotions.

[1291] A "resume" is a document that lists an individual's educational background, work history, skills, and other basic information.

[1292] "Direct entry" is a method in which the user manually enters basic information in digital form.

[1293] "Basic information" refers to important information for identifying an individual, such as the user's name, date of birth, educational background, and work history.

[1294] A "chronology" is a table of data organized over time based on acquired basic information.

[1295] A "photo" is a still image taken with a camera or other device.

[1296] A "social networking service (SNS)" is an online platform that allows individuals to share information and communicate via the Internet.

[1297] "Data" refers to a collection of information that the system can capture, such as photos or social media posts.

[1298] A "date and time" is a specific date and time when a particular event occurred.

[1299] A "place" is a geographic location to which a particular event or piece of data is associated.

[1300] An "album" is a digital collection of captured photos and data.

[1301] "Viewing permissions" refers to the scope and conditions under which a user has the authority to access albums and data.

[1302] "Sharing" means making certain information or data accessible to other users.

[1303] A "comment" is a text message that a user leaves for a particular piece of content within an album.

[1304] An "emotion engine" refers to a technology that analyzes emotions from user input text and reactions, and uses the results to adjust the system's behavior.

[1305] "Dynamic adjustment" means changing the system's display and functionality in real time based on the results of sentiment analysis.

[1306] This invention relates to a system for preserving and sharing memories of the deceased, which combines an emotion engine that recognizes the user's emotions. This system includes a means for generating a chronology by importing basic information from a resume or manually entered data, a means for importing data from photos and social networking services (SNS) and analyzing the date, time, location, etc., a means for creating an album based on the acquired data, setting viewing permissions, and sharing it, a means for leaving comments on the album and sharing it with other users, and an emotion engine that recognizes the user's emotions.

[1307] Obtaining basic information and generating a timeline

[1308] First, the user uploads their resume. The device sends this resume file to the server, which then analyzes it. Using optical character recognition (OCR), basic information such as name, date of birth, educational background, and work history is extracted, and this basic information is stored in a database. The server then automatically generates a timeline based on this information.

[1309] Import and analyze photos and social media data

[1310] Next, the user uploads a photo or connects to a social media account. The device sends the photo to the server, which analyzes the photo's EXIF ​​data to obtain the date and time the photo was taken and the location. The server also uses the social media API to obtain the user's posted data and analyzes it to extract the date, time, location, and tag information. This data is also stored in the database.

[1311] Album Creation

[1312] The server automatically generates album pages based on the acquired basic information, photos, and social media data. The generated albums are organized based on a timeline, photo dates, and locations, and users can edit and add to them from their devices. This allows memories of the deceased to be stored in a centralized location.

[1313] Viewing permission management and sharing

[1314] Users can set viewing permissions for albums for specific family and friends. When a user enters the email addresses of people to whom they want to grant viewing permissions from their device, the server sets the viewing permissions based on this information and generates a shared link. People who receive the shared link can view the album with specific access permissions.

[1315] Comment function

[1316] When a user enters a comment on an album, the comment is sent from the device to the server, which stores the comment in a database and makes the information available to other viewers in real time. This allows family and friends to share and discuss memories on the album.

[1317] Emotion engine integration

[1318] The emotion engine analyzes user emotions based on user reactions to text input, comments, photos, and social media posts. Based on this, the emotion engine dynamically adjusts the album structure and display method. It is also possible to dynamically adjust individual viewing permissions based on emotions.

[1319] Hardware / Software used

[1320] The system is implemented using the following hardware and software:

[1321] Hardware:

[1322] Server (cloud or on-premise): Hosts the database and application server.

[1323] User terminal: A device such as a PC or smartphone that a user uses to input and view data.

[1324] software:

[1325] Python: A whole-program scripting language.

[1326] Flask: A web application framework.

[1327] pytesseract: A library for OCR (Optical Character Recognition).

[1328] OpenCV: A library for image processing.

[1329] scikit-learn: A library for sentiment analysis.

[1330] Specific examples

[1331] For example, suppose a user wants to create an album of memories of their mother and share them with their grandmother. The user uploads a photo taken on Mother's Day and attaches a comment such as, "I loved my mother because she always had a kind smile." The emotion engine interprets this comment as "positive," highlighting parts of the album and automatically recommending other positive memories.

[1332] Example prompt sentence:

[1333] I want to create an album with photos taken on Mother's Day and thank you messages. I want the app to analyze the positive emotions in the photo uploads and comments and display related memories.

[1334] This allows users to preserve memories of the deceased more individually and share them in a flexible and personalized way based on their emotions.

[1335] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1336] Step 1:

[1337] A user uploads a resume from their device. The resume file is sent from the device to the server. The server receives the file and uses OCR technology to extract the resume's text data. The input is a scanned resume image, and the output is basic information such as name, date of birth, educational background, and work history.

[1338] Step 2:

[1339] The server saves the extracted basic information in a database. At this time, the basic information is indexed to manage the information in a chronological table format. The input is the extracted basic information, and the output is the basic information in a chronological table format stored in the database.

[1340] Step 3:

[1341] A user uploads a photo from their device. The photo file is sent from the device to the server, and the server receives it. The server uses OpenCV to analyze the EXIF ​​data of the photo and obtains the date and time of the photo and location information. The input is the uploaded photo data, and the output is the date and time of the photo and location information.

[1342] Step 4:

[1343] A user links their SNS account, and the server retrieves the user's posted data via the SNS's API. The server analyzes the retrieved data and extracts the posting date and time, location, and tag information. The input is the posting data retrieved from the SNS, and the output is the analyzed date, time, location, and tag information.

[1344] Step 5:

[1345] Album pages are automatically generated based on the basic information acquired by the server, the photo's EXIF ​​data, and the data posted on social media. Album pages are organized based on chronology, shooting date and location, and users can edit and add to them from their devices. The input is all the collected data, and the output is the generated album page.

[1346] Step 6:

[1347] The user sets viewing permissions for specific family and friends from their device. The server then sets the viewing permissions based on this and generates a shared link. The input is the email addresses of the people to whom viewing permissions are to be granted, and the output is the set viewing permissions and the generated shared link.

[1348] Step 7:

[1349] When a user enters a comment on an album, the comment is sent from the device to the server, which saves the comment in a database. The comment information saved by the server is reflected in real time to other viewers. The input is the user's comment, and the output is the comment stored in the database and its real-time reflection.

[1350] Step 8:

[1351] The emotion engine analyzes user text input, comments, and reactions to photos and social media posts. The server dynamically adjusts the album structure and display method based on the analysis results. The input is data for analyzing emotions, and the output is the dynamically adjusted album layout and display.

[1352] Step 9:

[1353] Depending on the user's emotions, the server dynamically adjusts the viewing privileges so that only specific content is displayed. The input is the result of emotion analysis, and the output is the dynamically adjusted viewing privileges.

[1354] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1355] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1356] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1357] [Third embodiment]

[1358] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1359] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1360] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1361] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1362] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1363] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1364] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1365] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1366] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1367] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1368] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1369] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1370] This invention relates to a system for centrally storing memories of the deceased and sharing them with family and friends. This system includes the following various means: a means for generating a timeline by importing basic information from a resume or manually entered data, a means for importing data from photos and social networking services (SNS) and analyzing the date, time, location, etc., a means for generating an album based on the imported data, setting viewing permissions, and sharing it, and a means for leaving comments on the album and sharing it with other users.

[1371] Obtaining basic information and generating a timeline

[1372] When a user uploads a resume, the resume file is sent from the device to the server. The server analyzes the received resume file and uses optical character recognition (OCR) to extract basic information such as name, date of birth, educational background, and work history. This basic information is stored in a database, and the server automatically generates a timeline based on this information.

[1373] Specific examples

[1374] The user uploads a resume and the device sends it to the server.

[1375] The server receives the image data of the resume and extracts the text data using OCR technology.

[1376] The server extracts names, dates of birth, educational background, and work history and stores them in a database, automatically generating a timeline.

[1377] Import and analyze photos and social media data

[1378] When a user uploads a photo or connects to a social media account, the device sends it to the server. The server analyzes the photo's EXIF ​​data to obtain the date and time the photo was taken and the location information. It also uses the social media API to obtain the user's posted data, analyzes it, and extracts the date, time, location, and tag information. This data is also stored in the database.

[1379] Specific examples

[1380] The user uploads photos from their trip and the device sends the photo files to the server.

[1381] The server analyzes the photo's EXIF ​​data to determine the date, time and location of the photo.

[1382] When a social media account is linked, the server retrieves the social media post data, analyzes it, and extracts the necessary information.

[1383] Album Creation

[1384] The server automatically generates album pages based on the acquired basic information, photos, and social media data. The generated albums are organized based on a timeline, photo dates, and locations, and users can edit and add to them from their devices. This allows memories of the deceased to be stored in a centralized location.

[1385] Specific examples

[1386] The server collects the information stored in the database and automatically generates an album page.

[1387] Users can view album pages from their devices and edit and add photos and text.

[1388] The server reflects the edited and added information in the database and updates the album.

[1389] Viewing permission management and sharing

[1390] Users can set viewing permissions for albums for specific family and friends. When a user enters the email addresses of people to whom they want to grant viewing permissions from their device, the server sets the viewing permissions based on this information and generates a shared link. People who receive the shared link can view the album with specific access permissions.

[1391] Specific examples

[1392] The user enters the email addresses of family and friends and sets viewing permissions.

[1393] The server sets viewing permissions for the specified email address and generates a shared link.

[1394] Family and friends who receive the shared link can access and view the album.

[1395] Comment function

[1396] When a user enters a comment on an album, the comment is sent from the device to the server, which stores the comment in a database and makes the information available to other viewers in real time. This allows family and friends to share and discuss memories on the album.

[1397] Specific examples

[1398] The user enters a comment on a specific page of the album and presses the send button.

[1399] The server receives the comments and stores them in a database.

[1400] Other users with viewing permissions can view the comments in real time from their devices.

[1401] The above is a specific embodiment of the present invention. By using this system, it is possible to preserve rich memories of the deceased and easily share them with family and friends.

[1402] The processing flow will be explained below.

[1403] Obtaining basic information and generating a timeline

[1404] Step 1:

[1405] A user uploads a resume.

[1406] The user selects a resume file from the terminal and presses the upload button.

[1407] The device receives the file and sends it to the server.

[1408] Step 2:

[1409] The server receives the resume.

[1410] The server receives and stores the uploaded resume file.

[1411] Step 3:

[1412] The server extracts basic information.

[1413] The server uses optical character recognition (OCR) technology to extract information such as name, date of birth, educational background, and work history from the resume.

[1414] Step 4:

[1415] The server stores it in a database.

[1416] The server stores the extracted information in a database.

[1417] Step 5:

[1418] The server generates the timeline.

[1419] The server generates an initial timeline based on the date of birth and adds information such as educational background and work history to the timeline.

[1420] Import and analyze photos and social media data

[1421] Step 1:

[1422] The user uploads a photo.

[1423] The user selects a photo from the device and presses the upload button.

[1424] The device receives the photo file and sends it to the server.

[1425] Step 2:

[1426] The server receives the photo.

[1427] The server receives and stores the uploaded photo files.

[1428] Step 3:

[1429] The server parses the EXIF ​​data of the photo.

[1430] The server reads the EXIF ​​data of the photo and extracts the date and time the photo was taken and the location information.

[1431] Step 4:

[1432] The user links their social media account.

[1433] The user enters the authentication information for their SNS account and presses the link button.

[1434] The device sends the SNS authentication information to the server.

[1435] Step 5:

[1436] The server retrieves the social networking data.

[1437] The server uses the SNS API to obtain the user's posting data (date, time, location, tags, etc.).

[1438] Step 6:

[1439] The server stores it in a database.

[1440] The server stores the acquired social media data and photo information in a database.

[1441] Album Creation

[1442] Step 1:

[1443] The server collects the data.

[1444] The server collects basic information, photos, and social media data from the database.

[1445] Step 2:

[1446] The server generates the album page.

[1447] The server automatically generates an album page based on the collected data.

[1448] Step 3:

[1449] The user checks the album.

[1450] The user browses the created album from the terminal and checks the contents.

[1451] Step 4:

[1452] Users edit and add.

[1453] The user adds to or edits the contents of the album and sends the changes to the server.

[1454] The server saves the changes to the database and updates the album.

[1455] Viewing permission management and sharing

[1456] Step 1:

[1457] The user accesses the View Permissions Settings page.

[1458] The user accesses the viewing permission settings page from the device.

[1459] Step 2:

[1460] The user sets the viewing permissions.

[1461] The user enters the email addresses of family and friends and sets viewing permissions.

[1462] The terminal sends the setting information to the server.

[1463] Step 3:

[1464] The server sets the viewing permissions.

[1465] The server sets the viewing authority for the specified email address.

[1466] Step 4:

[1467] The server generates a sharing link.

[1468] The server will generate a sharing link for the album and send it to the specified email address.

[1469] Comment function

[1470] Step 1:

[1471] The user enters a comment.

[1472] The user opens the album page from the terminal and enters a comment in the comment input form.

[1473] Step 2:

[1474] A user submits a comment.

[1475] The user presses the send button and sends the comment to the server.

[1476] Step 3:

[1477] The server receives the comment.

[1478] The server receives the submitted comments.

[1479] Step 4:

[1480] The server stores the comments.

[1481] The server stores the comments in a database.

[1482] Step 5:

[1483] The server displays the comments in real time.

[1484] The server transmits the comments in real time to the terminals of other users who have viewing authority and displays them on the album page.

[1485] Example 1

[1486] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1487] In modern society, many memories and records are stored as digital data. However, this data is scattered across various devices and platforms, making it difficult to manage it centrally. In particular, to share memories and records of deceased people with family and friends, a system is needed to effectively aggregate, organize, and display this data appropriately. Furthermore, from a privacy perspective, it is necessary to set detailed access permissions for data viewing, and a function is also required for users to share memories and exchange opinions.

[1488] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1489] In this invention, the server includes a means for importing basic information from a resume or through direct input and generating a timeline, a means for extracting basic information from image data using character recognition technology, a means for importing photos and data from social networking services and analyzing the date, time, location, etc., a means for automatically generating an album based on the acquired basic information, photos, and data from social networking services, setting viewing permissions for the album, and sharing it with other users, and a means for entering comments into the album and sharing it with other users. This allows memories of the deceased to be centrally stored and safely and easily shared with family and friends. It also promotes communication between users, allowing them to share and discuss memories of the deceased.

[1490] "Basic information" refers to information such as name, date of birth, educational background, and work history obtained from a resume or by manually entering the information.

[1491] A "chronology" is a table that is created based on the acquired basic information and that chronologically organizes the events and career history of the user's life.

[1492] "Image data" refers to visual data stored in digital format, such as photographs or scanned documents.

[1493] "Character recognition technology" is a technology that uses optical character recognition (OCR) technology to extract character information from image data as digital text.

[1494] "Social networking service" refers to an online platform that enables users to interact with others over the Internet, including blogs, microblogs, and photo sharing.

[1495] "EXIF data" is additional information included in digital photos, including the date and time the photo was taken, location information, camera settings, and so on.

[1496] "Analysis" is the process of examining data in detail to understand its structure, meaning, and patterns.

[1497] An "album" is content that is automatically generated based on acquired basic information, photos, and data from social networking services, and is used to organize and display a user's memories.

[1498] "Viewing authority" is an access control function that allows a specific user to access specific data or content.

[1499] "Entering a comment" refers to the act of a user adding a text message to an album.

[1500] A "database" is a system for efficiently storing and managing digital data, including basic information, photos, social media data, and comments.

[1501] "Server" refers to a computer system that provides functions such as data processing, storage, and network communication.

[1502] This invention relates to a system for centrally storing memories of the deceased and sharing them with family and friends. This system includes a means for generating a timeline by importing basic information from a resume or manually inputting it, a means for importing data from photos and social networking services (SNS) and analyzing the date, time, location, etc., a means for generating an album based on the imported data, setting viewing permissions, and sharing it, and a means for leaving comments on the album and sharing it with other users.

[1503] Obtaining basic information and generating a timeline

[1504] When a user uploads a resume, the resume file is sent from the device to the server. The server analyzes the received resume file and uses character recognition technology (e.g., Google Cloud Vision or Tesseract) to extract basic information such as name, date of birth, educational background, and work history. This basic information is stored in a database, and the server automatically generates a timeline based on it. This timeline will then be used as the basic information for the album that is created.

[1505] Specific examples

[1506] The user uploads a resume and the device sends it to the server.

[1507] The server receives the image data of the resume and extracts the text data using OCR technology.

[1508] The server extracts names, dates of birth, educational background, and work history and stores them in a database, automatically generating a timeline.

[1509] Example prompt:

[1510] "Please upload an image of your resume."

[1511] "Use Google Cloud Vision to extract name, date of birth, education history, and employment history."

[1512] Import and analyze photos and social media data

[1513] When a user uploads a photo or connects to a social media account, the device sends it to the server. The server analyzes the photo's EXIF ​​data to obtain the date and time the photo was taken and the location information. It also uses the social media API (e.g., Facebook Graph API) to obtain the user's posting data and analyzes it to extract date, time, location, and tag information. This data is also stored in the database and used when creating albums.

[1514] Specific examples

[1515] The user uploads photos from their trip and the device sends the photo files to the server.

[1516] The server analyzes the photo's EXIF ​​data to determine the date, time and location of the photo.

[1517] When a social media account is linked, the server retrieves the social media post data, analyzes it, and extracts the necessary information.

[1518] Example prompt:

[1519] "Upload your travel photos."

[1520] "Link your Facebook account to retrieve post data and extract information."

[1521] Album Creation

[1522] The server automatically generates album pages based on the acquired basic information, photos, and social media data. The generated albums are organized based on a timeline, photo dates, and locations, and users can edit and add to them from their devices. This allows memories of the deceased to be stored in a centralized location.

[1523] Specific examples

[1524] The server collects the information stored in the database and automatically generates an album page.

[1525] Users can view album pages from their devices and edit and add photos and text.

[1526] Example prompt:

[1527] "Automatically generate album pages based on the retrieved data."

[1528] "Allow album pages to be edited and added to."

[1529] Viewing permission management and sharing

[1530] Users can set viewing permissions for albums for specific family and friends. When a user enters the email addresses of people to whom they want to grant viewing permissions from their device, the server sets the viewing permissions based on this information and generates a shared link. People who receive the shared link can view the album with specific access permissions.

[1531] Specific examples

[1532] The user enters the email addresses of family and friends and sets viewing permissions.

[1533] The server sets viewing permissions for the specified email address and generates a shared link.

[1534] Family and friends who receive the shared link can access and view the album.

[1535] Example prompt:

[1536] "Enter the email address you want to set album viewing permissions for."

[1537] "Send the shared link to the address provided."

[1538] Comment function

[1539] When a user enters a comment on an album, the comment is sent from the device to the server, which stores the comment in a database and makes the information available to other viewers in real time. This allows family and friends to share and discuss memories on the album.

[1540] Specific examples

[1541] The user enters a comment on a specific page of the album and presses the send button.

[1542] The server receives the comments and stores them in a database.

[1543] Other users with viewing permissions can view the comments in real time from their devices.

[1544] Example prompt:

[1545] "Please enter a comment on the album page."

[1546] "Submitted comments are saved and displayed to other users in real time."

[1547] The above is a specific embodiment of the present invention. By using this system, it is possible to preserve rich memories of the deceased and easily share them with family and friends.

[1548] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1549] Step 1: Get some basic information

[1550] The user uploads a resume and the device sends it to the server.

[1551] Input: Resume file (PDF or image format)

[1552] Specific operation: The user opens the file selection dialog of the web browser, selects the resume file, and clicks the upload button. The terminal sends the selected file to the server via an HTTP request.

[1553] Output: The server receives the resume file.

[1554] Step 2: Resume Analysis

[1555] The server receives the image data of the resume and extracts the text information using OCR technology.

[1556] Input: Resume file (output of Step 1)

[1557] How it works: The server reads the resume file and calls the Google Cloud Vision API or the Tesseract OCR engine to perform character recognition. From the recognized text, information such as name, date of birth, educational background, and work history is extracted.

[1558] Output: Extracted text data of name, date of birth, educational background, and work history

[1559] Step 3: Save basic information and generate a timeline

[1560] The server stores the extracted information in a database and automatically generates a timeline.

[1561] Input: Extracted basic information (output of step 2)

[1562] Specific operation: The server saves the extracted information in a database using an SQL query. Based on the saved data, a timeline is automatically generated by organizing birth dates and educational history information in chronological order.

[1563] Output: Basic information stored in the database and an automatically generated timeline

[1564] Step 4: Upload and analyze photos

[1565] A user uploads a photo, and the device sends the photo file to the server, which analyzes the EXIF ​​data to obtain the date and time the photo was taken and the location.

[1566] Input: Photo file

[1567] Specific operation: The user opens the file selection dialog, selects a photo file, and clicks the upload button. The device sends the selected photo file to the server. The server analyzes the EXIF ​​data of the received photo and extracts the shooting date and location information.

[1568] Output: Extracted photo date and location information

[1569] Step 5: Link your social media accounts and collect data

[1570] The user enters authentication information to link their SNS account to the server. The server uses the SNS API to retrieve and analyze the user's posted data.

[1571] Input: Social media account credentials

[1572] Specific operation: The user clicks the SNS link button and enters their SNS login information in the displayed authentication information input form. The server saves the SNS account information and calls the SNS API (e.g., Facebook Graph API) to retrieve the posted data. The retrieved data is then analyzed to extract date, time, location, and tag information.

[1573] Output: Date, time, location, and tag information of extracted social media posts

[1574] Step 6: Create an album

[1575] The album page is automatically generated based on the basic information, photos, and SNS data obtained by the server.

[1576] Input: Basic information (output from Step 3), photo data (output from Step 4), social media data (output from Step 5)

[1577] Specific operation: The server retrieves basic information, photo data, and SNS data from the database, and embeds the data into the album page template. The album page is automatically generated, allowing users to easily view and edit it.

[1578] Output: Auto-generated album page

[1579] Step 7: Edit and add albums

[1580] Users view album pages from their devices and edit or add photos or text. The server reflects the edited or added information in the database and updates the album.

[1581] Input: User edits and additions

[1582] Specific operation: A user accesses an album page from a web browser, selects the photos and text they want to edit, and then edits, deletes, or adds them. The server receives the user's edits, saves them in the database, and updates the album.

[1583] Output: Updated album page

[1584] Step 8: Set viewing permissions and share

[1585] The user enters the email addresses of family and friends and sets viewing permissions. The server generates a shared link and sends it to the specified email addresses.

[1586] Input: Email address

[1587] Specific operation: The user enters an email address in the viewing permission setting form and clicks the submit button. The server saves the email address in the database and generates a token for setting viewing permissions. A shared link containing the generated token is sent via email.

[1588] Output: Email containing the shared link

[1589] Step 9: Browse your album

[1590] Family and friends who receive the shared link can view the album with specific access permissions.

[1591] Input: Shared Link

[1592] Specific operation: Click the received link, and the web browser will automatically redirect to the album page. The server will verify the token and confirm the viewing privileges before displaying the album page.

[1593] Output: Album page with confirmed viewing permissions

[1594] Step 10: Comment and share

[1595] A user enters a comment on a specific page of an album and presses the submit button. The server saves the comment in a database and makes the information available to other viewers in real time.

[1596] Input: Comment content

[1597] Specific operation: A user enters a comment in the comment input form and clicks the submit button. The server saves the received comment in a database and updates it so that it can be displayed to other viewers in real time.

[1598] Output: Saved comments and real-time updated album page

[1599] (Application example 1)

[1600] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1601] In modern factories, it is extremely important to properly manage robot operation and maintenance histories and quickly share necessary information. However, current systems manage this information in a decentralized manner, making it difficult to centralize the information and check and share it in real time. For this reason, there is a need for a system that can improve the operational efficiency of factory robots and respond quickly.

[1602] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1603] In this invention, the server includes means for importing basic information through historical information or direct input and generating a timeline, means for importing image data or data from social networking services (SNS) and analyzing the date, time, location, etc., means for generating an information collection page based on the imported data and setting viewing permissions for sharing, means for leaving comments on the information collection page and sharing it with other users, means for acquiring, saving, and checking the operation history and maintenance history of the factory robot in real time, and means for uploading and viewing the operation history via an application installed on a smartphone or tablet. This enables centralized management and real-time sharing of the operation history and maintenance history of the factory robot.

[1604] "History information" is a general term for data about the past activities or events of an individual or device.

[1605] "Basic information" refers to the main attribute information about an individual or device, including data such as name, date of birth, educational background, work history, device ID, name, and model.

[1606] A "timeline" is a list of events or occurrences organized by date, and is data presented in chronological order.

[1607] "Image data" is a form of visual data such as photographs or images captured with a digital camera.

[1608] A "social networking service (SNS)" is a platform that allows users to communicate with each other online.

[1609] "Means of analysis" refers to the process of capturing data, analyzing its contents using specific algorithms or techniques, and extracting or evaluating specific information.

[1610] An "information aggregation page" is a web page or digital document that centrally displays and manages information collected from multiple data sources.

[1611] "Viewing authority" refers to a control setting that allows access to or viewing of specific information or content.

[1612] "Leaving a comment" is the act of writing down opinions or thoughts about specific information or content.

[1613] A "factory robot" is an industrial robot designed to perform automated operations or tasks.

[1614] "Operation history" is a record of specific actions and operations performed by a device or robot.

[1615] "Maintenance history" is a detailed record of the maintenance and repairs that machines, equipment, etc. have undergone.

[1616] "Real-time review" refers to the process of obtaining data and information almost instantly and reviewing it in the present.

[1617] A "smartphone" is a highly functional mobile phone that can connect to the Internet and use applications.

[1618] A "tablet" is a portable electronic device with a touchscreen that can connect to the Internet and use applications.

[1619] An "application" is a software program designed to perform a specific task or function.

[1620] The system to realize this application example is a platform that integrates multiple means to centrally manage the operation and maintenance history of factory robots and share information in real time. This system consists of hardware such as servers, smartphones, tablets, and factory robots, as well as software using Flask.

[1621] Program processing

[1622] Obtaining basic information and generating a timeline

[1623] Users input historical information from their smartphones or tablets and send it to the server. The server analyzes the received information, incorporates basic information from the historical information or manually input, and automatically generates a timeline. This creates a basic operational record of the factory robot.

[1624] Importing and analyzing image data and social media data

[1625] When a user links image data or a social media account, the server receives it and analyzes the EXIF ​​information of the image data and the data posted on the social media. The server identifies the date, time, and location information and stores it in a database.

[1626] Creating an information aggregation page

[1627] The server automatically generates an information aggregation page based on the acquired basic information, image data, and social media data. The generated page is organized based on timeline, photo date and time, and location, and users can edit and add to it from their smartphones or tablets. This allows the operation history and maintenance history of factory robots to be stored in a centralized location.

[1628] Viewing permission management and sharing

[1629] Users can set viewing permissions for the information collection page from their smartphones or tablets. The server sets the viewing permissions based on the entered email address and generates a shared link. Engineers and administrators who receive the shared link can view the information collection page with specific access permissions.

[1630] Comment function

[1631] When a user enters a comment on an information collection page, the comment is sent to the server, which stores the comment in a database and makes the information available to other users in real time. This facilitates smooth communication between engineers and administrators.

[1632] Managing the operation and maintenance history of factory robots

[1633] When a factory robot completes a task, it sends its operation history (task date and time, content, results, etc.) to a server via smartphone or tablet. The server then stores the received operation history in a database, making it possible to check it in real time. This makes it possible to obtain and manage the latest information on the operating status and maintenance status of factory robots.

[1634] Specific examples

[1635] A user registers a new factory robot, enters its basic information and sends it to the server.

[1636] After regular maintenance is completed at the factory, operation and maintenance history is uploaded to a server from a smartphone.

[1637] Administrators can check the operation history of specific robots in real time from their smartphones and determine the next maintenance schedule.

[1638] Prompt Sentence Examples

[1639] Add basic information for a new factory robot. Enter the ID, name, and model.

[1640] Upload the history after the operation is completed. Please enter the robot ID, operation date and time, and operation content.

[1641] Get the operation history of a specific robot. Specify the robot ID.

[1642] This will enable centralized management and real-time sharing of factory robot operation and maintenance histories.

[1643] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1644] Step 1: Obtaining basic information and generating a timeline

[1645] The user enters historical information from a smartphone or tablet and sends it to the server. The server analyzes the received historical information and extracts basic information (ID, name, model, etc.). The server stores the extracted information in a database and generates a timeline based on this. The input is the information entered by the user, and the output is the basic information stored in the database and the generated timeline.

[1646] Step 2: Import and analyze image data and social media data

[1647] When a user links image data or a social media account, the device sends this to a server. The server analyzes the EXIF ​​information of the received image data and the data posted on the social media to identify the date, time, and location information. The server stores this information in a database. The input is the image data or social media data, and the output is the analyzed date, time, and location information.

[1648] Step 3: Create an information aggregation page

[1649] The server automatically generates information aggregation pages based on basic information, image data, and social media data. The generated pages are organized based on timeline, photo date and time, and location. Users can edit and add to these pages from their smartphones or tablets. The input is the information stored in the database, and the output is the generated information aggregation page.

[1650] Step 4: Manage viewing permissions and share

[1651] When a user enters the email addresses of people for whom they want to set viewing permissions from their smartphone or tablet, the server sets the viewing permissions based on this information and generates a shared link. The server sets viewing permissions for the specified email addresses and provides the shared link to the user. The input is the email addresses to which viewing permissions are granted, and the output is the set viewing permissions and the shared link.

[1652] Step 5: Commenting

[1653] The user enters a comment on the information collection page and presses the send button. The device sends the comment to the server. The server saves the comment in a database and makes the information available to other users in real time. The input is the user's comment, and the output is the comment saved in the database and an information collection page updated in real time.

[1654] Step 6: Managing the operation and maintenance history of factory robots

[1655] When a factory robot completes a task, it sends its operation history (task date and time, content, results, etc.) to a server via smartphone or tablet. The server stores the received operation history in a database so that managers and engineers can check it in real time. The input is the operation history and maintenance history, and the output is the history information stored in the database and a management screen updated in real time.

[1656] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1657] This invention relates to a system for preserving and sharing memories of the deceased, which is combined with an emotion engine that recognizes the user's emotions. This system includes the following various means: a means for generating a chronology by importing basic information from a resume or manually entered data, a means for importing data from photos and social networking services (SNS) and analyzing the date, time, location, etc., a means for generating an album based on the acquired data, setting viewing permissions, and sharing it, a means for leaving comments on the album and sharing it with other users, and an emotion engine that recognizes the user's emotions.

[1658] Obtaining basic information and generating a timeline

[1659] When a user uploads a resume, the device sends the resume file to the server. The server analyzes the received resume file and uses optical character recognition (OCR) to extract basic information such as name, date of birth, educational background, and work history. This basic information is stored in a database, and the server automatically generates a timeline based on it.

[1660] Specific examples

[1661] The user uploads a resume and the device sends it to the server.

[1662] The server receives the image data of the resume and extracts the text data using OCR technology.

[1663] The server extracts names, dates of birth, educational background, and work history and stores them in a database, automatically generating a timeline.

[1664] Import and analyze photos and social media data

[1665] When a user uploads a photo or connects to a social media account, the device sends it to the server. The server analyzes the photo's EXIF ​​data to obtain the date and time the photo was taken and the location information. It also uses the social media API to obtain the user's posted data, analyzes it, and extracts the date, time, location, and tag information. This data is also stored in the database.

[1666] Specific examples

[1667] The user uploads photos from their trip and the device sends the photo files to the server.

[1668] The server analyzes the photo's EXIF ​​data to determine the date, time and location of the photo.

[1669] When a social media account is linked, the server retrieves the social media post data, analyzes it, and extracts the necessary information.

[1670] Album Creation

[1671] The server automatically generates album pages based on the acquired basic information, photos, and social media data. The generated albums are organized based on a timeline, photo dates, and locations, and users can edit and add to them from their devices. This allows memories of the deceased to be stored in a centralized location.

[1672] Specific examples

[1673] The server collects the information stored in the database and automatically generates an album page.

[1674] Users can view album pages from their devices and edit and add photos and text.

[1675] The server reflects the edited and added information in the database and updates the album.

[1676] Viewing permission management and sharing

[1677] Users can set viewing permissions for albums for specific family and friends. When a user enters the email addresses of people to whom they want to grant viewing permissions from their device, the server sets the viewing permissions based on this information and generates a shared link. People who receive the shared link can view the album with specific access permissions.

[1678] Specific examples

[1679] The user enters the email addresses of family and friends and sets viewing permissions.

[1680] The server sets viewing permissions for the specified email address and generates a shared link.

[1681] Family and friends who receive the shared link can access and view the album.

[1682] Comment function

[1683] When a user enters a comment on an album, the comment is sent from the device to the server, which stores the comment in a database and makes the information available to other viewers in real time. This allows family and friends to share and discuss memories on the album.

[1684] Specific examples

[1685] The user enters a comment on a specific page of the album and presses the send button.

[1686] The server receives the comments and stores them in a database.

[1687] Other users with viewing permissions can view the comments in real time from their devices.

[1688] Emotion engine integration

[1689] The emotion engine analyzes user emotions based on user reactions to text input, comments, photos, and social media posts. Based on this, the emotion engine dynamically adjusts the album structure and display method. It is also possible to dynamically adjust individual viewing permissions based on emotions.

[1690] Specific examples

[1691] When a user enters a comment on an album, an emotion engine analyzes the user's emotions from the text.

[1692] The server dynamically adjusts the album page layout based on the analysis results.

[1693] Depending on the user's emotions, the server dynamically adjusts the viewing authority and displays only specific content.

[1694] The above is a specific embodiment of the present invention. By using this system, memories of the deceased can be richly preserved and flexibly shared based on emotions.

[1695] The processing flow will be explained below.

[1696] Obtaining basic information and generating a timeline

[1697] Step 1:

[1698] A user uploads a resume.

[1699] The user selects a resume file from the terminal and presses the upload button.

[1700] The device receives the file and sends it to the server.

[1701] Step 2:

[1702] The server receives the resume.

[1703] The server receives and stores the uploaded resume file.

[1704] Step 3:

[1705] The server extracts basic information.

[1706] The server uses optical character recognition (OCR) technology to extract information such as name, date of birth, educational background, and work history from the resume.

[1707] Step 4:

[1708] The server stores it in a database.

[1709] The server stores the extracted information in a database.

[1710] Step 5:

[1711] The server generates the timeline.

[1712] The server generates an initial timeline based on the date of birth and adds information such as educational background and work history to the timeline.

[1713] Import and analyze photos and social media data

[1714] Step 1:

[1715] The user uploads a photo.

[1716] The user selects a photo from the device and presses the upload button.

[1717] The device receives the photo file and sends it to the server.

[1718] Step 2:

[1719] The server receives the photo.

[1720] The server receives and stores the uploaded photo files.

[1721] Step 3:

[1722] The server parses the EXIF ​​data of the photo.

[1723] The server reads the EXIF ​​data of the photo and extracts the date and time the photo was taken and the location information.

[1724] Step 4:

[1725] The user links their social media account.

[1726] The user enters the authentication information for their SNS account and presses the link button.

[1727] The device sends the SNS authentication information to the server.

[1728] Step 5:

[1729] The server retrieves the social networking data.

[1730] The server uses the SNS API to obtain the user's posting data (date, time, location, tags, etc.).

[1731] Step 6:

[1732] The server stores it in a database.

[1733] The server stores the acquired social media data and photo information in a database.

[1734] Album Creation

[1735] Step 1:

[1736] The server collects the data.

[1737] The server collects basic information, photos, and social media data from the database.

[1738] Step 2:

[1739] The server generates the album page.

[1740] The server automatically generates an album page based on the collected data.

[1741] Step 3:

[1742] The user checks the album.

[1743] The user browses the created album from the terminal and checks the contents.

[1744] Step 4:

[1745] Users edit and add.

[1746] The user adds to or edits the contents of the album and sends the changes to the server.

[1747] The server saves the changes to the database and updates the album.

[1748] Viewing permission management and sharing

[1749] Step 1:

[1750] The user accesses the View Permissions Settings page.

[1751] The user accesses the viewing permission settings page from the device.

[1752] Step 2:

[1753] The user sets the viewing permissions.

[1754] The user enters the email addresses of family and friends and sets viewing permissions.

[1755] The terminal sends the setting information to the server.

[1756] Step 3:

[1757] The server sets the viewing permissions.

[1758] The server sets the viewing authority for the specified email address.

[1759] Step 4:

[1760] The server generates a sharing link.

[1761] The server will generate a sharing link for the album and send it to the specified email address.

[1762] Comment function

[1763] Step 1:

[1764] The user enters a comment.

[1765] The user opens the album page from the terminal and enters a comment in the comment input form.

[1766] Step 2:

[1767] A user submits a comment.

[1768] The user presses the send button and sends the comment to the server.

[1769] Step 3:

[1770] The server receives the comment.

[1771] The server receives the submitted comments.

[1772] Step 4:

[1773] The server stores the comments.

[1774] The server stores the comments in a database.

[1775] Step 5:

[1776] The server displays the comments in real time.

[1777] The server transmits the comments in real time to the terminals of other users who have viewing authority and displays them on the album page.

[1778] Emotion engine integration

[1779] Step 1:

[1780] Analyze user sentiment.

[1781] The server sends the text and comments entered by the user to the emotion engine.

[1782] The emotion engine analyzes the text and identifies the user's emotion.

[1783] Step 2:

[1784] Tailor your album based on emotion.

[1785] The server dynamically adjusts the page layout and display method of the album based on the emotional information obtained by the emotion engine.

[1786] Step 3:

[1787] Dynamically adjust viewing permissions.

[1788] The server dynamically adjusts viewing permissions according to the user's emotions based on the analysis results of the emotion engine.

[1789] Specific examples

[1790] When a user enters a comment on an album, an emotion engine analyzes the user's emotions from the text.

[1791] The server dynamically adjusts the album page layout based on the analysis results.

[1792] Depending on the user's emotions, the server dynamically adjusts the viewing authority and displays only specific content.

[1793] This system allows for rich preservation of memories of the deceased and flexible sharing based on emotions.

[1794] Example 2

[1795] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1796] Conventional systems for storing and sharing memories of the deceased require users to manually organize and manage information, and they have problems with creating flexible albums based on emotions and dynamically adjusting viewing permissions. This has led to issues with efficiently sharing memories and displaying appropriate information based on individual emotions.

[1797] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1798] In this invention, the server includes a means for importing basic information from a resume or through direct input and generating a timeline, a means for importing photos and data from social networking services (SNS) and analyzing the date, time, location, etc., a means for creating an album based on the imported data, setting viewing permissions for sharing, and integrating an emotion engine that analyzes the user's emotions to dynamically adjust the album configuration and display method. This allows for efficient organization and preservation of memories of the deceased, and enables flexible album configuration and dynamic adjustment of viewing permissions based on emotions.

[1799] "Basic information" refers to personal information such as the user's name, date of birth, educational background, and work history.

[1800] A "chronology" is a table generated from basic information that chronologically organizes the events and careers of a user's life.

[1801] "Photo" refers to image data uploaded by a user, including metadata and EXIF ​​information.

[1802] A "social networking service (SNS)" is a web service that allows users to interact with others online and share information.

[1803] "Data" is a general term for information collected by the system, such as background information, photos, and social media posting data uploaded or linked by users.

[1804] "Analysis" refers to the process of extracting and organizing details such as date, time, location, and tag information contained in the data.

[1805] An "album" is a digital record of a user's memories that is generated based on the captured data.

[1806] "Viewing authority" refers to access control that can be set to allow specific users to view the album.

[1807] "Sharing" refers to providing an album via a link or the like so that users with set viewing permissions can access the album.

[1808] A "comment" is a text message that a user enters for an album and shares with other users.

[1809] An "emotion engine" is a computer program or algorithm that analyzes emotions based on user input and behavior and reflects the results.

[1810] "Dynamic adjustment" refers to the process of changing settings and displays in real time based on acquired information and analysis results.

[1811] This invention relates to a system for preserving and sharing memories of the deceased, which is combined with an emotion engine that recognizes the user's emotions. This system includes a means for generating a chronology by importing basic information from a resume or manually entered data, a means for importing data from photos and social networking services (SNS) and analyzing the date, time, location, etc., a means for generating an album based on the acquired data, setting viewing permissions, and sharing the album, a means for leaving comments on the album and sharing it with other users, and an emotion engine that recognizes the user's emotions.

[1812] Obtaining basic information and generating a timeline

[1813] When a user uploads a resume, the device sends the resume file to the server. The server analyzes the received resume file and uses optical character recognition (OCR) to extract basic information such as name, date of birth, educational background, and work history. This basic information is stored in a database, and the server automatically generates a timeline based on it.

[1814] Specific examples

[1815] The user uploads a resume and the device sends it to the server.

[1816] The server extracts the character data using OCR technology.

[1817] The server extracts names, dates of birth, educational background, and work history and stores them in a database, automatically generating a timeline.

[1818] Import and analyze photos and social media data

[1819] When a user uploads a photo or connects to a social media account, the device sends it to the server. The server analyzes the photo's EXIF ​​data to obtain the date and time the photo was taken and the location information. It also uses the social media API to obtain the user's posted data, analyzes it, and extracts the date, time, location, and tag information. This data is also stored in the database.

[1820] Specific examples

[1821] The user uploads photos from their trip and the device sends the photo files to the server.

[1822] The server analyzes the photo's EXIF ​​data to determine the date, time and location of the photo.

[1823] The server retrieves the social media post data, analyzes it, and extracts the necessary information.

[1824] Album Creation

[1825] The server automatically generates album pages based on the acquired basic information, photos, and social media data. The generated albums are organized based on a timeline, photo dates, and locations, and users can edit and add to them from their devices. This allows memories of the deceased to be stored in a centralized location.

[1826] Specific examples

[1827] The server collects the information stored in the database and automatically generates an album page.

[1828] Users can view album pages from their devices and edit and add photos and text.

[1829] The server reflects the edited and added information in the database and updates the album.

[1830] Viewing permission management and sharing

[1831] Users can set viewing permissions for albums for specific family and friends. When a user enters the email addresses of the people to whom they want to grant viewing permissions from their device, the server sets the viewing permissions based on this information and generates a shared link. People who receive the shared link can view the album with specific access permissions.

[1832] Specific examples

[1833] The user enters the email addresses of family and friends and sets viewing permissions.

[1834] The server sets viewing permissions for the specified email address and generates a shared link.

[1835] Family and friends who receive the shared link can access and view the album.

[1836] Comment function

[1837] When a user enters a comment on an album, the comment is sent from the device to the server, which stores the comment in a database and makes the information available to other viewers in real time. This allows family and friends to share and discuss memories on the album.

[1838] Specific examples

[1839] The user enters a comment on a specific page of the album and presses the send button.

[1840] The server receives the comments and stores them in a database.

[1841] Other users with viewing permissions can view the comments in real time from their devices.

[1842] Emotion engine integration

[1843] The emotion engine analyzes user emotions based on user reactions to text input, comments, photos, and social media posts. Based on this, the emotion engine dynamically adjusts the album structure and display method. It is also possible to dynamically adjust individual viewing permissions based on emotions.

[1844] Specific examples

[1845] When a user enters a comment on an album, an emotion engine analyzes the user's emotions from the text.

[1846] The server dynamically adjusts the album page layout based on the analysis results.

[1847] Depending on the user's emotions, the server dynamically adjusts the viewing authority and displays only specific content.

[1848] Prompt Sentence Examples

[1849] Resume upload prompt: "Please upload your resume. The system will automatically extract your name, date of birth, education, and work history information to create a timeline."

[1850] Social media account linking prompt: "Please link your social media accounts. We will analyze your past posts and automatically add them to your memories album."

[1851] Comment prompt: "Please enter your memories or comments about this photo."

[1852] The above is a specific embodiment of the present invention. By using this system, memories of the deceased can be richly preserved and flexibly shared based on emotions.

[1853] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1854] Step 1:

[1855] The user uploads a resume file.

[1856] Input: A resume file (PDF or image format) specified by the user.

[1857] Specific actions: The user opens a file selection dialog through the web interface, selects a resume file, and clicks the "Upload" button.

[1858] Output: The selected resume file will be saved on your device.

[1859] Step 2:

[1860] The terminal sends the uploaded resume file to the server.

[1861] Input: A resume file uploaded by the user.

[1862] Specific operation: The terminal sends the resume file to the server using an HTTP POST request.

[1863] Output: The resume file arrives on the server.

[1864] Step 3:

[1865] The server extracts character data from the received resume file using OCR technology.

[1866] Input: The resume file that arrives on the server.

[1867] Specific operation: The server calls an OCR API (specifically, Google Cloud Vision API, etc.) to extract text data from the file.

[1868] Output: Text data such as name, date of birth, educational background, and work history is extracted.

[1869] Step 4:

[1870] The server extracts basic information, stores it in a database, and automatically generates a timeline.

[1871] Input: Extracted text data such as name, date of birth, educational background, and work history.

[1872] Specific operation: The server maps these data to each field and stores them in the database. It then executes the timeline generation algorithm to automatically generate a timeline.

[1873] Output: Basic information stored in a database and an automatically generated timeline.

[1874] Step 5:

[1875] Users can upload photos or connect their social media accounts.

[1876] Input: Photo file selected by the user or social media account information.

[1877] Specific operation: The user selects and uploads a photo file in the web interface, or clicks the SNS link button and enters authentication information.

[1878] Output: The selected photo files are saved to the device or the social networking credentials are obtained.

[1879] Step 6:

[1880] The device sends the uploaded photo files and social media authentication information to the server.

[1881] Input: A photo file selected by the user or social networking credentials.

[1882] Specific operation: The device sends a photo file to the server using an HTTP POST request, or sends an OAuth token for the SNS to the server.

[1883] Output: Photo file or authentication information arrives at the server.

[1884] Step 7:

[1885] The server analyzes the EXIF ​​data of the photo to obtain the date and time of the photo and location information. It also uses the SNS API to obtain user posted data and extracts the date, time, location, and tag information.

[1886] Input: Photo files and social networking credentials received on the server.

[1887] Specific operation: The server uses an image processing library to parse the EXIF ​​data, sends a request to the SNS API, and retrieves the post data.

[1888] Output: The shooting date and time, location information, and social media posting data are analyzed.

[1889] Step 8:

[1890] The server saves the retrieved data in the database.

[1891] Input: Analyzed photo date and time, location information, and social media posting data.

[1892] Specific operation: The server inserts these data into the corresponding database tables.

[1893] Output: Photo date and time, location information, and social media posting data stored in a database.

[1894] Step 9:

[1895] The server automatically generates an album page based on the stored information.

[1896] Input: Basic information stored in the database, photo date and time, location information, and social media posting data.

[1897] What happens: The server queries the stored data and applies the data to the album template to generate the page.

[1898] Output: Auto-generated album page.

[1899] Step 10:

[1900] Users can view album pages and edit and add photos and text.

[1901] Input: Generated album page and information stored in database.

[1902] Specific operation: A user accesses an album page through a web interface, places the cursor over the part they want to edit, and makes edits or adds.

[1903] Output: Edited and added album page.

[1904] Step 11:

[1905] The server reflects the user's edited and added information in the database and updates the album.

[1906] Input: Information edited or added by the user.

[1907] Specific operation: The server receives the form data and performs processing to update the database fields.

[1908] Output: The updated album page.

[1909] Step 12:

[1910] The user sets the viewing authority of the album for family and friends.

[1911] Input: Email addresses of family and friends specified by the user.

[1912] Specific actions: Enter an email address in the web interface and click the "Share" button.

[1913] Output: The email address information entered.

[1914] Step 13:

[1915] The server sets viewing permissions for the specified email address and generates a shared link.

[1916] Input: The email address provided by the user.

[1917] Specific operation: The server sets viewing permissions based on the email address and generates a unique sharing link.

[1918] Output: The generated sharing link.

[1919] Step 14:

[1920] The server will send the shared link to the specified email address.

[1921] Inputs: The generated sharing link and the email address provided.

[1922] Specific operation: The server uses an email sending service to send an email containing a link.

[1923] Output: The email sent.

[1924] Step 15:

[1925] The user enters a comment on a specific page of the album and presses the send button.

[1926] Input: The text entered in the comment input field.

[1927] Specific action: Enter text into the comment field in the web interface and click the "Submit" button.

[1928] Output: The comment text entered.

[1929] Step 16:

[1930] The server receives the comments and stores them in a database.

[1931] Input: Comment text submitted by user.

[1932] Specific operation: The server receives the comment data and inserts it into the corresponding table in the database.

[1933] Output: The comment stored in the database.

[1934] Step 17:

[1935] The server reflects the comments in real time to other users who have viewing authority.

[1936] Input: Comments stored in the database.

[1937] Specific operation: Comments are instantly displayed on other viewers' screens using WebSocket and real-time communication protocols.

[1938] Output: Comments screen updated in real time.

[1939] Step 18:

[1940] The server sends comments and text to the emotion engine, which analyzes the user's emotions.

[1941] Input: Comments and text entered by the user.

[1942] Specific operation: The server sends comment data to the sentiment analysis API and obtains sentiment tags.

[1943] Output: Sentiment analysis results (sentiment tags).

[1944] Step 19:

[1945] The server dynamically adjusts the album page layout based on the analysis results.

[1946] Input: Sentiment analysis results (sentiment tags).

[1947] Specific operation: Executes a script to dynamically generate a layout template.

[1948] Output: A dynamically adjusted album page.

[1949] Step 20:

[1950] The server dynamically adjusts viewing privileges according to the user's emotions and displays only specific content.

[1951] Input: Sentiment analysis results (sentiment tags).

[1952] Specific operation: Execute and apply a process to update viewing permissions based on emotion tags.

[1953] Output: Dynamically adjusted viewing permissions and displayed content.

[1954] (Application example 2)

[1955] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1956] When preserving and sharing memories of the deceased, it is difficult to provide a personalized experience that is appropriately adjusted based on the user's emotions. Another issue is that simple album generation systems cannot reflect changes in the user's emotions as they share their memories.

[1957] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for importing basic information from a resume or by direct input and generating a timeline; means for importing photos and data from social networking services (SNS) and analyzing the date, time, location, etc.; means for creating an album based on the imported data, setting viewing permissions, and sharing the album; means for leaving comments on the album and sharing it with other users; means for dynamically adjusting the content and display method of the album using an emotion engine that analyzes the user's emotions; and means for dynamically adjusting viewing permissions based on the user's emotions. This allows users to more individually preserve memories of the deceased and share them in a flexible and personalized manner based on emotions.

[1958] A "resume" is a document that lists an individual's educational background, work history, skills, and other basic information.

[1959] "Direct entry" is a method in which the user manually enters basic information in digital form.

[1960] "Basic information" refers to important information for identifying an individual, such as the user's name, date of birth, educational background, and work history.

[1961] A "chronology" is a table of data organized over time based on acquired basic information.

[1962] A "photo" is a still image taken with a camera or other device.

[1963] A "social networking service (SNS)" is an online platform that allows individuals to share information and communicate via the Internet.

[1964] "Data" refers to a collection of information that the system can capture, such as photos or social media posts.

[1965] A "date and time" is a specific date and time when a particular event occurred.

[1966] A "place" is a geographic location to which a particular event or piece of data is associated.

[1967] An "album" is a digital collection of captured photos and data.

[1968] "Viewing permissions" refers to the scope and conditions under which a user has the authority to access albums and data.

[1969] "Sharing" means making certain information or data accessible to other users.

[1970] A "comment" is a text message that a user leaves for a particular piece of content within an album.

[1971] An "emotion engine" refers to a technology that analyzes emotions from user input text and reactions, and uses the results to adjust the system's behavior.

[1972] "Dynamic adjustment" means changing the system's display and functionality in real time based on the results of sentiment analysis.

[1973] This invention relates to a system for preserving and sharing memories of the deceased, which combines an emotion engine that recognizes the user's emotions. This system includes a means for generating a chronology by importing basic information from a resume or manually entered data, a means for importing data from photos and social networking services (SNS) and analyzing the date, time, location, etc., a means for creating an album based on the acquired data, setting viewing permissions, and sharing it, a means for leaving comments on the album and sharing it with other users, and an emotion engine that recognizes the user's emotions.

[1974] Obtaining basic information and generating a timeline

[1975] First, the user uploads their resume. The device sends this resume file to the server, which then analyzes it. Using optical character recognition (OCR), basic information such as name, date of birth, educational background, and work history is extracted, and this basic information is stored in a database. The server then automatically generates a timeline based on this information.

[1976] Import and analyze photos and social media data

[1977] Next, the user uploads a photo or connects to a social media account. The device sends the photo to the server, which analyzes the photo's EXIF ​​data to obtain the date and time the photo was taken and the location. The server also uses the social media API to obtain the user's posted data and analyzes it to extract the date, time, location, and tag information. This data is also stored in the database.

[1978] Album Creation

[1979] The server automatically generates album pages based on the acquired basic information, photos, and social media data. The generated albums are organized based on a timeline, photo dates, and locations, and users can edit and add to them from their devices. This allows memories of the deceased to be stored in a centralized location.

[1980] Viewing permission management and sharing

[1981] Users can set viewing permissions for albums for specific family and friends. When a user enters the email addresses of people to whom they want to grant viewing permissions from their device, the server sets the viewing permissions based on this information and generates a shared link. People who receive the shared link can view the album with specific access permissions.

[1982] Comment function

[1983] When a user enters a comment on an album, the comment is sent from the device to the server, which stores the comment in a database and makes the information available to other viewers in real time. This allows family and friends to share and discuss memories on the album.

[1984] Emotion engine integration

[1985] The emotion engine analyzes user emotions based on user reactions to text input, comments, photos, and social media posts. Based on this, the emotion engine dynamically adjusts the album structure and display method. It is also possible to dynamically adjust individual viewing permissions based on emotions.

[1986] Hardware / Software used

[1987] The system is implemented using the following hardware and software:

[1988] Hardware:

[1989] Server (cloud or on-premise): Hosts the database and application server.

[1990] User terminal: A device such as a PC or smartphone that a user uses to input and view data.

[1991] software:

[1992] Python: A whole-program scripting language.

[1993] Flask: A web application framework.

[1994] pytesseract: A library for OCR (Optical Character Recognition).

[1995] OpenCV: A library for image processing.

[1996] scikit-learn: A library for sentiment analysis.

[1997] Specific examples

[1998] For example, suppose a user wants to create an album of memories of their mother and share them with their grandmother. The user uploads a photo taken on Mother's Day and attaches a comment such as, "I loved my mother because she always had a kind smile." The emotion engine interprets this comment as "positive," highlighting parts of the album and automatically recommending other positive memories.

[1999] Example prompt sentence:

[2000] I want to create an album with photos taken on Mother's Day and thank you messages. I want the app to analyze the positive emotions in the photo uploads and comments and display related memories.

[2001] This allows users to preserve memories of the deceased more individually and share them in a flexible and personalized way based on their emotions.

[2002] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2003] Step 1:

[2004] A user uploads a resume from their device. The resume file is sent from the device to the server. The server receives the file and uses OCR technology to extract the resume's text data. The input is a scanned resume image, and the output is basic information such as name, date of birth, educational background, and work history.

[2005] Step 2:

[2006] The server saves the extracted basic information in a database. At this time, the basic information is indexed to manage the information in a chronological table format. The input is the extracted basic information, and the output is the basic information in a chronological table format stored in the database.

[2007] Step 3:

[2008] A user uploads a photo from their device. The photo file is sent from the device to the server, and the server receives it. The server uses OpenCV to analyze the EXIF ​​data of the photo and obtains the date and time of the photo and location information. The input is the uploaded photo data, and the output is the date and time of the photo and location information.

[2009] Step 4:

[2010] A user links their SNS account, and the server retrieves the user's posted data via the SNS's API. The server analyzes the retrieved data and extracts the posting date and time, location, and tag information. The input is the posting data retrieved from the SNS, and the output is the analyzed date, time, location, and tag information.

[2011] Step 5:

[2012] Album pages are automatically generated based on the basic information acquired by the server, the photo's EXIF ​​data, and the data posted on social media. Album pages are organized based on chronology, shooting date and location, and users can edit and add to them from their devices. The input is all the collected data, and the output is the generated album page.

[2013] Step 6:

[2014] The user sets viewing permissions for specific family and friends from their device. The server then sets the viewing permissions based on this and generates a shared link. The input is the email addresses of the people to whom viewing permissions are to be granted, and the output is the set viewing permissions and the generated shared link.

[2015] Step 7:

[2016] When a user enters a comment on an album, the comment is sent from the device to the server, which saves the comment in a database. The comment information saved by the server is reflected in real time to other viewers. The input is the user's comment, and the output is the comment stored in the database and its real-time reflection.

[2017] Step 8:

[2018] The emotion engine analyzes user text input, comments, and reactions to photos and social media posts. The server dynamically adjusts the album structure and display method based on the analysis results. The input is data for analyzing emotions, and the output is the dynamically adjusted album layout and display.

[2019] Step 9:

[2020] Depending on the user's emotions, the server dynamically adjusts the viewing privileges so that only specific content is displayed. The input is the result of emotion analysis, and the output is the dynamically adjusted viewing privileges.

[2021] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2022] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2023] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2024] [Fourth embodiment]

[2025] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2026] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2028] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2029] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2030] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2032] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2033] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2034] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2036] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2038] This invention relates to a system for centrally storing memories of the deceased and sharing them with family and friends. This system includes the following various means: a means for generating a timeline by importing basic information from a resume or manually entered data, a means for importing data from photos and social networking services (SNS) and analyzing the date, time, location, etc., a means for generating an album based on the imported data, setting viewing permissions, and sharing it, and a means for leaving comments on the album and sharing it with other users.

[2039] Obtaining basic information and generating a timeline

[2040] When a user uploads a resume, the resume file is sent from the device to the server. The server analyzes the received resume file and uses optical character recognition (OCR) to extract basic information such as name, date of birth, educational background, and work history. This basic information is stored in a database, and the server automatically generates a timeline based on this information.

[2041] Specific examples

[2042] The user uploads a resume and the device sends it to the server.

[2043] The server receives the image data of the resume and extracts the text data using OCR technology.

[2044] The server extracts names, dates of birth, educational background, and work history and stores them in a database, automatically generating a timeline.

[2045] Import and analyze photos and social media data

[2046] When a user uploads a photo or connects to a social media account, the device sends it to the server. The server analyzes the photo's EXIF ​​data to obtain the date and time the photo was taken and the location information. It also uses the social media API to obtain the user's posted data, analyzes it, and extracts the date, time, location, and tag information. This data is also stored in the database.

[2047] Specific examples

[2048] The user uploads photos from their trip and the device sends the photo files to the server.

[2049] The server analyzes the photo's EXIF ​​data to determine the date, time and location of the photo.

[2050] When a social media account is linked, the server retrieves the social media post data, analyzes it, and extracts the necessary information.

[2051] Album Creation

[2052] The server automatically generates album pages based on the acquired basic information, photos, and social media data. The generated albums are organized based on a timeline, photo dates, and locations, and users can edit and add to them from their devices. This allows memories of the deceased to be stored in a centralized location.

[2053] Specific examples

[2054] The server collects the information stored in the database and automatically generates an album page.

[2055] Users can view album pages from their devices and edit and add photos and text.

[2056] The server reflects the edited and added information in the database and updates the album.

[2057] Viewing permission management and sharing

[2058] Users can set viewing permissions for albums for specific family and friends. When a user enters the email addresses of people to whom they want to grant viewing permissions from their device, the server sets the viewing permissions based on this information and generates a shared link. People who receive the shared link can view the album with specific access permissions.

[2059] Specific examples

[2060] The user enters the email addresses of family and friends and sets viewing permissions.

[2061] The server sets viewing permissions for the specified email address and generates a shared link.

[2062] Family and friends who receive the shared link can access and view the album.

[2063] Comment function

[2064] When a user enters a comment on an album, the comment is sent from the device to the server, which stores the comment in a database and makes the information available to other viewers in real time. This allows family and friends to share and discuss memories on the album.

[2065] Specific examples

[2066] The user enters a comment on a specific page of the album and presses the send button.

[2067] The server receives the comments and stores them in a database.

[2068] Other users with viewing permissions can view the comments in real time from their devices.

[2069] The above is a specific embodiment of the present invention. By using this system, it is possible to preserve rich memories of the deceased and easily share them with family and friends.

[2070] The processing flow will be explained below.

[2071] Obtaining basic information and generating a timeline

[2072] Step 1:

[2073] A user uploads a resume.

[2074] The user selects a resume file from the terminal and presses the upload button.

[2075] The device receives the file and sends it to the server.

[2076] Step 2:

[2077] The server receives the resume.

[2078] The server receives and stores the uploaded resume file.

[2079] Step 3:

[2080] The server extracts basic information.

[2081] The server uses optical character recognition (OCR) technology to extract information such as name, date of birth, educational background, and work history from the resume.

[2082] Step 4:

[2083] The server stores it in a database.

[2084] The server stores the extracted information in a database.

[2085] Step 5:

[2086] The server generates the timeline.

[2087] The server generates an initial timeline based on the date of birth and adds information such as educational background and work history to the timeline.

[2088] Import and analyze photos and social media data

[2089] Step 1:

[2090] The user uploads a photo.

[2091] The user selects a photo from the device and presses the upload button.

[2092] The device receives the photo file and sends it to the server.

[2093] Step 2:

[2094] The server receives the photo.

[2095] The server receives and stores the uploaded photo files.

[2096] Step 3:

[2097] The server parses the EXIF ​​data of the photo.

[2098] The server reads the EXIF ​​data of the photo and extracts the date and time the photo was taken and the location information.

[2099] Step 4:

[2100] The user links their social media account.

[2101] The user enters the authentication information for their SNS account and presses the link button.

[2102] The device sends the SNS authentication information to the server.

[2103] Step 5:

[2104] The server retrieves the social networking data.

[2105] The server uses the SNS API to obtain the user's posting data (date, time, location, tags, etc.).

[2106] Step 6:

[2107] The server stores it in a database.

[2108] The server stores the acquired social media data and photo information in a database.

[2109] Album Creation

[2110] Step 1:

[2111] The server collects the data.

[2112] The server collects basic information, photos, and social media data from the database.

[2113] Step 2:

[2114] The server generates the album page.

[2115] The server automatically generates an album page based on the collected data.

[2116] Step 3:

[2117] The user checks the album.

[2118] The user browses the created album from the terminal and checks the contents.

[2119] Step 4:

[2120] Users edit and add.

[2121] The user adds to or edits the contents of the album and sends the changes to the server.

[2122] The server saves the changes to the database and updates the album.

[2123] Viewing permission management and sharing

[2124] Step 1:

[2125] The user accesses the View Permissions Settings page.

[2126] The user accesses the viewing permission settings page from the device.

[2127] Step 2:

[2128] The user sets the viewing permissions.

[2129] The user enters the email addresses of family and friends and sets viewing permissions.

[2130] The terminal sends the setting information to the server.

[2131] Step 3:

[2132] The server sets the viewing permissions.

[2133] The server sets the viewing authority for the specified email address.

[2134] Step 4:

[2135] The server generates a sharing link.

[2136] The server will generate a sharing link for the album and send it to the specified email address.

[2137] Comment function

[2138] Step 1:

[2139] The user enters a comment.

[2140] The user opens the album page from the terminal and enters a comment in the comment input form.

[2141] Step 2:

[2142] A user submits a comment.

[2143] The user presses the send button and sends the comment to the server.

[2144] Step 3:

[2145] The server receives the comment.

[2146] The server receives the submitted comments.

[2147] Step 4:

[2148] The server stores the comments.

[2149] The server stores the comments in a database.

[2150] Step 5:

[2151] The server displays the comments in real time.

[2152] The server transmits the comments in real time to the terminals of other users who have viewing authority and displays them on the album page.

[2153] Example 1

[2154] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2155] In modern society, many memories and records are stored as digital data. However, this data is scattered across various devices and platforms, making it difficult to manage it centrally. In particular, to share memories and records of deceased people with family and friends, a system is needed to effectively aggregate, organize, and display this data appropriately. Furthermore, from a privacy perspective, it is necessary to set detailed access permissions for data viewing, and a function is also required for users to share memories and exchange opinions.

[2156] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2157] In this invention, the server includes a means for importing basic information from a resume or through direct input and generating a timeline, a means for extracting basic information from image data using character recognition technology, a means for importing photos and data from social networking services and analyzing the date, time, location, etc., a means for automatically generating an album based on the acquired basic information, photos, and data from social networking services, setting viewing permissions for the album, and sharing it with other users, and a means for entering comments into the album and sharing it with other users. This allows memories of the deceased to be centrally stored and safely and easily shared with family and friends. It also promotes communication between users, allowing them to share and discuss memories of the deceased.

[2158] "Basic information" refers to information such as name, date of birth, educational background, and work history obtained from a resume or by manually entering the information.

[2159] A "chronology" is a table that is created based on the acquired basic information and that chronologically organizes the events and career history of the user's life.

[2160] "Image data" refers to visual data stored in digital format, such as photographs or scanned documents.

[2161] "Character recognition technology" is a technology that uses optical character recognition (OCR) technology to extract character information from image data as digital text.

[2162] "Social networking service" refers to an online platform that enables users to interact with others over the Internet, including blogs, microblogs, and photo sharing.

[2163] "EXIF data" is additional information included in digital photos, including the date and time the photo was taken, location information, camera settings, and so on.

[2164] "Analysis" is the process of examining data in detail to understand its structure, meaning, and patterns.

[2165] An "album" is content that is automatically generated based on acquired basic information, photos, and data from social networking services, and is used to organize and display a user's memories.

[2166] "Viewing authority" is an access control function that allows a specific user to access specific data or content.

[2167] "Entering a comment" refers to the act of a user adding a text message to an album.

[2168] A "database" is a system for efficiently storing and managing digital data, including basic information, photos, social media data, and comments.

[2169] "Server" refers to a computer system that provides functions such as data processing, storage, and network communication.

[2170] This invention relates to a system for centrally storing memories of the deceased and sharing them with family and friends. This system includes a means for generating a timeline by importing basic information from a resume or manually inputting it, a means for importing data from photos and social networking services (SNS) and analyzing the date, time, location, etc., a means for generating an album based on the imported data, setting viewing permissions, and sharing it, and a means for leaving comments on the album and sharing it with other users.

[2171] Obtaining basic information and generating a timeline

[2172] When a user uploads a resume, the resume file is sent from the device to the server. The server analyzes the received resume file and uses character recognition technology (e.g., Google Cloud Vision or Tesseract) to extract basic information such as name, date of birth, educational background, and work history. This basic information is stored in a database, and the server automatically generates a timeline based on it. This timeline will then be used as the basic information for the album that is created.

[2173] Specific examples

[2174] The user uploads a resume and the device sends it to the server.

[2175] The server receives the image data of the resume and extracts the text data using OCR technology.

[2176] The server extracts names, dates of birth, educational background, and work history and stores them in a database, automatically generating a timeline.

[2177] Example prompt:

[2178] "Please upload an image of your resume."

[2179] "Use Google Cloud Vision to extract name, date of birth, education history, and employment history."

[2180] Import and analyze photos and social media data

[2181] When a user uploads a photo or connects to a social media account, the device sends it to the server. The server analyzes the photo's EXIF ​​data to obtain the date and time the photo was taken and the location information. It also uses the social media API (e.g., Facebook Graph API) to obtain the user's posting data and analyzes it to extract date, time, location, and tag information. This data is also stored in the database and used when creating albums.

[2182] Specific examples

[2183] The user uploads photos from their trip and the device sends the photo files to the server.

[2184] The server analyzes the photo's EXIF ​​data to determine the date, time and location of the photo.

[2185] When a social media account is linked, the server retrieves the social media post data, analyzes it, and extracts the necessary information.

[2186] Example prompt:

[2187] "Upload your travel photos."

[2188] "Link your Facebook account to retrieve post data and extract information."

[2189] Album Creation

[2190] The server automatically generates album pages based on the acquired basic information, photos, and social media data. The generated albums are organized based on a timeline, photo dates, and locations, and users can edit and add to them from their devices. This allows memories of the deceased to be stored in a centralized location.

[2191] Specific examples

[2192] The server collects the information stored in the database and automatically generates an album page.

[2193] Users can view album pages from their devices and edit and add photos and text.

[2194] Example prompt:

[2195] "Automatically generate album pages based on the retrieved data."

[2196] "Allow album pages to be edited and added to."

[2197] Viewing permission management and sharing

[2198] Users can set viewing permissions for albums for specific family and friends. When a user enters the email addresses of people to whom they want to grant viewing permissions from their device, the server sets the viewing permissions based on this information and generates a shared link. People who receive the shared link can view the album with specific access permissions.

[2199] Specific examples

[2200] The user enters the email addresses of family and friends and sets viewing permissions.

[2201] The server sets viewing permissions for the specified email address and generates a shared link.

[2202] Family and friends who receive the shared link can access and view the album.

[2203] Example prompt:

[2204] "Enter the email address you want to set album viewing permissions for."

[2205] "Send the shared link to the address provided."

[2206] Comment function

[2207] When a user enters a comment on an album, the comment is sent from the device to the server, which stores the comment in a database and makes the information available to other viewers in real time. This allows family and friends to share and discuss memories on the album.

[2208] Specific examples

[2209] The user enters a comment on a specific page of the album and presses the send button.

[2210] The server receives the comments and stores them in a database.

[2211] Other users with viewing permissions can view the comments in real time from their devices.

[2212] Example prompt:

[2213] "Please enter a comment on the album page."

[2214] "Submitted comments are saved and displayed to other users in real time."

[2215] The above is a specific embodiment of the present invention. By using this system, it is possible to preserve rich memories of the deceased and easily share them with family and friends.

[2216] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2217] Step 1: Get some basic information

[2218] The user uploads a resume and the device sends it to the server.

[2219] Input: Resume file (PDF or image format)

[2220] Specific operation: The user opens the file selection dialog of the web browser, selects the resume file, and clicks the upload button. The terminal sends the selected file to the server via an HTTP request.

[2221] Output: The server receives the resume file.

[2222] Step 2: Resume Analysis

[2223] The server receives the image data of the resume and extracts the text information using OCR technology.

[2224] Input: Resume file (output of Step 1)

[2225] How it works: The server reads the resume file and calls the Google Cloud Vision API or the Tesseract OCR engine to perform character recognition. From the recognized text, information such as name, date of birth, educational background, and work history is extracted.

[2226] Output: Extracted text data of name, date of birth, educational background, and work history

[2227] Step 3: Save basic information and generate a timeline

[2228] The server stores the extracted information in a database and automatically generates a timeline.

[2229] Input: Extracted basic information (output of step 2)

[2230] Specific operation: The server saves the extracted information in a database using an SQL query. Based on the saved data, a timeline is automatically generated by organizing birth dates and educational history information in chronological order.

[2231] Output: Basic information stored in the database and an automatically generated timeline

[2232] Step 4: Upload and analyze photos

[2233] A user uploads a photo, and the device sends the photo file to the server, which analyzes the EXIF ​​data to obtain the date and time the photo was taken and the location.

[2234] Input: Photo file

[2235] Specific operation: The user opens the file selection dialog, selects a photo file, and clicks the upload button. The device sends the selected photo file to the server. The server analyzes the EXIF ​​data of the received photo and extracts the shooting date and location information.

[2236] Output: Extracted photo date and location information

[2237] Step 5: Link your social media accounts and collect data

[2238] The user enters authentication information to link their SNS account to the server. The server uses the SNS API to retrieve and analyze the user's posted data.

[2239] Input: Social media account credentials

[2240] Specific operation: The user clicks the SNS link button and enters their SNS login information in the displayed authentication information input form. The server saves the SNS account information and calls the SNS API (e.g., Facebook Graph API) to retrieve the posted data. The retrieved data is then analyzed to extract date, time, location, and tag information.

[2241] Output: Date, time, location, and tag information of extracted social media posts

[2242] Step 6: Create an album

[2243] The album page is automatically generated based on the basic information, photos, and SNS data obtained by the server.

[2244] Input: Basic information (output from Step 3), photo data (output from Step 4), social media data (output from Step 5)

[2245] Specific operation: The server retrieves basic information, photo data, and SNS data from the database, and embeds the data into the album page template. The album page is automatically generated, allowing users to easily view and edit it.

[2246] Output: Auto-generated album page

[2247] Step 7: Edit and add albums

[2248] Users view album pages from their devices and edit or add photos or text. The server reflects the edited or added information in the database and updates the album.

[2249] Input: User edits and additions

[2250] Specific operation: A user accesses an album page from a web browser, selects the photos and text they want to edit, and then edits, deletes, or adds them. The server receives the user's edits, saves them in the database, and updates the album.

[2251] Output: Updated album page

[2252] Step 8: Set viewing permissions and share

[2253] The user enters the email addresses of family and friends and sets viewing permissions. The server generates a shared link and sends it to the specified email addresses.

[2254] Input: Email address

[2255] Specific operation: The user enters an email address in the viewing permission setting form and clicks the submit button. The server saves the email address in the database and generates a token for setting viewing permissions. A shared link containing the generated token is sent via email.

[2256] Output: Email containing the shared link

[2257] Step 9: Browse your album

[2258] Family and friends who receive the shared link can view the album with specific access permissions.

[2259] Input: Shared Link

[2260] Specific operation: Click the received link, and the web browser will automatically redirect to the album page. The server will verify the token and confirm the viewing privileges before displaying the album page.

[2261] Output: Album page with confirmed viewing permissions

[2262] Step 10: Comment and share

[2263] A user enters a comment on a specific page of an album and presses the submit button. The server saves the comment in a database and makes the information available to other viewers in real time.

[2264] Input: Comment content

[2265] Specific operation: A user enters a comment in the comment input form and clicks the submit button. The server saves the received comment in a database and updates it so that it can be displayed to other viewers in real time.

[2266] Output: Saved comments and real-time updated album page

[2267] (Application example 1)

[2268] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2269] In modern factories, it is extremely important to properly manage robot operation and maintenance histories and quickly share necessary information. However, current systems manage this information in a decentralized manner, making it difficult to centralize the information and check and share it in real time. For this reason, there is a need for a system that can improve the operational efficiency of factory robots and respond quickly.

[2270] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2271] In this invention, the server includes means for importing basic information through historical information or direct input and generating a timeline, means for importing image data or data from social networking services (SNS) and analyzing the date, time, location, etc., means for generating an information collection page based on the imported data and setting viewing permissions for sharing, means for leaving comments on the information collection page and sharing it with other users, means for acquiring, saving, and checking the operation history and maintenance history of the factory robot in real time, and means for uploading and viewing the operation history via an application installed on a smartphone or tablet. This enables centralized management and real-time sharing of the operation history and maintenance history of the factory robot.

[2272] "History information" is a general term for data about the past activities or events of an individual or device.

[2273] "Basic information" refers to the main attribute information about an individual or device, including data such as name, date of birth, educational background, work history, device ID, name, and model.

[2274] A "timeline" is a list of events or occurrences organized by date, and is data presented in chronological order.

[2275] "Image data" is a form of visual data such as photographs or images captured with a digital camera.

[2276] A "social networking service (SNS)" is a platform that allows users to communicate with each other online.

[2277] "Means of analysis" refers to the process of capturing data, analyzing its contents using specific algorithms or techniques, and extracting or evaluating specific information.

[2278] An "information aggregation page" is a web page or digital document that centrally displays and manages information collected from multiple data sources.

[2279] "Viewing authority" refers to a control setting that allows access to or viewing of specific information or content.

[2280] "Leaving a comment" is the act of writing down opinions or thoughts about specific information or content.

[2281] A "factory robot" is an industrial robot designed to perform automated operations or tasks.

[2282] "Operation history" is a record of specific actions and operations performed by a device or robot.

[2283] "Maintenance history" is a detailed record of the maintenance and repairs that machines, equipment, etc. have undergone.

[2284] "Real-time review" refers to the process of obtaining data and information almost instantly and reviewing it in the present.

[2285] A "smartphone" is a highly functional mobile phone that can connect to the Internet and use applications.

[2286] A "tablet" is a portable electronic device with a touchscreen that can connect to the Internet and use applications.

[2287] An "application" is a software program designed to perform a specific task or function.

[2288] The system to realize this application example is a platform that integrates multiple means to centrally manage the operation and maintenance history of factory robots and share information in real time. This system consists of hardware such as servers, smartphones, tablets, and factory robots, as well as software using Flask.

[2289] Program processing

[2290] Obtaining basic information and generating a timeline

[2291] Users input historical information from their smartphones or tablets and send it to the server. The server analyzes the received information, incorporates basic information from the historical information or manually input, and automatically generates a timeline. This creates a basic operational record of the factory robot.

[2292] Importing and analyzing image data and social media data

[2293] When a user links image data or a social media account, the server receives it and analyzes the EXIF ​​information of the image data and the data posted on the social media. The server identifies the date, time, and location information and stores it in a database.

[2294] Creating an information aggregation page

[2295] The server automatically generates an information aggregation page based on the acquired basic information, image data, and social media data. The generated page is organized based on timeline, photo date and time, and location, and users can edit and add to it from their smartphones or tablets. This allows the operation history and maintenance history of factory robots to be stored in a centralized location.

[2296] Viewing permission management and sharing

[2297] Users can set viewing permissions for the information collection page from their smartphones or tablets. The server sets the viewing permissions based on the entered email address and generates a shared link. Engineers and administrators who receive the shared link can view the information collection page with specific access permissions.

[2298] Comment function

[2299] When a user enters a comment on an information collection page, the comment is sent to the server, which stores the comment in a database and makes the information available to other users in real time. This facilitates smooth communication between engineers and administrators.

[2300] Managing the operation and maintenance history of factory robots

[2301] When a factory robot completes a task, it sends its operation history (task date and time, content, results, etc.) to a server via smartphone or tablet. The server then stores the received operation history in a database, making it possible to check it in real time. This makes it possible to obtain and manage the latest information on the operating status and maintenance status of factory robots.

[2302] Specific examples

[2303] A user registers a new factory robot, enters its basic information and sends it to the server.

[2304] After regular maintenance is completed at the factory, operation and maintenance history is uploaded to a server from a smartphone.

[2305] Administrators can check the operation history of specific robots in real time from their smartphones and determine the next maintenance schedule.

[2306] Prompt Sentence Examples

[2307] Add basic information for a new factory robot. Enter the ID, name, and model.

[2308] Upload the history after the operation is completed. Please enter the robot ID, operation date and time, and operation content.

[2309] Get the operation history of a specific robot. Specify the robot ID.

[2310] This will enable centralized management and real-time sharing of factory robot operation and maintenance histories.

[2311] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2312] Step 1: Obtaining basic information and generating a timeline

[2313] The user enters historical information from a smartphone or tablet and sends it to the server. The server analyzes the received historical information and extracts basic information (ID, name, model, etc.). The server stores the extracted information in a database and generates a timeline based on this. The input is the information entered by the user, and the output is the basic information stored in the database and the generated timeline.

[2314] Step 2: Import and analyze image data and social media data

[2315] When a user links image data or a social media account, the device sends this to a server. The server analyzes the EXIF ​​information of the received image data and the data posted on the social media to identify the date, time, and location information. The server stores this information in a database. The input is the image data or social media data, and the output is the analyzed date, time, and location information.

[2316] Step 3: Create an information aggregation page

[2317] The server automatically generates information aggregation pages based on basic information, image data, and social media data. The generated pages are organized based on timeline, photo date and time, and location. Users can edit and add to these pages from their smartphones or tablets. The input is the information stored in the database, and the output is the generated information aggregation page.

[2318] Step 4: Manage viewing permissions and share

[2319] When a user enters the email addresses of people for whom they want to set viewing permissions from their smartphone or tablet, the server sets the viewing permissions based on this information and generates a shared link. The server sets viewing permissions for the specified email addresses and provides the shared link to the user. The input is the email addresses to which viewing permissions are granted, and the output is the set viewing permissions and the shared link.

[2320] Step 5: Commenting

[2321] The user enters a comment on the information collection page and presses the send button. The device sends the comment to the server. The server saves the comment in a database and makes the information available to other users in real time. The input is the user's comment, and the output is the comment saved in the database and an information collection page updated in real time.

[2322] Step 6: Managing the operation and maintenance history of factory robots

[2323] When a factory robot completes a task, it sends its operation history (task date and time, content, results, etc.) to a server via smartphone or tablet. The server stores the received operation history in a database so that managers and engineers can check it in real time. The input is the operation history and maintenance history, and the output is the history information stored in the database and a management screen updated in real time.

[2324] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2325] This invention relates to a system for preserving and sharing memories of the deceased, which is combined with an emotion engine that recognizes the user's emotions. This system includes the following various means: a means for generating a chronology by importing basic information from a resume or manually entered data, a means for importing data from photos and social networking services (SNS) and analyzing the date, time, location, etc., a means for generating an album based on the acquired data, setting viewing permissions, and sharing it, a means for leaving comments on the album and sharing it with other users, and an emotion engine that recognizes the user's emotions.

[2326] Obtaining basic information and generating a timeline

[2327] When a user uploads a resume, the device sends the resume file to the server. The server analyzes the received resume file and uses optical character recognition (OCR) to extract basic information such as name, date of birth, educational background, and work history. This basic information is stored in a database, and the server automatically generates a timeline based on it.

[2328] Specific examples

[2329] The user uploads a resume and the device sends it to the server.

[2330] The server receives the image data of the resume and extracts the text data using OCR technology.

[2331] The server extracts names, dates of birth, educational background, and work history and stores them in a database, automatically generating a timeline.

[2332] Import and analyze photos and social media data

[2333] When a user uploads a photo or connects to a social media account, the device sends it to the server. The server analyzes the photo's EXIF ​​data to obtain the date and time the photo was taken and the location information. It also uses the social media API to obtain the user's posted data, analyzes it, and extracts the date, time, location, and tag information. This data is also stored in the database.

[2334] Specific examples

[2335] The user uploads photos from their trip and the device sends the photo files to the server.

[2336] The server analyzes the photo's EXIF ​​data to determine the date, time and location of the photo.

[2337] When a social media account is linked, the server retrieves the social media post data, analyzes it, and extracts the necessary information.

[2338] Album Creation

[2339] The server automatically generates album pages based on the acquired basic information, photos, and social media data. The generated albums are organized based on a timeline, photo dates, and locations, and users can edit and add to them from their devices. This allows memories of the de...

Claims

1. A means to generate a timeline by taking in basic information from a resume or by manually entering it; A means of importing photos and data from social networking services (SNS) and analyzing the date, time, location, etc. Create an album based on the imported data, set viewing permissions and share it. A way to leave comments on albums and share them with other users, A system including:

2. 2. The system of claim 1, further comprising means for extracting basic information from image data of the resume using character recognition technology.

3. The system according to claim 1, further comprising means for analyzing date and time and location information from EXIF ​​data of a photograph and data posted to a social networking site.

Images