System

Abstract

A system is provided.SOLUTION: A system comprising: means for receiving a request related to a travel destination input by a user and selecting a plurality of travel destination candidates based on the request; means for displaying information of the selected travel destinations to the user; means for acquiring position information of the user at a site and presenting an optimum photographing point based on the position information; and means for analyzing an optimum arrangement and angle for an object to be photographed by the user using a generation AI and presenting an analysis result to the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] With current photography technology, users need advanced photography techniques and knowledge to take photos that "look good" and satisfy them. Finding the best photo spot when traveling is often difficult and time-consuming. Furthermore, when users photograph an object, it can be difficult to find the optimal position and angle, which can result in poor photo quality. A solution to these issues is needed. [Means for solving the problem]

[0005] The present invention solves the above problem by providing a system that includes a means for receiving a user's request regarding a travel destination and selecting a plurality of travel destination candidates based on the request, a means for displaying information about the selected travel destination to the user, a means for acquiring the user's location information on the site and presenting optimal photo spots based on the location information, and a means for analyzing the optimal position and angle for the object the user wishes to photograph using a generation AI and presenting the analysis results to the user.

[0006] "User" refers to an individual who uses this system to take photos and obtain information about travel destinations.

[0007] "Travel destination candidates" refer to multiple travel destination locations recommended by the system based on the user's requests and conditions.

[0008] "Location Information" means information that indicates a user's current geographic location using GPS data or other location-determining technology.

[0009] "Photo spot" refers to a specific location recommended by the system for taking the best photos when the user takes photos on location.

[0010] "Subject" refers to the specific object or scene that a user attempts to capture in a photo using a camera app.

[0011] "Generative AI" refers to algorithms or systems that use artificial intelligence techniques to perform specific tasks, in this case analyzing the optimal photo placement and angle.

[0012] "Analysis results" refers to the results that the generative AI derives from the optimal photo composition and shooting angle based on the user's input information. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0014] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0015] First, the terms used in the following description will be explained.

[0016] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0017] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0018] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0019] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0021] [First embodiment]

[0022] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0023] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0024] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0025] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0026] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0028] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0029] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0030] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0031] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0032] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0033] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0034] This invention relates to a camera application system that allows users to easily take photos that look "good." How each function is implemented will be described below in detail.

[0035] Travel destination suggestions based on travel requests

[0036] 1. Input and submit your request:

[0037] The user launches the camera app and selects the "travel destination suggestion" function.

[0038] The device prompts the user to input a request for a place they would like to go (e.g., beach, mountain, city).

[0039] The terminal transmits the input request to the server as a request.

[0040] 2. Request analysis and candidate selection:

[0041] The server receives the request and analyzes the input request.

[0042] The server accesses the database and selects multiple candidate travel destinations and scenic spots that match the request.

[0043] The server selects the most suitable travel destination from the candidates based on the evaluation criteria.

[0044] 3. Results display:

[0045] The server transmits the selection result to the terminal.

[0046] The device displays detailed information about the travel destination (photos, access methods, reviews, etc.) to the user to assist in creating travel plans.

[0047] Photo spot guidance function after arriving at the location

[0048] 1. Location acquisition and transmission:

[0049] The user arrives at their travel destination and launches the app.

[0050] The device acquires the user's GPS information and sends it to the server.

[0051] 2. Search and select a shooting spot:

[0052] The server receives the GPS information and searches the database for nearby photography points.

[0053] The server selects the most suitable shooting point from the searched points based on the evaluation criteria.

[0054] 3. Directional signs:

[0055] The server sends the selected shooting points and route information to the terminal.

[0056] The device will display directions to the photo spot to the user and provide a link to a map app.

[0057] Optimal placement and shooting angle suggestions for object photography

[0058] 1. Enter and submit information about the subject:

[0059] The user launches the camera app and selects the "mono photography" function.

[0060] The device prompts the user to input the object to be photographed (e.g., coffee cup, food, plant).

[0061] The terminal transmits the photographing target information to the server.

[0062] 2. Shooting arrangement analysis:

[0063] Based on the information received by the server, the generation AI is used to analyze the optimal placement and shooting angle.

[0064] During the analysis process, the server utilizes photographic data and feedback from similar objects stored in a database.

[0065] 3. Guide display:

[0066] The server generates placement guides and shooting angle instructions from the analysis results and sends the results to the terminal.

[0067] The device displays guidelines for placement and angle on the screen to the user to assist in taking photos.

[0068] Specific examples

[0069] Examples of travel destination suggestions:

[0070] 1. The user enters into the app, "I want to go to a place where I can enjoy nature."

[0071] 2. The device sends a request to the server.

[0072] 3. The server searches for places where people can enjoy nature and selects "Highland Park."

[0073] 4. The selection results are sent to the terminal, and detailed information about "Kogen Park" is displayed to the user.

[0074] Examples of photo spot guides:

[0075] 5. The user arrives at "Takahara Park" and obtains their current location.

[0076] 6. The device sends GPS information to the server.

[0077] 7. The server searches for nearby photo spots and selects an "observation deck."

[0078] 8. Directions to the observation deck will be displayed on the device, and a link to a map app will also be provided.

[0079] Examples of Mono photography:

[0080] 9. The user enters, "I want to take beautiful photos of cafe lattes."

[0081] 10. The device sends the information to the server.

[0082] 11. The server uses generated AI to analyze the optimal placement and angle, and recommends placing the camera in the center of the table and taking a photo at a 45-degree angle from the top left.

[0083] 12. A recommended placement guide is displayed on the device, and the user takes the photo following the instructions.

[0084] These processes allow users to easily take "eye-catching" photos and enhance the enjoyment of their trip.

[0085] The processing flow will be explained below.

[0086] Travel destination suggestions based on travel requests

[0087] Step 1:

[0088] The user launches the camera app and selects the "Travel Suggestion" feature. The device prompts the user to enter a destination (e.g., beach, mountain, city) they would like to visit.

[0089] Step 2:

[0090] The terminal transmits the input request to the server as a request.

[0091] Step 3:

[0092] The server receives the request, analyzes the input requirements, and accesses a database to select multiple candidate travel destinations and scenic spots that match the requirements.

[0093] Step 4:

[0094] The server selects the most suitable travel destination from the candidates based on the evaluation criteria.

[0095] Step 5:

[0096] The server transmits the selection result to the terminal.

[0097] Step 6:

[0098] The device displays detailed information about the travel destination (photos, access methods, reviews, etc.) to the user to assist in creating travel plans.

[0099] Photo spot guidance function after arriving at the location

[0100] Step 1:

[0101] When the user arrives at their travel destination and launches the app, the device acquires the user's GPS information.

[0102] Step 2:

[0103] The device sends GPS information to the server.

[0104] Step 3:

[0105] The server receives the GPS information and searches the database for nearby photography points.

[0106] Step 4:

[0107] Based on the search results, the server selects the optimal shooting point according to the evaluation criteria.

[0108] Step 5:

[0109] The server sends the selected shooting points and route information to the terminal.

[0110] Step 6:

[0111] The device will display directions to the photo spot to the user and provide a link to a map app.

[0112] Optimal placement and shooting angle suggestions for object photography

[0113] Step 1:

[0114] The user launches the camera app and selects the "Take a Picture" function. The device prompts the user to input the object to be photographed (e.g., coffee cup, food, plant).

[0115] Step 2:

[0116] The terminal transmits the photographing target information to the server.

[0117] Step 3:

[0118] Based on the information received, the server uses generative AI to analyze the optimal placement and shooting angle. During the analysis process, the server utilizes photography data and feedback from similar objects stored in a database.

[0119] Step 4:

[0120] The server generates placement guides and shooting angle instructions from the analysis results and sends the results to the terminal.

[0121] Step 5:

[0122] The device displays guidelines for placement and angle on the screen to the user to assist in taking photos.

[0123] Example 1

[0124] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0125] With conventional camera applications, users had to spend time selecting the travel destination and photo spot they wanted to take photos at, and it was difficult to find the optimal position and angle when taking the photo. As a result, there was insufficient support for taking "eye-catching" photos easily, and user satisfaction was low. In addition, there was insufficient information gathering and guidance on local photo spots, making it difficult to enjoy taking photos at the destination more efficiently.

[0126] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0127] In this invention, the server includes: means for receiving a user's travel destination request and using a natural language processing engine to analyze the request; means for selecting multiple travel destination candidates from a database based on the analyzed request and selecting the optimal travel destination based on evaluation criteria; means for displaying information about the selected travel destination to the user; means for acquiring the user's location information on the site using a GPS sensor, searching the database for optimal photo spots based on the location information, and selecting the optimal photo spot based on evaluation criteria; and means for having the user input information about the object they wish to photograph, using a generative AI model to analyze the optimal placement and angle based on that information using prompt sentences, and presenting the analysis results to the user. This allows users to efficiently select travel destinations and photo spots and easily take "eye-catching" photos with the optimal placement and angle. Furthermore, by collecting information and providing guidance on local photo spots, users can enjoy taking photos at their destinations even more.

[0128] A "user" is an individual who uses the camera application to receive suggestions for travel destinations, guidance on photography spots, and suggestions for placement and angles for taking photographs of objects.

[0129] "Requests" refers to the travel destination and photography requests entered by the User through the Application.

[0130] A "natural language processing engine" refers to software technology that analyzes requests entered by users and understands and processes their meaning.

[0131] A "database" is a collection of information that stores information on potential travel destinations and photo spots, and is managed in a form that can be accessed by a server.

[0132] "Evaluation criteria" refers to the rules and parameters that serve as the basis for selecting the travel destination or photo spot that best suits the user's needs.

[0133] A "GPS sensor" is a location information acquisition device that identifies the user's current location.

[0134] "Generative AI model" refers to artificial intelligence technology used to suggest optimal placement and shooting angles for the subject a user is trying to photograph.

[0135] A "prompt sentence" refers to an input sentence used to provide context or a question to a generative AI model.

[0136] "Analysis results" refers to the optimal placement and shooting angle suggestions output by the generative AI model based on user input.

[0137] "Travel destination candidates" refers to multiple travel destination candidates selected from a database based on the user's requests.

[0138] "Photo Spot" refers to a location recommended for users to take photos on-site.

[0139] "Route information" refers to the route and access method for a user to reach a specific photo spot.

[0140] "Placement guide" refers to instruction information regarding the placement of objects that a user should refer to when taking a photograph.

[0141] "Angle guide" refers to instruction information regarding the camera angle that a user should refer to when taking a photo.

[0142] This invention relates to a camera application system that allows users to easily take photos that look "good." How each function is implemented will be described below in detail.

[0143] Travel destination suggestions based on travel requests

[0144] The user launches the camera app and selects the "travel destination suggestion" function. The user inputs their desired destination (e.g., beach, mountain, city). The device sends the inputted request in a data format such as JSON to the server as an HTTP POST request. The server analyzes the received request using a natural language processing engine (e.g., ANT NLP) and accesses a travel destination database (e.g., SQL, MongoDB) to search for potential travel destinations that match the user's request. It then selects the most suitable travel destination based on evaluation criteria. The server sends the selected travel destination information to the device, and the device displays detailed information about the destination (e.g., photos, access instructions, reviews, etc.) to the user.

[0145] Specific examples

[0146] The user enters into the app, "I want to go to a place where I can enjoy nature." The device sends the request to the server. The server searches for places where people can enjoy nature and selects "Highland Park." The server sends the selection results to the device, and the device displays detailed information about "Highland Park" to the user.

[0147] Photo spot guidance function after arriving at the location

[0148] The user arrives at their travel destination and launches the camera app. The device acquires the user's current location using the GPS sensor and sends the GPS data to the server. The server identifies the user's current location based on the received GPS data and uses a GPS data analysis tool (e.g., Geopy) to search for nearby photo spots from a database containing information on photo spots. The server scores the searched photo spots based on evaluation criteria and selects the most suitable photo spot. The server sends the selected photo spot and its route information to the device, which displays it on the user interface and provides a link to a map app (e.g., Google Maps).

[0149] Specific examples

[0150] The user arrives at "Kogen Park" and obtains their current location. The device sends GPS information to the server. The server searches for nearby photo spots and selects the "observation deck." The server sends directions to the "observation deck" to the device, which displays them on the user interface and also provides a link to the map app.

[0151] Optimal placement and shooting angle suggestions for object photography

[0152] The user launches the camera app and selects the "Taking a Photo of an Object" function. The user inputs the object to be photographed (e.g., coffee cup, food, plant). The device sends the input information about the object to be photographed in data format such as JSON to the server. The server uses a generative AI model (e.g., OpenAI's GPT-4) based on the received information to analyze the optimal placement and shooting angle using prompt text. During the analysis process, the server utilizes photography data and feedback of similar objects stored in a database. The server generates placement guides and shooting angle instructions from the analysis results and sends them to the device. The device displays these on a user interface, providing the user with specific placement and angle guidelines.

[0153] Specific examples

[0154] The user inputs, "I want to take a beautiful photo of my cafe latte." The device sends this information to the server. The server uses generative AI to analyze the optimal placement and angle, and recommends "Place it in the center of the table and take the photo at a 45-degree angle from the top left." The server sends the recommended placement guide to the device, which displays it on the user interface. The user follows the instructions to take the photo.

[0155] These functions allow users to easily take eye-catching photos, enhancing the enjoyment of their trip.

[0156] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0157] Travel destination suggestions based on travel requests

[0158] Step 1: Enter and submit your request

[0159] A user launches a camera app and selects the travel destination suggestion feature. Next, the user enters a destination preference (e.g., beach, mountain, city). The input data is passed to the device, which converts the input data into JSON format and sends it to the server as an HTTP POST request. Here, the input is the user preference and the output is the request to the server.

[0160] Step 2: Request analysis and candidate selection

[0161] The server analyzes the received request using a natural language processing engine. Based on the analysis results, the server sends an SQL query to a travel destination database to search for candidate locations that match the request. This database search takes the request analysis results as input and generates a list of candidate locations as output. The server then scores the list of candidate locations based on evaluation criteria and selects the best candidate location. This selection process generates a list of candidate locations as input and the best candidate as output.

[0162] Step 3: View the results

[0163] The server sends the selection results in JSON format to the device. This selection result includes detailed information about the best travel destinations (photos, access instructions, reviews, etc.). The device receives this data and displays it in a user interface. The input here is the selection result, and the output is the display on the device screen.

[0164] Photo spot guidance function after arriving at the location

[0165] Step 1: Obtaining and sending location information

[0166] When a user arrives at their travel destination and launches the camera app, the device uses the GPS sensor to obtain the user's current location and sends the GPS data to the server as an HTTP POST request. Here, the input is the GPS data and the output is the request to the server.

[0167] Step 2: Search and select a shooting location

[0168] The server identifies the location information based on the received GPS data. Next, the server accesses a database that stores information on photography points and searches for nearby photography points based on the current location. In this process, a GPS data analysis tool is used, with the GPS data as input and the photography point list as output. The server then scores the photography point list based on evaluation criteria and selects the optimal photography point. The input for this scoring is the photography point list and the output is the optimal photography point.

[0169] Step 3: Guidance

[0170] The server sends the selected photo spot information (latitude and longitude, details, route guidance) to the device. The device receives this information, displays it on the user interface, and provides a link to the map app. The input here is the selection result, and the output is the device screen display and link.

[0171] Optimal placement and shooting angle suggestions for object photography

[0172] Step 1: Enter and submit information about the subject

[0173] The user launches the camera app and selects the "Take a Picture" function. The user inputs the object to be photographed (e.g., coffee cup, food, plant). The input data is passed to the device, which converts it into JSON format and sends it to the server. Here, the input is the object information, and the output is the request to the server.

[0174] Step 2: Shooting arrangement analysis

[0175] The server uses the received information to analyze the placement and shooting angle using a generative AI model. During this process, a prompt is generated and sent to the AI ​​model. The analysis uses user input data and database-based shooting data, with object information and prompts as input and the analysis results as output.

[0176] Step 3: Guide display

[0177] The server sends the analysis results in JSON format to the terminal. The terminal receives this data and displays placement guides and angle guides in the user interface. Here, the input is the analysis results and the output is the terminal screen display.

[0178] These processing steps allow the user to efficiently select travel destinations and photography spots, and take photos that "look great" with the optimal positioning and angle.

[0179] (Application example 1)

[0180] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0181] With conventional camera applications, users often have difficulty finding the best photo spot when traveling or in a store, or determining the optimal position and angle of the subject they want to photograph. Furthermore, there is a lack of efficient guidance, particularly when it comes to guiding users to Instagrammable spots within a store, resulting in poor user convenience. To solve these problems, there was a need for a way for users to easily find the best photo spot and method.

[0182] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0183] In this invention, the server includes means for receiving a user's request regarding a travel destination and selecting multiple travel destination candidates based on the request, means for displaying information about the selected travel destination to the user, means for acquiring the user's location information on the site and presenting optimal photo spots based on the location information, means for analyzing the optimal position and angle for the object the user is trying to photograph using a generation AI and presenting the analysis results to the user, and means for acquiring the user's location information within a store and presenting optimal Instagrammable spots. This enables users to efficiently find optimal photo spots and methods and take high-quality photos.

[0184] The "travel destination candidate selection means" is a function that receives requests regarding travel destinations input by the user and selects multiple travel destination candidates from a database based on those requests.

[0185] The "travel destination information display means" is a function that visually displays detailed information about the selected travel destination to the user.

[0186] "Location information acquisition means" is a function that acquires the user's current location information using location information services such as GPS.

[0187] The "photography point presentation means" is a function that presents the user with the best photography points in the vicinity based on the acquired position information.

[0188] The "generative AI analysis means" is a function that uses generative AI to analyze the optimal position and angle for the subject the user is trying to photograph and presents the results to the user.

[0189] The "Instagrammable spot suggestion method" is a function that suggests the most suitable Instagrammable spots to users based on their location information within the store.

[0190] This invention provides a camera application system that allows users to easily take photos that look "good." The following describes how each function is implemented in detail.

[0191] Travel destination suggestions based on travel requests

[0192] 1. Input and submit your request:

[0193] The user launches the camera app and selects the "Travel Destination Suggestion" function.

[0194] The terminal allows the user to input a request for a place they would like to go (e.g., beach, mountain, city).

[0195] The terminal transmits the input request to the server as a request.

[0196] 2. Request analysis and candidate selection:

[0197] The server receives the request and analyzes the input request.

[0198] The server accesses the database and selects multiple candidate travel destinations and scenic spots that match the request.

[0199] The server selects the most suitable travel destination from the candidates based on the evaluation criteria.

[0200] 3. Results display:

[0201] The server transmits the selection result to the terminal.

[0202] The device displays detailed information about the travel destination (photos, access methods, reviews, etc.) to the user to assist in creating travel plans.

[0203] Photo spot guidance function after arriving at the location

[0204] 1. Location acquisition and transmission:

[0205] The user arrives at their travel destination and launches the app.

[0206] The device acquires the user's GPS information and sends it to the server.

[0207] 2. Search and select a shooting spot:

[0208] The server receives the GPS information and searches the database for nearby photography points.

[0209] The server selects the most suitable shooting point from the searched points based on the evaluation criteria.

[0210] 3. Directional signs:

[0211] The server transmits the selected photographing points and their route information to the terminal.

[0212] The device will display directions to the photo spot to the user and provide a link to a map app.

[0213] Optimal placement and shooting angle suggestions for object photography

[0214] 1. Enter and submit information about the subject:

[0215] The user launches the camera app and selects the "mono photography" function.

[0216] The device prompts the user to input the object to be photographed (e.g., coffee cup, food, plant).

[0217] The terminal transmits the photographing target information to the server.

[0218] 2. Shooting arrangement analysis:

[0219] Based on the information received, the server uses generative AI to analyze the optimal placement and shooting angle.

[0220] During the analysis process, the server utilizes photographic data and feedback from similar objects stored in a database.

[0221] 3. Guide display:

[0222] The server generates placement guides and shooting angle instructions from the analysis results and sends the results to the terminal.

[0223] The device displays guidelines for placement and angle on the screen to assist the user in taking photos.

[0224] Guide to Instagrammable spots within the store

[0225] 1. Location acquisition and transmission:

[0226] The user enters the store and launches the app.

[0227] The terminal acquires the user's current location information and transmits it to the server.

[0228] 2. Search and display Instagrammable spots:

[0229] The server receives the current location information and searches the store database for the best Instagrammable spots.

[0230] The server selects the most suitable spot from the searched spots based on the evaluation criteria.

[0231] 3. Spot guide signs:

[0232] The server sends the selected spot and its route information to the terminal.

[0233] The device will display directions to the spot to the user and provide a link to a map app.

[0234] With these features, users can efficiently find the best photo spots and methods when traveling or in stores, and take high-quality photos.

[0235] Specific examples

[0236] Examples of travel destination suggestions:

[0237] 1. The user enters into the app, "I want to go to a place where I can enjoy nature."

[0238] 2. The device sends a request to the server.

[0239] 3. The server searches for places where people can enjoy nature and selects "Highland Park."

[0240] 4. The selection results are sent to the terminal, and detailed information about "Kogen Park" is displayed to the user.

[0241] Examples of photo spot guides:

[0242] 1. The user arrives at "Takahara Park" and obtains their current location.

[0243] 2. The device sends GPS information to the server.

[0244] 3. The server searches for nearby photo spots and selects an "observation deck."

[0245] 4. Directions to the observation deck will be displayed on the device, and a link to a map app will also be provided.

[0246] Examples of Mono photography:

[0247] 1. The user enters, "I want to take beautiful photos of cafe lattes."

[0248] 2. The device sends the information to the server.

[0249] 3. The server uses generated AI to analyze the optimal placement and angle, and recommends placing the camera in the center of the table and taking a photo at a 45-degree angle from the top left.

[0250] 4. A recommended placement guide is displayed on the device, and the user takes the photo following the instructions.

[0251] Examples of in-store Instagrammable spots:

[0252] 1. The user enters the store and launches the app.

[0253] 2. The device sends location information to the server.

[0254] 3. The server searches for the best Instagrammable spots and selects the "Photogenic Corner."

[0255] 4. Directions to the "Photogenic Corner" will be displayed on the device, and a link to a map app will also be provided.

[0256] Example prompt sentence:

[0257] "Use the camera app to capture a beautiful image of a coffee latte. Optimize the arrangement and angle for the best shot."

[0258] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0259] Step 1:

[0260] The user launches the camera app and selects the "Travel Destination Suggestion" function. The user inputs a request about the place they want to go (e.g., beach, mountain, city). The device sends this request to the server as a request. As input, there is the user's travel destination request, and as output, the request data is sent to the server.

[0261] Step 2:

[0262] The server analyzes the received request data and determines the user's needs. Based on the analysis results, the server accesses the database and selects multiple travel destination candidates that match the needs. The server receives the user's request data as input, searches the travel destination data in the database, and outputs matching candidates.

[0263] Step 3:

[0264] The server selects the most suitable travel destination based on the evaluation criteria and sends the results along with detailed information (photos, access methods, reviews, etc.) to the device. The evaluation criteria and potential travel destinations are required as input, and data containing detailed information about the travel destinations is sent to the device as output.

[0265] Step 4:

[0266] The terminal displays detailed information about travel destinations received from the server to the user. The user creates a travel plan based on the displayed information. The detailed information from the server is input, and the information is presented visually to the user as output.

[0267] Step 5:

[0268] When the user arrives at their travel destination and launches the app again, the device acquires the user's GPS information and sends it to the server. The input is the GPS information acquired by the device, and the output is the location data sent to the server.

[0269] Step 6:

[0270] The server searches the database for nearby photography spots based on the received location information. The optimal photography spot is selected from the search results based on evaluation criteria. The server receives location data and photography spot data for the search as input, and obtains the optimal photography spot data as output.

[0271] Step 7:

[0272] The server sends the selected shooting points and their route information to the terminal. The server's selection data and route information are required as input, and the route information is sent to the terminal as output.

[0273] Step 8:

[0274] The device displays directions to the photo spot to the user and provides a link to a map app. The user follows the directions to move to the optimal photo spot. The input is the guidance information displayed on the device, and the output is the guidance information visualized for the user.

[0275] Step 9:

[0276] The user inputs the object to be photographed (e.g., coffee cup, food, plant) and selects the "Take a Picture" function. The device sends this information to the server. The input is the object data entered by the user, and the output is the data sent to the server.

[0277] Step 10:

[0278] Based on the received information, the server uses a generative AI model to analyze the optimal placement and shooting angle. This analysis utilizes the photography data and feedback of similar objects stored in a database. The received data and the contents of the database are input, and the analysis results are generated as output.

[0279] Step 11:

[0280] The server generates placement guides and shooting angle instructions from the analysis results and sends them to the terminal. The server's analysis results are input, and guide information is sent to the terminal as output.

[0281] Step 12:

[0282] The device displays guidelines for placement and angle on the screen to assist the user in taking photos. The user takes photos according to the guidelines. The input is guide information displayed on the device, and the output is a visual display to the user.

[0283] Step 13:

[0284] When a user enters a store, the app automatically launches to guide them to Instagrammable spots. The device acquires the user's current location information and sends it to the server. The device's location information is input, and data sent to the server is output.

[0285] Step 14:

[0286] The server accesses the store's database of Instagrammable spots and searches for the best spot based on the user's location information. The best spot is selected based on the evaluation criteria. Store data and location information are input, and spot information is generated as output.

[0287] Step 15:

[0288] The server sends the selection result and route information to the terminal. The input is the selection data and route information stored in the server, and the output is data sent to the terminal.

[0289] Step 16:

[0290] The device displays directions to Instagrammable spots and provides a link to a map app. The user follows the directions and takes photos at the best spots. The input is the device's display data, and the output is a visual presentation to the user.

[0291] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0292] This invention relates to a camera application system that allows users to take more satisfying and "eye-catching" photos by combining an emotion engine that recognizes the user's emotions. This system helps users select travel destinations, guides them to photo spots on the spot, and adjusts and suggests the optimal position and angle for product photography based on emotion data.

[0293] Travel destination suggestions based on travel requests

[0294] 1. Request input and emotion information acquisition:

[0295] The user launches the camera app and selects the "travel destination suggestion" function.

[0296] The device prompts the user to input a request for a place they would like to go (e.g., beach, mountain, city).

[0297] The device acquires emotional information using the user's camera and microphone, and the emotion engine analyzes the user's current emotional state.

[0298] 2. Sending requests and emotional data:

[0299] The terminal transmits the input request information and emotion data to the server.

[0300] 3. Candidate selection based on requests and sentiment data:

[0301] The server receives the request and analyzes the desire and emotion data.

[0302] The server accesses the database and selects multiple candidate travel destinations and scenic spots that match the request.

[0303] The emotion engine uses emotional data to select candidate locations that best suit the user's emotional state.

[0304] 4. Results display:

[0305] The server transmits the selection result to the terminal.

[0306] The device displays detailed information about the travel destination (photos, access methods, reviews, etc.) to the user to assist in creating travel plans.

[0307] Photo spot guidance function after arriving at the location

[0308] 1. Location and emotion information acquisition:

[0309] The user arrives at their travel destination and launches the app.

[0310] The device acquires the user's GPS information and emotional information and sends it to the server.

[0311] 2. Shooting spot selection based on location and emotion data:

[0312] The server receives the GPS information and emotion data and searches the database for nearby photo spots.

[0313] Based on the search results, the server selects the shooting point that best suits the user's emotional state.

[0314] 3. Directional signs:

[0315] The server sends the selected shooting points and route information to the terminal.

[0316] The device will display directions to the photo spot to the user and provide a link to a map app.

[0317] Optimal placement and shooting angle suggestions for object photography

[0318] 1. Acquiring subject information and emotion information:

[0319] The user launches the camera app and selects the "mono photography" function.

[0320] The device prompts the user to input the object to be photographed (e.g., coffee cup, food, plant).

[0321] The terminal acquires the user's emotion information using an emotion engine.

[0322] 2. Shooting arrangement analysis based on emotion data:

[0323] The terminal transmits the photographing subject information and emotion data to the server.

[0324] Based on the information received by the server, the generation AI is used to analyze the optimal placement and shooting angle.

[0325] During the analysis process, the server takes emotional data into consideration to determine the optimal composition for the photo.

[0326] 3. Guide display:

[0327] The server generates placement guides and shooting angle instructions from the analysis results and sends the results to the terminal.

[0328] The device displays guidelines for placement and angle on the screen to the user to assist in taking photos.

[0329] Specific examples

[0330] Examples of travel destination suggestions:

[0331] 1. The user enters into the app, "I want to go to a place where I can enjoy nature," and at the same time, the emotion engine analyzes the emotion as "I want to relax."

[0332] 2. The device sends requests and emotional information to the server.

[0333] 3. The server searches for places where people can enjoy nature and selects "Highland Park," which has a high relaxing effect.

[0334] 4. The selection results are sent to the terminal, and detailed information about "Kogen Park" is displayed to the user.

[0335] Examples of photo spot guides:

[0336] 5. The user arrives at "Kogen Park" and their current location and emotion information is acquired.

[0337] 6. The device sends GPS information and emotion data to the server.

[0338] 7. The server searches for nearby photo spots and selects the "observation deck." Based on the emotional data, it determines that the view from the observation deck will have a relaxing effect.

[0339] 8. Directions to the observation deck will be displayed on the device, and a link to a map app will also be provided.

[0340] Examples of Mono photography:

[0341] 9. The user enters, "I want to take a beautiful photo of my cafe latte," and the emotion engine analyzes it to determine the emotion of "happiness."

[0342] 10. The device sends the information to the server.

[0343] 11. The server uses AI to analyze the optimal placement and angle, recommending placing the photo in the center of the table and taking a photo at a 45-degree angle from the top left. Based on emotional data, the server also considers lighting to create a happy mood.

[0344] 12. A recommended placement guide is displayed on the device, and the user takes the photo following the instructions.

[0345] This allows users to easily take high-quality photos that reflect their own emotions, doubling the enjoyment of their travels and everyday life.

[0346] The processing flow will be explained below.

[0347] Travel destination suggestions based on travel requests

[0348] Step 1:

[0349] The user launches the camera app and selects the "Travel Suggestion" feature. The device prompts the user to enter a destination (e.g., beach, mountain, city) they would like to visit.

[0350] Step 2:

[0351] The device acquires emotional information using the user's camera and microphone, and the emotion engine analyzes the user's current emotional state.

[0352] Step 3:

[0353] The terminal transmits the input request information and emotion data to the server as a request.

[0354] Step 4:

[0355] The server receives the request, analyzes the input desires and emotion data, and accesses the database to select multiple candidate travel destinations and scenic spots that match the desires.

[0356] Step 5:

[0357] The emotion engine uses emotional data to select potential travel destinations that best suit the user's emotional state based on evaluation criteria.

[0358] Step 6:

[0359] The server transmits the selection result to the terminal.

[0360] Step 7:

[0361] The device displays detailed information about the destination (photos, access methods, reviews, etc.) along with emotion-based recommendations, allowing users to select a destination that best suits their emotions.

[0362] Photo spot guidance function after arriving at the location

[0363] Step 1:

[0364] When the user arrives at their travel destination and launches the app, the device acquires the user's GPS information.

[0365] Step 2:

[0366] The device acquires emotional information, and the emotion engine analyzes the user's current emotional state in real time.

[0367] Step 3:

[0368] The device sends GPS information and emotion data to the server.

[0369] Step 4:

[0370] The server receives the GPS information and emotion data and searches the database for nearby photo spots.

[0371] Step 5:

[0372] The server selects the photo spot that best suits the user's emotional state based on the evaluation criteria, based on the search results for nearby photo spots.

[0373] Step 6:

[0374] The server sends the selected shooting points and route information to the terminal.

[0375] Step 7:

[0376] The device displays directions to the photo spot and also provides a link to a map app, allowing users to take photos that are highly satisfying by being guided to the optimal photo spot that matches their emotions.

[0377] Optimal placement and shooting angle suggestions for object photography

[0378] Step 1:

[0379] The user launches the camera app and selects the "Take a Picture" function. The device prompts the user to enter information about the object to be photographed (e.g., coffee cup, food, plant).

[0380] Step 2:

[0381] The terminal uses an emotion engine to acquire the user's emotion information and analyze the current emotional state.

[0382] Step 3:

[0383] The device transmits information about the subject being photographed and emotion data to the server.

[0384] Step 4:

[0385] Based on the subject information and emotion data received by the server, the generative AI analyzes the optimal placement and shooting angle. During the analysis process, the server also takes the emotion data into consideration to determine the optimal shooting composition.

[0386] Step 5:

[0387] The server sends the placement guide and shooting angle instructions generated from the analysis results to the terminal.

[0388] Step 6:

[0389] The device will provide users with on-screen placement and angle guidelines, as well as emotion-based photography advice and tips, making it easier for users to take photos that best suit their emotional state.

[0390] Specific examples

[0391] Examples of travel destination suggestions:

[0392] 1. The user enters into the app, "I want to go somewhere where I can enjoy nature," and the device uses computer vision to analyze the emotion as "I want to relax."

[0393] 2. The device sends this information to the server.

[0394] 3. The server searches for places where you can enjoy nature and selects a "highland park" that has a high relaxing effect.

[0395] 4. The selection results and the reasons why the park has such a relaxing effect are sent to the device, and detailed information about "Kogen Park" is displayed to the user.

[0396] Examples of photo spot guides:

[0397] 5. The user arrives at "Kogen Park" and obtains their current location and real-time emotion information.

[0398] 6. The device sends GPS information and emotion data to the server.

[0399] 7. The server searches for nearby photo spots and selects "Observation Deck." It determines that the view from the observation deck will enhance relaxation.

[0400] 8. Directions to the observation deck will be displayed on the device, and a link to a map app will also be provided.

[0401] Examples of Mono photography:

[0402] 9. The user enters, "I want to take a beautiful photo of my cafe latte," and the device analyzes the emotion of "happiness" using facial expression recognition.

[0403] 10. The device sends the information to the server.

[0404] 11. The server uses AI to analyze the optimal placement and angle, recommending placing the photo in the center of the table and taking a photo at a 45-degree angle from the top left. It also takes into consideration how the light is applied to create a happy mood.

[0405] 12. Along with a placement guide, advice on how to emphasize a happy atmosphere is displayed on the device, and the user follows the instructions to take the photo.

[0406] These processes enable users to easily take high-quality photos that reflect their own emotions, enhancing the enjoyment of travel and everyday life.

[0407] Example 2

[0408] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0409] Conventional camera applications offer travel destination suggestions and photo spot guidance based on user requests, but because they do not take the user's emotional state into account, they are unable to provide suggestions and guidance that are in line with the user's feelings, and as a result, they are unable to sufficiently increase satisfaction. Furthermore, suggestions for camera placement and angles when taking photos are limited to general ones, and they are unable to provide optimal suggestions that reflect the emotions of each individual user. For this reason, there was a need for a service that is easy for users to use and in line with their emotions.

[0410] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0411] In this invention, the server includes means for receiving a user's travel destination request and selecting multiple travel destination candidates based on the request and the user's emotional information, means for displaying detailed information about the selected travel destination to the user, means for acquiring the user's location information and emotional information on the location and suggesting optimal photo spots based on that information, and means for analyzing the optimal position and angle for the object the user is trying to photograph using a generative AI model and presenting the analysis results to the user. This makes it possible to suggest travel destinations and photo spots that take the user's emotional state into consideration, and to provide guidance on photo positions and angles tailored to each individual user.

[0412] "User" means any individual or entity that uses the System.

[0413] "Travel destination requests" are information including places the user wants to visit and desired conditions.

[0414] "Emotional information" is data that indicates the user's current emotional state.

[0415] "Travel destination candidates" are multiple travel destinations suggested based on the user's travel destination requests and emotional information.

[0416] "Detailed information" refers to information such as photos, access methods, and reviews about potential travel destinations.

[0417] "Location information" is data that indicates the user's current location.

[0418] "Photo spots" are ideal locations for users to take photos while traveling.

[0419] A "subject" is an object or scene that the user wishes to photograph.

[0420] "Layout" refers to the position and order of the objects to be photographed.

[0421] "Angle" is a setting that indicates the direction and tilt of the camera when taking a photo.

[0422] A "generative AI model" is an algorithm that uses artificial intelligence technology to analyze data and generate optimal results.

[0423] The "analysis results" are suggestions for optimal placement and angles provided by the generative AI model.

[0424] This invention relates to a camera application system that allows users to take more satisfying photos by combining it with an emotion engine that recognizes the user's emotions. This system helps users select travel destinations, guides them to photography spots on the spot, and adjusts and suggests the optimal position and angle for product photography based on emotion data.

[0425] Travel destination suggestions based on travel requests

[0426] When a user launches the camera app and selects the "travel destination suggestion" function, the device prompts the user to input their desired destination (e.g., beach, mountain, city). The device then uses the user's camera and microphone to obtain emotional information, and the emotion engine analyzes the user's current emotional state. The analysis results and the desired information are sent to a server, which then accesses a database to select candidate destinations and scenic spots that match the user's desired destination. The emotion engine then uses the emotional data to select candidate destinations that best suit the user's emotional state, and sends the selection results to the device. The device then displays detailed information about the destination (photos, access methods, reviews, etc.) to the user, assisting them in creating their travel plans.

[0427] Specific examples

[0428] When a user inputs into the app that they would like to go to a place where they can enjoy nature and smile into the camera, the device sends their request and emotional information to the server. The server analyzes the information, selects a "highland park" with a high relaxation effect, and displays detailed information about it on the device.

[0429] Photo spot guidance function after arriving at the location

[0430] When a user arrives at their travel destination and launches the app, the device acquires the user's GPS information and emotional information and sends them to the server. The server receives the GPS information and emotional data and searches a database for nearby photo spots. It then selects the optimal photo spot based on the user's emotional state and sends the results to the device. The device then displays directions to the photo spot and provides a link to the map app.

[0431] Specific examples

[0432] When a user arrives at "Kogen Park" and starts the app with a smile, the device sends GPS information and emotional data to the server. The server searches for nearby photo spots, selects an "observation deck" with a relaxing effect in mind, and displays the information on the device.

[0433] Optimal placement and shooting angle suggestions for object photography

[0434] When a user launches the camera app and selects the "Taking a Photo of an Object" function, the device prompts them to input the object to be photographed (e.g., coffee cup, food, plant) and uses an emotion engine to obtain the user's emotional information. The device then sends the information about the object and the emotional data to the server, which then uses a generative AI model to analyze the optimal placement and shooting angle. The analysis results are sent to the device as the optimal composition based on the emotional data, and the device then presents guidelines for placement and angle to the user.

[0435] Specific examples

[0436] When a user inputs "I want to take a beautiful photo of my cafe latte," and the emotion engine analyzes the emotion as "happiness," the device sends the information to the server. The server uses a generative AI model to analyze the optimal placement and angle, recommending "place it in the center of the table and take the photo at a 45-degree angle from the top left." A placement guide is displayed to the user, who then follows the instructions to take the photo.

[0437] This allows users to easily take high-quality photos that reflect their own emotions, increasing the enjoyment of their travels and everyday life.

[0438] Prompt Sentence Examples

[0439] 1. "I want to go to a place where I can enjoy nature."

[0440] 2. "I want to take beautiful photos of cafe lattes."

[0441] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0442] Travel destination suggestions based on travel requests

[0443] Step 1:

[0444] User: Launches the camera app and selects the "Travel Destination Suggestion" function. Enters a request such as "I want to go to the beach."

[0445] Step 2:

[0446] Device: Obtains user input and emotional information in real time using a camera and microphone. The emotion engine analyzes the user's current emotional state and gives a result such as "I want to have fun."

[0447] Step 3:

[0448] Terminal: Sends the request information and the emotion data as the analysis result to the server. The request information and emotion data are included as input.

[0449] Step 4:

[0450] Server: Receives the request information and emotion data, accesses the database, and searches for travel destinations and scenic spots that match the request. In this case, multiple beach-related travel destinations are selected as candidates.

[0451] Step 5:

[0452] Server: Based on the emotional data, the server selects the candidate location that best suits the user's emotional state. Specifically, the server selects a beach in Hawaii, taking into account the emotion of "wanting to have fun."

[0453] Step 6:

[0454] Server: Sends the selection results to the device. The output includes detailed travel destination information (e.g., photos of Hawaiian beaches, how to get there, reviews, etc.).

[0455] Step 7:

[0456] Terminal: Displays the travel destination information received from the server to the user.

[0457] Photo spot guidance function after arriving at the location

[0458] Step 1:

[0459] User: Arrives at travel destination and launches the app.

[0460] Step 2:

[0461] Device: Obtains the user's GPS information and emotional information. Determines "relaxed" as the emotional data.

[0462] Step 3:

[0463] Terminal: Sends GPS information and emotion data to the server. Location information and emotion data are included as input.

[0464] Step 4:

[0465] Server: Receives GPS information and emotion data, searches for nearby photo spots from a database, and extracts the best photo spots related to the location based on the input.

[0466] Step 5:

[0467] Server: Considering the emotional data, select the optimal shooting point for the user's state. Select the "observation deck" considering its relaxing effect.

[0468] Step 6:

[0469] Server: Sends the selected photo points and their route information to the terminal. The output includes route information and photo point details.

[0470] Step 7:

[0471] On the device: Displays GPS and route information to the user and provides a link to a map app.

[0472] Optimal placement and shooting angle suggestions for object photography

[0473] Step 1:

[0474] User: Launch the camera app, select the "Object Shooting" function, and enter "Cafe Latte" as the subject to be photographed.

[0475] Step 2:

[0476] Device: Acquires information about the subject being photographed and uses the emotion engine to acquire the user's emotional information. Identifies "happiness" as the emotional data.

[0477] Step 3:

[0478] Terminal: Sends the photographed object information and emotion data to the server. The input includes the object information and emotion data.

[0479] Step 4:

[0480] Server: Receives information about the subject and emotion data, and uses a generative AI model to analyze the optimal placement and shooting angle. Specifically, it recommends placing the subject in the center of the table and taking a photo at a 45-degree angle from the top left.

[0481] Step 5:

[0482] Server: Generates placement guides and shooting angle instructions and sends the results to the device. The output includes specific placement methods and angle instructions.

[0483] Step 6:

[0484] Terminal: The placement guide from the server is displayed to the user, and the user takes the photo according to the instructions.

[0485] By clarifying the inputs and outputs at each step, the operation of the entire system can be understood concretely and comprehensively.

[0486] (Application example 2)

[0487] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0488] Today's consumers are seeking a higher level of satisfaction from their shopping experiences. In particular, in brick-and-mortar stores, they are seeking product suggestions tailored to their emotions and desires, as well as optimal photography environments. However, current shopping support systems lack the functionality to suggest products that take the user's emotional state into account, making them inefficient. Furthermore, they lack sufficient advice on optimal product placement and photography techniques, making it necessary to improve the system to increase consumer satisfaction. To solve this problem, it is important to utilize users' emotional data and location information to provide a more personalized shopping experience.

[0489] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for receiving a travel destination request input by a user and selecting multiple travel destination candidates based on the request; means for displaying information about the selected travel destination to the user; means for acquiring the user's location information on the site and suggesting optimal photography points based on the location information; means for analyzing the optimal placement and angle of an object the user intends to photograph using a generation AI and presenting the analysis results to the user; and means for analyzing the user's emotional state, proposing optimal products based on the emotional data, and suggesting where to place the products and how to photograph them. This allows the user to receive personalized product suggestions based on their emotional state and also provides an optimal photography environment, thereby improving satisfaction with the overall shopping experience.

[0490] 1. "Travel destination candidates" are multiple travel destination options selected by the system based on the requests entered by the user.

[0491] 2. "Location Information" means data about a User's current location when in that location, obtained through GPS or other location measurement technologies.

[0492] 3. "Photo spots" are suitable locations for users to take photos, and are presented by the system based on location information and emotion data.

[0493] 4. "Subject" refers to the object, scenery, or other subject that the user wishes to photograph.

[0494] 5. "Arrangement" refers to the position or arrangement of objects to best present them.

[0495] 6. "Angle" tells the camera which direction to take the picture from when shooting.

[0496] 7. "Generative AI" refers to artificial intelligence that analyzes and suggests optimal travel destinations, photo spots, and the placement and angle of objects based on a user's emotional data and location information.

[0497] 8. “Emotional State” means data that indicates the user’s current psychological and emotional state, and is obtained through sensors such as cameras and microphones.

[0498] 9. "Products" refers to the items offered to Users for purchase in the physical store.

[0499] 10. "Route information" refers to directions and guidance information for users to reach the optimal photo spot.

[0500] The present invention provides a system that allows users to have an optimal shopping experience in a physical store by combining an emotion engine that recognizes user emotions. Specific embodiments will be described below.

[0501] System configuration

[0502] 1. Hardware and Software Configuration

[0503] Server: It has a database and generative AI model, analyzes emotional data and location information, and makes optimal suggestions. The server works in conjunction with the emotional data analysis engine.

[0504] Device: The user's smartphone or tablet is used to acquire emotion data, acquire location information, and display suggestions. Smartphones are equipped with a camera, GPS, and microphone.

[0505] Emotion engine: Analyzes the emotional data sent by the user to the device and determines the user's current emotional state.

[0506] Program processing overview

[0507] 1. Obtaining user emotion data

[0508] When a user launches the shopping support app in a physical store, the app uses the device's camera and microphone to collect the user's emotional data.

[0509] An emotion engine analyzes this data to determine the user's current emotional state.

[0510] 2. Obtaining location information

[0511] When a user is in a physical store, their current location is obtained using the device's GPS or beacon.

[0512] This allows the system to determine which area of ​​the store the user is in.

[0513] 3. Proposal Processing

[0514] Emotion data and location information are sent to the server.

[0515] The server's generative AI model analyzes this information and calculates product suggestions, product placement locations, and photography methods that are best suited to the user's emotional state.

[0516] An example of a generated prompt: "The user's emotional data indicates that they are feeling stressed. The user's location is the food court on the first floor of a shopping center. Suggest products that are ideal for reducing stress."

[0517] 4. Display of proposal results

[0518] The server sends the proposal to the terminal.

[0519] The device displays the received suggestions to the user and also provides guidance on the best angle and placement for photographing the product.

[0520] Specific examples

[0521] For example, if a user is in a shopping center and the emotion engine detects that they are feeling stressed, the system will acquire the user's location information and suggest relaxation products and locations (e.g., massage chairs or aroma oil corners) that are effective in reducing stress. These suggestions will be displayed on the device, and the user will be guided to the product and the best way to take a photo (e.g., "take a photo from a 45-degree angle starting from the top left").

[0522] By using a generative AI model, it is possible to make detailed suggestions based on the user's individual emotional state, which is expected to improve the shopping experience.

[0523] As described above, the system of the present invention can utilize emotional data and location information to provide users with personalized shopping suggestions, allowing them to have a comfortable and satisfying shopping experience that is tailored to their emotions.

[0524] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0525] Step 1:

[0526] A user launches a shopping support app in a physical store. The device starts collecting emotion data through the app. As input, the smartphone's camera and microphone are used to capture the user's facial expressions and tone of voice, and the data is sent to the emotion engine. The emotion engine analyzes this input data and outputs the user's current emotional state (e.g., stress, joy, excitement, etc.).

[0527] Step 2:

[0528] The device also obtains the user's current location information. As input, it collects location data from the smartphone's GPS and beacons. This location data is used to determine which area the user is in and provides current location information as output.

[0529] Step 3:

[0530] The device sends the acquired emotional data and location information to the server. The server receives this data and prepares to generate suggestions based on the emotional data and location information. The emotional data and location data are passed to the server as input. The server processes and analyzes this data using a generative AI model.

[0531] Step 4:

[0532] The server then proposes optimal products based on the emotional data. Specifically, the server's generative AI model analyzes the emotional data and selects the products (e.g., massage equipment or relaxation items to relieve stress) that best suit the user's current emotional state. The input is the emotional data, and the output is a list of suggested products.

[0533] Step 5:

[0534] The server then suggests where to place these products and how to photograph them based on the location information. Specifically, the generative AI model uses the location data to suggest the best place to place products around the user's current location and how to photograph them beautifully. The input is location information, and the output is where to place the products and the best way to photograph them. An example of a generated prompt: "We obtained emotional data that the user is 'feeling stressed.' The location information is the food court on the first floor of a shopping center. We suggest products that are ideal for reducing stress."

[0535] Step 6:

[0536] The server sends the recommendation results to the device. The device displays the received recommendation to the user. Specifically, the device visually presents the product list, placement locations, and optimal photography methods to the user. The system receives the recommendation results from the server as input and displays this information on the user's smartphone screen as output. The user can then find the recommended products and photograph them in the instructed way.

[0537] The detailed description of each processing step allows the system of the present invention to provide an optimal shopping experience, taking into account the user's emotional state and current location.

[0538] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0539] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0540] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0541] [Second embodiment]

[0542] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0543] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0544] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0545] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0546] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0547] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0548] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0549] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0550] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0551] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0552] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0553] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0554] This invention relates to a camera application system that allows users to easily take photos that look "good." How each function is implemented will be described below in detail.

[0555] Travel destination suggestions based on travel requests

[0556] 1. Input and submit your request:

[0557] The user launches the camera app and selects the "travel destination suggestion" function.

[0558] The device prompts the user to input a request for a place they would like to go (e.g., beach, mountain, city).

[0559] The terminal transmits the input request to the server as a request.

[0560] 2. Request analysis and candidate selection:

[0561] The server receives the request and analyzes the input request.

[0562] The server accesses the database and selects multiple candidate travel destinations and scenic spots that match the request.

[0563] The server selects the most suitable travel destination from the candidates based on the evaluation criteria.

[0564] 3. Results display:

[0565] The server transmits the selection result to the terminal.

[0566] The device displays detailed information about the travel destination (photos, access methods, reviews, etc.) to the user to assist in creating travel plans.

[0567] Photo spot guidance function after arriving at the location

[0568] 1. Location acquisition and transmission:

[0569] The user arrives at their travel destination and launches the app.

[0570] The device acquires the user's GPS information and sends it to the server.

[0571] 2. Search and select a shooting spot:

[0572] The server receives the GPS information and searches the database for nearby photography points.

[0573] The server selects the most suitable shooting point from the searched points based on the evaluation criteria.

[0574] 3. Directional signs:

[0575] The server sends the selected shooting points and route information to the terminal.

[0576] The device will display directions to the photo spot to the user and provide a link to a map app.

[0577] Optimal placement and shooting angle suggestions for object photography

[0578] 1. Enter and submit information about the subject:

[0579] The user launches the camera app and selects the "mono photography" function.

[0580] The device prompts the user to input the object to be photographed (e.g., coffee cup, food, plant).

[0581] The terminal transmits the photographing target information to the server.

[0582] 2. Shooting arrangement analysis:

[0583] Based on the information received by the server, the generation AI is used to analyze the optimal placement and shooting angle.

[0584] During the analysis process, the server utilizes photographic data and feedback from similar objects stored in a database.

[0585] 3. Guide display:

[0586] The server generates placement guides and shooting angle instructions from the analysis results and sends the results to the terminal.

[0587] The device displays guidelines for placement and angle on the screen to the user to assist in taking photos.

[0588] Specific examples

[0589] Examples of travel destination suggestions:

[0590] 1. The user enters into the app, "I want to go to a place where I can enjoy nature."

[0591] 2. The device sends a request to the server.

[0592] 3. The server searches for places where people can enjoy nature and selects "Highland Park."

[0593] 4. The selection results are sent to the terminal, and detailed information about "Kogen Park" is displayed to the user.

[0594] Examples of photo spot guides:

[0595] 5. The user arrives at "Takahara Park" and obtains their current location.

[0596] 6. The device sends GPS information to the server.

[0597] 7. The server searches for nearby photo spots and selects an "observation deck."

[0598] 8. Directions to the observation deck will be displayed on the device, and a link to a map app will also be provided.

[0599] Examples of Mono photography:

[0600] 9. The user enters, "I want to take beautiful photos of cafe lattes."

[0601] 10. The device sends the information to the server.

[0602] 11. The server uses generated AI to analyze the optimal placement and angle, and recommends placing the camera in the center of the table and taking a photo at a 45-degree angle from the top left.

[0603] 12. A recommended placement guide is displayed on the device, and the user takes the photo following the instructions.

[0604] These processes allow users to easily take "eye-catching" photos and enhance the enjoyment of their trip.

[0605] The processing flow will be explained below.

[0606] Travel destination suggestions based on travel requests

[0607] Step 1:

[0608] The user launches the camera app and selects the "Travel Suggestion" feature. The device prompts the user to enter a destination (e.g., beach, mountain, city) they would like to visit.

[0609] Step 2:

[0610] The terminal transmits the input request to the server as a request.

[0611] Step 3:

[0612] The server receives the request, analyzes the input requirements, and accesses a database to select multiple candidate travel destinations and scenic spots that match the requirements.

[0613] Step 4:

[0614] The server selects the most suitable travel destination from the candidates based on the evaluation criteria.

[0615] Step 5:

[0616] The server transmits the selection result to the terminal.

[0617] Step 6:

[0618] The device displays detailed information about the travel destination (photos, access methods, reviews, etc.) to the user to assist in creating travel plans.

[0619] Photo spot guidance function after arriving at the location

[0620] Step 1:

[0621] When the user arrives at their travel destination and launches the app, the device acquires the user's GPS information.

[0622] Step 2:

[0623] The device sends GPS information to the server.

[0624] Step 3:

[0625] The server receives the GPS information and searches the database for nearby photography points.

[0626] Step 4:

[0627] Based on the search results, the server selects the optimal shooting point according to the evaluation criteria.

[0628] Step 5:

[0629] The server sends the selected shooting points and route information to the terminal.

[0630] Step 6:

[0631] The device will display directions to the photo spot to the user and provide a link to a map app.

[0632] Optimal placement and shooting angle suggestions for object photography

[0633] Step 1:

[0634] The user launches the camera app and selects the "Take a Picture" function. The device prompts the user to input the object to be photographed (e.g., coffee cup, food, plant).

[0635] Step 2:

[0636] The terminal transmits the photographing target information to the server.

[0637] Step 3:

[0638] Based on the information received, the server uses generative AI to analyze the optimal placement and shooting angle. During the analysis process, the server utilizes photography data and feedback from similar objects stored in a database.

[0639] Step 4:

[0640] The server generates placement guides and shooting angle instructions from the analysis results and sends the results to the terminal.

[0641] Step 5:

[0642] The device displays guidelines for placement and angle on the screen to the user to assist in taking photos.

[0643] Example 1

[0644] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0645] With conventional camera applications, users had to spend time selecting the travel destination and photo spot they wanted to take photos at, and it was difficult to find the optimal position and angle when taking the photo. As a result, there was insufficient support for taking "eye-catching" photos easily, and user satisfaction was low. In addition, there was insufficient information gathering and guidance on local photo spots, making it difficult to enjoy taking photos at the destination more efficiently.

[0646] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0647] In this invention, the server includes: means for receiving a user's travel destination request and using a natural language processing engine to analyze the request; means for selecting multiple travel destination candidates from a database based on the analyzed request and selecting the optimal travel destination based on evaluation criteria; means for displaying information about the selected travel destination to the user; means for acquiring the user's location information on the site using a GPS sensor, searching the database for optimal photo spots based on the location information, and selecting the optimal photo spot based on evaluation criteria; and means for having the user input information about the object they wish to photograph, using a generative AI model to analyze the optimal placement and angle based on that information using prompt sentences, and presenting the analysis results to the user. This allows users to efficiently select travel destinations and photo spots and easily take "eye-catching" photos with the optimal placement and angle. Furthermore, by collecting information and providing guidance on local photo spots, users can enjoy taking photos at their destinations even more.

[0648] A "user" is an individual who uses the camera application to receive suggestions for travel destinations, guidance on photography spots, and suggestions for placement and angles for taking photographs of objects.

[0649] "Requests" refers to the travel destination and photography requests entered by the User through the Application.

[0650] A "natural language processing engine" refers to software technology that analyzes requests entered by users and understands and processes their meaning.

[0651] A "database" is a collection of information that stores information on potential travel destinations and photo spots, and is managed in a form that can be accessed by a server.

[0652] "Evaluation criteria" refers to the rules and parameters that serve as the basis for selecting the travel destination or photo spot that best suits the user's needs.

[0653] A "GPS sensor" is a location information acquisition device that identifies the user's current location.

[0654] "Generative AI model" refers to artificial intelligence technology used to suggest optimal placement and shooting angles for the subject a user is trying to photograph.

[0655] A "prompt sentence" refers to an input sentence used to provide context or a question to a generative AI model.

[0656] "Analysis results" refers to the optimal placement and shooting angle suggestions output by the generative AI model based on user input.

[0657] "Travel destination candidates" refers to multiple travel destination candidates selected from a database based on the user's requests.

[0658] "Photo Spot" refers to a location recommended for users to take photos on-site.

[0659] "Route information" refers to the route and access method for a user to reach a specific photo spot.

[0660] "Placement guide" refers to instruction information regarding the placement of objects that a user should refer to when taking a photograph.

[0661] "Angle guide" refers to instruction information regarding the camera angle that a user should refer to when taking a photo.

[0662] This invention relates to a camera application system that allows users to easily take photos that look "good." How each function is implemented will be described below in detail.

[0663] Travel destination suggestions based on travel requests

[0664] The user launches the camera app and selects the "travel destination suggestion" function. The user inputs their desired destination (e.g., beach, mountain, city). The device sends the inputted request in a data format such as JSON to the server as an HTTP POST request. The server analyzes the received request using a natural language processing engine (e.g., ANT NLP) and accesses a travel destination database (e.g., SQL, MongoDB) to search for potential travel destinations that match the user's request. It then selects the most suitable travel destination based on evaluation criteria. The server sends the selected travel destination information to the device, and the device displays detailed information about the destination (e.g., photos, access instructions, reviews, etc.) to the user.

[0665] Specific examples

[0666] The user enters into the app, "I want to go to a place where I can enjoy nature." The device sends the request to the server. The server searches for places where people can enjoy nature and selects "Highland Park." The server sends the selection results to the device, and the device displays detailed information about "Highland Park" to the user.

[0667] Photo spot guidance function after arriving at the location

[0668] The user arrives at their travel destination and launches the camera app. The device acquires the user's current location using the GPS sensor and sends the GPS data to the server. The server identifies the user's current location based on the received GPS data and uses a GPS data analysis tool (e.g., Geopy) to search for nearby photo spots from a database containing information on photo spots. The server scores the searched photo spots based on evaluation criteria and selects the most suitable photo spot. The server sends the selected photo spot and its route information to the device, which displays it on the user interface and provides a link to a map app (e.g., Google Maps).

[0669] Specific examples

[0670] The user arrives at "Kogen Park" and obtains their current location. The device sends GPS information to the server. The server searches for nearby photo spots and selects the "observation deck." The server sends directions to the "observation deck" to the device, which displays them on the user interface and also provides a link to the map app.

[0671] Optimal placement and shooting angle suggestions for object photography

[0672] The user launches the camera app and selects the "Taking a Photo of an Object" function. The user inputs the object to be photographed (e.g., coffee cup, food, plant). The device sends the input information about the object to be photographed in data format such as JSON to the server. The server uses a generative AI model (e.g., OpenAI's GPT-4) based on the received information to analyze the optimal placement and shooting angle using prompt text. During the analysis process, the server utilizes photography data and feedback of similar objects stored in a database. The server generates placement guides and shooting angle instructions from the analysis results and sends them to the device. The device displays these on a user interface, providing the user with specific placement and angle guidelines.

[0673] Specific examples

[0674] The user inputs, "I want to take a beautiful photo of my cafe latte." The device sends this information to the server. The server uses generative AI to analyze the optimal placement and angle, and recommends "Place it in the center of the table and take the photo at a 45-degree angle from the top left." The server sends the recommended placement guide to the device, which displays it on the user interface. The user follows the instructions to take the photo.

[0675] These functions allow users to easily take eye-catching photos, enhancing the enjoyment of their trip.

[0676] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0677] Travel destination suggestions based on travel requests

[0678] Step 1: Enter and submit your request

[0679] A user launches a camera app and selects the travel destination suggestion feature. Next, the user enters a destination preference (e.g., beach, mountain, city). The input data is passed to the device, which converts the input data into JSON format and sends it to the server as an HTTP POST request. Here, the input is the user preference and the output is the request to the server.

[0680] Step 2: Request analysis and candidate selection

[0681] The server analyzes the received request using a natural language processing engine. Based on the analysis results, the server sends an SQL query to a travel destination database to search for candidate locations that match the request. This database search takes the request analysis results as input and generates a list of candidate locations as output. The server then scores the list of candidate locations based on evaluation criteria and selects the best candidate location. This selection process generates a list of candidate locations as input and the best candidate as output.

[0682] Step 3: View the results

[0683] The server sends the selection results in JSON format to the device. This selection result includes detailed information about the best travel destinations (photos, access instructions, reviews, etc.). The device receives this data and displays it in a user interface. The input here is the selection result, and the output is the display on the device screen.

[0684] Photo spot guidance function after arriving at the location

[0685] Step 1: Obtaining and sending location information

[0686] When a user arrives at their travel destination and launches the camera app, the device uses the GPS sensor to obtain the user's current location and sends the GPS data to the server as an HTTP POST request. Here, the input is the GPS data and the output is the request to the server.

[0687] Step 2: Search and select a shooting location

[0688] The server identifies the location information based on the received GPS data. Next, the server accesses a database that stores information on photography points and searches for nearby photography points based on the current location. In this process, a GPS data analysis tool is used, with the GPS data as input and the photography point list as output. The server then scores the photography point list based on evaluation criteria and selects the optimal photography point. The input for this scoring is the photography point list and the output is the optimal photography point.

[0689] Step 3: Guidance

[0690] The server sends the selected photo spot information (latitude and longitude, details, route guidance) to the device. The device receives this information, displays it on the user interface, and provides a link to the map app. The input here is the selection result, and the output is the device screen display and link.

[0691] Optimal placement and shooting angle suggestions for object photography

[0692] Step 1: Enter and submit information about the subject

[0693] The user launches the camera app and selects the "Take a Picture" function. The user inputs the object to be photographed (e.g., coffee cup, food, plant). The input data is passed to the device, which converts it into JSON format and sends it to the server. Here, the input is the object information, and the output is the request to the server.

[0694] Step 2: Shooting arrangement analysis

[0695] The server uses the received information to analyze the placement and shooting angle using a generative AI model. During this process, a prompt is generated and sent to the AI ​​model. The analysis uses user input data and database-based shooting data, with object information and prompts as input and the analysis results as output.

[0696] Step 3: Guide display

[0697] The server sends the analysis results in JSON format to the terminal. The terminal receives this data and displays placement guides and angle guides in the user interface. Here, the input is the analysis results and the output is the terminal screen display.

[0698] These processing steps allow the user to efficiently select travel destinations and photography spots, and take photos that "look great" with the optimal positioning and angle.

[0699] (Application example 1)

[0700] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0701] With conventional camera applications, users often have difficulty finding the best photo spot when traveling or in a store, or determining the optimal position and angle of the subject they want to photograph. Furthermore, there is a lack of efficient guidance, particularly when it comes to guiding users to Instagrammable spots within a store, resulting in poor user convenience. To solve these problems, there was a need for a way for users to easily find the best photo spot and method.

[0702] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0703] In this invention, the server includes means for receiving a user's request regarding a travel destination and selecting multiple travel destination candidates based on the request, means for displaying information about the selected travel destination to the user, means for acquiring the user's location information on the site and presenting optimal photo spots based on the location information, means for analyzing the optimal position and angle for the object the user is trying to photograph using a generation AI and presenting the analysis results to the user, and means for acquiring the user's location information within a store and presenting optimal Instagrammable spots. This enables users to efficiently find optimal photo spots and methods and take high-quality photos.

[0704] The "travel destination candidate selection means" is a function that receives requests regarding travel destinations input by the user and selects multiple travel destination candidates from a database based on those requests.

[0705] The "travel destination information display means" is a function that visually displays detailed information about the selected travel destination to the user.

[0706] "Location information acquisition means" is a function that acquires the user's current location information using location information services such as GPS.

[0707] The "photography point presentation means" is a function that presents the user with the best photography points in the vicinity based on the acquired position information.

[0708] The "generative AI analysis means" is a function that uses generative AI to analyze the optimal position and angle for the subject the user is trying to photograph and presents the results to the user.

[0709] The "Instagrammable spot suggestion method" is a function that suggests the most suitable Instagrammable spots to users based on their location information within the store.

[0710] This invention provides a camera application system that allows users to easily take photos that look "good." The following describes how each function is implemented in detail.

[0711] Travel destination suggestions based on travel requests

[0712] 1. Input and submit your request:

[0713] The user launches the camera app and selects the "Travel Destination Suggestion" function.

[0714] The terminal allows the user to input a request for a place they would like to go (e.g., beach, mountain, city).

[0715] The terminal transmits the input request to the server as a request.

[0716] 2. Request analysis and candidate selection:

[0717] The server receives the request and analyzes the input request.

[0718] The server accesses the database and selects multiple candidate travel destinations and scenic spots that match the request.

[0719] The server selects the most suitable travel destination from the candidates based on the evaluation criteria.

[0720] 3. Results display:

[0721] The server transmits the selection result to the terminal.

[0722] The device displays detailed information about the travel destination (photos, access methods, reviews, etc.) to the user to assist in creating travel plans.

[0723] Photo spot guidance function after arriving at the location

[0724] 1. Location acquisition and transmission:

[0725] The user arrives at their travel destination and launches the app.

[0726] The device acquires the user's GPS information and sends it to the server.

[0727] 2. Search and select a shooting spot:

[0728] The server receives the GPS information and searches the database for nearby photography points.

[0729] The server selects the most suitable shooting point from the searched points based on the evaluation criteria.

[0730] 3. Directional signs:

[0731] The server transmits the selected photographing points and their route information to the terminal.

[0732] The device will display directions to the photo spot to the user and provide a link to a map app.

[0733] Optimal placement and shooting angle suggestions for object photography

[0734] 1. Enter and submit information about the subject:

[0735] The user launches the camera app and selects the "mono photography" function.

[0736] The device prompts the user to input the object to be photographed (e.g., coffee cup, food, plant).

[0737] The terminal transmits the photographing target information to the server.

[0738] 2. Shooting arrangement analysis:

[0739] Based on the information received, the server uses generative AI to analyze the optimal placement and shooting angle.

[0740] During the analysis process, the server utilizes photographic data and feedback from similar objects stored in a database.

[0741] 3. Guide display:

[0742] The server generates placement guides and shooting angle instructions from the analysis results and sends the results to the terminal.

[0743] The device displays guidelines for placement and angle on the screen to assist the user in taking photos.

[0744] Guide to Instagrammable spots within the store

[0745] 1. Location acquisition and transmission:

[0746] The user enters the store and launches the app.

[0747] The terminal acquires the user's current location information and transmits it to the server.

[0748] 2. Search and display Instagrammable spots:

[0749] The server receives the current location information and searches the store database for the best Instagrammable spots.

[0750] The server selects the most suitable spot from the searched spots based on the evaluation criteria.

[0751] 3. Spot guide signs:

[0752] The server sends the selected spot and its route information to the terminal.

[0753] The device will display directions to the spot to the user and provide a link to a map app.

[0754] With these features, users can efficiently find the best photo spots and methods when traveling or in stores, and take high-quality photos.

[0755] Specific examples

[0756] Examples of travel destination suggestions:

[0757] 1. The user enters into the app, "I want to go to a place where I can enjoy nature."

[0758] 2. The device sends a request to the server.

[0759] 3. The server searches for places where people can enjoy nature and selects "Highland Park."

[0760] 4. The selection results are sent to the terminal, and detailed information about "Kogen Park" is displayed to the user.

[0761] Examples of photo spot guides:

[0762] 1. The user arrives at "Takahara Park" and obtains their current location.

[0763] 2. The device sends GPS information to the server.

[0764] 3. The server searches for nearby photo spots and selects an "observation deck."

[0765] 4. Directions to the observation deck will be displayed on the device, and a link to a map app will also be provided.

[0766] Examples of Mono photography:

[0767] 1. The user enters, "I want to take beautiful photos of cafe lattes."

[0768] 2. The device sends the information to the server.

[0769] 3. The server uses generated AI to analyze the optimal placement and angle, and recommends placing the camera in the center of the table and taking a photo at a 45-degree angle from the top left.

[0770] 4. A recommended placement guide is displayed on the device, and the user takes the photo following the instructions.

[0771] Examples of in-store Instagrammable spots:

[0772] 1. The user enters the store and launches the app.

[0773] 2. The device sends location information to the server.

[0774] 3. The server searches for the best Instagrammable spots and selects the "Photogenic Corner."

[0775] 4. Directions to the "Photogenic Corner" will be displayed on the device, and a link to a map app will also be provided.

[0776] Example prompt sentence:

[0777] "Use the camera app to capture a beautiful image of a coffee latte. Optimize the arrangement and angle for the best shot."

[0778] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0779] Step 1:

[0780] The user launches the camera app and selects the "Travel Destination Suggestion" function. The user inputs a request about the place they want to go (e.g., beach, mountain, city). The device sends this request to the server as a request. As input, there is the user's travel destination request, and as output, the request data is sent to the server.

[0781] Step 2:

[0782] The server analyzes the received request data and determines the user's needs. Based on the analysis results, the server accesses the database and selects multiple travel destination candidates that match the needs. The server receives the user's request data as input, searches the travel destination data in the database, and outputs matching candidates.

[0783] Step 3:

[0784] The server selects the most suitable travel destination based on the evaluation criteria and sends the results along with detailed information (photos, access methods, reviews, etc.) to the device. The evaluation criteria and potential travel destinations are required as input, and data containing detailed information about the travel destinations is sent to the device as output.

[0785] Step 4:

[0786] The terminal displays detailed information about travel destinations received from the server to the user. The user creates a travel plan based on the displayed information. The detailed information from the server is input, and the information is presented visually to the user as output.

[0787] Step 5:

[0788] When the user arrives at their travel destination and launches the app again, the device acquires the user's GPS information and sends it to the server. The input is the GPS information acquired by the device, and the output is the location data sent to the server.

[0789] Step 6:

[0790] The server searches the database for nearby photography spots based on the received location information. The optimal photography spot is selected from the search results based on evaluation criteria. The server receives location data and photography spot data for the search as input, and obtains the optimal photography spot data as output.

[0791] Step 7:

[0792] The server sends the selected shooting points and their route information to the terminal. The server's selection data and route information are required as input, and the route information is sent to the terminal as output.

[0793] Step 8:

[0794] The device displays directions to the photo spot to the user and provides a link to a map app. The user follows the directions to move to the optimal photo spot. The input is the guidance information displayed on the device, and the output is the guidance information visualized for the user.

[0795] Step 9:

[0796] The user inputs the object to be photographed (e.g., coffee cup, food, plant) and selects the "Take a Picture" function. The device sends this information to the server. The input is the object data entered by the user, and the output is the data sent to the server.

[0797] Step 10:

[0798] Based on the received information, the server uses a generative AI model to analyze the optimal placement and shooting angle. This analysis utilizes the photography data and feedback of similar objects stored in a database. The received data and the contents of the database are input, and the analysis results are generated as output.

[0799] Step 11:

[0800] The server generates placement guides and shooting angle instructions from the analysis results and sends them to the terminal. The server's analysis results are input, and guide information is sent to the terminal as output.

[0801] Step 12:

[0802] The device displays guidelines for placement and angle on the screen to assist the user in taking photos. The user takes photos according to the guidelines. The input is guide information displayed on the device, and the output is a visual display to the user.

[0803] Step 13:

[0804] When a user enters a store, the app automatically launches to guide them to Instagrammable spots. The device acquires the user's current location information and sends it to the server. The device's location information is input, and data sent to the server is output.

[0805] Step 14:

[0806] The server accesses the store's database of Instagrammable spots and searches for the best spot based on the user's location information. The best spot is selected based on the evaluation criteria. Store data and location information are input, and spot information is generated as output.

[0807] Step 15:

[0808] The server sends the selection result and route information to the terminal. The input is the selection data and route information stored in the server, and the output is data sent to the terminal.

[0809] Step 16:

[0810] The device displays directions to Instagrammable spots and provides a link to a map app. The user follows the directions and takes photos at the best spots. The input is the device's display data, and the output is a visual presentation to the user.

[0811] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0812] This invention relates to a camera application system that allows users to take more satisfying and "eye-catching" photos by combining an emotion engine that recognizes the user's emotions. This system helps users select travel destinations, guides them to photo spots on the spot, and adjusts and suggests the optimal position and angle for product photography based on emotion data.

[0813] Travel destination suggestions based on travel requests

[0814] 1. Request input and emotion information acquisition:

[0815] The user launches the camera app and selects the "travel destination suggestion" function.

[0816] The device prompts the user to input a request for a place they would like to go (e.g., beach, mountain, city).

[0817] The device acquires emotional information using the user's camera and microphone, and the emotion engine analyzes the user's current emotional state.

[0818] 2. Sending requests and emotional data:

[0819] The terminal transmits the input request information and emotion data to the server.

[0820] 3. Candidate selection based on requests and sentiment data:

[0821] The server receives the request and analyzes the desire and emotion data.

[0822] The server accesses the database and selects multiple candidate travel destinations and scenic spots that match the request.

[0823] The emotion engine uses emotional data to select candidate locations that best suit the user's emotional state.

[0824] 4. Results display:

[0825] The server transmits the selection result to the terminal.

[0826] The device displays detailed information about the travel destination (photos, access methods, reviews, etc.) to the user to assist in creating travel plans.

[0827] Photo spot guidance function after arriving at the location

[0828] 1. Location and emotion information acquisition:

[0829] The user arrives at their travel destination and launches the app.

[0830] The device acquires the user's GPS information and emotional information and sends it to the server.

[0831] 2. Shooting spot selection based on location and emotion data:

[0832] The server receives the GPS information and emotion data and searches the database for nearby photo spots.

[0833] Based on the search results, the server selects the shooting point that best suits the user's emotional state.

[0834] 3. Directional signs:

[0835] The server sends the selected shooting points and route information to the terminal.

[0836] The device will display directions to the photo spot to the user and provide a link to a map app.

[0837] Optimal placement and shooting angle suggestions for object photography

[0838] 1. Acquiring subject information and emotion information:

[0839] The user launches the camera app and selects the "mono photography" function.

[0840] The device prompts the user to input the object to be photographed (e.g., coffee cup, food, plant).

[0841] The terminal acquires the user's emotion information using an emotion engine.

[0842] 2. Shooting arrangement analysis based on emotion data:

[0843] The terminal transmits the photographing subject information and emotion data to the server.

[0844] Based on the information received by the server, the generation AI is used to analyze the optimal placement and shooting angle.

[0845] During the analysis process, the server takes emotional data into consideration to determine the optimal composition for the photo.

[0846] 3. Guide display:

[0847] The server generates placement guides and shooting angle instructions from the analysis results and sends the results to the terminal.

[0848] The device displays guidelines for placement and angle on the screen to the user to assist in taking photos.

[0849] Specific examples

[0850] Examples of travel destination suggestions:

[0851] 1. The user enters into the app, "I want to go to a place where I can enjoy nature," and at the same time, the emotion engine analyzes the emotion as "I want to relax."

[0852] 2. The device sends requests and emotional information to the server.

[0853] 3. The server searches for places where people can enjoy nature and selects "Highland Park," which has a high relaxing effect.

[0854] 4. The selection results are sent to the terminal, and detailed information about "Kogen Park" is displayed to the user.

[0855] Examples of photo spot guides:

[0856] 5. The user arrives at "Kogen Park" and their current location and emotion information is acquired.

[0857] 6. The device sends GPS information and emotion data to the server.

[0858] 7. The server searches for nearby photo spots and selects the "observation deck." Based on the emotional data, it determines that the view from the observation deck will have a relaxing effect.

[0859] 8. Directions to the observation deck will be displayed on the device, and a link to a map app will also be provided.

[0860] Examples of Mono photography:

[0861] 9. The user enters, "I want to take a beautiful photo of my cafe latte," and the emotion engine analyzes it to determine the emotion of "happiness."

[0862] 10. The device sends the information to the server.

[0863] 11. The server uses AI to analyze the optimal placement and angle, recommending placing the photo in the center of the table and taking a photo at a 45-degree angle from the top left. Based on emotional data, the server also considers lighting to create a happy mood.

[0864] 12. A recommended placement guide is displayed on the device, and the user takes the photo following the instructions.

[0865] This allows users to easily take high-quality photos that reflect their own emotions, doubling the enjoyment of their travels and everyday life.

[0866] The processing flow will be explained below.

[0867] Travel destination suggestions based on travel requests

[0868] Step 1:

[0869] The user launches the camera app and selects the "Travel Suggestion" feature. The device prompts the user to enter a destination (e.g., beach, mountain, city) they would like to visit.

[0870] Step 2:

[0871] The device acquires emotional information using the user's camera and microphone, and the emotion engine analyzes the user's current emotional state.

[0872] Step 3:

[0873] The terminal transmits the input request information and emotion data to the server as a request.

[0874] Step 4:

[0875] The server receives the request, analyzes the input desires and emotion data, and accesses the database to select multiple candidate travel destinations and scenic spots that match the desires.

[0876] Step 5:

[0877] The emotion engine uses emotional data to select potential travel destinations that best suit the user's emotional state based on evaluation criteria.

[0878] Step 6:

[0879] The server transmits the selection result to the terminal.

[0880] Step 7:

[0881] The device displays detailed information about the destination (photos, access methods, reviews, etc.) along with emotion-based recommendations, allowing users to select a destination that best suits their emotions.

[0882] Photo spot guidance function after arriving at the location

[0883] Step 1:

[0884] When the user arrives at their travel destination and launches the app, the device acquires the user's GPS information.

[0885] Step 2:

[0886] The device acquires emotional information, and the emotion engine analyzes the user's current emotional state in real time.

[0887] Step 3:

[0888] The device sends GPS information and emotion data to the server.

[0889] Step 4:

[0890] The server receives the GPS information and emotion data and searches the database for nearby photo spots.

[0891] Step 5:

[0892] The server selects the photo spot that best suits the user's emotional state based on the evaluation criteria, based on the search results for nearby photo spots.

[0893] Step 6:

[0894] The server sends the selected shooting points and route information to the terminal.

[0895] Step 7:

[0896] The device displays directions to the photo spot and also provides a link to a map app, allowing users to take photos that are highly satisfying by being guided to the optimal photo spot that matches their emotions.

[0897] Optimal placement and shooting angle suggestions for object photography

[0898] Step 1:

[0899] The user launches the camera app and selects the "Take a Picture" function. The device prompts the user to enter information about the object to be photographed (e.g., coffee cup, food, plant).

[0900] Step 2:

[0901] The terminal uses an emotion engine to acquire the user's emotion information and analyze the current emotional state.

[0902] Step 3:

[0903] The device transmits information about the subject being photographed and emotion data to the server.

[0904] Step 4:

[0905] Based on the subject information and emotion data received by the server, the generative AI analyzes the optimal placement and shooting angle. During the analysis process, the server also takes the emotion data into consideration to determine the optimal shooting composition.

[0906] Step 5:

[0907] The server sends the placement guide and shooting angle instructions generated from the analysis results to the terminal.

[0908] Step 6:

[0909] The device will provide users with on-screen placement and angle guidelines, as well as emotion-based photography advice and tips, making it easier for users to take photos that best suit their emotional state.

[0910] Specific examples

[0911] Examples of travel destination suggestions:

[0912] 1. The user enters into the app, "I want to go somewhere where I can enjoy nature," and the device uses computer vision to analyze the emotion as "I want to relax."

[0913] 2. The device sends this information to the server.

[0914] 3. The server searches for places where you can enjoy nature and selects a "highland park" that has a high relaxing effect.

[0915] 4. The selection results and the reasons why the park has such a relaxing effect are sent to the device, and detailed information about "Kogen Park" is displayed to the user.

[0916] Examples of photo spot guides:

[0917] 5. The user arrives at "Kogen Park" and obtains their current location and real-time emotion information.

[0918] 6. The device sends GPS information and emotion data to the server.

[0919] 7. The server searches for nearby photo spots and selects "Observation Deck." It determines that the view from the observation deck will enhance relaxation.

[0920] 8. Directions to the observation deck will be displayed on the device, and a link to a map app will also be provided.

[0921] Examples of Mono photography:

[0922] 9. The user enters, "I want to take a beautiful photo of my cafe latte," and the device analyzes the emotion of "happiness" using facial expression recognition.

[0923] 10. The device sends the information to the server.

[0924] 11. The server uses AI to analyze the optimal placement and angle, recommending placing the photo in the center of the table and taking a photo at a 45-degree angle from the top left. It also takes into consideration how the light is applied to create a happy mood.

[0925] 12. Along with a placement guide, advice on how to emphasize a happy atmosphere is displayed on the device, and the user follows the instructions to take the photo.

[0926] These processes enable users to easily take high-quality photos that reflect their own emotions, enhancing the enjoyment of travel and everyday life.

[0927] Example 2

[0928] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0929] Conventional camera applications offer travel destination suggestions and photo spot guidance based on user requests, but because they do not take the user's emotional state into account, they are unable to provide suggestions and guidance that are in line with the user's feelings, and as a result, they are unable to sufficiently increase satisfaction. Furthermore, suggestions for camera placement and angles when taking photos are limited to general ones, and they are unable to provide optimal suggestions that reflect the emotions of each individual user. For this reason, there was a need for a service that is easy for users to use and in line with their emotions.

[0930] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0931] In this invention, the server includes means for receiving a user's travel destination request and selecting multiple travel destination candidates based on the request and the user's emotional information, means for displaying detailed information about the selected travel destination to the user, means for acquiring the user's location information and emotional information on the location and suggesting optimal photo spots based on that information, and means for analyzing the optimal position and angle for the object the user is trying to photograph using a generative AI model and presenting the analysis results to the user. This makes it possible to suggest travel destinations and photo spots that take the user's emotional state into consideration, and to provide guidance on photo positions and angles tailored to each individual user.

[0932] "User" means any individual or entity that uses the System.

[0933] "Travel destination requests" are information including places the user wants to visit and desired conditions.

[0934] "Emotional information" is data that indicates the user's current emotional state.

[0935] "Travel destination candidates" are multiple travel destinations suggested based on the user's travel destination requests and emotional information.

[0936] "Detailed information" refers to information such as photos, access methods, and reviews about potential travel destinations.

[0937] "Location information" is data that indicates the user's current location.

[0938] "Photo spots" are ideal locations for users to take photos while traveling.

[0939] A "subject" is an object or scene that the user wishes to photograph.

[0940] "Layout" refers to the position and order of the objects to be photographed.

[0941] "Angle" is a setting that indicates the direction and tilt of the camera when taking a photo.

[0942] A "generative AI model" is an algorithm that uses artificial intelligence technology to analyze data and generate optimal results.

[0943] The "analysis results" are suggestions for optimal placement and angles provided by the generative AI model.

[0944] This invention relates to a camera application system that allows users to take more satisfying photos by combining it with an emotion engine that recognizes the user's emotions. This system helps users select travel destinations, guides them to photography spots on the spot, and adjusts and suggests the optimal position and angle for product photography based on emotion data.

[0945] Travel destination suggestions based on travel requests

[0946] When a user launches the camera app and selects the "travel destination suggestion" function, the device prompts the user to input their desired destination (e.g., beach, mountain, city). The device then uses the user's camera and microphone to obtain emotional information, and the emotion engine analyzes the user's current emotional state. The analysis results and the desired information are sent to a server, which then accesses a database to select candidate destinations and scenic spots that match the user's desired destination. The emotion engine then uses the emotional data to select candidate destinations that best suit the user's emotional state, and sends the selection results to the device. The device then displays detailed information about the destination (photos, access methods, reviews, etc.) to the user, assisting them in creating their travel plans.

[0947] Specific examples

[0948] When a user inputs into the app that they would like to go to a place where they can enjoy nature and smile into the camera, the device sends their request and emotional information to the server. The server analyzes the information, selects a "highland park" with a high relaxation effect, and displays detailed information about it on the device.

[0949] Photo spot guidance function after arriving at the location

[0950] When a user arrives at their travel destination and launches the app, the device acquires the user's GPS information and emotional information and sends them to the server. The server receives the GPS information and emotional data and searches a database for nearby photo spots. It then selects the optimal photo spot based on the user's emotional state and sends the results to the device. The device then displays directions to the photo spot and provides a link to the map app.

[0951] Specific examples

[0952] When a user arrives at "Kogen Park" and starts the app with a smile, the device sends GPS information and emotional data to the server. The server searches for nearby photo spots, selects an "observation deck" with a relaxing effect in mind, and displays the information on the device.

[0953] Optimal placement and shooting angle suggestions for object photography

[0954] When a user launches the camera app and selects the "Taking a Photo of an Object" function, the device prompts them to input the object to be photographed (e.g., coffee cup, food, plant) and uses an emotion engine to obtain the user's emotional information. The device then sends the information about the object and the emotional data to the server, which then uses a generative AI model to analyze the optimal placement and shooting angle. The analysis results are sent to the device as the optimal composition based on the emotional data, and the device then presents guidelines for placement and angle to the user.

[0955] Specific examples

[0956] When a user inputs "I want to take a beautiful photo of my cafe latte," and the emotion engine analyzes the emotion as "happiness," the device sends the information to the server. The server uses a generative AI model to analyze the optimal placement and angle, recommending "place it in the center of the table and take the photo at a 45-degree angle from the top left." A placement guide is displayed to the user, who then follows the instructions to take the photo.

[0957] This allows users to easily take high-quality photos that reflect their own emotions, increasing the enjoyment of their travels and everyday life.

[0958] Prompt Sentence Examples

[0959] 1. "I want to go to a place where I can enjoy nature."

[0960] 2. "I want to take beautiful photos of cafe lattes."

[0961] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0962] Travel destination suggestions based on travel requests

[0963] Step 1:

[0964] User: Launches the camera app and selects the "Travel Destination Suggestion" function. Enters a request such as "I want to go to the beach."

[0965] Step 2:

[0966] Device: Obtains user input and emotional information in real time using a camera and microphone. The emotion engine analyzes the user's current emotional state and gives a result such as "I want to have fun."

[0967] Step 3:

[0968] Terminal: Sends the request information and the emotion data as the analysis result to the server. The request information and emotion data are included as input.

[0969] Step 4:

[0970] Server: Receives the request information and emotion data, accesses the database, and searches for travel destinations and scenic spots that match the request. In this case, multiple beach-related travel destinations are selected as candidates.

[0971] Step 5:

[0972] Server: Based on the emotional data, the server selects the candidate location that best suits the user's emotional state. Specifically, the server selects a beach in Hawaii, taking into account the emotion of "wanting to have fun."

[0973] Step 6:

[0974] Server: Sends the selection results to the device. The output includes detailed travel destination information (e.g., photos of Hawaiian beaches, how to get there, reviews, etc.).

[0975] Step 7:

[0976] Terminal: Displays the travel destination information received from the server to the user.

[0977] Photo spot guidance function after arriving at the location

[0978] Step 1:

[0979] User: Arrives at travel destination and launches the app.

[0980] Step 2:

[0981] Device: Obtains the user's GPS information and emotional information. Determines "relaxed" as the emotional data.

[0982] Step 3:

[0983] Terminal: Sends GPS information and emotion data to the server. Location information and emotion data are included as input.

[0984] Step 4:

[0985] Server: Receives GPS information and emotion data, searches for nearby photo spots from a database, and extracts the best photo spots related to the location based on the input.

[0986] Step 5:

[0987] Server: Considering the emotional data, select the optimal shooting point for the user's state. Select the "observation deck" considering its relaxing effect.

[0988] Step 6:

[0989] Server: Sends the selected photo points and their route information to the terminal. The output includes route information and photo point details.

[0990] Step 7:

[0991] On the device: Displays GPS and route information to the user and provides a link to a map app.

[0992] Optimal placement and shooting angle suggestions for object photography

[0993] Step 1:

[0994] User: Launch the camera app, select the "Object Shooting" function, and enter "Cafe Latte" as the subject to be photographed.

[0995] Step 2:

[0996] Device: Acquires information about the subject being photographed and uses the emotion engine to acquire the user's emotional information. Identifies "happiness" as the emotional data.

[0997] Step 3:

[0998] Terminal: Sends the photographed object information and emotion data to the server. The input includes the object information and emotion data.

[0999] Step 4:

[1000] Server: Receives information about the subject and emotion data, and uses a generative AI model to analyze the optimal placement and shooting angle. Specifically, it recommends placing the subject in the center of the table and taking a photo at a 45-degree angle from the top left.

[1001] Step 5:

[1002] Server: Generates placement guides and shooting angle instructions and sends the results to the device. The output includes specific placement methods and angle instructions.

[1003] Step 6:

[1004] Terminal: The placement guide from the server is displayed to the user, and the user takes the photo according to the instructions.

[1005] By clarifying the inputs and outputs at each step, the operation of the entire system can be understood concretely and comprehensively.

[1006] (Application example 2)

[1007] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1008] Today's consumers are seeking a higher level of satisfaction from their shopping experiences. In particular, in brick-and-mortar stores, they are seeking product suggestions tailored to their emotions and desires, as well as optimal photography environments. However, current shopping support systems lack the functionality to suggest products that take the user's emotional state into account, making them inefficient. Furthermore, they lack sufficient advice on optimal product placement and photography techniques, making it necessary to improve the system to increase consumer satisfaction. To solve this problem, it is important to utilize users' emotional data and location information to provide a more personalized shopping experience.

[1009] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for receiving a travel destination request input by a user and selecting multiple travel destination candidates based on the request; means for displaying information about the selected travel destination to the user; means for acquiring the user's location information on the site and suggesting optimal photography points based on the location information; means for analyzing the optimal placement and angle of an object the user intends to photograph using a generation AI and presenting the analysis results to the user; and means for analyzing the user's emotional state, proposing optimal products based on the emotional data, and suggesting where to place the products and how to photograph them. This allows the user to receive personalized product suggestions based on their emotional state and also provides an optimal photography environment, thereby improving satisfaction with the overall shopping experience.

[1010] 1. "Travel destination candidates" are multiple travel destination options selected by the system based on the requests entered by the user.

[1011] 2. "Location Information" means data about a User's current location when in that location, obtained through GPS or other location measurement technologies.

[1012] 3. "Photo spots" are suitable locations for users to take photos, and are presented by the system based on location information and emotion data.

[1013] 4. "Subject" refers to the object, scenery, or other subject that the user wishes to photograph.

[1014] 5. "Arrangement" refers to the position or arrangement of objects to best present them.

[1015] 6. "Angle" tells the camera which direction to take the picture from when shooting.

[1016] 7. "Generative AI" refers to artificial intelligence that analyzes and suggests optimal travel destinations, photo spots, and the placement and angle of objects based on a user's emotional data and location information.

[1017] 8. “Emotional State” means data that indicates the user’s current psychological and emotional state, and is obtained through sensors such as cameras and microphones.

[1018] 9. "Products" refers to the items offered to Users for purchase in the physical store.

[1019] 10. "Route information" refers to directions and guidance information for users to reach the optimal photo spot.

[1020] The present invention provides a system that allows users to have an optimal shopping experience in a physical store by combining an emotion engine that recognizes user emotions. Specific embodiments will be described below.

[1021] System configuration

[1022] 1. Hardware and Software Configuration

[1023] Server: It has a database and generative AI model, analyzes emotional data and location information, and makes optimal suggestions. The server works in conjunction with the emotional data analysis engine.

[1024] Device: The user's smartphone or tablet is used to acquire emotion data, acquire location information, and display suggestions. Smartphones are equipped with a camera, GPS, and microphone.

[1025] Emotion engine: Analyzes the emotional data sent by the user to the device and determines the user's current emotional state.

[1026] Program processing overview

[1027] 1. Obtaining user emotion data

[1028] When a user launches the shopping support app in a physical store, the app uses the device's camera and microphone to collect the user's emotional data.

[1029] An emotion engine analyzes this data to determine the user's current emotional state.

[1030] 2. Obtaining location information

[1031] When a user is in a physical store, their current location is obtained using the device's GPS or beacon.

[1032] This allows the system to determine which area of ​​the store the user is in.

[1033] 3. Proposal Processing

[1034] Emotion data and location information are sent to the server.

[1035] The server's generative AI model analyzes this information and calculates product suggestions, product placement locations, and photography methods that are best suited to the user's emotional state.

[1036] An example of a generated prompt: "The user's emotional data indicates that they are feeling stressed. The user's location is the food court on the first floor of a shopping center. Suggest products that are ideal for reducing stress."

[1037] 4. Display of proposal results

[1038] The server sends the proposal to the terminal.

[1039] The device displays the received suggestions to the user and also provides guidance on the best angle and placement for photographing the product.

[1040] Specific examples

[1041] For example, if a user is in a shopping center and the emotion engine detects that they are feeling stressed, the system will acquire the user's location information and suggest relaxation products and locations (e.g., massage chairs or aroma oil corners) that are effective in reducing stress. These suggestions will be displayed on the device, and the user will be guided to the product and the best way to take a photo (e.g., "take a photo from a 45-degree angle starting from the top left").

[1042] By using a generative AI model, it is possible to make detailed suggestions based on the user's individual emotional state, which is expected to improve the shopping experience.

[1043] As described above, the system of the present invention can utilize emotional data and location information to provide users with personalized shopping suggestions, allowing them to have a comfortable and satisfying shopping experience that is tailored to their emotions.

[1044] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1045] Step 1:

[1046] A user launches a shopping support app in a physical store. The device starts collecting emotion data through the app. As input, the smartphone's camera and microphone are used to capture the user's facial expressions and tone of voice, and the data is sent to the emotion engine. The emotion engine analyzes this input data and outputs the user's current emotional state (e.g., stress, joy, excitement, etc.).

[1047] Step 2:

[1048] The device also obtains the user's current location information. As input, it collects location data from the smartphone's GPS and beacons. This location data is used to determine which area the user is in and provides current location information as output.

[1049] Step 3:

[1050] The device sends the acquired emotional data and location information to the server. The server receives this data and prepares to generate suggestions based on the emotional data and location information. The emotional data and location data are passed to the server as input. The server processes and analyzes this data using a generative AI model.

[1051] Step 4:

[1052] The server then proposes optimal products based on the emotional data. Specifically, the server's generative AI model analyzes the emotional data and selects the products (e.g., massage equipment or relaxation items to relieve stress) that best suit the user's current emotional state. The input is the emotional data, and the output is a list of suggested products.

[1053] Step 5:

[1054] The server then suggests where to place these products and how to photograph them based on the location information. Specifically, the generative AI model uses the location data to suggest the best place to place products around the user's current location and how to photograph them beautifully. The input is location information, and the output is where to place the products and the best way to photograph them. An example of a generated prompt: "We obtained emotional data that the user is 'feeling stressed.' The location information is the food court on the first floor of a shopping center. We suggest products that are ideal for reducing stress."

[1055] Step 6:

[1056] The server sends the recommendation results to the device. The device displays the received recommendation to the user. Specifically, the device visually presents the product list, placement locations, and optimal photography methods to the user. The system receives the recommendation results from the server as input and displays this information on the user's smartphone screen as output. The user can then find the recommended products and photograph them in the instructed way.

[1057] The detailed description of each processing step allows the system of the present invention to provide an optimal shopping experience, taking into account the user's emotional state and current location.

[1058] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1059] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1060] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1061] [Third embodiment]

[1062] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1063] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1064] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1065] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1066] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1067] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1068] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1069] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1070] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1071] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1072] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1073] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1074] This invention relates to a camera application system that allows users to easily take photos that look "good." How each function is implemented will be described below in detail.

[1075] Travel destination suggestions based on travel requests

[1076] 1. Input and submit your request:

[1077] The user launches the camera app and selects the "travel destination suggestion" function.

[1078] The device prompts the user to input a request for a place they would like to go (e.g., beach, mountain, city).

[1079] The terminal transmits the input request to the server as a request.

[1080] 2. Request analysis and candidate selection:

[1081] The server receives the request and analyzes the input request.

[1082] The server accesses the database and selects multiple candidate travel destinations and scenic spots that match the request.

[1083] The server selects the most suitable travel destination from the candidates based on the evaluation criteria.

[1084] 3. Results display:

[1085] The server transmits the selection result to the terminal.

[1086] The device displays detailed information about the travel destination (photos, access methods, reviews, etc.) to the user to assist in creating travel plans.

[1087] Photo spot guidance function after arriving at the location

[1088] 1. Location acquisition and transmission:

[1089] The user arrives at their travel destination and launches the app.

[1090] The device acquires the user's GPS information and sends it to the server.

[1091] 2. Search and select a shooting spot:

[1092] The server receives the GPS information and searches the database for nearby photography points.

[1093] The server selects the most suitable shooting point from the searched points based on the evaluation criteria.

[1094] 3. Directional signs:

[1095] The server sends the selected shooting points and route information to the terminal.

[1096] The device will display directions to the photo spot to the user and provide a link to a map app.

[1097] Optimal placement and shooting angle suggestions for object photography

[1098] 1. Enter and submit information about the subject:

[1099] The user launches the camera app and selects the "mono photography" function.

[1100] The device prompts the user to input the object to be photographed (e.g., coffee cup, food, plant).

[1101] The terminal transmits the photographing target information to the server.

[1102] 2. Shooting arrangement analysis:

[1103] Based on the information received by the server, the generation AI is used to analyze the optimal placement and shooting angle.

[1104] During the analysis process, the server utilizes photographic data and feedback from similar objects stored in a database.

[1105] 3. Guide display:

[1106] The server generates placement guides and shooting angle instructions from the analysis results and sends the results to the terminal.

[1107] The device displays guidelines for placement and angle on the screen to the user to assist in taking photos.

[1108] Specific examples

[1109] Examples of travel destination suggestions:

[1110] 1. The user enters into the app, "I want to go to a place where I can enjoy nature."

[1111] 2. The device sends a request to the server.

[1112] 3. The server searches for places where people can enjoy nature and selects "Highland Park."

[1113] 4. The selection results are sent to the terminal, and detailed information about "Kogen Park" is displayed to the user.

[1114] Examples of photo spot guides:

[1115] 5. The user arrives at "Takahara Park" and obtains their current location.

[1116] 6. The device sends GPS information to the server.

[1117] 7. The server searches for nearby photo spots and selects an "observation deck."

[1118] 8. Directions to the observation deck will be displayed on the device, and a link to a map app will also be provided.

[1119] Examples of Mono photography:

[1120] 9. The user enters, "I want to take beautiful photos of cafe lattes."

[1121] 10. The device sends the information to the server.

[1122] 11. The server uses generated AI to analyze the optimal placement and angle, and recommends placing the camera in the center of the table and taking a photo at a 45-degree angle from the top left.

[1123] 12. A recommended placement guide is displayed on the device, and the user takes the photo following the instructions.

[1124] These processes allow users to easily take "eye-catching" photos and enhance the enjoyment of their trip.

[1125] The processing flow will be explained below.

[1126] Travel destination suggestions based on travel requests

[1127] Step 1:

[1128] The user launches the camera app and selects the "Travel Suggestion" feature. The device prompts the user to enter a destination (e.g., beach, mountain, city) they would like to visit.

[1129] Step 2:

[1130] The terminal transmits the input request to the server as a request.

[1131] Step 3:

[1132] The server receives the request, analyzes the input requirements, and accesses a database to select multiple candidate travel destinations and scenic spots that match the requirements.

[1133] Step 4:

[1134] The server selects the most suitable travel destination from the candidates based on the evaluation criteria.

[1135] Step 5:

[1136] The server transmits the selection result to the terminal.

[1137] Step 6:

[1138] The device displays detailed information about the travel destination (photos, access methods, reviews, etc.) to the user to assist in creating travel plans.

[1139] Photo spot guidance function after arriving at the location

[1140] Step 1:

[1141] When the user arrives at their travel destination and launches the app, the device acquires the user's GPS information.

[1142] Step 2:

[1143] The device sends GPS information to the server.

[1144] Step 3:

[1145] The server receives the GPS information and searches the database for nearby photography points.

[1146] Step 4:

[1147] Based on the search results, the server selects the optimal shooting point according to the evaluation criteria.

[1148] Step 5:

[1149] The server sends the selected shooting points and route information to the terminal.

[1150] Step 6:

[1151] The device will display directions to the photo spot to the user and provide a link to a map app.

[1152] Optimal placement and shooting angle suggestions for object photography

[1153] Step 1:

[1154] The user launches the camera app and selects the "Take a Picture" function. The device prompts the user to input the object to be photographed (e.g., coffee cup, food, plant).

[1155] Step 2:

[1156] The terminal transmits the photographing target information to the server.

[1157] Step 3:

[1158] Based on the information received, the server uses generative AI to analyze the optimal placement and shooting angle. During the analysis process, the server utilizes photography data and feedback from similar objects stored in a database.

[1159] Step 4:

[1160] The server generates placement guides and shooting angle instructions from the analysis results and sends the results to the terminal.

[1161] Step 5:

[1162] The device displays guidelines for placement and angle on the screen to the user to assist in taking photos.

[1163] Example 1

[1164] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1165] With conventional camera applications, users had to spend time selecting the travel destination and photo spot they wanted to take photos at, and it was difficult to find the optimal position and angle when taking the photo. As a result, there was insufficient support for taking "eye-catching" photos easily, and user satisfaction was low. In addition, there was insufficient information gathering and guidance on local photo spots, making it difficult to enjoy taking photos at the destination more efficiently.

[1166] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1167] In this invention, the server includes: means for receiving a user's travel destination request and using a natural language processing engine to analyze the request; means for selecting multiple travel destination candidates from a database based on the analyzed request and selecting the optimal travel destination based on evaluation criteria; means for displaying information about the selected travel destination to the user; means for acquiring the user's location information on the site using a GPS sensor, searching the database for optimal photo spots based on the location information, and selecting the optimal photo spot based on evaluation criteria; and means for having the user input information about the object they wish to photograph, using a generative AI model to analyze the optimal placement and angle based on that information using prompt sentences, and presenting the analysis results to the user. This allows users to efficiently select travel destinations and photo spots and easily take "eye-catching" photos with the optimal placement and angle. Furthermore, by collecting information and providing guidance on local photo spots, users can enjoy taking photos at their destinations even more.

[1168] A "user" is an individual who uses the camera application to receive suggestions for travel destinations, guidance on photography spots, and suggestions for placement and angles for taking photographs of objects.

[1169] "Requests" refers to the travel destination and photography requests entered by the User through the Application.

[1170] A "natural language processing engine" refers to software technology that analyzes requests entered by users and understands and processes their meaning.

[1171] A "database" is a collection of information that stores information on potential travel destinations and photo spots, and is managed in a form that can be accessed by a server.

[1172] "Evaluation criteria" refers to the rules and parameters that serve as the basis for selecting the travel destination or photo spot that best suits the user's needs.

[1173] A "GPS sensor" is a location information acquisition device that identifies the user's current location.

[1174] "Generative AI model" refers to artificial intelligence technology used to suggest optimal placement and shooting angles for the subject a user is trying to photograph.

[1175] A "prompt sentence" refers to an input sentence used to provide context or a question to a generative AI model.

[1176] "Analysis results" refers to the optimal placement and shooting angle suggestions output by the generative AI model based on user input.

[1177] "Travel destination candidates" refers to multiple travel destination candidates selected from a database based on the user's requests.

[1178] "Photo Spot" refers to a location recommended for users to take photos on-site.

[1179] "Route information" refers to the route and access method for a user to reach a specific photo spot.

[1180] "Placement guide" refers to instruction information regarding the placement of objects that a user should refer to when taking a photograph.

[1181] "Angle guide" refers to instruction information regarding the camera angle that a user should refer to when taking a photo.

[1182] This invention relates to a camera application system that allows users to easily take photos that look "good." How each function is implemented will be described below in detail.

[1183] Travel destination suggestions based on travel requests

[1184] The user launches the camera app and selects the "travel destination suggestion" function. The user inputs their desired destination (e.g., beach, mountain, city). The device sends the inputted request in a data format such as JSON to the server as an HTTP POST request. The server analyzes the received request using a natural language processing engine (e.g., ANT NLP) and accesses a travel destination database (e.g., SQL, MongoDB) to search for potential travel destinations that match the user's request. It then selects the most suitable travel destination based on evaluation criteria. The server sends the selected travel destination information to the device, and the device displays detailed information about the destination (e.g., photos, access instructions, reviews, etc.) to the user.

[1185] Specific examples

[1186] The user enters into the app, "I want to go to a place where I can enjoy nature." The device sends the request to the server. The server searches for places where people can enjoy nature and selects "Highland Park." The server sends the selection results to the device, and the device displays detailed information about "Highland Park" to the user.

[1187] Photo spot guidance function after arriving at the location

[1188] The user arrives at their travel destination and launches the camera app. The device acquires the user's current location using the GPS sensor and sends the GPS data to the server. The server identifies the user's current location based on the received GPS data and uses a GPS data analysis tool (e.g., Geopy) to search for nearby photo spots from a database containing information on photo spots. The server scores the searched photo spots based on evaluation criteria and selects the most suitable photo spot. The server sends the selected photo spot and its route information to the device, which displays it on the user interface and provides a link to a map app (e.g., Google Maps).

[1189] Specific examples

[1190] The user arrives at "Kogen Park" and obtains their current location. The device sends GPS information to the server. The server searches for nearby photo spots and selects the "observation deck." The server sends directions to the "observation deck" to the device, which displays them on the user interface and also provides a link to the map app.

[1191] Optimal placement and shooting angle suggestions for object photography

[1192] The user launches the camera app and selects the "Taking a Photo of an Object" function. The user inputs the object to be photographed (e.g., coffee cup, food, plant). The device sends the input information about the object to be photographed in data format such as JSON to the server. The server uses a generative AI model (e.g., OpenAI's GPT-4) based on the received information to analyze the optimal placement and shooting angle using prompt text. During the analysis process, the server utilizes photography data and feedback of similar objects stored in a database. The server generates placement guides and shooting angle instructions from the analysis results and sends them to the device. The device displays these on a user interface, providing the user with specific placement and angle guidelines.

[1193] Specific examples

[1194] The user inputs, "I want to take a beautiful photo of my cafe latte." The device sends this information to the server. The server uses generative AI to analyze the optimal placement and angle, and recommends "Place it in the center of the table and take the photo at a 45-degree angle from the top left." The server sends the recommended placement guide to the device, which displays it on the user interface. The user follows the instructions to take the photo.

[1195] These functions allow users to easily take eye-catching photos, enhancing the enjoyment of their trip.

[1196] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1197] Travel destination suggestions based on travel requests

[1198] Step 1: Enter and submit your request

[1199] A user launches a camera app and selects the travel destination suggestion feature. Next, the user enters a destination preference (e.g., beach, mountain, city). The input data is passed to the device, which converts the input data into JSON format and sends it to the server as an HTTP POST request. Here, the input is the user preference and the output is the request to the server.

[1200] Step 2: Request analysis and candidate selection

[1201] The server analyzes the received request using a natural language processing engine. Based on the analysis results, the server sends an SQL query to a travel destination database to search for candidate locations that match the request. This database search takes the request analysis results as input and generates a list of candidate locations as output. The server then scores the list of candidate locations based on evaluation criteria and selects the best candidate location. This selection process generates a list of candidate locations as input and the best candidate as output.

[1202] Step 3: View the results

[1203] The server sends the selection results in JSON format to the device. This selection result includes detailed information about the best travel destinations (photos, access instructions, reviews, etc.). The device receives this data and displays it in a user interface. The input here is the selection result, and the output is the display on the device screen.

[1204] Photo spot guidance function after arriving at the location

[1205] Step 1: Obtaining and sending location information

[1206] When a user arrives at their travel destination and launches the camera app, the device uses the GPS sensor to obtain the user's current location and sends the GPS data to the server as an HTTP POST request. Here, the input is the GPS data and the output is the request to the server.

[1207] Step 2: Search and select a shooting location

[1208] The server identifies the location information based on the received GPS data. Next, the server accesses a database that stores information on photography points and searches for nearby photography points based on the current location. In this process, a GPS data analysis tool is used, with the GPS data as input and the photography point list as output. The server then scores the photography point list based on evaluation criteria and selects the optimal photography point. The input for this scoring is the photography point list and the output is the optimal photography point.

[1209] Step 3: Guidance

[1210] The server sends the selected photo spot information (latitude and longitude, details, route guidance) to the device. The device receives this information, displays it on the user interface, and provides a link to the map app. The input here is the selection result, and the output is the device screen display and link.

[1211] Optimal placement and shooting angle suggestions for object photography

[1212] Step 1: Enter and submit information about the subject

[1213] The user launches the camera app and selects the "Take a Picture" function. The user inputs the object to be photographed (e.g., coffee cup, food, plant). The input data is passed to the device, which converts it into JSON format and sends it to the server. Here, the input is the object information, and the output is the request to the server.

[1214] Step 2: Shooting arrangement analysis

[1215] The server uses the received information to analyze the placement and shooting angle using a generative AI model. During this process, a prompt is generated and sent to the AI ​​model. The analysis uses user input data and database-based shooting data, with object information and prompts as input and the analysis results as output.

[1216] Step 3: Guide display

[1217] The server sends the analysis results in JSON format to the terminal. The terminal receives this data and displays placement guides and angle guides in the user interface. Here, the input is the analysis results and the output is the terminal screen display.

[1218] These processing steps allow the user to efficiently select travel destinations and photography spots, and take photos that "look great" with the optimal positioning and angle.

[1219] (Application example 1)

[1220] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1221] With conventional camera applications, users often have difficulty finding the best photo spot when traveling or in a store, or determining the optimal position and angle of the subject they want to photograph. Furthermore, there is a lack of efficient guidance, particularly when it comes to guiding users to Instagrammable spots within a store, resulting in poor user convenience. To solve these problems, there was a need for a way for users to easily find the best photo spot and method.

[1222] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1223] In this invention, the server includes means for receiving a user's request regarding a travel destination and selecting multiple travel destination candidates based on the request, means for displaying information about the selected travel destination to the user, means for acquiring the user's location information on the site and presenting optimal photo spots based on the location information, means for analyzing the optimal position and angle for the object the user is trying to photograph using a generation AI and presenting the analysis results to the user, and means for acquiring the user's location information within a store and presenting optimal Instagrammable spots. This enables users to efficiently find optimal photo spots and methods and take high-quality photos.

[1224] The "travel destination candidate selection means" is a function that receives requests regarding travel destinations input by the user and selects multiple travel destination candidates from a database based on those requests.

[1225] The "travel destination information display means" is a function that visually displays detailed information about the selected travel destination to the user.

[1226] "Location information acquisition means" is a function that acquires the user's current location information using location information services such as GPS.

[1227] The "photography point presentation means" is a function that presents the user with the best photography points in the vicinity based on the acquired position information.

[1228] The "generative AI analysis means" is a function that uses generative AI to analyze the optimal position and angle for the subject the user is trying to photograph and presents the results to the user.

[1229] The "Instagrammable spot suggestion method" is a function that suggests the most suitable Instagrammable spots to users based on their location information within the store.

[1230] This invention provides a camera application system that allows users to easily take photos that look "good." The following describes how each function is implemented in detail.

[1231] Travel destination suggestions based on travel requests

[1232] 1. Input and submit your request:

[1233] The user launches the camera app and selects the "Travel Destination Suggestion" function.

[1234] The terminal allows the user to input a request for a place they would like to go (e.g., beach, mountain, city).

[1235] The terminal transmits the input request to the server as a request.

[1236] 2. Request analysis and candidate selection:

[1237] The server receives the request and analyzes the input request.

[1238] The server accesses the database and selects multiple candidate travel destinations and scenic spots that match the request.

[1239] The server selects the most suitable travel destination from the candidates based on the evaluation criteria.

[1240] 3. Results display:

[1241] The server transmits the selection result to the terminal.

[1242] The device displays detailed information about the travel destination (photos, access methods, reviews, etc.) to the user to assist in creating travel plans.

[1243] Photo spot guidance function after arriving at the location

[1244] 1. Location acquisition and transmission:

[1245] The user arrives at their travel destination and launches the app.

[1246] The device acquires the user's GPS information and sends it to the server.

[1247] 2. Search and select a shooting spot:

[1248] The server receives the GPS information and searches the database for nearby photography points.

[1249] The server selects the most suitable shooting point from the searched points based on the evaluation criteria.

[1250] 3. Directional signs:

[1251] The server transmits the selected photographing points and their route information to the terminal.

[1252] The device will display directions to the photo spot to the user and provide a link to a map app.

[1253] Optimal placement and shooting angle suggestions for object photography

[1254] 1. Enter and submit information about the subject:

[1255] The user launches the camera app and selects the "mono photography" function.

[1256] The device prompts the user to input the object to be photographed (e.g., coffee cup, food, plant).

[1257] The terminal transmits the photographing target information to the server.

[1258] 2. Shooting arrangement analysis:

[1259] Based on the information received, the server uses generative AI to analyze the optimal placement and shooting angle.

[1260] During the analysis process, the server utilizes photographic data and feedback from similar objects stored in a database.

[1261] 3. Guide display:

[1262] The server generates placement guides and shooting angle instructions from the analysis results and sends the results to the terminal.

[1263] The device displays guidelines for placement and angle on the screen to assist the user in taking photos.

[1264] Guide to Instagrammable spots within the store

[1265] 1. Location acquisition and transmission:

[1266] The user enters the store and launches the app.

[1267] The terminal acquires the user's current location information and transmits it to the server.

[1268] 2. Search and display Instagrammable spots:

[1269] The server receives the current location information and searches the store database for the best Instagrammable spots.

[1270] The server selects the most suitable spot from the searched spots based on the evaluation criteria.

[1271] 3. Spot guide signs:

[1272] The server sends the selected spot and its route information to the terminal.

[1273] The device will display directions to the spot to the user and provide a link to a map app.

[1274] With these features, users can efficiently find the best photo spots and methods when traveling or in stores, and take high-quality photos.

[1275] Specific examples

[1276] Examples of travel destination suggestions:

[1277] 1. The user enters into the app, "I want to go to a place where I can enjoy nature."

[1278] 2. The device sends a request to the server.

[1279] 3. The server searches for places where people can enjoy nature and selects "Highland Park."

[1280] 4. The selection results are sent to the terminal, and detailed information about "Kogen Park" is displayed to the user.

[1281] Examples of photo spot guides:

[1282] 1. The user arrives at "Takahara Park" and obtains their current location.

[1283] 2. The device sends GPS information to the server.

[1284] 3. The server searches for nearby photo spots and selects an "observation deck."

[1285] 4. Directions to the observation deck will be displayed on the device, and a link to a map app will also be provided.

[1286] Examples of Mono photography:

[1287] 1. The user enters, "I want to take beautiful photos of cafe lattes."

[1288] 2. The device sends the information to the server.

[1289] 3. The server uses generated AI to analyze the optimal placement and angle, and recommends placing the camera in the center of the table and taking a photo at a 45-degree angle from the top left.

[1290] 4. A recommended placement guide is displayed on the device, and the user takes the photo following the instructions.

[1291] Examples of in-store Instagrammable spots:

[1292] 1. The user enters the store and launches the app.

[1293] 2. The device sends location information to the server.

[1294] 3. The server searches for the best Instagrammable spots and selects the "Photogenic Corner."

[1295] 4. Directions to the "Photogenic Corner" will be displayed on the device, and a link to a map app will also be provided.

[1296] Example prompt sentence:

[1297] "Use the camera app to capture a beautiful image of a coffee latte. Optimize the arrangement and angle for the best shot."

[1298] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1299] Step 1:

[1300] The user launches the camera app and selects the "Travel Destination Suggestion" function. The user inputs a request about the place they want to go (e.g., beach, mountain, city). The device sends this request to the server as a request. As input, there is the user's travel destination request, and as output, the request data is sent to the server.

[1301] Step 2:

[1302] The server analyzes the received request data and determines the user's needs. Based on the analysis results, the server accesses the database and selects multiple travel destination candidates that match the needs. The server receives the user's request data as input, searches the travel destination data in the database, and outputs matching candidates.

[1303] Step 3:

[1304] The server selects the most suitable travel destination based on the evaluation criteria and sends the results along with detailed information (photos, access methods, reviews, etc.) to the device. The evaluation criteria and potential travel destinations are required as input, and data containing detailed information about the travel destinations is sent to the device as output.

[1305] Step 4:

[1306] The terminal displays detailed information about travel destinations received from the server to the user. The user creates a travel plan based on the displayed information. The detailed information from the server is input, and the information is presented visually to the user as output.

[1307] Step 5:

[1308] When the user arrives at their travel destination and launches the app again, the device acquires the user's GPS information and sends it to the server. The input is the GPS information acquired by the device, and the output is the location data sent to the server.

[1309] Step 6:

[1310] The server searches the database for nearby photography spots based on the received location information. The optimal photography spot is selected from the search results based on evaluation criteria. The server receives location data and photography spot data for the search as input, and obtains the optimal photography spot data as output.

[1311] Step 7:

[1312] The server sends the selected shooting points and their route information to the terminal. The server's selection data and route information are required as input, and the route information is sent to the terminal as output.

[1313] Step 8:

[1314] The device displays directions to the photo spot to the user and provides a link to a map app. The user follows the directions to move to the optimal photo spot. The input is the guidance information displayed on the device, and the output is the guidance information visualized for the user.

[1315] Step 9:

[1316] The user inputs the object to be photographed (e.g., coffee cup, food, plant) and selects the "Take a Picture" function. The device sends this information to the server. The input is the object data entered by the user, and the output is the data sent to the server.

[1317] Step 10:

[1318] Based on the received information, the server uses a generative AI model to analyze the optimal placement and shooting angle. This analysis utilizes the photography data and feedback of similar objects stored in a database. The received data and the contents of the database are input, and the analysis results are generated as output.

[1319] Step 11:

[1320] The server generates placement guides and shooting angle instructions from the analysis results and sends them to the terminal. The server's analysis results are input, and guide information is sent to the terminal as output.

[1321] Step 12:

[1322] The device displays guidelines for placement and angle on the screen to assist the user in taking photos. The user takes photos according to the guidelines. The input is guide information displayed on the device, and the output is a visual display to the user.

[1323] Step 13:

[1324] When a user enters a store, the app automatically launches to guide them to Instagrammable spots. The device acquires the user's current location information and sends it to the server. The device's location information is input, and data sent to the server is output.

[1325] Step 14:

[1326] The server accesses the store's database of Instagrammable spots and searches for the best spot based on the user's location information. The best spot is selected based on the evaluation criteria. Store data and location information are input, and spot information is generated as output.

[1327] Step 15:

[1328] The server sends the selection result and route information to the terminal. The input is the selection data and route information stored in the server, and the output is data sent to the terminal.

[1329] Step 16:

[1330] The device displays directions to Instagrammable spots and provides a link to a map app. The user follows the directions and takes photos at the best spots. The input is the device's display data, and the output is a visual presentation to the user.

[1331] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1332] This invention relates to a camera application system that allows users to take more satisfying and "eye-catching" photos by combining an emotion engine that recognizes the user's emotions. This system helps users select travel destinations, guides them to photo spots on the spot, and adjusts and suggests the optimal position and angle for product photography based on emotion data.

[1333] Travel destination suggestions based on travel requests

[1334] 1. Request input and emotion information acquisition:

[1335] The user launches the camera app and selects the "travel destination suggestion" function.

[1336] The device prompts the user to input a request for a place they would like to go (e.g., beach, mountain, city).

[1337] The device acquires emotional information using the user's camera and microphone, and the emotion engine analyzes the user's current emotional state.

[1338] 2. Sending requests and emotional data:

[1339] The terminal transmits the input request information and emotion data to the server.

[1340] 3. Candidate selection based on requests and sentiment data:

[1341] The server receives the request and analyzes the desire and emotion data.

[1342] The server accesses the database and selects multiple candidate travel destinations and scenic spots that match the request.

[1343] The emotion engine uses emotional data to select candidate locations that best suit the user's emotional state.

[1344] 4. Results display:

[1345] The server transmits the selection result to the terminal.

[1346] The device displays detailed information about the travel destination (photos, access methods, reviews, etc.) to the user to assist in creating travel plans.

[1347] Photo spot guidance function after arriving at the location

[1348] 1. Location and emotion information acquisition:

[1349] The user arrives at their travel destination and launches the app.

[1350] The device acquires the user's GPS information and emotional information and sends it to the server.

[1351] 2. Shooting spot selection based on location and emotion data:

[1352] The server receives the GPS information and emotion data and searches the database for nearby photo spots.

[1353] Based on the search results, the server selects the shooting point that best suits the user's emotional state.

[1354] 3. Directional signs:

[1355] The server sends the selected shooting points and route information to the terminal.

[1356] The device will display directions to the photo spot to the user and provide a link to a map app.

[1357] Optimal placement and shooting angle suggestions for object photography

[1358] 1. Acquiring subject information and emotion information:

[1359] The user launches the camera app and selects the "mono photography" function.

[1360] The device prompts the user to input the object to be photographed (e.g., coffee cup, food, plant).

[1361] The terminal acquires the user's emotion information using an emotion engine.

[1362] 2. Shooting arrangement analysis based on emotion data:

[1363] The terminal transmits the photographing subject information and emotion data to the server.

[1364] Based on the information received by the server, the generation AI is used to analyze the optimal placement and shooting angle.

[1365] During the analysis process, the server takes emotional data into consideration to determine the optimal composition for the photo.

[1366] 3. Guide display:

[1367] The server generates placement guides and shooting angle instructions from the analysis results and sends the results to the terminal.

[1368] The device displays guidelines for placement and angle on the screen to the user to assist in taking photos.

[1369] Specific examples

[1370] Examples of travel destination suggestions:

[1371] 1. The user enters into the app, "I want to go to a place where I can enjoy nature," and at the same time, the emotion engine analyzes the emotion as "I want to relax."

[1372] 2. The device sends requests and emotional information to the server.

[1373] 3. The server searches for places where people can enjoy nature and selects "Highland Park," which has a high relaxing effect.

[1374] 4. The selection results are sent to the terminal, and detailed information about "Kogen Park" is displayed to the user.

[1375] Examples of photo spot guides:

[1376] 5. The user arrives at "Kogen Park" and their current location and emotion information is acquired.

[1377] 6. The device sends GPS information and emotion data to the server.

[1378] 7. The server searches for nearby photo spots and selects the "observation deck." Based on the emotional data, it determines that the view from the observation deck will have a relaxing effect.

[1379] 8. Directions to the observation deck will be displayed on the device, and a link to a map app will also be provided.

[1380] Examples of Mono photography:

[1381] 9. The user enters, "I want to take a beautiful photo of my cafe latte," and the emotion engine analyzes it to determine the emotion of "happiness."

[1382] 10. The device sends the information to the server.

[1383] 11. The server uses AI to analyze the optimal placement and angle, recommending placing the photo in the center of the table and taking a photo at a 45-degree angle from the top left. Based on emotional data, the server also considers lighting to create a happy mood.

[1384] 12. A recommended placement guide is displayed on the device, and the user takes the photo following the instructions.

[1385] This allows users to easily take high-quality photos that reflect their own emotions, doubling the enjoyment of their travels and everyday life.

[1386] The processing flow will be explained below.

[1387] Travel destination suggestions based on travel requests

[1388] Step 1:

[1389] The user launches the camera app and selects the "Travel Suggestion" feature. The device prompts the user to enter a destination (e.g., beach, mountain, city) they would like to visit.

[1390] Step 2:

[1391] The device acquires emotional information using the user's camera and microphone, and the emotion engine analyzes the user's current emotional state.

[1392] Step 3:

[1393] The terminal transmits the input request information and emotion data to the server as a request.

[1394] Step 4:

[1395] The server receives the request, analyzes the input desires and emotion data, and accesses the database to select multiple candidate travel destinations and scenic spots that match the desires.

[1396] Step 5:

[1397] The emotion engine uses emotional data to select potential travel destinations that best suit the user's emotional state based on evaluation criteria.

[1398] Step 6:

[1399] The server transmits the selection result to the terminal.

[1400] Step 7:

[1401] The device displays detailed information about the destination (photos, access methods, reviews, etc.) along with emotion-based recommendations, allowing users to select a destination that best suits their emotions.

[1402] Photo spot guidance function after arriving at the location

[1403] Step 1:

[1404] When the user arrives at their travel destination and launches the app, the device acquires the user's GPS information.

[1405] Step 2:

[1406] The device acquires emotional information, and the emotion engine analyzes the user's current emotional state in real time.

[1407] Step 3:

[1408] The device sends GPS information and emotion data to the server.

[1409] Step 4:

[1410] The server receives the GPS information and emotion data and searches the database for nearby photo spots.

[1411] Step 5:

[1412] The server selects the photo spot that best suits the user's emotional state based on the evaluation criteria, based on the search results for nearby photo spots.

[1413] Step 6:

[1414] The server sends the selected shooting points and route information to the terminal.

[1415] Step 7:

[1416] The device displays directions to the photo spot and also provides a link to a map app, allowing users to take photos that are highly satisfying by being guided to the optimal photo spot that matches their emotions.

[1417] Optimal placement and shooting angle suggestions for object photography

[1418] Step 1:

[1419] The user launches the camera app and selects the "Take a Picture" function. The device prompts the user to enter information about the object to be photographed (e.g., coffee cup, food, plant).

[1420] Step 2:

[1421] The terminal uses an emotion engine to acquire the user's emotion information and analyze the current emotional state.

[1422] Step 3:

[1423] The device transmits information about the subject being photographed and emotion data to the server.

[1424] Step 4:

[1425] Based on the subject information and emotion data received by the server, the generative AI analyzes the optimal placement and shooting angle. During the analysis process, the server also takes the emotion data into consideration to determine the optimal shooting composition.

[1426] Step 5:

[1427] The server sends the placement guide and shooting angle instructions generated from the analysis results to the terminal.

[1428] Step 6:

[1429] The device will provide users with on-screen placement and angle guidelines, as well as emotion-based photography advice and tips, making it easier for users to take photos that best suit their emotional state.

[1430] Specific examples

[1431] Examples of travel destination suggestions:

[1432] 1. The user enters into the app, "I want to go somewhere where I can enjoy nature," and the device uses computer vision to analyze the emotion as "I want to relax."

[1433] 2. The device sends this information to the server.

[1434] 3. The server searches for places where you can enjoy nature and selects a "highland park" that has a high relaxing effect.

[1435] 4. The selection results and the reasons why the park has such a relaxing effect are sent to the device, and detailed information about "Kogen Park" is displayed to the user.

[1436] Examples of photo spot guides:

[1437] 5. The user arrives at "Kogen Park" and obtains their current location and real-time emotion information.

[1438] 6. The device sends GPS information and emotion data to the server.

[1439] 7. The server searches for nearby photo spots and selects "Observation Deck." It determines that the view from the observation deck will enhance relaxation.

[1440] 8. Directions to the observation deck will be displayed on the device, and a link to a map app will also be provided.

[1441] Examples of Mono photography:

[1442] 9. The user enters, "I want to take a beautiful photo of my cafe latte," and the device analyzes the emotion of "happiness" using facial expression recognition.

[1443] 10. The device sends the information to the server.

[1444] 11. The server uses AI to analyze the optimal placement and angle, recommending placing the photo in the center of the table and taking a photo at a 45-degree angle from the top left. It also takes into consideration how the light is applied to create a happy mood.

[1445] 12. Along with a placement guide, advice on how to emphasize a happy atmosphere is displayed on the device, and the user follows the instructions to take the photo.

[1446] These processes enable users to easily take high-quality photos that reflect their own emotions, enhancing the enjoyment of travel and everyday life.

[1447] Example 2

[1448] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1449] Conventional camera applications offer travel destination suggestions and photo spot guidance based on user requests, but because they do not take the user's emotional state into account, they are unable to provide suggestions and guidance that are in line with the user's feelings, and as a result, they are unable to sufficiently increase satisfaction. Furthermore, suggestions for camera placement and angles when taking photos are limited to general ones, and they are unable to provide optimal suggestions that reflect the emotions of each individual user. For this reason, there was a need for a service that is easy for users to use and in line with their emotions.

[1450] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1451] In this invention, the server includes means for receiving a user's travel destination request and selecting multiple travel destination candidates based on the request and the user's emotional information, means for displaying detailed information about the selected travel destination to the user, means for acquiring the user's location information and emotional information on the location and suggesting optimal photo spots based on that information, and means for analyzing the optimal position and angle for the object the user is trying to photograph using a generative AI model and presenting the analysis results to the user. This makes it possible to suggest travel destinations and photo spots that take the user's emotional state into consideration, and to provide guidance on photo positions and angles tailored to each individual user.

[1452] "User" means any individual or entity that uses the System.

[1453] "Travel destination requests" are information including places the user wants to visit and desired conditions.

[1454] "Emotional information" is data that indicates the user's current emotional state.

[1455] "Travel destination candidates" are multiple travel destinations suggested based on the user's travel destination requests and emotional information.

[1456] "Detailed information" refers to information such as photos, access methods, and reviews about potential travel destinations.

[1457] "Location information" is data that indicates the user's current location.

[1458] "Photo spots" are ideal locations for users to take photos while traveling.

[1459] A "subject" is an object or scene that the user wishes to photograph.

[1460] "Layout" refers to the position and order of the objects to be photographed.

[1461] "Angle" is a setting that indicates the direction and tilt of the camera when taking a photo.

[1462] A "generative AI model" is an algorithm that uses artificial intelligence technology to analyze data and generate optimal results.

[1463] The "analysis results" are suggestions for optimal placement and angles provided by the generative AI model.

[1464] This invention relates to a camera application system that allows users to take more satisfying photos by combining it with an emotion engine that recognizes the user's emotions. This system helps users select travel destinations, guides them to photography spots on the spot, and adjusts and suggests the optimal position and angle for product photography based on emotion data.

[1465] Travel destination suggestions based on travel requests

[1466] When a user launches the camera app and selects the "travel destination suggestion" function, the device prompts the user to input their desired destination (e.g., beach, mountain, city). The device then uses the user's camera and microphone to obtain emotional information, and the emotion engine analyzes the user's current emotional state. The analysis results and the desired information are sent to a server, which then accesses a database to select candidate destinations and scenic spots that match the user's desired destination. The emotion engine then uses the emotional data to select candidate destinations that best suit the user's emotional state, and sends the selection results to the device. The device then displays detailed information about the destination (photos, access methods, reviews, etc.) to the user, assisting them in creating their travel plans.

[1467] Specific examples

[1468] When a user inputs into the app that they would like to go to a place where they can enjoy nature and smile into the camera, the device sends their request and emotional information to the server. The server analyzes the information, selects a "highland park" with a high relaxation effect, and displays detailed information about it on the device.

[1469] Photo spot guidance function after arriving at the location

[1470] When a user arrives at their travel destination and launches the app, the device acquires the user's GPS information and emotional information and sends them to the server. The server receives the GPS information and emotional data and searches a database for nearby photo spots. It then selects the optimal photo spot based on the user's emotional state and sends the results to the device. The device then displays directions to the photo spot and provides a link to the map app.

[1471] Specific examples

[1472] When a user arrives at "Kogen Park" and starts the app with a smile, the device sends GPS information and emotional data to the server. The server searches for nearby photo spots, selects an "observation deck" with a relaxing effect in mind, and displays the information on the device.

[1473] Optimal placement and shooting angle suggestions for object photography

[1474] When a user launches the camera app and selects the "Taking a Photo of an Object" function, the device prompts them to input the object to be photographed (e.g., coffee cup, food, plant) and uses an emotion engine to obtain the user's emotional information. The device then sends the information about the object and the emotional data to the server, which then uses a generative AI model to analyze the optimal placement and shooting angle. The analysis results are sent to the device as the optimal composition based on the emotional data, and the device then presents guidelines for placement and angle to the user.

[1475] Specific examples

[1476] When a user inputs "I want to take a beautiful photo of my cafe latte," and the emotion engine analyzes the emotion as "happiness," the device sends the information to the server. The server uses a generative AI model to analyze the optimal placement and angle, recommending "place it in the center of the table and take the photo at a 45-degree angle from the top left." A placement guide is displayed to the user, who then follows the instructions to take the photo.

[1477] This allows users to easily take high-quality photos that reflect their own emotions, increasing the enjoyment of their travels and everyday life.

[1478] Prompt Sentence Examples

[1479] 1. "I want to go to a place where I can enjoy nature."

[1480] 2. "I want to take beautiful photos of cafe lattes."

[1481] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1482] Travel destination suggestions based on travel requests

[1483] Step 1:

[1484] User: Launches the camera app and selects the "Travel Destination Suggestion" function. Enters a request such as "I want to go to the beach."

[1485] Step 2:

[1486] Device: Obtains user input and emotional information in real time using a camera and microphone. The emotion engine analyzes the user's current emotional state and gives a result such as "I want to have fun."

[1487] Step 3:

[1488] Terminal: Sends the request information and the emotion data as the analysis result to the server. The request information and emotion data are included as input.

[1489] Step 4:

[1490] Server: Receives the request information and emotion data, accesses the database, and searches for travel destinations and scenic spots that match the request. In this case, multiple beach-related travel destinations are selected as candidates.

[1491] Step 5:

[1492] Server: Based on the emotional data, the server selects the candidate location that best suits the user's emotional state. Specifically, the server selects a beach in Hawaii, taking into account the emotion of "wanting to have fun."

[1493] Step 6:

[1494] Server: Sends the selection results to the device. The output includes detailed travel destination information (e.g., photos of Hawaiian beaches, how to get there, reviews, etc.).

[1495] Step 7:

[1496] Terminal: Displays the travel destination information received from the server to the user.

[1497] Photo spot guidance function after arriving at the location

[1498] Step 1:

[1499] User: Arrives at travel destination and launches the app.

[1500] Step 2:

[1501] Device: Obtains the user's GPS information and emotional information. Determines "relaxed" as the emotional data.

[1502] Step 3:

[1503] Terminal: Sends GPS information and emotion data to the server. Location information and emotion data are included as input.

[1504] Step 4:

[1505] Server: Receives GPS information and emotion data, searches for nearby photo spots from a database, and extracts the best photo spots related to the location based on the input.

[1506] Step 5:

[1507] Server: Considering the emotional data, select the optimal shooting point for the user's state. Select the "observation deck" considering its relaxing effect.

[1508] Step 6:

[1509] Server: Sends the selected photo points and their route information to the terminal. The output includes route information and photo point details.

[1510] Step 7:

[1511] On the device: Displays GPS and route information to the user and provides a link to a map app.

[1512] Optimal placement and shooting angle suggestions for object photography

[1513] Step 1:

[1514] User: Launch the camera app, select the "Object Shooting" function, and enter "Cafe Latte" as the subject to be photographed.

[1515] Step 2:

[1516] Device: Acquires information about the subject being photographed and uses the emotion engine to acquire the user's emotional information. Identifies "happiness" as the emotional data.

[1517] Step 3:

[1518] Terminal: Sends the photographed object information and emotion data to the server. The input includes the object information and emotion data.

[1519] Step 4:

[1520] Server: Receives information about the subject and emotion data, and uses a generative AI model to analyze the optimal placement and shooting angle. Specifically, it recommends placing the subject in the center of the table and taking a photo at a 45-degree angle from the top left.

[1521] Step 5:

[1522] Server: Generates placement guides and shooting angle instructions and sends the results to the device. The output includes specific placement methods and angle instructions.

[1523] Step 6:

[1524] Terminal: The placement guide from the server is displayed to the user, and the user takes the photo according to the instructions.

[1525] By clarifying the inputs and outputs at each step, the operation of the entire system can be understood concretely and comprehensively.

[1526] (Application example 2)

[1527] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1528] Today's consumers are seeking a higher level of satisfaction from their shopping experiences. In particular, in brick-and-mortar stores, they are seeking product suggestions tailored to their emotions and desires, as well as optimal photography environments. However, current shopping support systems lack the functionality to suggest products that take the user's emotional state into account, making them inefficient. Furthermore, they lack sufficient advice on optimal product placement and photography techniques, making it necessary to improve the system to increase consumer satisfaction. To solve this problem, it is important to utilize users' emotional data and location information to provide a more personalized shopping experience.

[1529] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for receiving a travel destination request input by a user and selecting multiple travel destination candidates based on the request; means for displaying information about the selected travel destination to the user; means for acquiring the user's location information on the site and suggesting optimal photography points based on the location information; means for analyzing the optimal placement and angle of an object the user intends to photograph using a generation AI and presenting the analysis results to the user; and means for analyzing the user's emotional state, proposing optimal products based on the emotional data, and suggesting where to place the products and how to photograph them. This allows the user to receive personalized product suggestions based on their emotional state and also provides an optimal photography environment, thereby improving satisfaction with the overall shopping experience.

[1530] 1. "Travel destination candidates" are multiple travel destination options selected by the system based on the requests entered by the user.

[1531] 2. "Location Information" means data about a User's current location when in that location, obtained through GPS or other location measurement technologies.

[1532] 3. "Photo spots" are suitable locations for users to take photos, and are presented by the system based on location information and emotion data.

[1533] 4. "Subject" refers to the object, scenery, or other subject that the user wishes to photograph.

[1534] 5. "Arrangement" refers to the position or arrangement of objects to best present them.

[1535] 6. "Angle" tells the camera which direction to take the picture from when shooting.

[1536] 7. "Generative AI" refers to artificial intelligence that analyzes and suggests optimal travel destinations, photo spots, and the placement and angle of objects based on a user's emotional data and location information.

[1537] 8. “Emotional State” means data that indicates the user’s current psychological and emotional state, and is obtained through sensors such as cameras and microphones.

[1538] 9. "Products" refers to the items offered to Users for purchase in the physical store.

[1539] 10. "Route information" refers to directions and guidance information for users to reach the optimal photo spot.

[1540] The present invention provides a system that allows users to have an optimal shopping experience in a physical store by combining an emotion engine that recognizes user emotions. Specific embodiments will be described below.

[1541] System configuration

[1542] 1. Hardware and Software Configuration

[1543] Server: It has a database and generative AI model, analyzes emotional data and location information, and makes optimal suggestions. The server works in conjunction with the emotional data analysis engine.

[1544] Device: The user's smartphone or tablet is used to acquire emotion data, acquire location information, and display suggestions. Smartphones are equipped with a camera, GPS, and microphone.

[1545] Emotion engine: Analyzes the emotional data sent by the user to the device and determines the user's current emotional state.

[1546] Program processing overview

[1547] 1. Obtaining user emotion data

[1548] When a user launches the shopping support app in a physical store, the app uses the device's camera and microphone to collect the user's emotional data.

[1549] An emotion engine analyzes this data to determine the user's current emotional state.

[1550] 2. Obtaining location information

[1551] When a user is in a physical store, their current location is obtained using the device's GPS or beacon.

[1552] This allows the system to determine which area of ​​the store the user is in.

[1553] 3. Proposal Processing

[1554] Emotion data and location information are sent to the server.

[1555] The server's generative AI model analyzes this information and calculates product suggestions, product placement locations, and photography methods that are best suited to the user's emotional state.

[1556] An example of a generated prompt: "The user's emotional data indicates that they are feeling stressed. The user's location is the food court on the first floor of a shopping center. Suggest products that are ideal for reducing stress."

[1557] 4. Display of proposal results

[1558] The server sends the proposal to the terminal.

[1559] The device displays the received suggestions to the user and also provides guidance on the best angle and placement for photographing the product.

[1560] Specific examples

[1561] For example, if a user is in a shopping center and the emotion engine detects that they are feeling stressed, the system will acquire the user's location information and suggest relaxation products and locations (e.g., massage chairs or aroma oil corners) that are effective in reducing stress. These suggestions will be displayed on the device, and the user will be guided to the product and the best way to take a photo (e.g., "take a photo from a 45-degree angle starting from the top left").

[1562] By using a generative AI model, it is possible to make detailed suggestions based on the user's individual emotional state, which is expected to improve the shopping experience.

[1563] As described above, the system of the present invention can utilize emotional data and location information to provide users with personalized shopping suggestions, allowing them to have a comfortable and satisfying shopping experience that is tailored to their emotions.

[1564] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1565] Step 1:

[1566] A user launches a shopping support app in a physical store. The device starts collecting emotion data through the app. As input, the smartphone's camera and microphone are used to capture the user's facial expressions and tone of voice, and the data is sent to the emotion engine. The emotion engine analyzes this input data and outputs the user's current emotional state (e.g., stress, joy, excitement, etc.).

[1567] Step 2:

[1568] The device also obtains the user's current location information. As input, it collects location data from the smartphone's GPS and beacons. This location data is used to determine which area the user is in and provides current location information as output.

[1569] Step 3:

[1570] The device sends the acquired emotional data and location information to the server. The server receives this data and prepares to generate suggestions based on the emotional data and location information. The emotional data and location data are passed to the server as input. The server processes and analyzes this data using a generative AI model.

[1571] Step 4:

[1572] The server then proposes optimal products based on the emotional data. Specifically, the server's generative AI model analyzes the emotional data and selects the products (e.g., massage equipment or relaxation items to relieve stress) that best suit the user's current emotional state. The input is the emotional data, and the output is a list of suggested products.

[1573] Step 5:

[1574] The server then suggests where to place these products and how to photograph them based on the location information. Specifically, the generative AI model uses the location data to suggest the best place to place products around the user's current location and how to photograph them beautifully. The input is location information, and the output is where to place the products and the best way to photograph them. An example of a generated prompt: "We obtained emotional data that the user is 'feeling stressed.' The location information is the food court on the first floor of a shopping center. We suggest products that are ideal for reducing stress."

[1575] Step 6:

[1576] The server sends the recommendation results to the device. The device displays the received recommendation to the user. Specifically, the device visually presents the product list, placement locations, and optimal photography methods to the user. The system receives the recommendation results from the server as input and displays this information on the user's smartphone screen as output. The user can then find the recommended products and photograph them in the instructed way.

[1577] The detailed description of each processing step allows the system of the present invention to provide an optimal shopping experience, taking into account the user's emotional state and current location.

[1578] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1579] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1580] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1581] [Fourth embodiment]

[1582] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1583] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1584] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1585] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1586] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1587] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1588] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1589] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1590] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1591] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1592] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1593] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1594] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1595] This invention relates to a camera application system that allows users to easily take photos that look "good." How each function is implemented will be described below in detail.

[1596] Travel destination suggestions based on travel requests

[1597] 1. Input and submit your request:

[1598] The user launches the camera app and selects the "travel destination suggestion" function.

[1599] The device prompts the user to input a request for a place they would like to go (e.g., beach, mountain, city).

[1600] The terminal transmits the input request to the server as a request.

[1601] 2. Request analysis and candidate selection:

[1602] The server receives the request and analyzes the input request.

[1603] The server accesses the database and selects multiple candidate travel destinations and scenic spots that match the request.

[1604] The server selects the most suitable travel destination from the candidates based on the evaluation criteria.

[1605] 3. Results display:

[1606] The server transmits the selection result to the terminal.

[1607] The device displays detailed information about the travel destination (photos, access methods, reviews, etc.) to the user to assist in creating travel plans.

[1608] Photo spot guidance function after arriving at the location

[1609] 1. Location acquisition and transmission:

[1610] The user arrives at their travel destination and launches the app.

[1611] The device acquires the user's GPS information and sends it to the server.

[1612] 2. Search and select a shooting spot:

[1613] The server receives the GPS information and searches the database for nearby photography points.

[1614] The server selects the most suitable shooting point from the searched points based on the evaluation criteria.

[1615] 3. Directional signs:

[1616] The server sends the selected shooting points and route information to the terminal.

[1617] The device will display directions to the photo spot to the user and provide a link to a map app.

[1618] Optimal placement and shooting angle suggestions for object photography

[1619] 1. Enter and submit information about the subject:

[1620] The user launches the camera app and selects the "mono photography" function.

[1621] The device prompts the user to input the object to be photographed (e.g., coffee cup, food, plant).

[1622] The terminal transmits the photographing target information to the server.

[1623] 2. Shooting arrangement analysis:

[1624] Based on the information received by the server, the generation AI is used to analyze the optimal placement and shooting angle.

[1625] During the analysis process, the server utilizes photographic data and feedback from similar objects stored in a database.

[1626] 3. Guide display:

[1627] The server generates placement guides and shooting angle instructions from the analysis results and sends the results to the terminal.

[1628] The device displays guidelines for placement and angle on the screen to the user to assist in taking photos.

[1629] Specific examples

[1630] Examples of travel destination suggestions:

[1631] 1. The user enters into the app, "I want to go to a place where I can enjoy nature."

[1632] 2. The device sends a request to the server.

[1633] 3. The server searches for places where people can enjoy nature and selects "Highland Park."

[1634] 4. The selection results are sent to the terminal, and detailed information about "Kogen Park" is displayed to the user.

[1635] Examples of photo spot guides:

[1636] 5. The user arrives at "Takahara Park" and obtains their current location.

[1637] 6. The device sends GPS information to the server.

[1638] 7. The server searches for nearby photo spots and selects an "observation deck."

[1639] 8. Directions to the observation deck will be displayed on the device, and a link to a map app will also be provided.

[1640] Examples of Mono photography:

[1641] 9. The user enters, "I want to take beautiful photos of cafe lattes."

[1642] 10. The device sends the information to the server.

[1643] 11. The server uses generated AI to analyze the optimal placement and angle, and recommends placing the camera in the center of the table and taking a photo at a 45-degree angle from the top left.

[1644] 12. A recommended placement guide is displayed on the device, and the user takes the photo following the instructions.

[1645] These processes allow users to easily take "eye-catching" photos and enhance the enjoyment of their trip.

[1646] The processing flow will be explained below.

[1647] Travel destination suggestions based on travel requests

[1648] Step 1:

[1649] The user launches the camera app and selects the "Travel Suggestion" feature. The device prompts the user to enter a destination (e.g., beach, mountain, city) they would like to visit.

[1650] Step 2:

[1651] The terminal transmits the input request to the server as a request.

[1652] Step 3:

[1653] The server receives the request, analyzes the input requirements, and accesses a database to select multiple candidate travel destinations and scenic spots that match the requirements.

[1654] Step 4:

[1655] The server selects the most suitable travel destination from the candidates based on the evaluation criteria.

[1656] Step 5:

[1657] The server transmits the selection result to the terminal.

[1658] Step 6:

[1659] The device displays detailed information about the travel destination (photos, access methods, reviews, etc.) to the user to assist in creating travel plans.

[1660] Photo spot guidance function after arriving at the location

[1661] Step 1:

[1662] When the user arrives at their travel destination and launches the app, the device acquires the user's GPS information.

[1663] Step 2:

[1664] The device sends GPS information to the server.

[1665] Step 3:

[1666] The server receives the GPS information and searches the database for nearby photography points.

[1667] Step 4:

[1668] Based on the search results, the server selects the optimal shooting point according to the evaluation criteria.

[1669] Step 5:

[1670] The server sends the selected shooting points and route information to the terminal.

[1671] Step 6:

[1672] The device will display directions to the photo spot to the user and provide a link to a map app.

[1673] Optimal placement and shooting angle suggestions for object photography

[1674] Step 1:

[1675] The user launches the camera app and selects the "Take a Picture" function. The device prompts the user to input the object to be photographed (e.g., coffee cup, food, plant).

[1676] Step 2:

[1677] The terminal transmits the photographing target information to the server.

[1678] Step 3:

[1679] Based on the information received, the server uses generative AI to analyze the optimal placement and shooting angle. During the analysis process, the server utilizes photography data and feedback from similar objects stored in a database.

[1680] Step 4:

[1681] The server generates placement guides and shooting angle instructions from the analysis results and sends the results to the terminal.

[1682] Step 5:

[1683] The device displays guidelines for placement and angle on the screen to the user to assist in taking photos.

[1684] Example 1

[1685] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1686] With conventional camera applications, users had to spend time selecting the travel destination and photo spot they wanted to take photos at, and it was difficult to find the optimal position and angle when taking the photo. As a result, there was insufficient support for taking "eye-catching" photos easily, and user satisfaction was low. In addition, there was insufficient information gathering and guidance on local photo spots, making it difficult to enjoy taking photos at the destination more efficiently.

[1687] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1688] In this invention, the server includes: means for receiving a user's travel destination request and using a natural language processing engine to analyze the request; means for selecting multiple travel destination candidates from a database based on the analyzed request and selecting the optimal travel destination based on evaluation criteria; means for displaying information about the selected travel destination to the user; means for acquiring the user's location information on the site using a GPS sensor, searching the database for optimal photo spots based on the location information, and selecting the optimal photo spot based on evaluation criteria; and means for having the user input information about the object they wish to photograph, using a generative AI model to analyze the optimal placement and angle based on that information using prompt sentences, and presenting the analysis results to the user. This allows users to efficiently select travel destinations and photo spots and easily take "eye-catching" photos with the optimal placement and angle. Furthermore, by collecting information and providing guidance on local photo spots, users can enjoy taking photos at their destinations even more.

[1689] A "user" is an individual who uses the camera application to receive suggestions for travel destinations, guidance on photography spots, and suggestions for placement and angles for taking photographs of objects.

[1690] "Requests" refers to the travel destination and photography requests entered by the User through the Application.

[1691] A "natural language processing engine" refers to software technology that analyzes requests entered by users and understands and processes their meaning.

[1692] A "database" is a collection of information that stores information on potential travel destinations and photo spots, and is managed in a form that can be accessed by a server.

[1693] "Evaluation criteria" refers to the rules and parameters that serve as the basis for selecting the travel destination or photo spot that best suits the user's needs.

[1694] A "GPS sensor" is a location information acquisition device that identifies the user's current location.

[1695] "Generative AI model" refers to artificial intelligence technology used to suggest optimal placement and shooting angles for the subject a user is trying to photograph.

[1696] A "prompt sentence" refers to an input sentence used to provide context or a question to a generative AI model.

[1697] "Analysis results" refers to the optimal placement and shooting angle suggestions output by the generative AI model based on user input.

[1698] "Travel destination candidates" refers to multiple travel destination candidates selected from a database based on the user's requests.

[1699] "Photo Spot" refers to a location recommended for users to take photos on-site.

[1700] "Route information" refers to the route and access method for a user to reach a specific photo spot.

[1701] "Placement guide" refers to instruction information regarding the placement of objects that a user should refer to when taking a photograph.

[1702] "Angle guide" refers to instruction information regarding the camera angle that a user should refer to when taking a photo.

[1703] This invention relates to a camera application system that allows users to easily take photos that look "good." How each function is implemented will be described below in detail.

[1704] Travel destination suggestions based on travel requests

[1705] The user launches the camera app and selects the "travel destination suggestion" function. The user inputs their desired destination (e.g., beach, mountain, city). The device sends the inputted request in a data format such as JSON to the server as an HTTP POST request. The server analyzes the received request using a natural language processing engine (e.g., ANT NLP) and accesses a travel destination database (e.g., SQL, MongoDB) to search for potential travel destinations that match the user's request. It then selects the most suitable travel destination based on evaluation criteria. The server sends the selected travel destination information to the device, and the device displays detailed information about the destination (e.g., photos, access instructions, reviews, etc.) to the user.

[1706] Specific examples

[1707] The user enters into the app, "I want to go to a place where I can enjoy nature." The device sends the request to the server. The server searches for places where people can enjoy nature and selects "Highland Park." The server sends the selection results to the device, and the device displays detailed information about "Highland Park" to the user.

[1708] Photo spot guidance function after arriving at the location

[1709] The user arrives at their travel destination and launches the camera app. The device acquires the user's current location using the GPS sensor and sends the GPS data to the server. The server identifies the user's current location based on the received GPS data and uses a GPS data analysis tool (e.g., Geopy) to search for nearby photo spots from a database containing information on photo spots. The server scores the searched photo spots based on evaluation criteria and selects the most suitable photo spot. The server sends the selected photo spot and its route information to the device, which displays it on the user interface and provides a link to a map app (e.g., Google Maps).

[1710] Specific examples

[1711] The user arrives at "Kogen Park" and obtains their current location. The device sends GPS information to the server. The server searches for nearby photo spots and selects the "observation deck." The server sends directions to the "observation deck" to the device, which displays them on the user interface and also provides a link to the map app.

[1712] Optimal placement and shooting angle suggestions for object photography

[1713] The user launches the camera app and selects the "Taking a Photo of an Object" function. The user inputs the object to be photographed (e.g., coffee cup, food, plant). The device sends the input information about the object to be photographed in data format such as JSON to the server. The server uses a generative AI model (e.g., OpenAI's GPT-4) based on the received information to analyze the optimal placement and shooting angle using prompt text. During the analysis process, the server utilizes photography data and feedback of similar objects stored in a database. The server generates placement guides and shooting angle instructions from the analysis results and sends them to the device. The device displays these on a user interface, providing the user with specific placement and angle guidelines.

[1714] Specific examples

[1715] The user inputs, "I want to take a beautiful photo of my cafe latte." The device sends this information to the server. The server uses generative AI to analyze the optimal placement and angle, and recommends "Place it in the center of the table and take the photo at a 45-degree angle from the top left." The server sends the recommended placement guide to the device, which displays it on the user interface. The user follows the instructions to take the photo.

[1716] These functions allow users to easily take eye-catching photos, enhancing the enjoyment of their trip.

[1717] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1718] Travel destination suggestions based on travel requests

[1719] Step 1: Enter and submit your request

[1720] A user launches a camera app and selects the travel destination suggestion feature. Next, the user enters a destination preference (e.g., beach, mountain, city). The input data is passed to the device, which converts the input data into JSON format and sends it to the server as an HTTP POST request. Here, the input is the user preference and the output is the request to the server.

[1721] Step 2: Request analysis and candidate selection

[1722] The server analyzes the received request using a natural language processing engine. Based on the analysis results, the server sends an SQL query to a travel destination database to search for candidate locations that match the request. This database search takes the request analysis results as input and generates a list of candidate locations as output. The server then scores the list of candidate locations based on evaluation criteria and selects the best candidate location. This selection process generates a list of candidate locations as input and the best candidate as output.

[1723] Step 3: View the results

[1724] The server sends the selection results in JSON format to the device. This selection result includes detailed information about the best travel destinations (photos, access instructions, reviews, etc.). The device receives this data and displays it in a user interface. The input here is the selection result, and the output is the display on the device screen.

[1725] Photo spot guidance function after arriving at the location

[1726] Step 1: Obtaining and sending location information

[1727] When a user arrives at their travel destination and launches the camera app, the device uses the GPS sensor to obtain the user's current location and sends the GPS data to the server as an HTTP POST request. Here, the input is the GPS data and the output is the request to the server.

[1728] Step 2: Search and select a shooting location

[1729] The server identifies the location information based on the received GPS data. Next, the server accesses a database that stores information on photography points and searches for nearby photography points based on the current location. In this process, a GPS data analysis tool is used, with the GPS data as input and the photography point list as output. The server then scores the photography point list based on evaluation criteria and selects the optimal photography point. The input for this scoring is the photography point list and the output is the optimal photography point.

[1730] Step 3: Guidance

[1731] The server sends the selected photo spot information (latitude and longitude, details, route guidance) to the device. The device receives this information, displays it on the user interface, and provides a link to the map app. The input here is the selection result, and the output is the device screen display and link.

[1732] Optimal placement and shooting angle suggestions for object photography

[1733] Step 1: Enter and submit information about the subject

[1734] The user launches the camera app and selects the "Take a Picture" function. The user inputs the object to be photographed (e.g., coffee cup, food, plant). The input data is passed to the device, which converts it into JSON format and sends it to the server. Here, the input is the object information, and the output is the request to the server.

[1735] Step 2: Shooting arrangement analysis

[1736] The server uses the received information to analyze the placement and shooting angle using a generative AI model. During this process, a prompt is generated and sent to the AI ​​model. The analysis uses user input data and database-based shooting data, with object information and prompts as input and the analysis results as output.

[1737] Step 3: Guide display

[1738] The server sends the analysis results in JSON format to the terminal. The terminal receives this data and displays placement guides and angle guides in the user interface. Here, the input is the analysis results and the output is the terminal screen display.

[1739] These processing steps allow the user to efficiently select travel destinations and photography spots, and take photos that "look great" with the optimal positioning and angle.

[1740] (Application example 1)

[1741] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1742] With conventional camera applications, users often have difficulty finding the best photo spot when traveling or in a store, or determining the optimal position and angle of the subject they want to photograph. Furthermore, there is a lack of efficient guidance, particularly when it comes to guiding users to Instagrammable spots within a store, resulting in poor user convenience. To solve these problems, there was a need for a way for users to easily find the best photo spot and method.

[1743] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1744] In this invention, the server includes means for receiving a user's request regarding a travel destination and selecting multiple travel destination candidates based on the request, means for displaying information about the selected travel destination to the user, means for acquiring the user's location information on the site and presenting optimal photo spots based on the location information, means for analyzing the optimal position and angle for the object the user is trying to photograph using a generation AI and presenting the analysis results to the user, and means for acquiring the user's location information within a store and presenting optimal Instagrammable spots. This enables users to efficiently find optimal photo spots and methods and take high-quality photos.

[1745] The "travel destination candidate selection means" is a function that receives requests regarding travel destinations input by the user and selects multiple travel destination candidates from a database based on those requests.

[1746] The "travel destination information display means" is a function that visually displays detailed information about the selected travel destination to the user.

[1747] "Location information acquisition means" is a function that acquires the user's current location information using location information services such as GPS.

[1748] The "photography point presentation means" is a function that presents the user with the best photography points in the vicinity based on the acquired position information.

[1749] The "generative AI analysis means" is a function that uses generative AI to analyze the optimal position and angle for the subject the user is trying to photograph and presents the results to the user.

[1750] The "Instagrammable spot suggestion method" is a function that suggests the most suitable Instagrammable spots to users based on their location information within the store.

[1751] This invention provides a camera application system that allows users to easily take photos that look "good." The following describes how each function is implemented in detail.

[1752] Travel destination suggestions based on travel requests

[1753] 1. Input and submit your request:

[1754] The user launches the camera app and selects the "Travel Destination Suggestion" function.

[1755] The terminal allows the user to input a request for a place they would like to go (e.g., beach, mountain, city).

[1756] The terminal transmits the input request to the server as a request.

[1757] 2. Request analysis and candidate selection:

[1758] The server receives the request and analyzes the input request.

[1759] The server accesses the database and selects multiple candidate travel destinations and scenic spots that match the request.

[1760] The server selects the most suitable travel destination from the candidates based on the evaluation criteria.

[1761] 3. Results display:

[1762] The server transmits the selection result to the terminal.

[1763] The device displays detailed information about the travel destination (photos, access methods, reviews, etc.) to the user to assist in creating travel plans.

[1764] Photo spot guidance function after arriving at the location

[1765] 1. Location acquisition and transmission:

[1766] The user arrives at their travel destination and launches the app.

[1767] The device acquires the user's GPS information and sends it to the server.

[1768] 2. Search and select a shooting spot:

[1769] The server receives the GPS information and searches the database for nearby photography points.

[1770] The server selects the most suitable shooting point from the searched points based on the evaluation criteria.

[1771] 3. Directional signs:

[1772] The server transmits the selected photographing points and their route information to the terminal.

[1773] The device will display directions to the photo spot to the user and provide a link to a map app.

[1774] Optimal placement and shooting angle suggestions for object photography

[1775] 1. Enter and submit information about the subject:

[1776] The user launches the camera app and selects the "mono photography" function.

[1777] The device prompts the user to input the object to be photographed (e.g., coffee cup, food, plant).

[1778] The terminal transmits the photographing target information to the server.

[1779] 2. Shooting arrangement analysis:

[1780] Based on the information received, the server uses generative AI to analyze the optimal placement and shooting angle.

[1781] During the analysis process, the server utilizes photographic data and feedback from similar objects stored in a database.

[1782] 3. Guide display:

[1783] The server generates placement guides and shooting angle instructions from the analysis results and sends the results to the terminal.

[1784] The device displays guidelines for placement and angle on the screen to assist the user in taking photos.

[1785] Guide to Instagrammable spots within the store

[1786] 1. Location acquisition and transmission:

[1787] The user enters the store and launches the app.

[1788] The terminal acquires the user's current location information and transmits it to the server.

[1789] 2. Search and display Instagrammable spots:

[1790] The server receives the current location information and searches the store database for the best Instagrammable spots.

[1791] The server selects the most suitable spot from the searched spots based on the evaluation criteria.

[1792] 3. Spot guide signs:

[1793] The server sends the selected spot and its route information to the terminal.

[1794] The device will display directions to the spot to the user and provide a link to a map app.

[1795] With these features, users can efficiently find the best photo spots and methods when traveling or in stores, and take high-quality photos.

[1796] Specific examples

[1797] Examples of travel destination suggestions:

[1798] 1. The user enters into the app, "I want to go to a place where I can enjoy nature."

[1799] 2. The device sends a request to the server.

[1800] 3. The server searches for places where people can enjoy nature and selects "Highland Park."

[1801] 4. The selection results are sent to the terminal, and detailed information about "Kogen Park" is displayed to the user.

[1802] Examples of photo spot guides:

[1803] 1. The user arrives at "Takahara Park" and obtains their current location.

[1804] 2. The device sends GPS information to the server.

[1805] 3. The server searches for nearby photo spots and selects an "observation deck."

[1806] 4. Directions to the observation deck will be displayed on the device, and a link to a map app will also be provided.

[1807] Examples of Mono photography:

[1808] 1. The user enters, "I want to take beautiful photos of cafe lattes."

[1809] 2. The device sends the information to the server.

[1810] 3. The server uses generated AI to analyze the optimal placement and angle, and recommends placing the camera in the center of the table and taking a photo at a 45-degree angle from the top left.

[1811] 4. A recommended placement guide is displayed on the device, and the user takes the photo following the instructions.

[1812] Examples of in-store Instagrammable spots:

[1813] 1. The user enters the store and launches the app.

[1814] 2. The device sends location information to the server.

[1815] 3. The server searches for the best Instagrammable spots and selects the "Photogenic Corner."

[1816] 4. Directions to the "Photogenic Corner" will be displayed on the device, and a link to a map app will also be provided.

[1817] Example prompt sentence:

[1818] "Use the camera app to capture a beautiful image of a coffee latte. Optimize the arrangement and angle for the best shot."

[1819] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1820] Step 1:

[1821] The user launches the camera app and selects the "Travel Destination Suggestion" function. The user inputs a request about the place they want to go (e.g., beach, mountain, city). The device sends this request to the server as a request. As input, there is the user's travel destination request, and as output, the request data is sent to the server.

[1822] Step 2:

[1823] The server analyzes the received request data and determines the user's needs. Based on the analysis results, the server accesses the database and selects multiple travel destination candidates that match the needs. The server receives the user's request data as input, searches the travel destination data in the database, and outputs matching candidates.

[1824] Step 3:

[1825] The server selects the most suitable travel destination based on the evaluation criteria and sends the results along with detailed information (photos, access methods, reviews, etc.) to the device. The evaluation criteria and potential travel destinations are required as input, and data containing detailed information about the travel destinations is sent to the device as output.

[1826] Step 4:

[1827] The terminal displays detailed information about travel destinations received from the server to the user. The user creates a travel plan based on the displayed information. The detailed information from the server is input, and the information is presented visually to the user as output.

[1828] Step 5:

[1829] When the user arrives at their travel destination and launches the app again, the device acquires the user's GPS information and sends it to the server. The input is the GPS information acquired by the device, and the output is the location data sent to the server.

[1830] Step 6:

[1831] The server searches the database for nearby photography spots based on the received location information. The optimal photography spot is selected from the search results based on evaluation criteria. The server receives location data and photography spot data for the search as input, and obtains the optimal photography spot data as output.

[1832] Step 7:

[1833] The server sends the selected shooting points and their route information to the terminal. The server's selection data and route information are required as input, and the route information is sent to the terminal as output.

[1834] Step 8:

[1835] The device displays directions to the photo spot to the user and provides a link to a map app. The user follows the directions to move to the optimal photo spot. The input is the guidance information displayed on the device, and the output is the guidance information visualized for the user.

[1836] Step 9:

[1837] The user inputs the object to be photographed (e.g., coffee cup, food, plant) and selects the "Take a Picture" function. The device sends this information to the server. The input is the object data entered by the user, and the output is the data sent to the server.

[1838] Step 10:

[1839] Based on the received information, the server uses a generative AI model to analyze the optimal placement and shooting angle. This analysis utilizes the photography data and feedback of similar objects stored in a database. The received data and the contents of the database are input, and the analysis results are generated as output.

[1840] Step 11:

[1841] The server generates placement guides and shooting angle instructions from the analysis results and sends them to the terminal. The server's analysis results are input, and guide information is sent to the terminal as output.

[1842] Step 12:

[1843] The device displays guidelines for placement and angle on the screen to assist the user in taking photos. The user takes photos according to the guidelines. The input is guide information displayed on the device, and the output is a visual display to the user.

[1844] Step 13:

[1845] When a user enters a store, the app automatically launches to guide them to Instagrammable spots. The device acquires the user's current location information and sends it to the server. The device's location information is input, and data sent to the server is output.

[1846] Step 14:

[1847] The server accesses the store's database of Instagrammable spots and searches for the best spot based on the user's location information. The best spot is selected based on the evaluation criteria. Store data and location information are input, and spot information is generated as output.

[1848] Step 15:

[1849] The server sends the selection result and route information to the terminal. The input is the selection data and route information stored in the server, and the output is data sent to the terminal.

[1850] Step 16:

[1851] The device displays directions to Instagrammable spots and provides a link to a map app. The user follows the directions and takes photos at the best spots. The input is the device's display data, and the output is a visual presentation to the user.

[1852] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1853] This invention relates to a camera application system that allows users to take more satisfying and "eye-catching" photos by combining an emotion engine that recognizes the user's emotions. This system helps users select travel destinations, guides them to photo spots on the spot, and adjusts and suggests the optimal position and angle for product photography based on emotion data.

[1854] Travel destination suggestions based on travel requests

[1855] 1. Request input and emotion information acquisition:

[1856] The user launches the camera app and selects the "travel destination suggestion" function.

[1857] The device prompts the user to input a request for a place they would like to go (e.g., beach, mountain, city).

[1858] The device acquires emotional information using the user's camera and microphone, and the emotion engine analyzes the user's current emotional state.

[1859] 2. Sending requests and emotional data:

[1860] The terminal transmits the input request information and emotion data to the server.

[1861] 3. Candidate selection based on requests and sentiment data:

[1862] The server receives the request and analyzes the desire and emotion data.

[1863] The server accesses the database and selects multiple candidate travel destinations and scenic spots that match the request.

[1864] The emotion engine uses emotional data to select candidate locations that best suit the user's emotional state.

[1865] 4. Results display:

[1866] The server transmits the selection result to the terminal.

[1867] The device displays detailed information about the travel destination (photos, access methods, reviews, etc.) to the user to assist in creating travel plans.

[1868] Photo spot guidance function after arriving at the location

[1869] 1. Location and emotion information acquisition:

[1870] The user arrives at their travel destination and launches the app.

[1871] The device acquires the user's GPS information and emotional information and sends it to the server.

[1872] 2. Shooting spot selection based on location and emotion data:

[1873] The server receives the GPS information and emotion data and searches the database for nearby photo spots.

[1874] Based on the search results, the server selects the shooting point that best suits the user's emotional state.

[1875] 3. Directional signs:

[1876] The server sends the selected shooting points and route information to the terminal.

[1877] The device will display directions to the photo spot to the user and provide a link to a map app.

[1878] Optimal placement and shooting angle suggestions for object photography

[1879] 1. Acquiring subject information and emotion information:

[1880] The user launches the camera app and selects the "mono photography" function.

[1881] The device prompts the user to input the object to be photographed (e.g., coffee cup, food, plant).

[1882] The terminal acquires the user's emotion information using an emotion engine.

[1883] 2. Shooting arrangement analysis based on emotion data:

[1884] The terminal transmits the photographing subject information and emotion data to the server.

[1885] Based on the information received by the server, the generation AI is used to analyze the optimal placement and shooting angle.

[1886] During the analysis process, the server takes emotional data into consideration to determine the optimal composition for the photo.

[1887] 3. Guide display:

[1888] The server generates placement guides and shooting angle instructions from the analysis results and sends the results to the terminal.

[1889] The device displays guidelines for placement and angle on the screen to the user to assist in taking photos.

[1890] Specific examples

[1891] Examples of travel destination suggestions:

[1892] 1. The user enters into the app, "I want to go to a place where I can enjoy nature," and at the same time, the emotion engine analyzes the emotion as "I want to relax."

[1893] 2. The device sends requests and emotional information to the server.

[1894] 3. The server searches for places where people can enjoy nature and selects "Highland Park," which has a high relaxing effect.

[1895] 4. The selection results are sent to the terminal, and detailed information about "Kogen Park" is displayed to the user.

[1896] Examples of photo spot guides:

[1897] 5. The user arrives at "Kogen Park" and their current location and emotion information is acquired.

[1898] 6. The device sends GPS information and emotion data to the server.

[1899] 7. The server searches for nearby photo spots and selects the "observation deck." Based on the emotional data, it determines that the view from the observation deck will have a relaxing effect.

[1900] 8. Directions to the observation deck will be displayed on the device, and a link to a map app will also be provided.

[1901] Examples of Mono photography:

[1902] 9. The user enters, "I want to take a beautiful photo of my cafe latte," and the emotion engine analyzes it to determine the emotion of "happiness."

[1903] 10. The device sends the information to the server.

[1904] 11. The server uses AI to analyze the optimal placement and angle, recommending placing the photo in the center of the table and taking a photo at a 45-degree angle from the top left. Based on emotional data, the server also considers lighting to create a happy mood.

[1905] 12. A recommended placement guide is displayed on the device, and the user takes the photo following the instructions.

[1906] This allows users to easily take high-quality photos that reflect their own emotions, doubling the enjoyment of their travels and everyday life.

[1907] The processing flow will be explained below.

[1908] Travel destination suggestions based on travel requests

[1909] Step 1:

[1910] The user launches the camera app and selects the "Travel Suggestion" feature. The device prompts the user to enter a destination (e.g., beach, mountain, city) they would like to visit.

[1911] Step 2:

[1912] The device acquires emotional information using the user's camera and microphone, and the emotion engine analyzes the user's current emotional state.

[1913] Step 3:

[1914] The terminal transmits the input request information and emotion data to the server as a request.

[1915] Step 4:

[1916] The server receives the request, analyzes the input desires and emotion data, and accesses the database to select multiple candidate travel destinations and scenic spots that match the desires.

[1917] Step 5:

[1918] The emotion engine uses emotional data to select potential travel destinations that best suit the user's emotional state based on evaluation criteria.

[1919] Step 6:

[1920] The server transmits the selection result to the terminal.

[1921] Step 7:

[1922] The device displays detailed information about the destination (photos, access methods, reviews, etc.) along with emotion-based recommendations, allowing users to select a destination that best suits their emotions.

[1923] Photo spot guidance function after arriving at the location

[1924] Step 1:

[1925] When the user arrives at their travel destination and launches the app, the device acquires the user's GPS information.

[1926] Step 2:

[1927] The device acquires emotional information, and the emotion engine analyzes the user's current emotional state in real time.

[1928] Step 3:

[1929] The device sends GPS information and emotion data to the server.

[1930] Step 4:

[1931] The server receives the GPS information and emotion data and searches the database for nearby photo spots.

[1932] Step 5:

[1933] The server selects the photo spot that best suits the user's emotional state based on the evaluation criteria, based on the search results for nearby photo spots.

[1934] Step 6:

[1935] The server sends the selected shooting points and route information to the terminal.

[1936] Step 7:

[1937] The device displays directions to the photo spot and also provides a link to a map app, allowing users to take photos that are highly satisfying by being guided to the optimal photo spot that matches their emotions.

[1938] Optimal placement and shooting angle suggestions for object photography

[1939] Step 1:

[1940] The user launches the camera app and selects the "Take a Picture" function. The device prompts the user to enter information about the object to be photographed (e.g., coffee cup, food, plant).

[1941] Step 2:

[1942] The terminal uses an emotion engine to acquire the user's emotion information and analyze the current emotional state.

[1943] Step 3:

[1944] The device transmits information about the subject being photographed and emotion data to the server.

[1945] Step 4:

[1946] Based on the subject information and emotion data received by the server, the generative AI analyzes the optimal placement and shooting angle. During the analysis process, the server also takes the emotion data into consideration to determine the optimal shooting composition.

[1947] Step 5:

[1948] The server sends the placement guide and shooting angle instructions generated from the analysis results to the terminal.

[1949] Step 6:

[1950] The device will provide users with on-screen placement and angle guidelines, as well as emotion-based photography advice and tips, making it easier for users to take photos that best suit their emotional state.

[1951] Specific examples

[1952] Examples of travel destination suggestions:

[1953] 1. The user enters into the app, "I want to go somewhere where I can enjoy nature," and the device uses computer vision to analyze the emotion as "I want to relax."

[1954] 2. The device sends this information to the server.

[1955] 3. The server searches for places where you can enjoy nature and selects a "highland park" that has a high relaxing effect.

[1956] 4. The selection results and the reasons why the park has such a relaxing effect are sent to the device, and detailed information about "Kogen Park" is displayed to the user.

[1957] Examples of photo spot guides:

[1958] 5. The user arrives at "Kogen Park" and obtains their current location and real-time emotion information.

[1959] 6. The device sends GPS information and emotion data to the server.

[1960] 7. The server searches for nearby photo spots and selects "Observation Deck." It determines that the view from the observation deck will enhance relaxation.

[1961] 8. Directions to the observation deck will be displayed on the device, and a link to a map app will also be provided.

[1962] Examples of Mono photography:

[1963] 9. The user enters, "I want to take a beautiful photo of my cafe latte," and the device analyzes the emotion of "happiness" using facial expression recognition.

[1964] 10. The device sends the information to the server.

[1965] 11. The server uses AI to analyze the optimal placement and angle, recommending placing the photo in the center of the table and taking a photo at a 45-degree angle from the top left. It also takes into consideration how the light is applied to create a happy mood.

[1966] 12. Along with a placement guide, advice on how to emphasize a happy atmosphere is displayed on the device, and the user follows the instructions to take the photo.

[1967] These processes enable users to easily take high-quality photos that reflect their own emotions, enhancing the enjoyment of travel and everyday life.

[1968] Example 2

[1969] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1970] Conventional camera applications offer travel destination suggestions and photo spot guidance based on user requests, but because they do not take the user's emotional state into account, they are unable to provide suggestions and guidance that are in line with the user's feelings, and as a result, they are unable to sufficiently increase satisfaction. Furthermore, suggestions for camera placement and angles when taking photos are limited to general ones, and they are unable to provide optimal suggestions that reflect the emotions of each individual user. For this reason, there was a need for a service that is easy for users to use and in line with their emotions.

[1971] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1972] In this invention, the server includes means for receiving a user's travel destination request and selecting multiple travel destination candidates based on the request and the user's emotional information, means for displaying detailed information about the selected travel destination to the user, means for acquiring the user's location information and emotional information on the location and suggesting optimal photo spots based on that information, and means for analyzing the optimal position and angle for the object the user is trying to photograph using a generative AI model and presenting the analysis results to the user. This makes it possible to suggest travel destinations and photo spots that take the user's emotional state into consideration, and to provide guidance on photo positions and angles tailored to each individual user.

[1973] "User" means any individual or entity that uses the System.

[1974] "Travel destination requests" are information including places the user wants to visit and desired conditions.

[1975] "Emotional information" is data that indicates the user's current emotional state.

[1976] "Travel destination candidates" are multiple travel destinations suggested based on the user's travel destination requests and emotional information.

[1977] "Detailed information" refers to information such as photos, access methods, and reviews about potential travel destinations.

[1978] "Location information" is data that indicates the user's current location.

[1979] "Photo spots" are ideal locations for users to take photos while traveling.

[1980] A "subject" is an object or scene that the user wishes to photograph.

[1981] "Layout" refers to the position and order of the objects to be photographed.

[1982] "Angle" is a setting that indicates the direction and tilt of the camera when taking a photo.

[1983] A "generative AI model" is an algorithm that uses artificial intelligence technology to analyze data and generate optimal results.

[1984] The "analysis results" are suggestions for optimal placement and angles provided by the generative AI model.

[1985] This invention relates to a camera application system that allows users to take more satisfying photos by combining it with an emotion engine that recognizes the user's emotions. This system helps users select travel destinations, guides them to photography spots on the spot, and adjusts and suggests the optimal position and angle for product photography based on emotion data.

[1986] Travel destination suggestions based on travel requests

[1987] When a user launches the camera app and selects the "travel destination suggestion" function, the device prompts the user to input their desired destination (e.g., beach, mountain, city). The device then uses the user's camera and microphone to obtain emotional information, and the emotion engine analyzes the user's current emotional state. The analysis results and the desired information are sent to a server, which then accesses a database to select candidate destinations and scenic spots that match the user's desired destination. The emotion engine then uses the emotional data to select candidate destinations that best suit the user's emotional state, and sends the selection results to the device. The device then displays detailed information about the destination (photos, access methods, reviews, etc.) to the user, assisting them in creating their travel plans.

[1988] Specific examples

[1989] When a user inputs into the app that they would like to go to a place where they can enjoy nature and smile into the camera, the device sends their request and emotional information to the server. The server analyzes the information, selects a "highland park" with a high relaxation effect, and displays detailed information about it on the device.

[1990] Photo spot guidance function after arriving at the location

[1991] When a user arrives at their travel destination and launches the app, the device acquires the user's GPS information and emotional information and sends them to the server. The server receives the GPS information and emotional data and searches a database for nearby photo spots. It then selects the optimal photo spot based on the user's emotional state and sends the results to the device. The device then displays directions to the photo spot and provides a link to the map app.

[1992] Specific examples

[1993] When a user arrives at "Kogen Park" and starts the app with a smile, the device sends GPS information and emotional data to the server. The server searches for nearby photo spots, selects an "observation deck" with a relaxing effect in mind, and displays the information on the device.

[1994] Optimal placement and shooting angle suggestions for object photography

[1995] When a user launches the camera app and selects the "Taking a Photo of an Object" function, the device prompts them to input the object to be photographed (e.g., coffee cup, food, plant) and uses an emotion engine to obtain the user's emotional information. The device then sends the information about the object and the emotional data to the server, which then uses a generative AI model to analyze the optimal placement and shooting angle. The analysis results are sent to the device as the optimal composition based on the emotional data, and the device then presents guidelines for placement and angle to the user.

[1996] Specific examples

[1997] When a user inputs "I want to take a beautiful photo of my cafe latte," and the emotion engine analyzes the emotion as "happiness," the device sends the information to the server. The server uses a generative AI model to analyze the optimal placement and angle, recommending "place it in the center of the table and take the photo at a 45-degree angle from the top left." A placement guide is displayed to the user, who then follows the instructions to take the photo.

[1998] This allows users to easily take high-quality photos that reflect their own emotions, increasing the enjoyment of their travels and everyday life.

[1999] Prompt Sentence Examples

[2000] 1. "I want to go to a place where I can enjoy nature."

[2001] 2. "I want to take beautiful photos of cafe lattes."

[2002] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2003] Travel destination suggestions based on travel requests

[2004] Step 1:

[2005] User: Launches the camera app and selects the "Travel Destination Suggestion" function. Enters a request such as "I want to go to the beach."

[2006] Step 2:

[2007] Device: Obtains user input and emotional information in real time using a camera and microphone. The emotion engine analyzes the user's current emotional state and gives a result such as "I want to have fun."

[2008] Step 3:

[2009] Terminal: Sends the request information and the emotion data as the analysis result to the server. The request information and emotion data are included as input.

[2010] Step 4:

[2011] Server: Receives the request information and emotion data, accesses the database, and searches for travel destinations and scenic spots that match the request. In this case, multiple beach-related travel destinations are selected as candidates.

[2012] Step 5:

[2013] Server: Based on the emotional data, the server selects the candidate location that best suits the user's emotional state. Specifically, the server selects a beach in Hawaii, taking into account the emotion of "wanting to have fun."

[2014] Step 6:

[2015] Server: Sends the selection results to the device. The output includes detailed travel destination information (e.g., photos of Hawaiian beaches, how to get there, reviews, etc.).

[2016] Step 7:

[2017] Terminal: Displays the travel destination information received from the server to the user.

[2018] Photo spot guidance function after arriving at the location

[2019] Step 1:

[2020] User: Arrives at travel destination and launches the app.

[2021] Step 2:

[2022] Device: Obtains the user's GPS information and emotional information. Determines "relaxed" as the emotional data.

[2023] Step 3:

[2024] Terminal: Sends GPS information and emotion data to the server. Location information and emotion data are included as input.

[2025] Step 4:

[2026] Server: Receives GPS information and emotion data, searches for nearby photo spots from a database, and extracts the best photo spots related to the location based on the input.

[2027] Step 5:

[2028] Server: Considering the emotional data, select the optimal shooting point for the user's state. Select the "observation deck" considering its relaxing effect.

[2029] Step 6:

[2030] Server: Sends the selected photo points and their route information to the terminal. The output includes route information and photo point details.

[2031] Step 7:

[2032] On the device: Displays GPS and route information to the user and provides a link to a map app.

[2033] Optimal placement and shooting angle suggestions for object photography

[2034] Step 1:

[2035] User: Launch the camera app, select the "Object Shooting" function, and enter "Cafe Latte" as the subject to be photographed.

[2036] Step 2:

[2037] Device: Acquires information about the subject being photographed and uses the emotion engine to acquire the user's emotional information. Identifies "happiness" as the emotional data.

[2038] Step 3:

[2039] Terminal: Sends the photographed object information and emotion data to the server. The input includes the object information and emotion data.

[2040] Step 4:

[2041] Server: Receives information about the subject and emotion data, and uses a generative AI model to analyze the optimal placement and shooting angle. Specifically, it recommends placing the subject in the center of the table and taking a photo at a 45-degree angle from the top left.

[2042] Step 5:

[2043] Server: Generates placement guides and shooting angle instructions and sends the results to the device. The output includes specific placement methods and angle instructions.

[2044] Step 6:

[2045] Terminal: The placement guide from the server is displayed to the user, and the user takes the photo according to the instructions.

[2046] By clarifying the inputs and outputs at each step, the operation of the entire system can be understood concretely and comprehensively.

[2047] (Application example 2)

[2048] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2049] Today's consumers are seeking a higher level of satisfaction from their shopping experiences. In particular, in brick-and-mortar stores, they are seeking product suggestions tailored to their emotions and desires, as well as optimal photography environments. However, current shopping support systems lack the functionality to suggest products that take the user's emotional state into account, making them inefficient. Furthermore, they lack sufficient advice on optimal product place...

Claims

1. A means for receiving a request for a travel destination input by a user and selecting a plurality of travel destination candidates based on the request; means for displaying information about the selected travel destination to a user; A means for acquiring the user's location information on-site and presenting the optimal shooting spot based on that location information; A method for analyzing the optimal position and angle for the object the user is trying to photograph using AI generation and presenting the results of that analysis to the user. A system including:

2. 2. The system of claim 1, wherein the means for selecting potential travel destinations includes means for accessing a database, searching for travel destinations and scenic spots matching the desired destinations, and selecting based on evaluation criteria.

3. 2. The system according to claim 1, wherein the means for presenting the photography spots includes means for searching a database for the best photography spots in the vicinity based on the user's location information and displaying route information therefor.

Images