System

Abstract

To provide a system for generating and displaying a personalized recommended content list by collecting information on a sightseeing spot desired to visit and the kind of Japanese dress from a user.SOLUTION: This system is provided with a means for collecting information on a tourist spot desired to visit and the kind of Japanese dress, a means for generating and displaying a personalized recommended content list on the basis of the collected information, and a means for generating a travel schedule by calculating an optimum visiting order and a traffic route on the basis of a travel schedule and the tourist spot information desired to visit. A system comprising: means for providing; means for generating and displaying personalized content by combining a tourist spot video, a type of Japanese dress, and experience content based on a travel schedule; means for collecting and providing a congestion situation, weather information, and traffic information of a visit destination; and means for uploading a material photographed by a user, automatically editing and processing the material, and generating and providing sharable content.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, as many travelers, including international visitors, visit Japanese tourist destinations, demand for tourism experiences using traditional Japanese clothing is on the rise. However, it takes a great deal of time and effort for travelers to arrange their own traditional clothing, plan the order in which to visit tourist spots, and share their experiences on social media. Providing personalized content tailored to individual user preferences is particularly challenging. Furthermore, tourists are concentrating in certain tourist destinations, creating the problem of overtourism. [Means for solving the problem]

[0005] To address these issues, the present invention provides a system that collects information from users about tourist destinations and types of traditional Japanese clothing they wish to visit, and generates and displays a personalized list of recommended content. It also includes a system that calculates the optimal order of visits and transportation routes based on the travel itinerary and information about the tourist destinations they wish to visit, generating a travel schedule. It also includes a system that generates and displays personalized content that combines images of tourist destinations, types of traditional Japanese clothing, and experience details based on the travel schedule, and a system that provides real-time information on the congestion status of destinations, weather, and traffic on the day of the trip. Finally, the present invention aims to significantly improve convenience for travelers and efficiently promote the appeal of tourist destinations throughout Japan by providing a system that includes a system that allows users to upload footage they have taken during their trip, automatically edit and process it, and generate and provide shareable content.

[0006] "User" refers to an individual who uses the system to plan a trip or consume content.

[0007] A "terminal" is a device used by a user, and generally refers to a smartphone, tablet, etc.

[0008] "Server" refers to a computer system that processes and stores data and provides information to terminals through communication.

[0009] "Means for collecting information" refers to a function that provides an interface for users to input tourist spots they wish to visit and types of Japanese clothing they are interested in.

[0010] The "recommended content list" refers to a list that suggests content related to tourist spots and Japanese clothing based on the user's interest information.

[0011] "Travel Schedule" refers to a travel program or plan optimized based on a user's dates and desired destinations.

[0012] "Personalized content" refers to content such as videos, images, and text that are customized to suit a user's individual interests and travel plans.

[0013] "Real-time information" refers to the latest congestion, weather, and traffic information obtained on the day of travel.

[0014] "Means for uploading materials" refers to the function for sending photos and videos taken by users to the server.

[0015] "Means for automatic editing and processing" refers to the function of applying filters to uploaded materials, adding captions, etc., to generate content that can be shared on social media, etc.

[0016] "Shareable content" refers to photos and videos that have been edited and processed so that users can post them on social media or save them and share them with others. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8]FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] This invention relates to a system that allows travelers to more easily enjoy sightseeing experiences in traditional Japanese clothing. This system comprehensively supports users' trip planning, execution, and experience sharing through communication with users' terminals and a server.

[0039] First, the user starts up their device and inputs into the application the tourist spots they want to visit and the types of Japanese clothing they are interested in. For example, if the user selects "Kyoto" as a destination and inputs that they are interested in "ninjas," the device sends this information to the server. The server receives the user's input information, and AI analyzes the user's interest trends. Based on the analysis results, a personalized list of recommended content is generated and displayed to the user via the device. The recommended content list is made up of a combination of tourist spot videos, types of Japanese clothing, and experience content.

[0040] Next, the user inputs their travel itinerary and potential destinations. For example, if they input that they would like to visit Kinkakuji Temple, Gion, and Nijo Castle on a three-day trip to Kyoto, the device sends this information to the server. Based on the inputted itinerary and destination data, the server uses AI to calculate the optimal visiting order and transportation routes. Based on the calculation results, a specific travel itinerary is generated and displayed to the user on the device.

[0041] On the day of the trip, users can check real-time information on the spot using their devices. For example, the server obtains local congestion, weather, and traffic information and provides it to the user's device. Users can then flexibly adjust their schedule based on this information.

[0042] Additionally, photos and videos taken by users during their trip are uploaded to a server via their device. The server automatically edits and processes the uploaded material to generate content that can be posted to social media. For example, the server applies filters to photos, shortens videos, and adds captions. The generated content is provided to the device, where users can post it to social media or save it to share with others.

[0043] For example, if a user takes a photo wearing traditional Japanese clothing at Kinkakuji Temple in Kyoto, the photo is instantly uploaded to the server. The server then selects a filter appropriate for the photo, automatically generates a caption, and provides it to the user's device. The user can then view the generated content on their device, and if they like it, they can post it directly to social media sites such as Instagram.

[0044] In this way, this system comprehensively supports users from before to after their travel experience, and by providing personalized content, makes the Japanese clothing experience at travel destinations even more appealing.

[0045] The processing flow will be explained below.

[0046] Step 1:

[0047] The user starts the terminal and accesses the application.

[0048] Step 2:

[0049] The user inputs the tourist spot they want to visit (e.g., Kyoto) and the type of Japanese clothing they are interested in (e.g., ninja).

[0050] Step 3:

[0051] The terminal transmits the input information to the server.

[0052] Step 4:

[0053] The server receives the user's input information, and AI analyzes the user's interest trends.

[0054] Step 5:

[0055] Based on the analysis results, the server generates a personalized list of recommended content, including related tourist spot videos, types of Japanese clothing, and experience content.

[0056] Step 6:

[0057] The terminal displays the generated recommended content list to the user.

[0058] Step 7:

[0059] The user inputs the desired travel dates and the tourist spots they want to visit (e.g., Kinkakuji Temple, Gion, Nijo Castle).

[0060] Step 8:

[0061] The terminal transmits the inputted schedule and visiting place information to the server.

[0062] Step 9:

[0063] Based on the received schedule and destination information, the server uses AI to calculate the optimal order of visits and transportation routes.

[0064] Step 10:

[0065] The server generates a specific travel schedule based on the calculation results.

[0066] Step 11:

[0067] The terminal displays the generated travel schedule to the user.

[0068] Step 12:

[0069] On the day of the trip, the user uses the terminal to check the congestion situation at tourist spots, weather information, and traffic information in real time.

[0070] Step 13:

[0071] The server collects local information and provides it to the user's terminal.

[0072] Step 14:

[0073] Users can flexibly adjust their travel schedules based on real-time information.

[0074] Step 15:

[0075] While traveling, users upload photos and videos taken on their devices to a server through the application.

[0076] Step 16:

[0077] The server automatically edits and processes the uploaded material (e.g., applying filters to photos or adding captions to videos).

[0078] Step 17:

[0079] The server generates edited and processed content.

[0080] Step 18:

[0081] The terminal provides the generated shareable content to the user.

[0082] Step 19:

[0083] Users can post the provided content to social media or save it as data.

[0084] Example 1

[0085] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0086] Conventional tourist travel systems are inadequate in creating personalized travel plans based on the user's interests and wishes, and in providing real-time information during the trip. Further improvements are needed to increase user satisfaction. Furthermore, editing content captured during the trip and sharing it on social media is cumbersome, making it difficult for users to easily share their travel memories with others. The present invention aims to solve these problems.

[0087] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0088] In this invention, the server includes means for collecting information from the user regarding tourist destinations desired to visit and types of Japanese clothing, means for generating a personalized recommended content list using a generative AI model, and means for calculating the optimal visiting order and transportation route based on the travel itinerary and desired tourist destination information entered by the user. This enables the creation of an optimal travel plan based on the user's interests and wishes. Furthermore, by automatically editing and processing footage taken during the trip, users can generate easily shareable content, allowing them to easily share their travel memories on social media and other platforms.

[0089] "User" refers to an individual who uses the system to plan and carry out a tourist trip.

[0090] A "terminal" is an electronic device that a user operates to input information or receive information from a server. Specifically, it includes smartphones and tablets.

[0091] A "server" is a computer system that processes data received from users and provides the required information and services.

[0092] "Desired tourist destinations" refer to places or areas that a user wishes to visit when traveling.

[0093] "Waso" refers to traditional Japanese clothing, including kimonos and hakama.

[0094] "Means of collecting information" refers to the methods and technologies for sending and receiving data entered by a user through a terminal to a server.

[0095] "Generative AI model" refers to an artificial intelligence algorithm that generates recommended content based on user input data.

[0096] A "personalized recommended content list" is a list of tourist attractions and experiences specially selected based on the user's interests and desires.

[0097] "Travel itinerary" refers to the period during which the user travels and the detailed schedule thereof.

[0098] The "visiting order" refers to the optimal order in which a user visits tourist spots during a trip.

[0099] "Transportation route" refers to the optimal travel route for touring tourist spots specified by the user.

[0100] A "travel schedule" is a detailed itinerary including visit orders and transportation routes that are useful when a user plans a trip.

[0101] "Real-time information" refers to the latest time-dependent data, such as current congestion status, weather information, and traffic information.

[0102] "Means for uploading materials" refers to the methods and technologies for transmitting photos and videos taken by users during their trip to a server.

[0103] "Means of automatic editing and processing" refers to technology that uses AI or algorithms to edit and process uploaded materials.

[0104] "Shareable content" refers to photos and videos that have been edited in a way that allows users to easily share them on social media and with other users.

[0105] The present invention relates to a system that enables travelers to more easily enjoy sightseeing experiences in traditional Japanese clothing. Specific embodiments of this system are described below.

[0106] First, the user starts up their device (such as a smartphone) and accesses the application. On the initial screen of the application, the user enters information about the tourist spots they want to visit and the types of Japanese clothing they are interested in. For example, the user selects "Kyoto" as a destination and enters that they are interested in "ninjas." This information is sent to the server via the device.

[0107] The server receives this user information and uses a generative AI model to analyze the user's interest trends. During the analysis, a prompt such as "What would you recommend for someone traveling to Kyoto who is interested in ninjas?" is input into the generative AI model. The AI ​​then generates a personalized list of recommended content that matches the user's interests. This list includes a combination of videos of tourist spots, types of Japanese clothing, and experience content. The generated content list is sent from the server to the device and displayed to the user.

[0108] Next, the user inputs their travel itinerary and the tourist spots they wish to visit into the application. For example, they might input, "I'd like to visit Kinkaku-ji Temple, Gion, and Nijo Castle on a three-day trip to Kyoto." The device then sends this information to the server. The server receives the input date and destination information and uses AI to calculate the optimal order of visits and transportation routes. As a result of the calculation, a specific travel itinerary is generated and sent to the device. The user can then view this travel itinerary in the application.

[0109] Furthermore, on the day of the trip, users can use their devices to check on-site information in real time. The server obtains local congestion, weather, traffic information, and other information via the Internet and provides it to the user's device. Users can flexibly adjust their travel schedule based on this information.

[0110] While traveling, users take photos and videos and upload them to a server via their device. The server receives this material and automatically edits and processes it using generative AI models. For example, it applies appropriate filters to photos, shortens and edits videos, and automatically generates appropriate captions. The shareable content generated in this way is then sent from the server to the device, where users can easily post it to social media.

[0111] For example, if a user takes a photo of themselves wearing traditional Japanese clothing at Kinkakuji Temple in Kyoto, the photo is instantly uploaded to the server. The server selects a filter appropriate for the photo and automatically generates a caption, such as "Experiencing traditional Japanese clothing at Kinkakuji Temple, Kinkakuji Temple, Kyoto," which is then provided to the user's device. The user can then review the generated content and, if they like it, post it directly to a social networking site.

[0112] This system will comprehensively support users from before to after their travel experience and provide personalized content, making the Japanese clothing experience at travel destinations even more appealing.

[0113] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0114] Step 1:

[0115] The user starts up the device and accesses the application. On the initial screen, they input information about the tourist spots they want to visit and the type of Japanese clothing they are interested in. For example, they select "Kyoto" as their destination and input that they are interested in "ninjas." At this time, the device sends the user's input information to the server.

[0116] Input: The tourist spot you want to visit and the type of Japanese clothing you want to wear.

[0117] Output: User input sent to the server

[0118] Step 2:

[0119] The server inputs the received information into the generative AI model. The generative AI model receives a prompt such as "What would you recommend to someone traveling to Kyoto who is interested in ninjas?" and the model performs an analysis. The AI ​​analyzes the user's interests and generates a personalized list of recommended content. This list includes a combination of tourist spot footage, types of Japanese clothing, and experience content. The generated content list is sent from the server to the device and displayed to the user.

[0120] Input: User input received by the server

[0121] Output: The generated personalized recommendation list

[0122] Step 3:

[0123] The user inputs their travel itinerary and potential destinations into the application. For example, they might input, "I'd like to visit Kinkakuji Temple, Gion, and Nijo Castle on a three-day trip to Kyoto." The device then sends this information to the server. The server receives the input date and destination information and uses AI to calculate the optimal order of visits and transportation routes. The calculation results are generated as a specific travel itinerary and sent to the device.

[0124] Input: User-entered travel dates and potential destinations

[0125] Output: Generated concrete travel schedule

[0126] Step 4:

[0127] On the day of the trip, the user uses the device to check on-site information in real time. The server obtains local congestion, weather, traffic information, etc. via the Internet and provides it to the user's device. Based on this information, the user can flexibly adjust their travel schedule. For example, information such as "Kinkaku-ji Temple is crowded, but Gion is empty" may be displayed.

[0128] Input: Local information obtained by the server via the Internet

[0129] Output: Real-time local information displayed on the user's device

[0130] Step 5:

[0131] During a trip, users take photos and videos and upload them to a server via their device. The server receives this material and automatically edits and processes it using generative AI models. For example, it applies filters to photos, shortens and edits videos, and automatically generates appropriate captions. The generated shareable content is then sent from the server to the device, where users can easily post it to social media.

[0132] Input: Photos and videos taken and uploaded by users

[0133] Output: Automatically edited and enhanced shareable content

[0134] Step 6:

[0135] For example, if a user takes a photo of themselves wearing traditional Japanese clothing at Kinkaku-ji Temple in Kyoto, the photo is instantly uploaded to the server. The server selects a filter appropriate for the photo and automatically generates a caption such as "Experience traditional Japanese clothing at Kinkaku-ji Temple, Kinkaku-ji Temple, Kyoto." The generated content is then provided to the user's device, where they can review it and, if they like it, post it to a social networking site.

[0136] Input: A photo taken by the user at Kinkakuji Temple

[0137] Output: Filtered and captioned content

[0138] (Application example 1)

[0139] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0140] Although many modern travelers are interested in experiencing Japanese clothing, they face challenges in planning their trips, selecting Japanese clothing, gathering real-time information at tourist spots, and effectively sharing their travel memories on social media. Furthermore, there is a lack of appropriate guidance in brick-and-mortar stores on how to select and put on Japanese clothing, preventing travelers from enjoying their travel experiences to the fullest.

[0141] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0142] In this invention, the server includes means for collecting information from the user regarding tourist spots that the user wishes to visit and types of Japanese clothing, means for generating a personalized recommended content list, and means for displaying the generated recommended content list to the user, thereby enabling the user to receive personalized support throughout the entire process from planning to carrying out and sharing the tour.

[0143] The system also includes a means for calculating the optimal order of visits and transportation routes based on the travel itinerary and information on desired tourist spots to generate a travel schedule, and a means for generating personalized content by combining tourist spot images, types of Japanese clothing, and experience details based on the generated travel schedule, thereby enabling users to travel efficiently and enjoyably.

[0144] Furthermore, there will be a means to collect real-time information on congestion, weather, and traffic conditions at destinations on the day of the trip and provide it to the user's device, a means to upload footage taken by the user during the trip and automatically edit and process it to generate shareable content, and a means to display how to select and wear Japanese clothing in physical stores. This will improve the comfort of the trip and make it easier to share memories.

[0145] It also includes a way to automatically select filters and generate captions for users' photos and edit them into shareable content, allowing them to easily share their travel memories on social media and reach more people. This not only makes the travel experience richer and more engaging, but also provides useful information to others.

[0146] The "means for collecting information from the user about tourist spots that the user wants to visit and types of Japanese clothing" is a device or program that acquires data about tourist spots that the user wants to visit and types of Japanese clothing that the user is interested in.

[0147] The "means for generating a personalized recommended content list" is a device or program that creates a list that suggests individually optimized tourist information and Japanese clothing experiences based on information entered by the user.

[0148] The "means for displaying the generated recommended content list to the user" refers to a device or program that displays the generated list of recommended tourist spot information and Japanese clothing experiences on the user's terminal.

[0149] "Means for calculating the optimal visiting order and travel route based on the travel itinerary and information on the tourist destinations desired to be visited" refers to a device or program that calculates the effective visiting order and travel route based on the travel itinerary and data on the tourist destinations desired to be visited specified by the user.

[0150] The "means for generating a travel schedule" is a device or program that creates a detailed travel schedule based on the calculated visiting order and transportation routes.

[0151] The "means for providing the generated travel schedule to the user" is a device or program that displays the generated travel schedule on the user's terminal.

[0152] "Means for generating personalized content by combining images of tourist spots, types of Japanese clothing, and experience content" refers to a device or program that generates individually optimized content by combining images of tourist spots, types of Japanese clothing, and experience content based on a travel schedule.

[0153] "Means for collecting congestion status, weather information, and traffic information of destinations in real time on the day of travel and providing it to the user's terminal" refers to a device or program that obtains current congestion status, weather, and traffic information of tourist destinations in real time and provides it to the user's terminal.

[0154] "Means for uploading materials taken by users while traveling and automatically editing and processing them to generate shareable content" refers to a device or program that allows users to upload photos and videos they have taken, automatically performs editing such as filtering and adding captions, and generates shareable content.

[0155] The "means for displaying the selection of Japanese clothing and how to wear it in a physical store" is a device or program that visually displays the Japanese clothing selected by the user and how to wear it in a physical store.

[0156] "Means for automatically selecting filters and generating captions for content captured by a user, and editing the content into shareable content" refers to a device or program that applies optimal filters to images and videos captured by a user, automatically generates captions, and edits the content into a format that can be shared on social media, etc.

[0157] This system allows users to easily and attractively experience sightseeing in traditional Japanese clothing. Specifically, it comprehensively supports users from planning their trip to experiencing the store, and editing and sharing photos and videos they have taken.

[0158] The general flow of the system is as follows:

[0159] Hardware and Software Configuration

[0160] Hardware:

[0161] Smartphones (e.g. iPhone, Android smartphones)

[0162] Smart glasses (e.g. Google Glass, Microsoft HoloLens)

[0163] Server (e.g. AWS, GCP)

[0164] software:

[0165] Frontend: React Native (a cross-platform mobile application development tool)

[0166] Backend: Node.js (server-side framework), MongoDB (database)

[0167] AI analysis: TensorFlow (machine learning library), Computer Vision API (image recognition)

[0168] Cloud services: AWS (Amazon Web Services) or GCP (Google Cloud Platform)

[0169] Specific steps for carrying out the invention

[0170] 1. User input

[0171] The user inputs into the application the tourist spots they wish to visit and the type of Japanese clothing they are interested in. For example, if they select "Kyoto" and "Ninja" Japanese clothing, the device sends this information to the server.

[0172] 2. Information analysis and personalized content generation

[0173] Based on the information collected from the user, the server uses an AI analysis engine (TensorFlow) to analyze the user's interests and generate a personalized list of recommended content.

[0174] The generated content list is displayed on a smartphone or smart glasses.

[0175] 3. Optimizing travel planning

[0176] When a user inputs their travel dates and desired places to visit, the server calculates the optimal order of visits and transportation routes, and generates a detailed travel schedule, which is then provided to the user's terminal.

[0177] 4. Providing real-time information on-site

[0178] On the day of the trip, the server collects real-time information on congestion, weather, and traffic conditions at the destinations and provides it to the user's device, allowing the user to adjust their schedule accordingly.

[0179] 5. Experience wearing traditional Japanese clothing at a physical store

[0180] At the physical store, users can choose a kimono and check how to dress using smart glasses or a smartphone, making dressing a smooth process.

[0181] 6. Automate content editing and sharing

[0182] Photos and videos taken by users during their trip are uploaded to a server, where filters and captions are automatically applied. The edited content is then delivered to the user's device and can be easily shared on social media.

[0183] Examples of concrete examples and prompts

[0184] As a concrete example, consider the case where a user takes a photo of themselves wearing traditional Japanese ninja attire at Kinkakuji Temple in Kyoto. This photo is instantly uploaded to the server, which selects an appropriate filter for the photo, automatically generates a caption, and provides it to the user's device.

[0185] An example prompt is:

[0186] "Add a caption to your photo of yourself in ninja attire at Kinkakuji Temple in Kyoto and choose a filter to post to Instagram."

[0187] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0188] Step 1:

[0189] The user inputs the tourist spots they wish to visit and the type of Japanese clothing they would like to wear into the terminal, and the input information is sent from the terminal to the server.

[0190] Input: Information about tourist spots and types of Japanese clothing entered by the user using a smartphone or smart glasses.

[0191] Data processing: The terminal converts the user-entered information into an appropriate format and sends it to the server.

[0192] Output: User input information received by the server.

[0193] Step 2:

[0194] The server uses an AI analysis engine (TensorFlow) to analyze the user's interests based on the received information, and generates a personalized list of recommended content based on the analysis results.

[0195] Input: User-entered information (tourist destination and type of Japanese clothing).

[0196] Data calculation: Analyze user interest trends using TensorFlow and generate a list of recommended content.

[0197] Output: A personalized list of recommended content.

[0198] Step 3:

[0199] The server transmits the generated recommended content list to the terminal and displays it to the user.

[0200] Input: A personalized list of recommended content.

[0201] Data processing: The server converts the content list into an appropriate format and sends it to the terminal.

[0202] Output: The device displays a list of recommended content to the user.

[0203] Step 4:

[0204] The user inputs the travel itinerary and desired places to visit into the terminal, and the input information is sent from the terminal to the server.

[0205] Input: Travel itinerary and desired places to visit entered by the user using a smartphone or smart glasses.

[0206] Data processing: The terminal converts the user-entered information into an appropriate format and sends it to the server.

[0207] Output: User input information received by the server.

[0208] Step 5:

[0209] Based on the information received, the server uses an AI analysis engine to calculate the optimal order of visits and transportation routes, and generates a detailed travel schedule.

[0210] Input: User-entered information (travel dates and desired places to visit).

[0211] Data calculation: An AI analysis engine optimizes visit order and transportation routes to generate a travel schedule.

[0212] Output: Optimized travel schedule.

[0213] Step 6:

[0214] The server transmits the generated travel schedule to the terminal and provides it to the user.

[0215] Input: The generated travel schedule.

[0216] Data processing: The server converts the travel schedule into an appropriate format and sends it to the terminal.

[0217] Output: The terminal displays the travel schedule to the user.

[0218] Step 7:

[0219] On the day of the trip, the server collects real-time information on congestion at the destinations, weather information, and traffic information, and provides it to the user's terminal.

[0220] Input: Real-time congestion, weather, and traffic information.

[0221] Data calculation: The server analyzes this information and updates the user's travel schedule.

[0222] Output: Updated real-time information is displayed on the user's terminal.

[0223] Step 8:

[0224] Using the terminal, users can choose Japanese clothing at a physical store and check how to wear it.

[0225] Input: Information about the Japanese clothing selected by the user.

[0226] Data processing: The terminal displays information about the kimono and provides instructions on how to put it on.

[0227] Output: Japanese clothing and how to wear it displayed on smart glasses or smartphone.

[0228] Step 9:

[0229] Users upload photos and videos they take while traveling from their device to the server, which then automatically selects filters and generates captions based on the uploaded photos and videos.

[0230] Input: Photos and videos taken by the user.

[0231] Data processing: The server uses the Computer Vision API to edit, filter, and generate captions.

[0232] Output: Edited photos and videos are generated.

[0233] Step 10:

[0234] The generated photos and videos are delivered to the user's device and converted into a format that can be easily shared on social media.

[0235] Input: Edited photos and videos.

[0236] Data processing: The server converts the data into a shareable format and sends it to the device.

[0237] Output: The content that can be shared on social media is displayed on the user's device.

[0238] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0239] This invention relates to a system that allows travelers to more easily enjoy sightseeing experiences in traditional Japanese clothing. This system comprehensively supports the user's trip, from planning to execution and experience sharing, through communication with the user's terminal and server. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it provides a more highly personalized experience.

[0240] First, the user starts up the device and accesses the application. The user inputs the tourist spot they want to visit (e.g., Kyoto) and the type of Japanese clothing they are interested in (e.g., ninja). The device sends this information to the server. At the same time, the emotion engine recognizes the user's emotions from their input and interactions.

[0241] The server receives the user's input information and emotional data, and AI analyzes the user's interests and emotional state. Based on the analysis results, a personalized list of recommended content is generated and displayed to the user via their device. The recommended content list is made up of a combination of tourist spot videos, types of Japanese clothing, and experience content.

[0242] Next, the user inputs their travel itinerary and potential destinations. For example, if they input that they would like to visit Kinkakuji Temple, Gion, and Nijo Castle on a three-day trip to Kyoto, the device will send this information to the server. The emotion engine will also continue to collect the user's emotion data and send it to the server.

[0243] The server receives the itinerary, destination information, and emotion data, and the AI ​​calculates the optimal visit order and transportation route. Based on the calculation results, a specific travel schedule is generated and displayed to the user via the device. During this process, the visit order and schedule are adjusted based on the user's emotion data to provide a more enjoyable experience.

[0244] On the day of the trip, users can use their devices to check real-time information on the congestion status of tourist attractions, weather information, and traffic information. The server collects local information and combines it with the user's emotional data to provide optimal real-time advice, allowing users to flexibly adjust their schedules based on this information.

[0245] While traveling, users upload photos and videos taken with their devices to the server through the application. The server automatically edits and processes the uploaded materials (e.g., applying filters to photos and adding captions to videos). The emotion engine analyzes the user's emotional data to generate more engaging content.

[0246] For example, if a user takes a photo wearing traditional Japanese clothing at Kinkakuji Temple in Kyoto, the photo is instantly uploaded to the server. The server analyzes the photo, selects a filter based on the user's emotional state at the time, automatically generates a caption, and provides it to the user's device. The user can then view the generated content on their device, and if they like it, they can post it directly to social media sites such as Instagram.

[0247] In this way, this system comprehensively supports users' travel experiences from before to after, and by providing personalized content, makes the Japanese clothing experience at travel destinations even more appealing. Furthermore, by combining it with an emotion engine, it is possible to provide an optimal experience according to the user's emotions, increasing travel satisfaction.

[0248] The processing flow will be explained below.

[0249] Step 1:

[0250] The user starts the terminal and accesses the application.

[0251] Step 2:

[0252] The user inputs the tourist spot they want to visit (e.g., Kyoto) and the type of Japanese clothing they are interested in (e.g., ninja).

[0253] Step 3:

[0254] The device sends the input information to the server, and at the same time, the emotion engine recognizes the user's emotions from their input and interactions and collects emotion data.

[0255] Step 4:

[0256] The server receives the user's input information and emotion data.

[0257] Step 5:

[0258] Based on the received information, the server uses AI to analyze the user's interests and emotional state. Based on the analysis results, it generates a personalized list of recommended content, including related tourist spot videos, types of Japanese clothing, and experience content.

[0259] Step 6:

[0260] The terminal displays the generated recommended content list to the user.

[0261] Step 7:

[0262] The user inputs the desired travel dates and the tourist spots they want to visit (e.g., Kinkakuji Temple, Gion, Nijo Castle).

[0263] Step 8:

[0264] The terminal transmits the input itinerary and destination information to the server. The emotion engine also continues to collect the user's emotion data and transmits it to the server.

[0265] Step 9:

[0266] The server receives information on the itinerary and destinations, as well as emotional data, and the AI ​​calculates the optimal order of visits and transportation routes. By taking emotional data into account, the calculations are made to ensure the user has a more enjoyable experience.

[0267] Step 10:

[0268] The server generates a specific travel schedule based on the calculation results.

[0269] Step 11:

[0270] The terminal displays the generated travel schedule to the user.

[0271] Step 12:

[0272] On the day of the trip, the user uses the terminal to check the congestion situation at tourist spots, weather information, and traffic information in real time.

[0273] Step 13:

[0274] The server collects local information and combines it with the user's emotional data to provide optimal real-time advice.

[0275] Step 14:

[0276] Users can flexibly adjust their travel schedules based on real-time information.

[0277] Step 15:

[0278] While traveling, users upload photos and videos taken on their devices to a server through the application.

[0279] Step 16:

[0280] The server automatically edits and processes the uploaded material. Specifically, an emotion engine analyzes the user's emotional data and automatically generates filters and captions based on their emotions at the time.

[0281] Step 17:

[0282] The server generates edited and processed content.

[0283] Step 18:

[0284] The terminal provides the generated shareable content to the user.

[0285] Step 19:

[0286] Users can post the provided content to social media or save it as data.

[0287] Example 2

[0288] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0289] Conventional travel planning systems have struggled to provide a personalized experience that fully reflects users' individual needs and emotions, making it difficult to achieve a satisfying travel experience. Furthermore, there were few systems that comprehensively supported the provision of real-time information during travel or the automatic editing and processing of user-generated content. This meant that users lacked consistent support from trip planning to execution and content sharing.

[0290] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for collecting information on destinations desired to be visited and types of costumes from the user, means using a generative AI model for generating a personalized recommended content list based on the information and emotion data collected from the user, and means for displaying the generated recommended content list to the user. This makes it possible to provide a personalized experience that reflects the individual needs and emotions of the user.

[0291] "User" refers to a person who uses the system to make travel plans.

[0292] "Terminal" refers to an electronic device used by a user, such as a computer, smartphone, or tablet.

[0293] "Server" refers to a computer system for receiving and processing information sent by users.

[0294] "Destination" refers to a place or tourist attraction that the user plans to visit.

[0295] "Outfit" refers to the type of Japanese clothing or specific clothing that the user plans to wear during their trip.

[0296] "Emotional data" refers to data relating to the emotional state recognized through the user's input and operational behavior.

[0297] "Generative AI model" refers to an artificial intelligence model that generates personalized content based on data obtained from users.

[0298] "Recommended content list" refers to a list of tourist attractions and experiences generated based on the user's interests and emotional state.

[0299] "Travel route" refers to the optimal travel route between the tourist destinations to be visited.

[0300] A "travel plan" refers to a plan including the order of tourist spots that a user will visit, the schedule, and transportation methods.

[0301] "Customized content" refers to tourism videos and experience content created to reflect the individual needs and emotions of users.

[0302] "Real-time information" refers to current information such as the congestion situation at tourist spots, weather information, and traffic information on the day of travel.

[0303] "Automatic editing and processing" refers to the process of automatically editing photos and videos taken by users, applying filters and adding captions.

[0304] "Shareable Content" refers to photos and videos that have been edited or enhanced and are in a format that users can share with others.

[0305] The present invention relates to a system that allows travelers to wear costumes and enjoy travel experiences more easily. This system comprehensively supports the user's trip from planning to execution and experience sharing through the user's terminal, server, and emotion engine.

[0306] First, the user starts up the device and accesses the application. The user inputs the destination they want to visit and the type of costume they are interested in. For example, the user inputs "Kyoto" and selects "ninja costume." This information is sent from the device to the server. At the same time, the emotion engine analyzes emotion data from the user's input and operation behavior. This emotion data is also sent to the server.

[0307] The server analyzes the received destination and costume information and emotional data using a generative AI model. Specifically, it uses an AI module built with Python and TensorFlow to accurately analyze the user's interests and emotional state. Based on the analysis results, a personalized recommended content list is generated and displayed to the user via their device. The recommended content list displayed here includes destination videos and costume experience details.

[0308] Next, the user enters their travel itinerary and potential destinations into the application. For example, they might enter, "I'd like to visit Kinkaku-ji Temple, Gion, and Nijo Castle during my three-day trip to Kyoto." The device then sends this information to the server. At the same time, the emotion engine continues to collect the user's emotion data and send it to the server.

[0309] The server uses the received schedule information and emotion data to have the AI ​​module calculate the optimal visit order and travel route. Based on the results of this calculation, a specific travel plan is generated and displayed to the user via their device. The visit order and schedule are adjusted taking into account the user's emotion data.

[0310] On the day of the trip, users can check real-time congestion, weather, and traffic information at their destinations on their devices. The server collects local information and combines it with emotion data to provide optimal real-time advice, allowing users to flexibly adjust their schedules.

[0311] While traveling, users upload photos and videos taken with their device to a server through the application. The server receives the uploaded material, analyzes emotional data, and automatically edits it by applying filters to photos or adding captions to videos. The edited content is then sent back to the device, where the user can review it and post it to social media.

[0312] For example, if a user takes a photo wearing traditional Japanese clothing at Kinkakuji Temple in Kyoto, the photo is instantly uploaded to the server. The server analyzes the photo and automatically generates a filter and caption based on the user's emotional data at the time, and provides it to the device. The user can then view the generated content on their device and post it to social media.

[0313] Here are some example prompts using a generative AI model:

[0314] "I've chosen Kyoto as my next travel destination. I'd like to visit Kinkaku-ji Temple, Gion, and Nijo Castle. What's the best order to visit them in and what are the transportation routes? I'd also like to try on traditional Japanese clothing during my trip."

[0315] "Automatically filter and caption photos taken during your trip. Edit them taking into account emotional data."

[0316] In this way, the system provides a personalized experience that reflects individual needs and emotions, making the user's travel experience even more attractive.

[0317] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0318] Step 1:

[0319] The user starts up the device and accesses the application. The user inputs the destination they wish to visit and the type of costume they are interested in on the application screen. At this time, they input "Kyoto" and "Ninja" as specific actions. The destination and costume information are generated as input data.

[0320] Input: Destination, costume type

[0321] Output: Destination information, costume information

[0322] Step 2:

[0323] The device sends the destination and outfit information entered by the user to the server. At the same time, the emotion engine analyzes the user's input and operational behavior to generate emotion data, which is also sent to the server.

[0324] Input: Destination information, costume information, operation behavior data

[0325] Output: Emotion data

[0326] Step 3:

[0327] The server inputs the received destination, costume information, and emotional data into the generative AI model. The generative AI model analyzes this data and generates a personalized list of recommended content based on the user's interests and emotional state. Specifically, it lists tourist spots and experience courses that are suitable for the destination "Kyoto" and the costume "Ninja."

[0328] Input: Destination information, costume information, emotion data

[0329] Output: Recommended content list

[0330] Step 4:

[0331] The server sends the generated recommended content list to the terminal, which then displays the recommended content list to the user. The user can scroll through the screen to check the recommended tourist spot videos and clothing experience content.

[0332] Input: Recommended content list

[0333] Output: Displayed list of recommended content

[0334] Step 5:

[0335] The user inputs the travel itinerary and desired destinations into the application. For example, "I would like to visit Kinkaku-ji Temple, Gion, and Nijo Castle on a three-day trip to Kyoto." The specific actions are to select the itinerary and add the destinations to be visited.

[0336] Input: Dates, desired destination information

[0337] Output: Travel itinerary information, destination information

[0338] Step 6:

[0339] The terminal transmits the travel itinerary information and the desired destination information to the server. The emotion engine then analyzes the user's emotion data, which is also transmitted to the server.

[0340] Input: Travel itinerary information, destination information, continuous operation behavior data

[0341] Output: Emotion data

[0342] Step 7:

[0343] The server calculates the optimal visit order and travel route based on the received itinerary information and emotion data. Specifically, the AI ​​module calculates the optimal visit order and travel route for Kinkaku-ji Temple, Gion, and Nijo Castle. A specific travel plan is generated based on the calculation results.

[0344] Input: Travel itinerary information, destination information, emotion data

[0345] Output: Optimal visit sequence and travel route

[0346] Step 8:

[0347] The server sends the generated itinerary to the terminal, which displays it to the user, who can review the schedule and make adjustments as necessary.

[0348] Input: Optimal visit sequence, travel route

[0349] Output: A displayed itinerary

[0350] Step 9:

[0351] On the day of the trip, the user uses their device to check real-time information on congestion, weather, and traffic at their destination. The server collects local information and combines it with the user's emotional data to provide optimal real-time advice. The user can then flexibly adjust their schedule based on this information.

[0352] Input: current location information, emotion data

[0353] Output: Real-time congestion, weather, and traffic information

[0354] Step 10:

[0355] While traveling, users upload photos and videos taken with their devices to a server through the application. The server receives the uploaded material, analyzes emotional data, and automatically applies filters to photos and adds captions to videos.

[0356] Input: photo data, video data, emotion data

[0357] Output: Edited and processed photos and videos

[0358] Step 11:

[0359] The edited and processed photos and videos are sent back to the device, where the user can check the generated content and, if they like it, post it to platforms such as social media.Specifically, the user checks the photos and videos on the application and posts them to social media.

[0360] Input: Edited and processed photos and videos

[0361] Output: Shareable content

[0362] (Application example 2)

[0363] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0364] The problem that this invention aims to solve is to make the travel experience richer and more satisfying by providing personalized suggestions using user emotional data in a system that supports travelers in easily enjoying sightseeing experiences in Japanese clothing. Another important problem is to improve the convenience and quality of the experience for travelers by providing information and generating content in real time during the trip.

[0365] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means. In this invention, the server includes: means for collecting information from a user regarding tourist spots that the user wishes to visit and types of Japanese clothing; means for generating a personalized recommended content list based on the information collected from the user; means for displaying the generated recommended content list to the user; means for calculating an optimal visiting order and transportation route based on the travel itinerary and information on tourist spots that the user wishes to visit, means for generating a travel schedule based on the calculated visiting order and transportation route; means for providing the generated travel schedule to the user; means for generating personalized content by combining images of tourist spots, types of Japanese clothing, and experience details based on the travel schedule; means for displaying the generated personalized content to the user; means for collecting congestion status, weather information, and traffic information at visiting destinations in real time on the day of the trip and providing the same to the user's terminal; means for uploading footage taken by the user during the trip and automatically editing and processing it to generate shareable content; This will significantly improve the travel experience by providing personalized sightseeing and dining experiences based on the user's emotions.

[0366] The "means for collecting information from the user regarding the tourist destinations they wish to visit and the type of Japanese clothing they prefer" refers to devices such as interfaces and sensors for inputting information about the tourist destinations they wish to visit and the type of Japanese clothing they prefer.

[0367] "Means for generating a personalized recommended content list" refers to algorithms and software for creating a list of tourist spots and Japanese clothing suggestions optimized for each user based on information and emotional data collected from the user.

[0368] "Means for calculating the optimal order of visits and transportation routes based on travel itinerary and information on desired tourist spots" refers to a system that analyzes the itinerary and information on tourist spots entered by the user, and calculates the optimal order of visits and transportation routes for tourist spots based on that information.

[0369] The "means for generating a travel schedule" is a program or device for generating a specific travel schedule based on the calculated visiting order and transportation route.

[0370] "Means for generating personalized content by combining images of tourist spots, types of Japanese clothing, and experience details based on travel schedules" refers to a system or algorithm that provides appropriate audio guidance and tourist experiences while taking into account each user's individual travel schedule.

[0371] The "means for displaying the personalized content to the user" refers to a device such as an interface or a display for displaying the generated personalized content on the user's terminal.

[0372] "Means of collecting real-time information on congestion, weather, and traffic conditions at destinations and providing it to the user's device" refers to a system that collects real-time information on congestion, weather, and traffic conditions at destinations and provides it to the user's device in order to maximize the user's convenience while traveling.

[0373] "Means for uploading materials taken by users while traveling and automatically editing and processing them to generate shareable content" refers to software or cloud services that allow users to upload photos and video data taken by users while traveling to a server, automatically edit and process them, and convert them into a shareable format.

[0374] "Means for recognizing user emotional data" refers to algorithms and sensors that analyze and determine the user's emotional state at any given time based on their input and behavioral data.

[0375] The "means for generating a personalized dish suggestion list" refers to a system or algorithm that generates a list of dishes that are considered to be optimal at any given time based on the user's emotional data and preferences.

[0376] "Means for displaying the suggested dish list to the user and supporting the user in ordering food" refers to an interface or application that displays the suggested dish list on the user's terminal and supports the user in easily ordering food.

[0377] MODE FOR CARRYING OUT THE INVENTION

[0378] This invention is a system that allows users to enjoy sightseeing experiences in traditional Japanese clothing, enriching the travel experience by making personalized suggestions using the user's emotional data. This system is built based on communication between the user's device and a server, and provides comprehensive support for trip planning, execution, and experience sharing. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it provides a more highly personalized experience.

[0379] System program generation

[0380] The program for this system is implemented using programming languages ​​such as Python and emotion recognition and recommendation engines such as EmotionEngine and FoodRecommender. Users access the system through a device such as a smartphone and enter the necessary information.

[0381] Explanation of program processing

[0382] Hardware and Software Configuration

[0383] User device: Smartphone

[0384] Emotion recognition engine: EmotionEngine

[0385] Suggestion engine: FoodRecommender

[0386] Cloud services and servers: Amazon Web Services (AWS), Google Cloud Platform (GCP), etc.

[0387] Data processing and calculation

[0388] The user inputs tourist destinations, types of Japanese clothing, travel schedule, emotional state, food preferences, etc. from the terminal. This information is sent to the server. The server performs the following processes based on the received information.

[0389] 1. Generate personalized recommendation lists:

[0390] The server uses AI to generate personalized tourist spot videos and experience content lists based on the user's preferred tourist spots, type of Japanese clothing, and emotional data.

[0391] 2. Generate travel schedule:

[0392] Based on the schedule and destination information entered by the user, the server calculates the optimal order of visits and transportation routes, and generates a travel schedule.

[0393] 3. Providing real-time information:

[0394] On the day of the trip, the server collects real-time information on congestion, weather, and traffic conditions at the destinations and provides it to the user's device, allowing the user to adjust their schedule flexibly.

[0395] 4. Automated Content Editing and Sharing:

[0396] Photos and videos taken by users during their trip are uploaded to the server, automatically edited and processed, and provided to users in a shareable format. The emotion engine applies appropriate filters and captions to the images.

[0397] 5. Personalized food suggestions:

[0398] Based on the user's emotional data and food preferences, the server uses an emotion recognition engine to generate and display a personalized list of food suggestions to the user, and also helps the user easily order food.

[0399] Examples of concrete examples and prompts

[0400] Specific examples

[0401] When a user launches the app, inputs "feeling tired" and selects "relaxing food," the emotion engine recognizes the "feeling tired" and sends it to the server, which then generates a list of dishes that are expected to have a relaxing effect (e.g., spicy tacos and beef stroganoff) and displays them on the user's device.

[0402] Prompt Sentence Examples

[0403] Enter the user's current mood, such as "Tired" or "Stressed"

[0404] Enter the type of food you want to eat. For example, "Relaxing food" or "Encouraging food."

[0405] As described above, the present invention is a system that provides personalized sightseeing and dining experiences based on the user's emotions, significantly improving the travel experience.

[0406] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0407] Step 1:

[0408] The user starts up the device and accesses the application. The user inputs the tourist spots they wish to visit, the type of Japanese clothing they would like to wear, their current emotional state, and their food preferences. The input information is then sent from the device to the server.

[0409] Input: tourist destination information, type of Japanese clothing, emotional state, food preferences

[0410] Output: Data sent from the device to the server

[0411] Step 2:

[0412] The server uses AI to generate a personalized list of recommended content based on the information collected from the user. An emotion recognition engine analyzes the emotional data and creates the recommendation list.

[0413] Input: User's tourist destination information, type of Japanese clothing, emotional data

[0414] Output: Recommended Content List

[0415] Step 3:

[0416] The server transmits the generated recommended content list to the terminal and displays it to the user.

[0417] Input: Recommended Content List

[0418] Output: Data displayed by the terminal

[0419] Step 4:

[0420] The user inputs the travel schedule and information on the tourist spots they wish to visit, and sends it from the terminal to the server.

[0421] Input: Travel dates, information on tourist spots you wish to visit

[0422] Output: Data sent from the device to the server

[0423] Step 5:

[0424] The server uses AI to calculate the optimal order of visits and transportation routes based on the date and desired places to visit entered by the user, and generates a travel schedule.

[0425] Input: Travel dates, information on tourist spots you wish to visit

[0426] Output: Travel schedule

[0427] Step 6:

[0428] A travel schedule is generated, transmitted to the terminal, and displayed to the user.

[0429] Input: Travel Schedule

[0430] Output: Data displayed by the terminal

[0431] Step 7:

[0432] On the day of the trip, the server collects real-time information on congestion at the destinations, weather information, and traffic information, and provides it to the user's terminal.

[0433] Input: Real-time information collection (traffic congestion, weather, traffic information)

[0434] Output: Real-time information data

[0435] Step 8:

[0436] Users upload photos and videos taken during their trip from their devices to the server, which then automatically edits and processes them to generate shareable content.

[0437] Input: Photos and videos taken during your trip

[0438] Output: Edited, shareable content

[0439] Step 9:

[0440] Based on the user's emotional data and food preferences, the server uses an emotion recognition engine to generate a personalized list of food suggestions, which are then sent to the device and displayed to the user.

[0441] Input: Emotional data, food preferences

[0442] Output: A personalized list of food suggestions

[0443] Step 10:

[0444] Users can easily order food by checking the list of suggested dishes and selecting from it.

[0445] Input: A list of dish suggestions

[0446] Output: Food order data

[0447] Through these steps, users can enjoy personalized sightseeing and dining experiences based on emotion data.

[0448] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0449] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0450] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0451] [Second embodiment]

[0452] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0453] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0454] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0455] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0456] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0457] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0458] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0459] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0460] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0461] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0462] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0463] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0464] This invention relates to a system that allows travelers to more easily enjoy sightseeing experiences in traditional Japanese clothing. This system comprehensively supports users' trip planning, execution, and experience sharing through communication with users' terminals and a server.

[0465] First, the user starts up their device and inputs into the application the tourist spots they want to visit and the types of Japanese clothing they are interested in. For example, if the user selects "Kyoto" as a destination and inputs that they are interested in "ninjas," the device sends this information to the server. The server receives the user's input information, and AI analyzes the user's interest trends. Based on the analysis results, a personalized list of recommended content is generated and displayed to the user via the device. The recommended content list is made up of a combination of tourist spot videos, types of Japanese clothing, and experience content.

[0466] Next, the user inputs their travel itinerary and potential destinations. For example, if they input that they would like to visit Kinkakuji Temple, Gion, and Nijo Castle on a three-day trip to Kyoto, the device sends this information to the server. Based on the inputted itinerary and destination data, the server uses AI to calculate the optimal visiting order and transportation routes. Based on the calculation results, a specific travel itinerary is generated and displayed to the user on the device.

[0467] On the day of the trip, users can check real-time information on the spot using their devices. For example, the server obtains local congestion, weather, and traffic information and provides it to the user's device. Users can then flexibly adjust their schedule based on this information.

[0468] Additionally, photos and videos taken by users during their trip are uploaded to a server via their device. The server automatically edits and processes the uploaded material to generate content that can be posted to social media. For example, the server applies filters to photos, shortens videos, and adds captions. The generated content is provided to the device, where users can post it to social media or save it to share with others.

[0469] For example, if a user takes a photo wearing traditional Japanese clothing at Kinkakuji Temple in Kyoto, the photo is instantly uploaded to the server. The server then selects a filter appropriate for the photo, automatically generates a caption, and provides it to the user's device. The user can then view the generated content on their device, and if they like it, they can post it directly to social media sites such as Instagram.

[0470] In this way, this system comprehensively supports users from before to after their travel experience, and by providing personalized content, makes the Japanese clothing experience at travel destinations even more appealing.

[0471] The processing flow will be explained below.

[0472] Step 1:

[0473] The user starts the terminal and accesses the application.

[0474] Step 2:

[0475] The user inputs the tourist spot they want to visit (e.g., Kyoto) and the type of Japanese clothing they are interested in (e.g., ninja).

[0476] Step 3:

[0477] The terminal transmits the input information to the server.

[0478] Step 4:

[0479] The server receives the user's input information, and AI analyzes the user's interest trends.

[0480] Step 5:

[0481] Based on the analysis results, the server generates a personalized list of recommended content, including related tourist spot videos, types of Japanese clothing, and experience content.

[0482] Step 6:

[0483] The terminal displays the generated recommended content list to the user.

[0484] Step 7:

[0485] The user inputs the desired travel dates and the tourist spots they want to visit (e.g., Kinkakuji Temple, Gion, Nijo Castle).

[0486] Step 8:

[0487] The terminal transmits the inputted schedule and visiting place information to the server.

[0488] Step 9:

[0489] Based on the received schedule and destination information, the server uses AI to calculate the optimal order of visits and transportation routes.

[0490] Step 10:

[0491] The server generates a specific travel schedule based on the calculation results.

[0492] Step 11:

[0493] The terminal displays the generated travel schedule to the user.

[0494] Step 12:

[0495] On the day of the trip, the user uses the terminal to check the congestion situation at tourist spots, weather information, and traffic information in real time.

[0496] Step 13:

[0497] The server collects local information and provides it to the user's terminal.

[0498] Step 14:

[0499] Users can flexibly adjust their travel schedules based on real-time information.

[0500] Step 15:

[0501] While traveling, users upload photos and videos taken on their devices to a server through the application.

[0502] Step 16:

[0503] The server automatically edits and processes the uploaded material (e.g., applying filters to photos or adding captions to videos).

[0504] Step 17:

[0505] The server generates edited and processed content.

[0506] Step 18:

[0507] The terminal provides the generated shareable content to the user.

[0508] Step 19:

[0509] Users can post the provided content to social media or save it as data.

[0510] Example 1

[0511] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0512] Conventional tourist travel systems are inadequate in creating personalized travel plans based on the user's interests and wishes, and in providing real-time information during the trip. Further improvements are needed to increase user satisfaction. Furthermore, editing content captured during the trip and sharing it on social media is cumbersome, making it difficult for users to easily share their travel memories with others. The present invention aims to solve these problems.

[0513] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0514] In this invention, the server includes means for collecting information from the user regarding tourist destinations desired to visit and types of Japanese clothing, means for generating a personalized recommended content list using a generative AI model, and means for calculating the optimal visiting order and transportation route based on the travel itinerary and desired tourist destination information entered by the user. This enables the creation of an optimal travel plan based on the user's interests and wishes. Furthermore, by automatically editing and processing footage taken during the trip, users can generate easily shareable content, allowing them to easily share their travel memories on social media and other platforms.

[0515] "User" refers to an individual who uses the system to plan and carry out a tourist trip.

[0516] A "terminal" is an electronic device that a user operates to input information or receive information from a server. Specifically, it includes smartphones and tablets.

[0517] A "server" is a computer system that processes data received from users and provides the required information and services.

[0518] "Desired tourist destinations" refer to places or areas that a user wishes to visit when traveling.

[0519] "Waso" refers to traditional Japanese clothing, including kimonos and hakama.

[0520] "Means of collecting information" refers to the methods and technologies for sending and receiving data entered by a user through a terminal to a server.

[0521] "Generative AI model" refers to an artificial intelligence algorithm that generates recommended content based on user input data.

[0522] A "personalized recommended content list" is a list of tourist attractions and experiences specially selected based on the user's interests and desires.

[0523] "Travel itinerary" refers to the period during which the user travels and the detailed schedule thereof.

[0524] The "visiting order" refers to the optimal order in which a user visits tourist spots during a trip.

[0525] "Transportation route" refers to the optimal travel route for touring tourist spots specified by the user.

[0526] A "travel schedule" is a detailed itinerary including visit orders and transportation routes that are useful when a user plans a trip.

[0527] "Real-time information" refers to the latest time-dependent data, such as current congestion status, weather information, and traffic information.

[0528] "Means for uploading materials" refers to the methods and technologies for transmitting photos and videos taken by users during their trip to a server.

[0529] "Means of automatic editing and processing" refers to technology that uses AI or algorithms to edit and process uploaded materials.

[0530] "Shareable content" refers to photos and videos that have been edited in a way that allows users to easily share them on social media and with other users.

[0531] The present invention relates to a system that enables travelers to more easily enjoy sightseeing experiences in traditional Japanese clothing. Specific embodiments of this system are described below.

[0532] First, the user starts up their device (such as a smartphone) and accesses the application. On the initial screen of the application, the user enters information about the tourist spots they want to visit and the types of Japanese clothing they are interested in. For example, the user selects "Kyoto" as a destination and enters that they are interested in "ninjas." This information is sent to the server via the device.

[0533] The server receives this user information and uses a generative AI model to analyze the user's interest trends. During the analysis, a prompt such as "What would you recommend for someone traveling to Kyoto who is interested in ninjas?" is input into the generative AI model. The AI ​​then generates a personalized list of recommended content that matches the user's interests. This list includes a combination of videos of tourist spots, types of Japanese clothing, and experience content. The generated content list is sent from the server to the device and displayed to the user.

[0534] Next, the user inputs their travel itinerary and the tourist spots they wish to visit into the application. For example, they might input, "I'd like to visit Kinkaku-ji Temple, Gion, and Nijo Castle on a three-day trip to Kyoto." The device then sends this information to the server. The server receives the input date and destination information and uses AI to calculate the optimal order of visits and transportation routes. As a result of the calculation, a specific travel itinerary is generated and sent to the device. The user can then view this travel itinerary in the application.

[0535] Furthermore, on the day of the trip, users can use their devices to check on-site information in real time. The server obtains local congestion, weather, traffic information, and other information via the Internet and provides it to the user's device. Users can flexibly adjust their travel schedule based on this information.

[0536] While traveling, users take photos and videos and upload them to a server via their device. The server receives this material and automatically edits and processes it using generative AI models. For example, it applies appropriate filters to photos, shortens and edits videos, and automatically generates appropriate captions. The shareable content generated in this way is then sent from the server to the device, where users can easily post it to social media.

[0537] For example, if a user takes a photo of themselves wearing traditional Japanese clothing at Kinkakuji Temple in Kyoto, the photo is instantly uploaded to the server. The server selects a filter appropriate for the photo and automatically generates a caption, such as "Experiencing traditional Japanese clothing at Kinkakuji Temple, Kinkakuji Temple, Kyoto," which is then provided to the user's device. The user can then review the generated content and, if they like it, post it directly to a social networking site.

[0538] This system will comprehensively support users from before to after their travel experience and provide personalized content, making the Japanese clothing experience at travel destinations even more appealing.

[0539] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0540] Step 1:

[0541] The user starts up the device and accesses the application. On the initial screen, they input information about the tourist spots they want to visit and the type of Japanese clothing they are interested in. For example, they select "Kyoto" as their destination and input that they are interested in "ninjas." At this time, the device sends the user's input information to the server.

[0542] Input: The tourist spot you want to visit and the type of Japanese clothing you want to wear.

[0543] Output: User input sent to the server

[0544] Step 2:

[0545] The server inputs the received information into the generative AI model. The generative AI model receives a prompt such as "What would you recommend to someone traveling to Kyoto who is interested in ninjas?" and the model performs an analysis. The AI ​​analyzes the user's interests and generates a personalized list of recommended content. This list includes a combination of tourist spot footage, types of Japanese clothing, and experience content. The generated content list is sent from the server to the device and displayed to the user.

[0546] Input: User input received by the server

[0547] Output: The generated personalized recommendation list

[0548] Step 3:

[0549] The user inputs their travel itinerary and potential destinations into the application. For example, they might input, "I'd like to visit Kinkakuji Temple, Gion, and Nijo Castle on a three-day trip to Kyoto." The device then sends this information to the server. The server receives the input date and destination information and uses AI to calculate the optimal order of visits and transportation routes. The calculation results are generated as a specific travel itinerary and sent to the device.

[0550] Input: User-entered travel dates and potential destinations

[0551] Output: Generated concrete travel schedule

[0552] Step 4:

[0553] On the day of the trip, the user uses the device to check on-site information in real time. The server obtains local congestion, weather, traffic information, etc. via the Internet and provides it to the user's device. Based on this information, the user can flexibly adjust their travel schedule. For example, information such as "Kinkaku-ji Temple is crowded, but Gion is empty" may be displayed.

[0554] Input: Local information obtained by the server via the Internet

[0555] Output: Real-time local information displayed on the user's device

[0556] Step 5:

[0557] During a trip, users take photos and videos and upload them to a server via their device. The server receives this material and automatically edits and processes it using generative AI models. For example, it applies filters to photos, shortens and edits videos, and automatically generates appropriate captions. The generated shareable content is then sent from the server to the device, where users can easily post it to social media.

[0558] Input: Photos and videos taken and uploaded by users

[0559] Output: Automatically edited and enhanced shareable content

[0560] Step 6:

[0561] For example, if a user takes a photo of themselves wearing traditional Japanese clothing at Kinkaku-ji Temple in Kyoto, the photo is instantly uploaded to the server. The server selects a filter appropriate for the photo and automatically generates a caption such as "Experience traditional Japanese clothing at Kinkaku-ji Temple, Kinkaku-ji Temple, Kyoto." The generated content is then provided to the user's device, where they can review it and, if they like it, post it to a social networking site.

[0562] Input: A photo taken by the user at Kinkakuji Temple

[0563] Output: Filtered and captioned content

[0564] (Application example 1)

[0565] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0566] Although many modern travelers are interested in experiencing Japanese clothing, they face challenges in planning their trips, selecting Japanese clothing, gathering real-time information at tourist spots, and effectively sharing their travel memories on social media. Furthermore, there is a lack of appropriate guidance in brick-and-mortar stores on how to select and put on Japanese clothing, preventing travelers from enjoying their travel experiences to the fullest.

[0567] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0568] In this invention, the server includes means for collecting information from the user regarding tourist spots that the user wishes to visit and types of Japanese clothing, means for generating a personalized recommended content list, and means for displaying the generated recommended content list to the user, thereby enabling the user to receive personalized support throughout the entire process from planning to carrying out and sharing the tour.

[0569] The system also includes a means for calculating the optimal order of visits and transportation routes based on the travel itinerary and information on desired tourist spots to generate a travel schedule, and a means for generating personalized content by combining tourist spot images, types of Japanese clothing, and experience details based on the generated travel schedule, thereby enabling users to travel efficiently and enjoyably.

[0570] Furthermore, there will be a means to collect real-time information on congestion, weather, and traffic conditions at destinations on the day of the trip and provide it to the user's device, a means to upload footage taken by the user during the trip and automatically edit and process it to generate shareable content, and a means to display how to select and wear Japanese clothing in physical stores. This will improve the comfort of the trip and make it easier to share memories.

[0571] It also includes a way to automatically select filters and generate captions for users' photos and edit them into shareable content, allowing them to easily share their travel memories on social media and reach more people. This not only makes the travel experience richer and more engaging, but also provides useful information to others.

[0572] The "means for collecting information from the user about tourist spots that the user wants to visit and types of Japanese clothing" is a device or program that acquires data about tourist spots that the user wants to visit and types of Japanese clothing that the user is interested in.

[0573] The "means for generating a personalized recommended content list" is a device or program that creates a list that suggests individually optimized tourist information and Japanese clothing experiences based on information entered by the user.

[0574] The "means for displaying the generated recommended content list to the user" refers to a device or program that displays the generated list of recommended tourist spot information and Japanese clothing experiences on the user's terminal.

[0575] "Means for calculating the optimal visiting order and travel route based on the travel itinerary and information on the tourist destinations desired to be visited" refers to a device or program that calculates the effective visiting order and travel route based on the travel itinerary and data on the tourist destinations desired to be visited specified by the user.

[0576] The "means for generating a travel schedule" is a device or program that creates a detailed travel schedule based on the calculated visiting order and transportation routes.

[0577] The "means for providing the generated travel schedule to the user" is a device or program that displays the generated travel schedule on the user's terminal.

[0578] "Means for generating personalized content by combining images of tourist spots, types of Japanese clothing, and experience content" refers to a device or program that generates individually optimized content by combining images of tourist spots, types of Japanese clothing, and experience content based on a travel schedule.

[0579] "Means for collecting congestion status, weather information, and traffic information of destinations in real time on the day of travel and providing it to the user's terminal" refers to a device or program that obtains current congestion status, weather, and traffic information of tourist destinations in real time and provides it to the user's terminal.

[0580] "Means for uploading materials taken by users while traveling and automatically editing and processing them to generate shareable content" refers to a device or program that allows users to upload photos and videos they have taken, automatically performs editing such as filtering and adding captions, and generates shareable content.

[0581] The "means for displaying the selection of Japanese clothing and how to wear it in a physical store" is a device or program that visually displays the Japanese clothing selected by the user and how to wear it in a physical store.

[0582] "Means for automatically selecting filters and generating captions for content captured by a user, and editing the content into shareable content" refers to a device or program that applies optimal filters to images and videos captured by a user, automatically generates captions, and edits the content into a format that can be shared on social media, etc.

[0583] This system allows users to easily and attractively experience sightseeing in traditional Japanese clothing. Specifically, it comprehensively supports users from planning their trip to experiencing the store, and editing and sharing photos and videos they have taken.

[0584] The general flow of the system is as follows:

[0585] Hardware and Software Configuration

[0586] Hardware:

[0587] Smartphones (e.g. iPhone, Android smartphones)

[0588] Smart glasses (e.g. Google Glass, Microsoft HoloLens)

[0589] Server (e.g. AWS, GCP)

[0590] software:

[0591] Frontend: React Native (a cross-platform mobile application development tool)

[0592] Backend: Node.js (server-side framework), MongoDB (database)

[0593] AI analysis: TensorFlow (machine learning library), Computer Vision API (image recognition)

[0594] Cloud services: AWS (Amazon Web Services) or GCP (Google Cloud Platform)

[0595] Specific steps for carrying out the invention

[0596] 1. User input

[0597] The user inputs into the application the tourist spots they wish to visit and the type of Japanese clothing they are interested in. For example, if they select "Kyoto" and "Ninja" Japanese clothing, the device sends this information to the server.

[0598] 2. Information analysis and personalized content generation

[0599] Based on the information collected from the user, the server uses an AI analysis engine (TensorFlow) to analyze the user's interests and generate a personalized list of recommended content.

[0600] The generated content list is displayed on a smartphone or smart glasses.

[0601] 3. Optimizing travel planning

[0602] When a user inputs their travel dates and desired places to visit, the server calculates the optimal order of visits and transportation routes, and generates a detailed travel schedule, which is then provided to the user's terminal.

[0603] 4. Providing real-time information on-site

[0604] On the day of the trip, the server collects real-time information on congestion, weather, and traffic conditions at the destinations and provides it to the user's device, allowing the user to adjust their schedule accordingly.

[0605] 5. Experience wearing traditional Japanese clothing at a physical store

[0606] At the physical store, users can choose a kimono and check how to dress using smart glasses or a smartphone, making dressing a smooth process.

[0607] 6. Automate content editing and sharing

[0608] Photos and videos taken by users during their trip are uploaded to a server, where filters and captions are automatically applied. The edited content is then delivered to the user's device and can be easily shared on social media.

[0609] Examples of concrete examples and prompts

[0610] As a concrete example, consider the case where a user takes a photo of themselves wearing traditional Japanese ninja attire at Kinkakuji Temple in Kyoto. This photo is instantly uploaded to the server, which selects an appropriate filter for the photo, automatically generates a caption, and provides it to the user's device.

[0611] An example prompt is:

[0612] "Add a caption to your photo of yourself in ninja attire at Kinkakuji Temple in Kyoto and choose a filter to post to Instagram."

[0613] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0614] Step 1:

[0615] The user inputs the tourist spots they wish to visit and the type of Japanese clothing they would like to wear into the terminal, and the input information is sent from the terminal to the server.

[0616] Input: Information about tourist spots and types of Japanese clothing entered by the user using a smartphone or smart glasses.

[0617] Data processing: The terminal converts the user-entered information into an appropriate format and sends it to the server.

[0618] Output: User input information received by the server.

[0619] Step 2:

[0620] The server uses an AI analysis engine (TensorFlow) to analyze the user's interests based on the received information, and generates a personalized list of recommended content based on the analysis results.

[0621] Input: User-entered information (tourist destination and type of Japanese clothing).

[0622] Data calculation: Analyze user interest trends using TensorFlow and generate a list of recommended content.

[0623] Output: A personalized list of recommended content.

[0624] Step 3:

[0625] The server transmits the generated recommended content list to the terminal and displays it to the user.

[0626] Input: A personalized list of recommended content.

[0627] Data processing: The server converts the content list into an appropriate format and sends it to the terminal.

[0628] Output: The device displays a list of recommended content to the user.

[0629] Step 4:

[0630] The user inputs the travel itinerary and desired places to visit into the terminal, and the input information is sent from the terminal to the server.

[0631] Input: Travel itinerary and desired places to visit entered by the user using a smartphone or smart glasses.

[0632] Data processing: The terminal converts the user-entered information into an appropriate format and sends it to the server.

[0633] Output: User input information received by the server.

[0634] Step 5:

[0635] Based on the information received, the server uses an AI analysis engine to calculate the optimal order of visits and transportation routes, and generates a detailed travel schedule.

[0636] Input: User-entered information (travel dates and desired places to visit).

[0637] Data calculation: An AI analysis engine optimizes visit order and transportation routes to generate a travel schedule.

[0638] Output: Optimized travel schedule.

[0639] Step 6:

[0640] The server transmits the generated travel schedule to the terminal and provides it to the user.

[0641] Input: The generated travel schedule.

[0642] Data processing: The server converts the travel schedule into an appropriate format and sends it to the terminal.

[0643] Output: The terminal displays the travel schedule to the user.

[0644] Step 7:

[0645] On the day of the trip, the server collects real-time information on congestion at the destinations, weather information, and traffic information, and provides it to the user's terminal.

[0646] Input: Real-time congestion, weather, and traffic information.

[0647] Data calculation: The server analyzes this information and updates the user's travel schedule.

[0648] Output: Updated real-time information is displayed on the user's terminal.

[0649] Step 8:

[0650] Using the terminal, users can choose Japanese clothing at a physical store and check how to wear it.

[0651] Input: Information about the Japanese clothing selected by the user.

[0652] Data processing: The terminal displays information about the kimono and provides instructions on how to put it on.

[0653] Output: Japanese clothing and how to wear it displayed on smart glasses or smartphone.

[0654] Step 9:

[0655] Users upload photos and videos they take while traveling from their device to the server, which then automatically selects filters and generates captions based on the uploaded photos and videos.

[0656] Input: Photos and videos taken by the user.

[0657] Data processing: The server uses the Computer Vision API to edit, filter, and generate captions.

[0658] Output: Edited photos and videos are generated.

[0659] Step 10:

[0660] The generated photos and videos are delivered to the user's device and converted into a format that can be easily shared on social media.

[0661] Input: Edited photos and videos.

[0662] Data processing: The server converts the data into a shareable format and sends it to the device.

[0663] Output: The content that can be shared on social media is displayed on the user's device.

[0664] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0665] This invention relates to a system that allows travelers to more easily enjoy sightseeing experiences in traditional Japanese clothing. This system comprehensively supports the user's trip, from planning to execution and experience sharing, through communication with the user's terminal and server. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it provides a more highly personalized experience.

[0666] First, the user starts up the device and accesses the application. The user inputs the tourist spot they want to visit (e.g., Kyoto) and the type of Japanese clothing they are interested in (e.g., ninja). The device sends this information to the server. At the same time, the emotion engine recognizes the user's emotions from their input and interactions.

[0667] The server receives the user's input information and emotional data, and AI analyzes the user's interests and emotional state. Based on the analysis results, a personalized list of recommended content is generated and displayed to the user via their device. The recommended content list is made up of a combination of tourist spot videos, types of Japanese clothing, and experience content.

[0668] Next, the user inputs their travel itinerary and potential destinations. For example, if they input that they would like to visit Kinkakuji Temple, Gion, and Nijo Castle on a three-day trip to Kyoto, the device will send this information to the server. The emotion engine will also continue to collect the user's emotion data and send it to the server.

[0669] The server receives the itinerary, destination information, and emotion data, and the AI ​​calculates the optimal visit order and transportation route. Based on the calculation results, a specific travel schedule is generated and displayed to the user via the device. During this process, the visit order and schedule are adjusted based on the user's emotion data to provide a more enjoyable experience.

[0670] On the day of the trip, users can use their devices to check real-time information on the congestion status of tourist attractions, weather information, and traffic information. The server collects local information and combines it with the user's emotional data to provide optimal real-time advice, allowing users to flexibly adjust their schedules based on this information.

[0671] While traveling, users upload photos and videos taken with their devices to the server through the application. The server automatically edits and processes the uploaded materials (e.g., applying filters to photos and adding captions to videos). The emotion engine analyzes the user's emotional data to generate more engaging content.

[0672] For example, if a user takes a photo wearing traditional Japanese clothing at Kinkakuji Temple in Kyoto, the photo is instantly uploaded to the server. The server analyzes the photo, selects a filter based on the user's emotional state at the time, automatically generates a caption, and provides it to the user's device. The user can then view the generated content on their device, and if they like it, they can post it directly to social media sites such as Instagram.

[0673] In this way, this system comprehensively supports users' travel experiences from before to after, and by providing personalized content, makes the Japanese clothing experience at travel destinations even more appealing. Furthermore, by combining it with an emotion engine, it is possible to provide an optimal experience according to the user's emotions, increasing travel satisfaction.

[0674] The processing flow will be explained below.

[0675] Step 1:

[0676] The user starts the terminal and accesses the application.

[0677] Step 2:

[0678] The user inputs the tourist spot they want to visit (e.g., Kyoto) and the type of Japanese clothing they are interested in (e.g., ninja).

[0679] Step 3:

[0680] The device sends the input information to the server, and at the same time, the emotion engine recognizes the user's emotions from their input and interactions and collects emotion data.

[0681] Step 4:

[0682] The server receives the user's input information and emotion data.

[0683] Step 5:

[0684] Based on the received information, the server uses AI to analyze the user's interests and emotional state. Based on the analysis results, it generates a personalized list of recommended content, including related tourist spot videos, types of Japanese clothing, and experience content.

[0685] Step 6:

[0686] The terminal displays the generated recommended content list to the user.

[0687] Step 7:

[0688] The user inputs the desired travel dates and the tourist spots they want to visit (e.g., Kinkakuji Temple, Gion, Nijo Castle).

[0689] Step 8:

[0690] The terminal transmits the input itinerary and destination information to the server. The emotion engine also continues to collect the user's emotion data and transmits it to the server.

[0691] Step 9:

[0692] The server receives information on the itinerary and destinations, as well as emotional data, and the AI ​​calculates the optimal order of visits and transportation routes. By taking emotional data into account, the calculations are made to ensure the user has a more enjoyable experience.

[0693] Step 10:

[0694] The server generates a specific travel schedule based on the calculation results.

[0695] Step 11:

[0696] The terminal displays the generated travel schedule to the user.

[0697] Step 12:

[0698] On the day of the trip, the user uses the terminal to check the congestion situation at tourist spots, weather information, and traffic information in real time.

[0699] Step 13:

[0700] The server collects local information and combines it with the user's emotional data to provide optimal real-time advice.

[0701] Step 14:

[0702] Users can flexibly adjust their travel schedules based on real-time information.

[0703] Step 15:

[0704] While traveling, users upload photos and videos taken on their devices to a server through the application.

[0705] Step 16:

[0706] The server automatically edits and processes the uploaded material. Specifically, an emotion engine analyzes the user's emotional data and automatically generates filters and captions based on their emotions at the time.

[0707] Step 17:

[0708] The server generates edited and processed content.

[0709] Step 18:

[0710] The terminal provides the generated shareable content to the user.

[0711] Step 19:

[0712] Users can post the provided content to social media or save it as data.

[0713] Example 2

[0714] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0715] Conventional travel planning systems have struggled to provide a personalized experience that fully reflects users' individual needs and emotions, making it difficult to achieve a satisfying travel experience. Furthermore, there were few systems that comprehensively supported the provision of real-time information during travel or the automatic editing and processing of user-generated content. This meant that users lacked consistent support from trip planning to execution and content sharing.

[0716] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for collecting information on destinations desired to be visited and types of costumes from the user, means using a generative AI model for generating a personalized recommended content list based on the information and emotion data collected from the user, and means for displaying the generated recommended content list to the user. This makes it possible to provide a personalized experience that reflects the individual needs and emotions of the user.

[0717] "User" refers to a person who uses the system to make travel plans.

[0718] "Terminal" refers to an electronic device used by a user, such as a computer, smartphone, or tablet.

[0719] "Server" refers to a computer system for receiving and processing information sent by users.

[0720] "Destination" refers to a place or tourist attraction that the user plans to visit.

[0721] "Outfit" refers to the type of Japanese clothing or specific clothing that the user plans to wear during their trip.

[0722] "Emotional data" refers to data relating to the emotional state recognized through the user's input and operational behavior.

[0723] "Generative AI model" refers to an artificial intelligence model that generates personalized content based on data obtained from users.

[0724] "Recommended content list" refers to a list of tourist attractions and experiences generated based on the user's interests and emotional state.

[0725] "Travel route" refers to the optimal travel route between the tourist destinations to be visited.

[0726] A "travel plan" refers to a plan including the order of tourist spots that a user will visit, the schedule, and transportation methods.

[0727] "Customized content" refers to tourism videos and experience content created to reflect the individual needs and emotions of users.

[0728] "Real-time information" refers to current information such as the congestion situation at tourist spots, weather information, and traffic information on the day of travel.

[0729] "Automatic editing and processing" refers to the process of automatically editing photos and videos taken by users, applying filters and adding captions.

[0730] "Shareable Content" refers to photos and videos that have been edited or enhanced and are in a format that users can share with others.

[0731] The present invention relates to a system that allows travelers to wear costumes and enjoy travel experiences more easily. This system comprehensively supports the user's trip from planning to execution and experience sharing through the user's terminal, server, and emotion engine.

[0732] First, the user starts up the device and accesses the application. The user inputs the destination they want to visit and the type of costume they are interested in. For example, the user inputs "Kyoto" and selects "ninja costume." This information is sent from the device to the server. At the same time, the emotion engine analyzes emotion data from the user's input and operation behavior. This emotion data is also sent to the server.

[0733] The server analyzes the received destination and costume information and emotional data using a generative AI model. Specifically, it uses an AI module built with Python and TensorFlow to accurately analyze the user's interests and emotional state. Based on the analysis results, a personalized recommended content list is generated and displayed to the user via their device. The recommended content list displayed here includes destination videos and costume experience details.

[0734] Next, the user enters their travel itinerary and potential destinations into the application. For example, they might enter, "I'd like to visit Kinkaku-ji Temple, Gion, and Nijo Castle during my three-day trip to Kyoto." The device then sends this information to the server. At the same time, the emotion engine continues to collect the user's emotion data and send it to the server.

[0735] The server uses the received schedule information and emotion data to have the AI ​​module calculate the optimal visit order and travel route. Based on the results of this calculation, a specific travel plan is generated and displayed to the user via their device. The visit order and schedule are adjusted taking into account the user's emotion data.

[0736] On the day of the trip, users can check real-time congestion, weather, and traffic information at their destinations on their devices. The server collects local information and combines it with emotion data to provide optimal real-time advice, allowing users to flexibly adjust their schedules.

[0737] While traveling, users upload photos and videos taken with their device to a server through the application. The server receives the uploaded material, analyzes emotional data, and automatically edits it by applying filters to photos or adding captions to videos. The edited content is then sent back to the device, where the user can review it and post it to social media.

[0738] For example, if a user takes a photo wearing traditional Japanese clothing at Kinkakuji Temple in Kyoto, the photo is instantly uploaded to the server. The server analyzes the photo and automatically generates a filter and caption based on the user's emotional data at the time, and provides it to the device. The user can then view the generated content on their device and post it to social media.

[0739] Here are some example prompts using a generative AI model:

[0740] "I've chosen Kyoto as my next travel destination. I'd like to visit Kinkaku-ji Temple, Gion, and Nijo Castle. What's the best order to visit them in and what are the transportation routes? I'd also like to try on traditional Japanese clothing during my trip."

[0741] "Automatically filter and caption photos taken during your trip. Edit them taking into account emotional data."

[0742] In this way, the system provides a personalized experience that reflects individual needs and emotions, making the user's travel experience even more attractive.

[0743] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0744] Step 1:

[0745] The user starts up the device and accesses the application. The user inputs the destination they wish to visit and the type of costume they are interested in on the application screen. At this time, they input "Kyoto" and "Ninja" as specific actions. The destination and costume information are generated as input data.

[0746] Input: Destination, costume type

[0747] Output: Destination information, costume information

[0748] Step 2:

[0749] The device sends the destination and outfit information entered by the user to the server. At the same time, the emotion engine analyzes the user's input and operational behavior to generate emotion data, which is also sent to the server.

[0750] Input: Destination information, costume information, operation behavior data

[0751] Output: Emotion data

[0752] Step 3:

[0753] The server inputs the received destination, costume information, and emotional data into the generative AI model. The generative AI model analyzes this data and generates a personalized list of recommended content based on the user's interests and emotional state. Specifically, it lists tourist spots and experience courses that are suitable for the destination "Kyoto" and the costume "Ninja."

[0754] Input: Destination information, costume information, emotion data

[0755] Output: Recommended content list

[0756] Step 4:

[0757] The server sends the generated recommended content list to the terminal, which then displays the recommended content list to the user. The user can scroll through the screen to check the recommended tourist spot videos and clothing experience content.

[0758] Input: Recommended content list

[0759] Output: Displayed list of recommended content

[0760] Step 5:

[0761] The user inputs the travel itinerary and desired destinations into the application. For example, "I would like to visit Kinkaku-ji Temple, Gion, and Nijo Castle on a three-day trip to Kyoto." The specific actions are to select the itinerary and add the destinations to be visited.

[0762] Input: Dates, desired destination information

[0763] Output: Travel itinerary information, destination information

[0764] Step 6:

[0765] The terminal transmits the travel itinerary information and the desired destination information to the server. The emotion engine then analyzes the user's emotion data, which is also transmitted to the server.

[0766] Input: Travel itinerary information, destination information, continuous operation behavior data

[0767] Output: Emotion data

[0768] Step 7:

[0769] The server calculates the optimal visit order and travel route based on the received itinerary information and emotion data. Specifically, the AI ​​module calculates the optimal visit order and travel route for Kinkaku-ji Temple, Gion, and Nijo Castle. A specific travel plan is generated based on the calculation results.

[0770] Input: Travel itinerary information, destination information, emotion data

[0771] Output: Optimal visit sequence and travel route

[0772] Step 8:

[0773] The server sends the generated itinerary to the terminal, which displays it to the user, who can review the schedule and make adjustments as necessary.

[0774] Input: Optimal visit sequence, travel route

[0775] Output: A displayed itinerary

[0776] Step 9:

[0777] On the day of the trip, the user uses their device to check real-time information on congestion, weather, and traffic at their destination. The server collects local information and combines it with the user's emotional data to provide optimal real-time advice. The user can then flexibly adjust their schedule based on this information.

[0778] Input: current location information, emotion data

[0779] Output: Real-time congestion, weather, and traffic information

[0780] Step 10:

[0781] While traveling, users upload photos and videos taken with their devices to a server through the application. The server receives the uploaded material, analyzes emotional data, and automatically applies filters to photos and adds captions to videos.

[0782] Input: photo data, video data, emotion data

[0783] Output: Edited and processed photos and videos

[0784] Step 11:

[0785] The edited and processed photos and videos are sent back to the device, where the user can check the generated content and, if they like it, post it to platforms such as social media.Specifically, the user checks the photos and videos on the application and posts them to social media.

[0786] Input: Edited and processed photos and videos

[0787] Output: Shareable content

[0788] (Application example 2)

[0789] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0790] The problem that this invention aims to solve is to make the travel experience richer and more satisfying by providing personalized suggestions using user emotional data in a system that supports travelers in easily enjoying sightseeing experiences in Japanese clothing. Another important problem is to improve the convenience and quality of the experience for travelers by providing information and generating content in real time during the trip.

[0791] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means. In this invention, the server includes: means for collecting information from a user regarding tourist spots that the user wishes to visit and types of Japanese clothing; means for generating a personalized recommended content list based on the information collected from the user; means for displaying the generated recommended content list to the user; means for calculating an optimal visiting order and transportation route based on the travel itinerary and information on tourist spots that the user wishes to visit, means for generating a travel schedule based on the calculated visiting order and transportation route; means for providing the generated travel schedule to the user; means for generating personalized content by combining images of tourist spots, types of Japanese clothing, and experience details based on the travel schedule; means for displaying the generated personalized content to the user; means for collecting congestion status, weather information, and traffic information at visiting destinations in real time on the day of the trip and providing the same to the user's terminal; means for uploading footage taken by the user during the trip and automatically editing and processing it to generate shareable content; This will significantly improve the travel experience by providing personalized sightseeing and dining experiences based on the user's emotions.

[0792] The "means for collecting information from the user regarding the tourist destinations they wish to visit and the type of Japanese clothing they prefer" refers to devices such as interfaces and sensors for inputting information about the tourist destinations they wish to visit and the type of Japanese clothing they prefer.

[0793] "Means for generating a personalized recommended content list" refers to algorithms and software for creating a list of tourist spots and Japanese clothing suggestions optimized for each user based on information and emotional data collected from the user.

[0794] "Means for calculating the optimal order of visits and transportation routes based on travel itinerary and information on desired tourist spots" refers to a system that analyzes the itinerary and information on tourist spots entered by the user, and calculates the optimal order of visits and transportation routes for tourist spots based on that information.

[0795] The "means for generating a travel schedule" is a program or device for generating a specific travel schedule based on the calculated visiting order and transportation route.

[0796] "Means for generating personalized content by combining images of tourist spots, types of Japanese clothing, and experience details based on travel schedules" refers to a system or algorithm that provides appropriate audio guidance and tourist experiences while taking into account each user's individual travel schedule.

[0797] The "means for displaying the personalized content to the user" refers to a device such as an interface or a display for displaying the generated personalized content on the user's terminal.

[0798] "Means of collecting real-time information on congestion, weather, and traffic conditions at destinations and providing it to the user's device" refers to a system that collects real-time information on congestion, weather, and traffic conditions at destinations and provides it to the user's device in order to maximize the user's convenience while traveling.

[0799] "Means for uploading materials taken by users while traveling and automatically editing and processing them to generate shareable content" refers to software or cloud services that allow users to upload photos and video data taken by users while traveling to a server, automatically edit and process them, and convert them into a shareable format.

[0800] "Means for recognizing user emotional data" refers to algorithms and sensors that analyze and determine the user's emotional state at any given time based on their input and behavioral data.

[0801] The "means for generating a personalized dish suggestion list" refers to a system or algorithm that generates a list of dishes that are considered to be optimal at any given time based on the user's emotional data and preferences.

[0802] "Means for displaying the suggested dish list to the user and supporting the user in ordering food" refers to an interface or application that displays the suggested dish list on the user's terminal and supports the user in easily ordering food.

[0803] MODE FOR CARRYING OUT THE INVENTION

[0804] This invention is a system that allows users to enjoy sightseeing experiences in traditional Japanese clothing, enriching the travel experience by making personalized suggestions using the user's emotional data. This system is built based on communication between the user's device and a server, and provides comprehensive support for trip planning, execution, and experience sharing. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it provides a more highly personalized experience.

[0805] System program generation

[0806] The program for this system is implemented using programming languages ​​such as Python and emotion recognition and recommendation engines such as EmotionEngine and FoodRecommender. Users access the system through a device such as a smartphone and enter the necessary information.

[0807] Explanation of program processing

[0808] Hardware and Software Configuration

[0809] User device: Smartphone

[0810] Emotion recognition engine: EmotionEngine

[0811] Suggestion engine: FoodRecommender

[0812] Cloud services and servers: Amazon Web Services (AWS), Google Cloud Platform (GCP), etc.

[0813] Data processing and calculation

[0814] The user inputs tourist destinations, types of Japanese clothing, travel schedule, emotional state, food preferences, etc. from the terminal. This information is sent to the server. The server performs the following processes based on the received information.

[0815] 1. Generate personalized recommendation lists:

[0816] The server uses AI to generate personalized tourist spot videos and experience content lists based on the user's preferred tourist spots, type of Japanese clothing, and emotional data.

[0817] 2. Generate travel schedule:

[0818] Based on the schedule and destination information entered by the user, the server calculates the optimal order of visits and transportation routes, and generates a travel schedule.

[0819] 3. Providing real-time information:

[0820] On the day of the trip, the server collects real-time information on congestion, weather, and traffic conditions at the destinations and provides it to the user's device, allowing the user to adjust their schedule flexibly.

[0821] 4. Automated Content Editing and Sharing:

[0822] Photos and videos taken by users during their trip are uploaded to the server, automatically edited and processed, and provided to users in a shareable format. The emotion engine applies appropriate filters and captions to the images.

[0823] 5. Personalized food suggestions:

[0824] Based on the user's emotional data and food preferences, the server uses an emotion recognition engine to generate and display a personalized list of food suggestions to the user, and also helps the user easily order food.

[0825] Examples of concrete examples and prompts

[0826] Specific examples

[0827] When a user launches the app, inputs "feeling tired" and selects "relaxing food," the emotion engine recognizes the "feeling tired" and sends it to the server, which then generates a list of dishes that are expected to have a relaxing effect (e.g., spicy tacos and beef stroganoff) and displays them on the user's device.

[0828] Prompt Sentence Examples

[0829] Enter the user's current mood, such as "Tired" or "Stressed"

[0830] Enter the type of food you want to eat. For example, "Relaxing food" or "Encouraging food."

[0831] As described above, the present invention is a system that provides personalized sightseeing and dining experiences based on the user's emotions, significantly improving the travel experience.

[0832] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0833] Step 1:

[0834] The user starts up the device and accesses the application. The user inputs the tourist spots they wish to visit, the type of Japanese clothing they would like to wear, their current emotional state, and their food preferences. The input information is then sent from the device to the server.

[0835] Input: tourist destination information, type of Japanese clothing, emotional state, food preferences

[0836] Output: Data sent from the device to the server

[0837] Step 2:

[0838] The server uses AI to generate a personalized list of recommended content based on the information collected from the user. An emotion recognition engine analyzes the emotional data and creates the recommendation list.

[0839] Input: User's tourist destination information, type of Japanese clothing, emotional data

[0840] Output: Recommended Content List

[0841] Step 3:

[0842] The server transmits the generated recommended content list to the terminal and displays it to the user.

[0843] Input: Recommended Content List

[0844] Output: Data displayed by the terminal

[0845] Step 4:

[0846] The user inputs the travel schedule and information on the tourist spots they wish to visit, and sends it from the terminal to the server.

[0847] Input: Travel dates, information on tourist spots you wish to visit

[0848] Output: Data sent from the device to the server

[0849] Step 5:

[0850] The server uses AI to calculate the optimal order of visits and transportation routes based on the date and desired places to visit entered by the user, and generates a travel schedule.

[0851] Input: Travel dates, information on tourist spots you wish to visit

[0852] Output: Travel schedule

[0853] Step 6:

[0854] A travel schedule is generated, transmitted to the terminal, and displayed to the user.

[0855] Input: Travel Schedule

[0856] Output: Data displayed by the terminal

[0857] Step 7:

[0858] On the day of the trip, the server collects real-time information on congestion at the destinations, weather information, and traffic information, and provides it to the user's terminal.

[0859] Input: Real-time information collection (traffic congestion, weather, traffic information)

[0860] Output: Real-time information data

[0861] Step 8:

[0862] Users upload photos and videos taken during their trip from their devices to the server, which then automatically edits and processes them to generate shareable content.

[0863] Input: Photos and videos taken during your trip

[0864] Output: Edited, shareable content

[0865] Step 9:

[0866] Based on the user's emotional data and food preferences, the server uses an emotion recognition engine to generate a personalized list of food suggestions, which are then sent to the device and displayed to the user.

[0867] Input: Emotional data, food preferences

[0868] Output: A personalized list of food suggestions

[0869] Step 10:

[0870] Users can easily order food by checking the list of suggested dishes and selecting from it.

[0871] Input: A list of dish suggestions

[0872] Output: Food order data

[0873] Through these steps, users can enjoy personalized sightseeing and dining experiences based on emotion data.

[0874] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0875] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0876] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0877] [Third embodiment]

[0878] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0879] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0880] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0881] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0882] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0883] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0884] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0885] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0886] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0887] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0888] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0889] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0890] This invention relates to a system that allows travelers to more easily enjoy sightseeing experiences in traditional Japanese clothing. This system comprehensively supports users' trip planning, execution, and experience sharing through communication with users' terminals and a server.

[0891] First, the user starts up their device and inputs into the application the tourist spots they want to visit and the types of Japanese clothing they are interested in. For example, if the user selects "Kyoto" as a destination and inputs that they are interested in "ninjas," the device sends this information to the server. The server receives the user's input information, and AI analyzes the user's interest trends. Based on the analysis results, a personalized list of recommended content is generated and displayed to the user via the device. The recommended content list is made up of a combination of tourist spot videos, types of Japanese clothing, and experience content.

[0892] Next, the user inputs their travel itinerary and potential destinations. For example, if they input that they would like to visit Kinkakuji Temple, Gion, and Nijo Castle on a three-day trip to Kyoto, the device sends this information to the server. Based on the inputted itinerary and destination data, the server uses AI to calculate the optimal visiting order and transportation routes. Based on the calculation results, a specific travel itinerary is generated and displayed to the user on the device.

[0893] On the day of the trip, users can check real-time information on the spot using their devices. For example, the server obtains local congestion, weather, and traffic information and provides it to the user's device. Users can then flexibly adjust their schedule based on this information.

[0894] Additionally, photos and videos taken by users during their trip are uploaded to a server via their device. The server automatically edits and processes the uploaded material to generate content that can be posted to social media. For example, the server applies filters to photos, shortens videos, and adds captions. The generated content is provided to the device, where users can post it to social media or save it to share with others.

[0895] For example, if a user takes a photo wearing traditional Japanese clothing at Kinkakuji Temple in Kyoto, the photo is instantly uploaded to the server. The server then selects a filter appropriate for the photo, automatically generates a caption, and provides it to the user's device. The user can then view the generated content on their device, and if they like it, they can post it directly to social media sites such as Instagram.

[0896] In this way, this system comprehensively supports users from before to after their travel experience, and by providing personalized content, makes the Japanese clothing experience at travel destinations even more appealing.

[0897] The processing flow will be explained below.

[0898] Step 1:

[0899] The user starts the terminal and accesses the application.

[0900] Step 2:

[0901] The user inputs the tourist spot they want to visit (e.g., Kyoto) and the type of Japanese clothing they are interested in (e.g., ninja).

[0902] Step 3:

[0903] The terminal transmits the input information to the server.

[0904] Step 4:

[0905] The server receives the user's input information, and AI analyzes the user's interest trends.

[0906] Step 5:

[0907] Based on the analysis results, the server generates a personalized list of recommended content, including related tourist spot videos, types of Japanese clothing, and experience content.

[0908] Step 6:

[0909] The terminal displays the generated recommended content list to the user.

[0910] Step 7:

[0911] The user inputs the desired travel dates and the tourist spots they want to visit (e.g., Kinkakuji Temple, Gion, Nijo Castle).

[0912] Step 8:

[0913] The terminal transmits the inputted schedule and visiting place information to the server.

[0914] Step 9:

[0915] Based on the received schedule and destination information, the server uses AI to calculate the optimal order of visits and transportation routes.

[0916] Step 10:

[0917] The server generates a specific travel schedule based on the calculation results.

[0918] Step 11:

[0919] The terminal displays the generated travel schedule to the user.

[0920] Step 12:

[0921] On the day of the trip, the user uses the terminal to check the congestion situation at tourist spots, weather information, and traffic information in real time.

[0922] Step 13:

[0923] The server collects local information and provides it to the user's terminal.

[0924] Step 14:

[0925] Users can flexibly adjust their travel schedules based on real-time information.

[0926] Step 15:

[0927] While traveling, users upload photos and videos taken on their devices to a server through the application.

[0928] Step 16:

[0929] The server automatically edits and processes the uploaded material (e.g., applying filters to photos or adding captions to videos).

[0930] Step 17:

[0931] The server generates edited and processed content.

[0932] Step 18:

[0933] The terminal provides the generated shareable content to the user.

[0934] Step 19:

[0935] Users can post the provided content to social media or save it as data.

[0936] Example 1

[0937] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0938] Conventional tourist travel systems are inadequate in creating personalized travel plans based on the user's interests and wishes, and in providing real-time information during the trip. Further improvements are needed to increase user satisfaction. Furthermore, editing content captured during the trip and sharing it on social media is cumbersome, making it difficult for users to easily share their travel memories with others. The present invention aims to solve these problems.

[0939] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0940] In this invention, the server includes means for collecting information from the user regarding tourist destinations desired to visit and types of Japanese clothing, means for generating a personalized recommended content list using a generative AI model, and means for calculating the optimal visiting order and transportation route based on the travel itinerary and desired tourist destination information entered by the user. This enables the creation of an optimal travel plan based on the user's interests and wishes. Furthermore, by automatically editing and processing footage taken during the trip, users can generate easily shareable content, allowing them to easily share their travel memories on social media and other platforms.

[0941] "User" refers to an individual who uses the system to plan and carry out a tourist trip.

[0942] A "terminal" is an electronic device that a user operates to input information or receive information from a server. Specifically, it includes smartphones and tablets.

[0943] A "server" is a computer system that processes data received from users and provides the required information and services.

[0944] "Desired tourist destinations" refer to places or areas that a user wishes to visit when traveling.

[0945] "Waso" refers to traditional Japanese clothing, including kimonos and hakama.

[0946] "Means of collecting information" refers to the methods and technologies for sending and receiving data entered by a user through a terminal to a server.

[0947] "Generative AI model" refers to an artificial intelligence algorithm that generates recommended content based on user input data.

[0948] A "personalized recommended content list" is a list of tourist attractions and experiences specially selected based on the user's interests and desires.

[0949] "Travel itinerary" refers to the period during which the user travels and the detailed schedule thereof.

[0950] The "visiting order" refers to the optimal order in which a user visits tourist spots during a trip.

[0951] "Transportation route" refers to the optimal travel route for touring tourist spots specified by the user.

[0952] A "travel schedule" is a detailed itinerary including visit orders and transportation routes that are useful when a user plans a trip.

[0953] "Real-time information" refers to the latest time-dependent data, such as current congestion status, weather information, and traffic information.

[0954] "Means for uploading materials" refers to the methods and technologies for transmitting photos and videos taken by users during their trip to a server.

[0955] "Means of automatic editing and processing" refers to technology that uses AI or algorithms to edit and process uploaded materials.

[0956] "Shareable content" refers to photos and videos that have been edited in a way that allows users to easily share them on social media and with other users.

[0957] The present invention relates to a system that enables travelers to more easily enjoy sightseeing experiences in traditional Japanese clothing. Specific embodiments of this system are described below.

[0958] First, the user starts up their device (such as a smartphone) and accesses the application. On the initial screen of the application, the user enters information about the tourist spots they want to visit and the types of Japanese clothing they are interested in. For example, the user selects "Kyoto" as a destination and enters that they are interested in "ninjas." This information is sent to the server via the device.

[0959] The server receives this user information and uses a generative AI model to analyze the user's interest trends. During the analysis, a prompt such as "What would you recommend for someone traveling to Kyoto who is interested in ninjas?" is input into the generative AI model. The AI ​​then generates a personalized list of recommended content that matches the user's interests. This list includes a combination of videos of tourist spots, types of Japanese clothing, and experience content. The generated content list is sent from the server to the device and displayed to the user.

[0960] Next, the user inputs their travel itinerary and the tourist spots they wish to visit into the application. For example, they might input, "I'd like to visit Kinkaku-ji Temple, Gion, and Nijo Castle on a three-day trip to Kyoto." The device then sends this information to the server. The server receives the input date and destination information and uses AI to calculate the optimal order of visits and transportation routes. As a result of the calculation, a specific travel itinerary is generated and sent to the device. The user can then view this travel itinerary in the application.

[0961] Furthermore, on the day of the trip, users can use their devices to check on-site information in real time. The server obtains local congestion, weather, traffic information, and other information via the Internet and provides it to the user's device. Users can flexibly adjust their travel schedule based on this information.

[0962] While traveling, users take photos and videos and upload them to a server via their device. The server receives this material and automatically edits and processes it using generative AI models. For example, it applies appropriate filters to photos, shortens and edits videos, and automatically generates appropriate captions. The shareable content generated in this way is then sent from the server to the device, where users can easily post it to social media.

[0963] For example, if a user takes a photo of themselves wearing traditional Japanese clothing at Kinkakuji Temple in Kyoto, the photo is instantly uploaded to the server. The server selects a filter appropriate for the photo and automatically generates a caption, such as "Experiencing traditional Japanese clothing at Kinkakuji Temple, Kinkakuji Temple, Kyoto," which is then provided to the user's device. The user can then review the generated content and, if they like it, post it directly to a social networking site.

[0964] This system will comprehensively support users from before to after their travel experience and provide personalized content, making the Japanese clothing experience at travel destinations even more appealing.

[0965] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0966] Step 1:

[0967] The user starts up the device and accesses the application. On the initial screen, they input information about the tourist spots they want to visit and the type of Japanese clothing they are interested in. For example, they select "Kyoto" as their destination and input that they are interested in "ninjas." At this time, the device sends the user's input information to the server.

[0968] Input: The tourist spot you want to visit and the type of Japanese clothing you want to wear.

[0969] Output: User input sent to the server

[0970] Step 2:

[0971] The server inputs the received information into the generative AI model. The generative AI model receives a prompt such as "What would you recommend to someone traveling to Kyoto who is interested in ninjas?" and the model performs an analysis. The AI ​​analyzes the user's interests and generates a personalized list of recommended content. This list includes a combination of tourist spot footage, types of Japanese clothing, and experience content. The generated content list is sent from the server to the device and displayed to the user.

[0972] Input: User input received by the server

[0973] Output: The generated personalized recommendation list

[0974] Step 3:

[0975] The user inputs their travel itinerary and potential destinations into the application. For example, they might input, "I'd like to visit Kinkakuji Temple, Gion, and Nijo Castle on a three-day trip to Kyoto." The device then sends this information to the server. The server receives the input date and destination information and uses AI to calculate the optimal order of visits and transportation routes. The calculation results are generated as a specific travel itinerary and sent to the device.

[0976] Input: User-entered travel dates and potential destinations

[0977] Output: Generated concrete travel schedule

[0978] Step 4:

[0979] On the day of the trip, the user uses the device to check on-site information in real time. The server obtains local congestion, weather, traffic information, etc. via the Internet and provides it to the user's device. Based on this information, the user can flexibly adjust their travel schedule. For example, information such as "Kinkaku-ji Temple is crowded, but Gion is empty" may be displayed.

[0980] Input: Local information obtained by the server via the Internet

[0981] Output: Real-time local information displayed on the user's device

[0982] Step 5:

[0983] During a trip, users take photos and videos and upload them to a server via their device. The server receives this material and automatically edits and processes it using generative AI models. For example, it applies filters to photos, shortens and edits videos, and automatically generates appropriate captions. The generated shareable content is then sent from the server to the device, where users can easily post it to social media.

[0984] Input: Photos and videos taken and uploaded by users

[0985] Output: Automatically edited and enhanced shareable content

[0986] Step 6:

[0987] For example, if a user takes a photo of themselves wearing traditional Japanese clothing at Kinkaku-ji Temple in Kyoto, the photo is instantly uploaded to the server. The server selects a filter appropriate for the photo and automatically generates a caption such as "Experience traditional Japanese clothing at Kinkaku-ji Temple, Kinkaku-ji Temple, Kyoto." The generated content is then provided to the user's device, where they can review it and, if they like it, post it to a social networking site.

[0988] Input: A photo taken by the user at Kinkakuji Temple

[0989] Output: Filtered and captioned content

[0990] (Application example 1)

[0991] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0992] Although many modern travelers are interested in experiencing Japanese clothing, they face challenges in planning their trips, selecting Japanese clothing, gathering real-time information at tourist spots, and effectively sharing their travel memories on social media. Furthermore, there is a lack of appropriate guidance in brick-and-mortar stores on how to select and put on Japanese clothing, preventing travelers from enjoying their travel experiences to the fullest.

[0993] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0994] In this invention, the server includes means for collecting information from the user regarding tourist spots that the user wishes to visit and types of Japanese clothing, means for generating a personalized recommended content list, and means for displaying the generated recommended content list to the user, thereby enabling the user to receive personalized support throughout the entire process from planning to carrying out and sharing the tour.

[0995] The system also includes a means for calculating the optimal order of visits and transportation routes based on the travel itinerary and information on desired tourist spots to generate a travel schedule, and a means for generating personalized content by combining tourist spot images, types of Japanese clothing, and experience details based on the generated travel schedule, thereby enabling users to travel efficiently and enjoyably.

[0996] Furthermore, there will be a means to collect real-time information on congestion, weather, and traffic conditions at destinations on the day of the trip and provide it to the user's device, a means to upload footage taken by the user during the trip and automatically edit and process it to generate shareable content, and a means to display how to select and wear Japanese clothing in physical stores. This will improve the comfort of the trip and make it easier to share memories.

[0997] It also includes a way to automatically select filters and generate captions for users' photos and edit them into shareable content, allowing them to easily share their travel memories on social media and reach more people. This not only makes the travel experience richer and more engaging, but also provides useful information to others.

[0998] The "means for collecting information from the user about tourist spots that the user wants to visit and types of Japanese clothing" is a device or program that acquires data about tourist spots that the user wants to visit and types of Japanese clothing that the user is interested in.

[0999] The "means for generating a personalized recommended content list" is a device or program that creates a list that suggests individually optimized tourist information and Japanese clothing experiences based on information entered by the user.

[1000] The "means for displaying the generated recommended content list to the user" refers to a device or program that displays the generated list of recommended tourist spot information and Japanese clothing experiences on the user's terminal.

[1001] "Means for calculating the optimal visiting order and travel route based on the travel itinerary and information on the tourist destinations desired to be visited" refers to a device or program that calculates the effective visiting order and travel route based on the travel itinerary and data on the tourist destinations desired to be visited specified by the user.

[1002] The "means for generating a travel schedule" is a device or program that creates a detailed travel schedule based on the calculated visiting order and transportation routes.

[1003] The "means for providing the generated travel schedule to the user" is a device or program that displays the generated travel schedule on the user's terminal.

[1004] "Means for generating personalized content by combining images of tourist spots, types of Japanese clothing, and experience content" refers to a device or program that generates individually optimized content by combining images of tourist spots, types of Japanese clothing, and experience content based on a travel schedule.

[1005] "Means for collecting congestion status, weather information, and traffic information of destinations in real time on the day of travel and providing it to the user's terminal" refers to a device or program that obtains current congestion status, weather, and traffic information of tourist destinations in real time and provides it to the user's terminal.

[1006] "Means for uploading materials taken by users while traveling and automatically editing and processing them to generate shareable content" refers to a device or program that allows users to upload photos and videos they have taken, automatically performs editing such as filtering and adding captions, and generates shareable content.

[1007] The "means for displaying the selection of Japanese clothing and how to wear it in a physical store" is a device or program that visually displays the Japanese clothing selected by the user and how to wear it in a physical store.

[1008] "Means for automatically selecting filters and generating captions for content captured by a user, and editing the content into shareable content" refers to a device or program that applies optimal filters to images and videos captured by a user, automatically generates captions, and edits the content into a format that can be shared on social media, etc.

[1009] This system allows users to easily and attractively experience sightseeing in traditional Japanese clothing. Specifically, it comprehensively supports users from planning their trip to experiencing the store, and editing and sharing photos and videos they have taken.

[1010] The general flow of the system is as follows:

[1011] Hardware and Software Configuration

[1012] Hardware:

[1013] Smartphones (e.g. iPhone, Android smartphones)

[1014] Smart glasses (e.g. Google Glass, Microsoft HoloLens)

[1015] Server (e.g. AWS, GCP)

[1016] software:

[1017] Frontend: React Native (a cross-platform mobile application development tool)

[1018] Backend: Node.js (server-side framework), MongoDB (database)

[1019] AI analysis: TensorFlow (machine learning library), Computer Vision API (image recognition)

[1020] Cloud services: AWS (Amazon Web Services) or GCP (Google Cloud Platform)

[1021] Specific steps for carrying out the invention

[1022] 1. User input

[1023] The user inputs into the application the tourist spots they wish to visit and the type of Japanese clothing they are interested in. For example, if they select "Kyoto" and "Ninja" Japanese clothing, the device sends this information to the server.

[1024] 2. Information analysis and personalized content generation

[1025] Based on the information collected from the user, the server uses an AI analysis engine (TensorFlow) to analyze the user's interests and generate a personalized list of recommended content.

[1026] The generated content list is displayed on a smartphone or smart glasses.

[1027] 3. Optimizing travel planning

[1028] When a user inputs their travel dates and desired places to visit, the server calculates the optimal order of visits and transportation routes, and generates a detailed travel schedule, which is then provided to the user's terminal.

[1029] 4. Providing real-time information on-site

[1030] On the day of the trip, the server collects real-time information on congestion, weather, and traffic conditions at the destinations and provides it to the user's device, allowing the user to adjust their schedule accordingly.

[1031] 5. Experience wearing traditional Japanese clothing at a physical store

[1032] At the physical store, users can choose a kimono and check how to dress using smart glasses or a smartphone, making dressing a smooth process.

[1033] 6. Automate content editing and sharing

[1034] Photos and videos taken by users during their trip are uploaded to a server, where filters and captions are automatically applied. The edited content is then delivered to the user's device and can be easily shared on social media.

[1035] Examples of concrete examples and prompts

[1036] As a concrete example, consider the case where a user takes a photo of themselves wearing traditional Japanese ninja attire at Kinkakuji Temple in Kyoto. This photo is instantly uploaded to the server, which selects an appropriate filter for the photo, automatically generates a caption, and provides it to the user's device.

[1037] An example prompt is:

[1038] "Add a caption to your photo of yourself in ninja attire at Kinkakuji Temple in Kyoto and choose a filter to post to Instagram."

[1039] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1040] Step 1:

[1041] The user inputs the tourist spots they wish to visit and the type of Japanese clothing they would like to wear into the terminal, and the input information is sent from the terminal to the server.

[1042] Input: Information about tourist spots and types of Japanese clothing entered by the user using a smartphone or smart glasses.

[1043] Data processing: The terminal converts the user-entered information into an appropriate format and sends it to the server.

[1044] Output: User input information received by the server.

[1045] Step 2:

[1046] The server uses an AI analysis engine (TensorFlow) to analyze the user's interests based on the received information, and generates a personalized list of recommended content based on the analysis results.

[1047] Input: User-entered information (tourist destination and type of Japanese clothing).

[1048] Data calculation: Analyze user interest trends using TensorFlow and generate a list of recommended content.

[1049] Output: A personalized list of recommended content.

[1050] Step 3:

[1051] The server transmits the generated recommended content list to the terminal and displays it to the user.

[1052] Input: A personalized list of recommended content.

[1053] Data processing: The server converts the content list into an appropriate format and sends it to the terminal.

[1054] Output: The device displays a list of recommended content to the user.

[1055] Step 4:

[1056] The user inputs the travel itinerary and desired places to visit into the terminal, and the input information is sent from the terminal to the server.

[1057] Input: Travel itinerary and desired places to visit entered by the user using a smartphone or smart glasses.

[1058] Data processing: The terminal converts the user-entered information into an appropriate format and sends it to the server.

[1059] Output: User input information received by the server.

[1060] Step 5:

[1061] Based on the information received, the server uses an AI analysis engine to calculate the optimal order of visits and transportation routes, and generates a detailed travel schedule.

[1062] Input: User-entered information (travel dates and desired places to visit).

[1063] Data calculation: An AI analysis engine optimizes visit order and transportation routes to generate a travel schedule.

[1064] Output: Optimized travel schedule.

[1065] Step 6:

[1066] The server transmits the generated travel schedule to the terminal and provides it to the user.

[1067] Input: The generated travel schedule.

[1068] Data processing: The server converts the travel schedule into an appropriate format and sends it to the terminal.

[1069] Output: The terminal displays the travel schedule to the user.

[1070] Step 7:

[1071] On the day of the trip, the server collects real-time information on congestion at the destinations, weather information, and traffic information, and provides it to the user's terminal.

[1072] Input: Real-time congestion, weather, and traffic information.

[1073] Data calculation: The server analyzes this information and updates the user's travel schedule.

[1074] Output: Updated real-time information is displayed on the user's terminal.

[1075] Step 8:

[1076] Using the terminal, users can choose Japanese clothing at a physical store and check how to wear it.

[1077] Input: Information about the Japanese clothing selected by the user.

[1078] Data processing: The terminal displays information about the kimono and provides instructions on how to put it on.

[1079] Output: Japanese clothing and how to wear it displayed on smart glasses or smartphone.

[1080] Step 9:

[1081] Users upload photos and videos they take while traveling from their device to the server, which then automatically selects filters and generates captions based on the uploaded photos and videos.

[1082] Input: Photos and videos taken by the user.

[1083] Data processing: The server uses the Computer Vision API to edit, filter, and generate captions.

[1084] Output: Edited photos and videos are generated.

[1085] Step 10:

[1086] The generated photos and videos are delivered to the user's device and converted into a format that can be easily shared on social media.

[1087] Input: Edited photos and videos.

[1088] Data processing: The server converts the data into a shareable format and sends it to the device.

[1089] Output: The content that can be shared on social media is displayed on the user's device.

[1090] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1091] This invention relates to a system that allows travelers to more easily enjoy sightseeing experiences in traditional Japanese clothing. This system comprehensively supports the user's trip, from planning to execution and experience sharing, through communication with the user's terminal and server. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it provides a more highly personalized experience.

[1092] First, the user starts up the device and accesses the application. The user inputs the tourist spot they want to visit (e.g., Kyoto) and the type of Japanese clothing they are interested in (e.g., ninja). The device sends this information to the server. At the same time, the emotion engine recognizes the user's emotions from their input and interactions.

[1093] The server receives the user's input information and emotional data, and AI analyzes the user's interests and emotional state. Based on the analysis results, a personalized list of recommended content is generated and displayed to the user via their device. The recommended content list is made up of a combination of tourist spot videos, types of Japanese clothing, and experience content.

[1094] Next, the user inputs their travel itinerary and potential destinations. For example, if they input that they would like to visit Kinkakuji Temple, Gion, and Nijo Castle on a three-day trip to Kyoto, the device will send this information to the server. The emotion engine will also continue to collect the user's emotion data and send it to the server.

[1095] The server receives the itinerary, destination information, and emotion data, and the AI ​​calculates the optimal visit order and transportation route. Based on the calculation results, a specific travel schedule is generated and displayed to the user via the device. During this process, the visit order and schedule are adjusted based on the user's emotion data to provide a more enjoyable experience.

[1096] On the day of the trip, users can use their devices to check real-time information on the congestion status of tourist attractions, weather information, and traffic information. The server collects local information and combines it with the user's emotional data to provide optimal real-time advice, allowing users to flexibly adjust their schedules based on this information.

[1097] While traveling, users upload photos and videos taken with their devices to the server through the application. The server automatically edits and processes the uploaded materials (e.g., applying filters to photos and adding captions to videos). The emotion engine analyzes the user's emotional data to generate more engaging content.

[1098] For example, if a user takes a photo wearing traditional Japanese clothing at Kinkakuji Temple in Kyoto, the photo is instantly uploaded to the server. The server analyzes the photo, selects a filter based on the user's emotional state at the time, automatically generates a caption, and provides it to the user's device. The user can then view the generated content on their device, and if they like it, they can post it directly to social media sites such as Instagram.

[1099] In this way, this system comprehensively supports users' travel experiences from before to after, and by providing personalized content, makes the Japanese clothing experience at travel destinations even more appealing. Furthermore, by combining it with an emotion engine, it is possible to provide an optimal experience according to the user's emotions, increasing travel satisfaction.

[1100] The processing flow will be explained below.

[1101] Step 1:

[1102] The user starts the terminal and accesses the application.

[1103] Step 2:

[1104] The user inputs the tourist spot they want to visit (e.g., Kyoto) and the type of Japanese clothing they are interested in (e.g., ninja).

[1105] Step 3:

[1106] The device sends the input information to the server, and at the same time, the emotion engine recognizes the user's emotions from their input and interactions and collects emotion data.

[1107] Step 4:

[1108] The server receives the user's input information and emotion data.

[1109] Step 5:

[1110] Based on the received information, the server uses AI to analyze the user's interests and emotional state. Based on the analysis results, it generates a personalized list of recommended content, including related tourist spot videos, types of Japanese clothing, and experience content.

[1111] Step 6:

[1112] The terminal displays the generated recommended content list to the user.

[1113] Step 7:

[1114] The user inputs the desired travel dates and the tourist spots they want to visit (e.g., Kinkakuji Temple, Gion, Nijo Castle).

[1115] Step 8:

[1116] The terminal transmits the input itinerary and destination information to the server. The emotion engine also continues to collect the user's emotion data and transmits it to the server.

[1117] Step 9:

[1118] The server receives information on the itinerary and destinations, as well as emotional data, and the AI ​​calculates the optimal order of visits and transportation routes. By taking emotional data into account, the calculations are made to ensure the user has a more enjoyable experience.

[1119] Step 10:

[1120] The server generates a specific travel schedule based on the calculation results.

[1121] Step 11:

[1122] The terminal displays the generated travel schedule to the user.

[1123] Step 12:

[1124] On the day of the trip, the user uses the terminal to check the congestion situation at tourist spots, weather information, and traffic information in real time.

[1125] Step 13:

[1126] The server collects local information and combines it with the user's emotional data to provide optimal real-time advice.

[1127] Step 14:

[1128] Users can flexibly adjust their travel schedules based on real-time information.

[1129] Step 15:

[1130] While traveling, users upload photos and videos taken on their devices to a server through the application.

[1131] Step 16:

[1132] The server automatically edits and processes the uploaded material. Specifically, an emotion engine analyzes the user's emotional data and automatically generates filters and captions based on their emotions at the time.

[1133] Step 17:

[1134] The server generates edited and processed content.

[1135] Step 18:

[1136] The terminal provides the generated shareable content to the user.

[1137] Step 19:

[1138] Users can post the provided content to social media or save it as data.

[1139] Example 2

[1140] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1141] Conventional travel planning systems have struggled to provide a personalized experience that fully reflects users' individual needs and emotions, making it difficult to achieve a satisfying travel experience. Furthermore, there were few systems that comprehensively supported the provision of real-time information during travel or the automatic editing and processing of user-generated content. This meant that users lacked consistent support from trip planning to execution and content sharing.

[1142] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for collecting information on destinations desired to be visited and types of costumes from the user, means using a generative AI model for generating a personalized recommended content list based on the information and emotion data collected from the user, and means for displaying the generated recommended content list to the user. This makes it possible to provide a personalized experience that reflects the individual needs and emotions of the user.

[1143] "User" refers to a person who uses the system to make travel plans.

[1144] "Terminal" refers to an electronic device used by a user, such as a computer, smartphone, or tablet.

[1145] "Server" refers to a computer system for receiving and processing information sent by users.

[1146] "Destination" refers to a place or tourist attraction that the user plans to visit.

[1147] "Outfit" refers to the type of Japanese clothing or specific clothing that the user plans to wear during their trip.

[1148] "Emotional data" refers to data relating to the emotional state recognized through the user's input and operational behavior.

[1149] "Generative AI model" refers to an artificial intelligence model that generates personalized content based on data obtained from users.

[1150] "Recommended content list" refers to a list of tourist attractions and experiences generated based on the user's interests and emotional state.

[1151] "Travel route" refers to the optimal travel route between the tourist destinations to be visited.

[1152] A "travel plan" refers to a plan including the order of tourist spots that a user will visit, the schedule, and transportation methods.

[1153] "Customized content" refers to tourism videos and experience content created to reflect the individual needs and emotions of users.

[1154] "Real-time information" refers to current information such as the congestion situation at tourist spots, weather information, and traffic information on the day of travel.

[1155] "Automatic editing and processing" refers to the process of automatically editing photos and videos taken by users, applying filters and adding captions.

[1156] "Shareable Content" refers to photos and videos that have been edited or enhanced and are in a format that users can share with others.

[1157] The present invention relates to a system that allows travelers to wear costumes and enjoy travel experiences more easily. This system comprehensively supports the user's trip from planning to execution and experience sharing through the user's terminal, server, and emotion engine.

[1158] First, the user starts up the device and accesses the application. The user inputs the destination they want to visit and the type of costume they are interested in. For example, the user inputs "Kyoto" and selects "ninja costume." This information is sent from the device to the server. At the same time, the emotion engine analyzes emotion data from the user's input and operation behavior. This emotion data is also sent to the server.

[1159] The server analyzes the received destination and costume information and emotional data using a generative AI model. Specifically, it uses an AI module built with Python and TensorFlow to accurately analyze the user's interests and emotional state. Based on the analysis results, a personalized recommended content list is generated and displayed to the user via their device. The recommended content list displayed here includes destination videos and costume experience details.

[1160] Next, the user enters their travel itinerary and potential destinations into the application. For example, they might enter, "I'd like to visit Kinkaku-ji Temple, Gion, and Nijo Castle during my three-day trip to Kyoto." The device then sends this information to the server. At the same time, the emotion engine continues to collect the user's emotion data and send it to the server.

[1161] The server uses the received schedule information and emotion data to have the AI ​​module calculate the optimal visit order and travel route. Based on the results of this calculation, a specific travel plan is generated and displayed to the user via their device. The visit order and schedule are adjusted taking into account the user's emotion data.

[1162] On the day of the trip, users can check real-time congestion, weather, and traffic information at their destinations on their devices. The server collects local information and combines it with emotion data to provide optimal real-time advice, allowing users to flexibly adjust their schedules.

[1163] While traveling, users upload photos and videos taken with their device to a server through the application. The server receives the uploaded material, analyzes emotional data, and automatically edits it by applying filters to photos or adding captions to videos. The edited content is then sent back to the device, where the user can review it and post it to social media.

[1164] For example, if a user takes a photo wearing traditional Japanese clothing at Kinkakuji Temple in Kyoto, the photo is instantly uploaded to the server. The server analyzes the photo and automatically generates a filter and caption based on the user's emotional data at the time, and provides it to the device. The user can then view the generated content on their device and post it to social media.

[1165] Here are some example prompts using a generative AI model:

[1166] "I've chosen Kyoto as my next travel destination. I'd like to visit Kinkaku-ji Temple, Gion, and Nijo Castle. What's the best order to visit them in and what are the transportation routes? I'd also like to try on traditional Japanese clothing during my trip."

[1167] "Automatically filter and caption photos taken during your trip. Edit them taking into account emotional data."

[1168] In this way, the system provides a personalized experience that reflects individual needs and emotions, making the user's travel experience even more attractive.

[1169] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1170] Step 1:

[1171] The user starts up the device and accesses the application. The user inputs the destination they wish to visit and the type of costume they are interested in on the application screen. At this time, they input "Kyoto" and "Ninja" as specific actions. The destination and costume information are generated as input data.

[1172] Input: Destination, costume type

[1173] Output: Destination information, costume information

[1174] Step 2:

[1175] The device sends the destination and outfit information entered by the user to the server. At the same time, the emotion engine analyzes the user's input and operational behavior to generate emotion data, which is also sent to the server.

[1176] Input: Destination information, costume information, operation behavior data

[1177] Output: Emotion data

[1178] Step 3:

[1179] The server inputs the received destination, costume information, and emotional data into the generative AI model. The generative AI model analyzes this data and generates a personalized list of recommended content based on the user's interests and emotional state. Specifically, it lists tourist spots and experience courses that are suitable for the destination "Kyoto" and the costume "Ninja."

[1180] Input: Destination information, costume information, emotion data

[1181] Output: Recommended content list

[1182] Step 4:

[1183] The server sends the generated recommended content list to the terminal, which then displays the recommended content list to the user. The user can scroll through the screen to check the recommended tourist spot videos and clothing experience content.

[1184] Input: Recommended content list

[1185] Output: Displayed list of recommended content

[1186] Step 5:

[1187] The user inputs the travel itinerary and desired destinations into the application. For example, "I would like to visit Kinkaku-ji Temple, Gion, and Nijo Castle on a three-day trip to Kyoto." The specific actions are to select the itinerary and add the destinations to be visited.

[1188] Input: Dates, desired destination information

[1189] Output: Travel itinerary information, destination information

[1190] Step 6:

[1191] The terminal transmits the travel itinerary information and the desired destination information to the server. The emotion engine then analyzes the user's emotion data, which is also transmitted to the server.

[1192] Input: Travel itinerary information, destination information, continuous operation behavior data

[1193] Output: Emotion data

[1194] Step 7:

[1195] The server calculates the optimal visit order and travel route based on the received itinerary information and emotion data. Specifically, the AI ​​module calculates the optimal visit order and travel route for Kinkaku-ji Temple, Gion, and Nijo Castle. A specific travel plan is generated based on the calculation results.

[1196] Input: Travel itinerary information, destination information, emotion data

[1197] Output: Optimal visit sequence and travel route

[1198] Step 8:

[1199] The server sends the generated itinerary to the terminal, which displays it to the user, who can review the schedule and make adjustments as necessary.

[1200] Input: Optimal visit sequence, travel route

[1201] Output: A displayed itinerary

[1202] Step 9:

[1203] On the day of the trip, the user uses their device to check real-time information on congestion, weather, and traffic at their destination. The server collects local information and combines it with the user's emotional data to provide optimal real-time advice. The user can then flexibly adjust their schedule based on this information.

[1204] Input: current location information, emotion data

[1205] Output: Real-time congestion, weather, and traffic information

[1206] Step 10:

[1207] While traveling, users upload photos and videos taken with their devices to a server through the application. The server receives the uploaded material, analyzes emotional data, and automatically applies filters to photos and adds captions to videos.

[1208] Input: photo data, video data, emotion data

[1209] Output: Edited and processed photos and videos

[1210] Step 11:

[1211] The edited and processed photos and videos are sent back to the device, where the user can check the generated content and, if they like it, post it to platforms such as social media.Specifically, the user checks the photos and videos on the application and posts them to social media.

[1212] Input: Edited and processed photos and videos

[1213] Output: Shareable content

[1214] (Application example 2)

[1215] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1216] The problem that this invention aims to solve is to make the travel experience richer and more satisfying by providing personalized suggestions using user emotional data in a system that supports travelers in easily enjoying sightseeing experiences in Japanese clothing. Another important problem is to improve the convenience and quality of the experience for travelers by providing information and generating content in real time during the trip.

[1217] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means. In this invention, the server includes: means for collecting information from a user regarding tourist spots that the user wishes to visit and types of Japanese clothing; means for generating a personalized recommended content list based on the information collected from the user; means for displaying the generated recommended content list to the user; means for calculating an optimal visiting order and transportation route based on the travel itinerary and information on tourist spots that the user wishes to visit, means for generating a travel schedule based on the calculated visiting order and transportation route; means for providing the generated travel schedule to the user; means for generating personalized content by combining images of tourist spots, types of Japanese clothing, and experience details based on the travel schedule; means for displaying the generated personalized content to the user; means for collecting congestion status, weather information, and traffic information at visiting destinations in real time on the day of the trip and providing the same to the user's terminal; means for uploading footage taken by the user during the trip and automatically editing and processing it to generate shareable content; This will significantly improve the travel experience by providing personalized sightseeing and dining experiences based on the user's emotions.

[1218] The "means for collecting information from the user regarding the tourist destinations they wish to visit and the type of Japanese clothing they prefer" refers to devices such as interfaces and sensors for inputting information about the tourist destinations they wish to visit and the type of Japanese clothing they prefer.

[1219] "Means for generating a personalized recommended content list" refers to algorithms and software for creating a list of tourist spots and Japanese clothing suggestions optimized for each user based on information and emotional data collected from the user.

[1220] "Means for calculating the optimal order of visits and transportation routes based on travel itinerary and information on desired tourist spots" refers to a system that analyzes the itinerary and information on tourist spots entered by the user, and calculates the optimal order of visits and transportation routes for tourist spots based on that information.

[1221] The "means for generating a travel schedule" is a program or device for generating a specific travel schedule based on the calculated visiting order and transportation route.

[1222] "Means for generating personalized content by combining images of tourist spots, types of Japanese clothing, and experience details based on travel schedules" refers to a system or algorithm that provides appropriate audio guidance and tourist experiences while taking into account each user's individual travel schedule.

[1223] The "means for displaying the personalized content to the user" refers to a device such as an interface or a display for displaying the generated personalized content on the user's terminal.

[1224] "Means of collecting real-time information on congestion, weather, and traffic conditions at destinations and providing it to the user's device" refers to a system that collects real-time information on congestion, weather, and traffic conditions at destinations and provides it to the user's device in order to maximize the user's convenience while traveling.

[1225] "Means for uploading materials taken by users while traveling and automatically editing and processing them to generate shareable content" refers to software or cloud services that allow users to upload photos and video data taken by users while traveling to a server, automatically edit and process them, and convert them into a shareable format.

[1226] "Means for recognizing user emotional data" refers to algorithms and sensors that analyze and determine the user's emotional state at any given time based on their input and behavioral data.

[1227] The "means for generating a personalized dish suggestion list" refers to a system or algorithm that generates a list of dishes that are considered to be optimal at any given time based on the user's emotional data and preferences.

[1228] "Means for displaying the suggested dish list to the user and supporting the user in ordering food" refers to an interface or application that displays the suggested dish list on the user's terminal and supports the user in easily ordering food.

[1229] MODE FOR CARRYING OUT THE INVENTION

[1230] This invention is a system that allows users to enjoy sightseeing experiences in traditional Japanese clothing, enriching the travel experience by making personalized suggestions using the user's emotional data. This system is built based on communication between the user's device and a server, and provides comprehensive support for trip planning, execution, and experience sharing. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it provides a more highly personalized experience.

[1231] System program generation

[1232] The program for this system is implemented using programming languages ​​such as Python and emotion recognition and recommendation engines such as EmotionEngine and FoodRecommender. Users access the system through a device such as a smartphone and enter the necessary information.

[1233] Explanation of program processing

[1234] Hardware and Software Configuration

[1235] User device: Smartphone

[1236] Emotion recognition engine: EmotionEngine

[1237] Suggestion engine: FoodRecommender

[1238] Cloud services and servers: Amazon Web Services (AWS), Google Cloud Platform (GCP), etc.

[1239] Data processing and calculation

[1240] The user inputs tourist destinations, types of Japanese clothing, travel schedule, emotional state, food preferences, etc. from the terminal. This information is sent to the server. The server performs the following processes based on the received information.

[1241] 1. Generate personalized recommendation lists:

[1242] The server uses AI to generate personalized tourist spot videos and experience content lists based on the user's preferred tourist spots, type of Japanese clothing, and emotional data.

[1243] 2. Generate travel schedule:

[1244] Based on the schedule and destination information entered by the user, the server calculates the optimal order of visits and transportation routes, and generates a travel schedule.

[1245] 3. Providing real-time information:

[1246] On the day of the trip, the server collects real-time information on congestion, weather, and traffic conditions at the destinations and provides it to the user's device, allowing the user to adjust their schedule flexibly.

[1247] 4. Automated Content Editing and Sharing:

[1248] Photos and videos taken by users during their trip are uploaded to the server, automatically edited and processed, and provided to users in a shareable format. The emotion engine applies appropriate filters and captions to the images.

[1249] 5. Personalized food suggestions:

[1250] Based on the user's emotional data and food preferences, the server uses an emotion recognition engine to generate and display a personalized list of food suggestions to the user, and also helps the user easily order food.

[1251] Examples of concrete examples and prompts

[1252] Specific examples

[1253] When a user launches the app, inputs "feeling tired" and selects "relaxing food," the emotion engine recognizes the "feeling tired" and sends it to the server, which then generates a list of dishes that are expected to have a relaxing effect (e.g., spicy tacos and beef stroganoff) and displays them on the user's device.

[1254] Prompt Sentence Examples

[1255] Enter the user's current mood, such as "Tired" or "Stressed"

[1256] Enter the type of food you want to eat. For example, "Relaxing food" or "Encouraging food."

[1257] As described above, the present invention is a system that provides personalized sightseeing and dining experiences based on the user's emotions, significantly improving the travel experience.

[1258] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1259] Step 1:

[1260] The user starts up the device and accesses the application. The user inputs the tourist spots they wish to visit, the type of Japanese clothing they would like to wear, their current emotional state, and their food preferences. The input information is then sent from the device to the server.

[1261] Input: tourist destination information, type of Japanese clothing, emotional state, food preferences

[1262] Output: Data sent from the device to the server

[1263] Step 2:

[1264] The server uses AI to generate a personalized list of recommended content based on the information collected from the user. An emotion recognition engine analyzes the emotional data and creates the recommendation list.

[1265] Input: User's tourist destination information, type of Japanese clothing, emotional data

[1266] Output: Recommended Content List

[1267] Step 3:

[1268] The server transmits the generated recommended content list to the terminal and displays it to the user.

[1269] Input: Recommended Content List

[1270] Output: Data displayed by the terminal

[1271] Step 4:

[1272] The user inputs the travel schedule and information on the tourist spots they wish to visit, and sends it from the terminal to the server.

[1273] Input: Travel dates, information on tourist spots you wish to visit

[1274] Output: Data sent from the device to the server

[1275] Step 5:

[1276] The server uses AI to calculate the optimal order of visits and transportation routes based on the date and desired places to visit entered by the user, and generates a travel schedule.

[1277] Input: Travel dates, information on tourist spots you wish to visit

[1278] Output: Travel schedule

[1279] Step 6:

[1280] A travel schedule is generated, transmitted to the terminal, and displayed to the user.

[1281] Input: Travel Schedule

[1282] Output: Data displayed by the terminal

[1283] Step 7:

[1284] On the day of the trip, the server collects real-time information on congestion at the destinations, weather information, and traffic information, and provides it to the user's terminal.

[1285] Input: Real-time information collection (traffic congestion, weather, traffic information)

[1286] Output: Real-time information data

[1287] Step 8:

[1288] Users upload photos and videos taken during their trip from their devices to the server, which then automatically edits and processes them to generate shareable content.

[1289] Input: Photos and videos taken during your trip

[1290] Output: Edited, shareable content

[1291] Step 9:

[1292] Based on the user's emotional data and food preferences, the server uses an emotion recognition engine to generate a personalized list of food suggestions, which are then sent to the device and displayed to the user.

[1293] Input: Emotional data, food preferences

[1294] Output: A personalized list of food suggestions

[1295] Step 10:

[1296] Users can easily order food by checking the list of suggested dishes and selecting from it.

[1297] Input: A list of dish suggestions

[1298] Output: Food order data

[1299] Through these steps, users can enjoy personalized sightseeing and dining experiences based on emotion data.

[1300] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1301] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1302] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1303] [Fourth embodiment]

[1304] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1305] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1306] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1307] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1308] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1309] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1310] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1311] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1312] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1313] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1314] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1315] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1316] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1317] This invention relates to a system that allows travelers to more easily enjoy sightseeing experiences in traditional Japanese clothing. This system comprehensively supports users' trip planning, execution, and experience sharing through communication with users' terminals and a server.

[1318] First, the user starts up their device and inputs into the application the tourist spots they want to visit and the types of Japanese clothing they are interested in. For example, if the user selects "Kyoto" as a destination and inputs that they are interested in "ninjas," the device sends this information to the server. The server receives the user's input information, and AI analyzes the user's interest trends. Based on the analysis results, a personalized list of recommended content is generated and displayed to the user via the device. The recommended content list is made up of a combination of tourist spot videos, types of Japanese clothing, and experience content.

[1319] Next, the user inputs their travel itinerary and potential destinations. For example, if they input that they would like to visit Kinkakuji Temple, Gion, and Nijo Castle on a three-day trip to Kyoto, the device sends this information to the server. Based on the inputted itinerary and destination data, the server uses AI to calculate the optimal visiting order and transportation routes. Based on the calculation results, a specific travel itinerary is generated and displayed to the user on the device.

[1320] On the day of the trip, users can check real-time information on the spot using their devices. For example, the server obtains local congestion, weather, and traffic information and provides it to the user's device. Users can then flexibly adjust their schedule based on this information.

[1321] Additionally, photos and videos taken by users during their trip are uploaded to a server via their device. The server automatically edits and processes the uploaded material to generate content that can be posted to social media. For example, the server applies filters to photos, shortens videos, and adds captions. The generated content is provided to the device, where users can post it to social media or save it to share with others.

[1322] For example, if a user takes a photo wearing traditional Japanese clothing at Kinkakuji Temple in Kyoto, the photo is instantly uploaded to the server. The server then selects a filter appropriate for the photo, automatically generates a caption, and provides it to the user's device. The user can then view the generated content on their device, and if they like it, they can post it directly to social media sites such as Instagram.

[1323] In this way, this system comprehensively supports users from before to after their travel experience, and by providing personalized content, makes the Japanese clothing experience at travel destinations even more appealing.

[1324] The processing flow will be explained below.

[1325] Step 1:

[1326] The user starts the terminal and accesses the application.

[1327] Step 2:

[1328] The user inputs the tourist spot they want to visit (e.g., Kyoto) and the type of Japanese clothing they are interested in (e.g., ninja).

[1329] Step 3:

[1330] The terminal transmits the input information to the server.

[1331] Step 4:

[1332] The server receives the user's input information, and AI analyzes the user's interest trends.

[1333] Step 5:

[1334] Based on the analysis results, the server generates a personalized list of recommended content, including related tourist spot videos, types of Japanese clothing, and experience content.

[1335] Step 6:

[1336] The terminal displays the generated recommended content list to the user.

[1337] Step 7:

[1338] The user inputs the desired travel dates and the tourist spots they want to visit (e.g., Kinkakuji Temple, Gion, Nijo Castle).

[1339] Step 8:

[1340] The terminal transmits the inputted schedule and visiting place information to the server.

[1341] Step 9:

[1342] Based on the received schedule and destination information, the server uses AI to calculate the optimal order of visits and transportation routes.

[1343] Step 10:

[1344] The server generates a specific travel schedule based on the calculation results.

[1345] Step 11:

[1346] The terminal displays the generated travel schedule to the user.

[1347] Step 12:

[1348] On the day of the trip, the user uses the terminal to check the congestion situation at tourist spots, weather information, and traffic information in real time.

[1349] Step 13:

[1350] The server collects local information and provides it to the user's terminal.

[1351] Step 14:

[1352] Users can flexibly adjust their travel schedules based on real-time information.

[1353] Step 15:

[1354] While traveling, users upload photos and videos taken on their devices to a server through the application.

[1355] Step 16:

[1356] The server automatically edits and processes the uploaded material (e.g., applying filters to photos or adding captions to videos).

[1357] Step 17:

[1358] The server generates edited and processed content.

[1359] Step 18:

[1360] The terminal provides the generated shareable content to the user.

[1361] Step 19:

[1362] Users can post the provided content to social media or save it as data.

[1363] Example 1

[1364] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1365] Conventional tourist travel systems are inadequate in creating personalized travel plans based on the user's interests and wishes, and in providing real-time information during the trip. Further improvements are needed to increase user satisfaction. Furthermore, editing content captured during the trip and sharing it on social media is cumbersome, making it difficult for users to easily share their travel memories with others. The present invention aims to solve these problems.

[1366] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1367] In this invention, the server includes means for collecting information from the user regarding tourist destinations desired to visit and types of Japanese clothing, means for generating a personalized recommended content list using a generative AI model, and means for calculating the optimal visiting order and transportation route based on the travel itinerary and desired tourist destination information entered by the user. This enables the creation of an optimal travel plan based on the user's interests and wishes. Furthermore, by automatically editing and processing footage taken during the trip, users can generate easily shareable content, allowing them to easily share their travel memories on social media and other platforms.

[1368] "User" refers to an individual who uses the system to plan and carry out a tourist trip.

[1369] A "terminal" is an electronic device that a user operates to input information or receive information from a server. Specifically, it includes smartphones and tablets.

[1370] A "server" is a computer system that processes data received from users and provides the required information and services.

[1371] "Desired tourist destinations" refer to places or areas that a user wishes to visit when traveling.

[1372] "Waso" refers to traditional Japanese clothing, including kimonos and hakama.

[1373] "Means of collecting information" refers to the methods and technologies for sending and receiving data entered by a user through a terminal to a server.

[1374] "Generative AI model" refers to an artificial intelligence algorithm that generates recommended content based on user input data.

[1375] A "personalized recommended content list" is a list of tourist attractions and experiences specially selected based on the user's interests and desires.

[1376] "Travel itinerary" refers to the period during which the user travels and the detailed schedule thereof.

[1377] The "visiting order" refers to the optimal order in which a user visits tourist spots during a trip.

[1378] "Transportation route" refers to the optimal travel route for touring tourist spots specified by the user.

[1379] A "travel schedule" is a detailed itinerary including visit orders and transportation routes that are useful when a user plans a trip.

[1380] "Real-time information" refers to the latest time-dependent data, such as current congestion status, weather information, and traffic information.

[1381] "Means for uploading materials" refers to the methods and technologies for transmitting photos and videos taken by users during their trip to a server.

[1382] "Means of automatic editing and processing" refers to technology that uses AI or algorithms to edit and process uploaded materials.

[1383] "Shareable content" refers to photos and videos that have been edited in a way that allows users to easily share them on social media and with other users.

[1384] The present invention relates to a system that enables travelers to more easily enjoy sightseeing experiences in traditional Japanese clothing. Specific embodiments of this system are described below.

[1385] First, the user starts up their device (such as a smartphone) and accesses the application. On the initial screen of the application, the user enters information about the tourist spots they want to visit and the types of Japanese clothing they are interested in. For example, the user selects "Kyoto" as a destination and enters that they are interested in "ninjas." This information is sent to the server via the device.

[1386] The server receives this user information and uses a generative AI model to analyze the user's interest trends. During the analysis, a prompt such as "What would you recommend for someone traveling to Kyoto who is interested in ninjas?" is input into the generative AI model. The AI ​​then generates a personalized list of recommended content that matches the user's interests. This list includes a combination of videos of tourist spots, types of Japanese clothing, and experience content. The generated content list is sent from the server to the device and displayed to the user.

[1387] Next, the user inputs their travel itinerary and the tourist spots they wish to visit into the application. For example, they might input, "I'd like to visit Kinkaku-ji Temple, Gion, and Nijo Castle on a three-day trip to Kyoto." The device then sends this information to the server. The server receives the input date and destination information and uses AI to calculate the optimal order of visits and transportation routes. As a result of the calculation, a specific travel itinerary is generated and sent to the device. The user can then view this travel itinerary in the application.

[1388] Furthermore, on the day of the trip, users can use their devices to check on-site information in real time. The server obtains local congestion, weather, traffic information, and other information via the Internet and provides it to the user's device. Users can flexibly adjust their travel schedule based on this information.

[1389] While traveling, users take photos and videos and upload them to a server via their device. The server receives this material and automatically edits and processes it using generative AI models. For example, it applies appropriate filters to photos, shortens and edits videos, and automatically generates appropriate captions. The shareable content generated in this way is then sent from the server to the device, where users can easily post it to social media.

[1390] For example, if a user takes a photo of themselves wearing traditional Japanese clothing at Kinkakuji Temple in Kyoto, the photo is instantly uploaded to the server. The server selects a filter appropriate for the photo and automatically generates a caption, such as "Experiencing traditional Japanese clothing at Kinkakuji Temple, Kinkakuji Temple, Kyoto," which is then provided to the user's device. The user can then review the generated content and, if they like it, post it directly to a social networking site.

[1391] This system will comprehensively support users from before to after their travel experience and provide personalized content, making the Japanese clothing experience at travel destinations even more appealing.

[1392] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1393] Step 1:

[1394] The user starts up the device and accesses the application. On the initial screen, they input information about the tourist spots they want to visit and the type of Japanese clothing they are interested in. For example, they select "Kyoto" as their destination and input that they are interested in "ninjas." At this time, the device sends the user's input information to the server.

[1395] Input: The tourist spot you want to visit and the type of Japanese clothing you want to wear.

[1396] Output: User input sent to the server

[1397] Step 2:

[1398] The server inputs the received information into the generative AI model. The generative AI model receives a prompt such as "What would you recommend to someone traveling to Kyoto who is interested in ninjas?" and the model performs an analysis. The AI ​​analyzes the user's interests and generates a personalized list of recommended content. This list includes a combination of tourist spot footage, types of Japanese clothing, and experience content. The generated content list is sent from the server to the device and displayed to the user.

[1399] Input: User input received by the server

[1400] Output: The generated personalized recommendation list

[1401] Step 3:

[1402] The user inputs their travel itinerary and potential destinations into the application. For example, they might input, "I'd like to visit Kinkakuji Temple, Gion, and Nijo Castle on a three-day trip to Kyoto." The device then sends this information to the server. The server receives the input date and destination information and uses AI to calculate the optimal order of visits and transportation routes. The calculation results are generated as a specific travel itinerary and sent to the device.

[1403] Input: User-entered travel dates and potential destinations

[1404] Output: Generated concrete travel schedule

[1405] Step 4:

[1406] On the day of the trip, the user uses the device to check on-site information in real time. The server obtains local congestion, weather, traffic information, etc. via the Internet and provides it to the user's device. Based on this information, the user can flexibly adjust their travel schedule. For example, information such as "Kinkaku-ji Temple is crowded, but Gion is empty" may be displayed.

[1407] Input: Local information obtained by the server via the Internet

[1408] Output: Real-time local information displayed on the user's device

[1409] Step 5:

[1410] During a trip, users take photos and videos and upload them to a server via their device. The server receives this material and automatically edits and processes it using generative AI models. For example, it applies filters to photos, shortens and edits videos, and automatically generates appropriate captions. The generated shareable content is then sent from the server to the device, where users can easily post it to social media.

[1411] Input: Photos and videos taken and uploaded by users

[1412] Output: Automatically edited and enhanced shareable content

[1413] Step 6:

[1414] For example, if a user takes a photo of themselves wearing traditional Japanese clothing at Kinkaku-ji Temple in Kyoto, the photo is instantly uploaded to the server. The server selects a filter appropriate for the photo and automatically generates a caption such as "Experience traditional Japanese clothing at Kinkaku-ji Temple, Kinkaku-ji Temple, Kyoto." The generated content is then provided to the user's device, where they can review it and, if they like it, post it to a social networking site.

[1415] Input: A photo taken by the user at Kinkakuji Temple

[1416] Output: Filtered and captioned content

[1417] (Application example 1)

[1418] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1419] Although many modern travelers are interested in experiencing Japanese clothing, they face challenges in planning their trips, selecting Japanese clothing, gathering real-time information at tourist spots, and effectively sharing their travel memories on social media. Furthermore, there is a lack of appropriate guidance in brick-and-mortar stores on how to select and put on Japanese clothing, preventing travelers from enjoying their travel experiences to the fullest.

[1420] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1421] In this invention, the server includes means for collecting information from the user regarding tourist spots that the user wishes to visit and types of Japanese clothing, means for generating a personalized recommended content list, and means for displaying the generated recommended content list to the user, thereby enabling the user to receive personalized support throughout the entire process from planning to carrying out and sharing the tour.

[1422] The system also includes a means for calculating the optimal order of visits and transportation routes based on the travel itinerary and information on desired tourist spots to generate a travel schedule, and a means for generating personalized content by combining tourist spot images, types of Japanese clothing, and experience details based on the generated travel schedule, thereby enabling users to travel efficiently and enjoyably.

[1423] Furthermore, there will be a means to collect real-time information on congestion, weather, and traffic conditions at destinations on the day of the trip and provide it to the user's device, a means to upload footage taken by the user during the trip and automatically edit and process it to generate shareable content, and a means to display how to select and wear Japanese clothing in physical stores. This will improve the comfort of the trip and make it easier to share memories.

[1424] It also includes a way to automatically select filters and generate captions for users' photos and edit them into shareable content, allowing them to easily share their travel memories on social media and reach more people. This not only makes the travel experience richer and more engaging, but also provides useful information to others.

[1425] The "means for collecting information from the user about tourist spots that the user wants to visit and types of Japanese clothing" is a device or program that acquires data about tourist spots that the user wants to visit and types of Japanese clothing that the user is interested in.

[1426] The "means for generating a personalized recommended content list" is a device or program that creates a list that suggests individually optimized tourist information and Japanese clothing experiences based on information entered by the user.

[1427] The "means for displaying the generated recommended content list to the user" refers to a device or program that displays the generated list of recommended tourist spot information and Japanese clothing experiences on the user's terminal.

[1428] "Means for calculating the optimal visiting order and travel route based on the travel itinerary and information on the tourist destinations desired to be visited" refers to a device or program that calculates the effective visiting order and travel route based on the travel itinerary and data on the tourist destinations desired to be visited specified by the user.

[1429] The "means for generating a travel schedule" is a device or program that creates a detailed travel schedule based on the calculated visiting order and transportation routes.

[1430] The "means for providing the generated travel schedule to the user" is a device or program that displays the generated travel schedule on the user's terminal.

[1431] "Means for generating personalized content by combining images of tourist spots, types of Japanese clothing, and experience content" refers to a device or program that generates individually optimized content by combining images of tourist spots, types of Japanese clothing, and experience content based on a travel schedule.

[1432] "Means for collecting congestion status, weather information, and traffic information of destinations in real time on the day of travel and providing it to the user's terminal" refers to a device or program that obtains current congestion status, weather, and traffic information of tourist destinations in real time and provides it to the user's terminal.

[1433] "Means for uploading materials taken by users while traveling and automatically editing and processing them to generate shareable content" refers to a device or program that allows users to upload photos and videos they have taken, automatically performs editing such as filtering and adding captions, and generates shareable content.

[1434] The "means for displaying the selection of Japanese clothing and how to wear it in a physical store" is a device or program that visually displays the Japanese clothing selected by the user and how to wear it in a physical store.

[1435] "Means for automatically selecting filters and generating captions for content captured by a user, and editing the content into shareable content" refers to a device or program that applies optimal filters to images and videos captured by a user, automatically generates captions, and edits the content into a format that can be shared on social media, etc.

[1436] This system allows users to easily and attractively experience sightseeing in traditional Japanese clothing. Specifically, it comprehensively supports users from planning their trip to experiencing the store, and editing and sharing photos and videos they have taken.

[1437] The general flow of the system is as follows:

[1438] Hardware and Software Configuration

[1439] Hardware:

[1440] Smartphones (e.g. iPhone, Android smartphones)

[1441] Smart glasses (e.g. Google Glass, Microsoft HoloLens)

[1442] Server (e.g. AWS, GCP)

[1443] software:

[1444] Frontend: React Native (a cross-platform mobile application development tool)

[1445] Backend: Node.js (server-side framework), MongoDB (database)

[1446] AI analysis: TensorFlow (machine learning library), Computer Vision API (image recognition)

[1447] Cloud services: AWS (Amazon Web Services) or GCP (Google Cloud Platform)

[1448] Specific steps for carrying out the invention

[1449] 1. User input

[1450] The user inputs into the application the tourist spots they wish to visit and the type of Japanese clothing they are interested in. For example, if they select "Kyoto" and "Ninja" Japanese clothing, the device sends this information to the server.

[1451] 2. Information analysis and personalized content generation

[1452] Based on the information collected from the user, the server uses an AI analysis engine (TensorFlow) to analyze the user's interests and generate a personalized list of recommended content.

[1453] The generated content list is displayed on a smartphone or smart glasses.

[1454] 3. Optimizing travel planning

[1455] When a user inputs their travel dates and desired places to visit, the server calculates the optimal order of visits and transportation routes, and generates a detailed travel schedule, which is then provided to the user's terminal.

[1456] 4. Providing real-time information on-site

[1457] On the day of the trip, the server collects real-time information on congestion, weather, and traffic conditions at the destinations and provides it to the user's device, allowing the user to adjust their schedule accordingly.

[1458] 5. Experience wearing traditional Japanese clothing at a physical store

[1459] At the physical store, users can choose a kimono and check how to dress using smart glasses or a smartphone, making dressing a smooth process.

[1460] 6. Automate content editing and sharing

[1461] Photos and videos taken by users during their trip are uploaded to a server, where filters and captions are automatically applied. The edited content is then delivered to the user's device and can be easily shared on social media.

[1462] Examples of concrete examples and prompts

[1463] As a concrete example, consider the case where a user takes a photo of themselves wearing traditional Japanese ninja attire at Kinkakuji Temple in Kyoto. This photo is instantly uploaded to the server, which selects an appropriate filter for the photo, automatically generates a caption, and provides it to the user's device.

[1464] An example prompt is:

[1465] "Add a caption to your photo of yourself in ninja attire at Kinkakuji Temple in Kyoto and choose a filter to post to Instagram."

[1466] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1467] Step 1:

[1468] The user inputs the tourist spots they wish to visit and the type of Japanese clothing they would like to wear into the terminal, and the input information is sent from the terminal to the server.

[1469] Input: Information about tourist spots and types of Japanese clothing entered by the user using a smartphone or smart glasses.

[1470] Data processing: The terminal converts the user-entered information into an appropriate format and sends it to the server.

[1471] Output: User input information received by the server.

[1472] Step 2:

[1473] The server uses an AI analysis engine (TensorFlow) to analyze the user's interests based on the received information, and generates a personalized list of recommended content based on the analysis results.

[1474] Input: User-entered information (tourist destination and type of Japanese clothing).

[1475] Data calculation: Analyze user interest trends using TensorFlow and generate a list of recommended content.

[1476] Output: A personalized list of recommended content.

[1477] Step 3:

[1478] The server transmits the generated recommended content list to the terminal and displays it to the user.

[1479] Input: A personalized list of recommended content.

[1480] Data processing: The server converts the content list into an appropriate format and sends it to the terminal.

[1481] Output: The device displays a list of recommended content to the user.

[1482] Step 4:

[1483] The user inputs the travel itinerary and desired places to visit into the terminal, and the input information is sent from the terminal to the server.

[1484] Input: Travel itinerary and desired places to visit entered by the user using a smartphone or smart glasses.

[1485] Data processing: The terminal converts the user-entered information into an appropriate format and sends it to the server.

[1486] Output: User input information received by the server.

[1487] Step 5:

[1488] Based on the information received, the server uses an AI analysis engine to calculate the optimal order of visits and transportation routes, and generates a detailed travel schedule.

[1489] Input: User-entered information (travel dates and desired places to visit).

[1490] Data calculation: An AI analysis engine optimizes visit order and transportation routes to generate a travel schedule.

[1491] Output: Optimized travel schedule.

[1492] Step 6:

[1493] The server transmits the generated travel schedule to the terminal and provides it to the user.

[1494] Input: The generated travel schedule.

[1495] Data processing: The server converts the travel schedule into an appropriate format and sends it to the terminal.

[1496] Output: The terminal displays the travel schedule to the user.

[1497] Step 7:

[1498] On the day of the trip, the server collects real-time information on congestion at the destinations, weather information, and traffic information, and provides it to the user's terminal.

[1499] Input: Real-time congestion, weather, and traffic information.

[1500] Data calculation: The server analyzes this information and updates the user's travel schedule.

[1501] Output: Updated real-time information is displayed on the user's terminal.

[1502] Step 8:

[1503] Using the terminal, users can choose Japanese clothing at a physical store and check how to wear it.

[1504] Input: Information about the Japanese clothing selected by the user.

[1505] Data processing: The terminal displays information about the kimono and provides instructions on how to put it on.

[1506] Output: Japanese clothing and how to wear it displayed on smart glasses or smartphone.

[1507] Step 9:

[1508] Users upload photos and videos they take while traveling from their device to the server, which then automatically selects filters and generates captions based on the uploaded photos and videos.

[1509] Input: Photos and videos taken by the user.

[1510] Data processing: The server uses the Computer Vision API to edit, filter, and generate captions.

[1511] Output: Edited photos and videos are generated.

[1512] Step 10:

[1513] The generated photos and videos are delivered to the user's device and converted into a format that can be easily shared on social media.

[1514] Input: Edited photos and videos.

[1515] Data processing: The server converts the data into a shareable format and sends it to the device.

[1516] Output: The content that can be shared on social media is displayed on the user's device.

[1517] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1518] This invention relates to a system that allows travelers to more easily enjoy sightseeing experiences in traditional Japanese clothing. This system comprehensively supports the user's trip, from planning to execution and experience sharing, through communication with the user's terminal and server. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it provides a more highly personalized experience.

[1519] First, the user starts up the device and accesses the application. The user inputs the tourist spot they want to visit (e.g., Kyoto) and the type of Japanese clothing they are interested in (e.g., ninja). The device sends this information to the server. At the same time, the emotion engine recognizes the user's emotions from their input and interactions.

[1520] The server receives the user's input information and emotional data, and AI analyzes the user's interests and emotional state. Based on the analysis results, a personalized list of recommended content is generated and displayed to the user via their device. The recommended content list is made up of a combination of tourist spot videos, types of Japanese clothing, and experience content.

[1521] Next, the user inputs their travel itinerary and potential destinations. For example, if they input that they would like to visit Kinkakuji Temple, Gion, and Nijo Castle on a three-day trip to Kyoto, the device will send this information to the server. The emotion engine will also continue to collect the user's emotion data and send it to the server.

[1522] The server receives the itinerary, destination information, and emotion data, and the AI ​​calculates the optimal visit order and transportation route. Based on the calculation results, a specific travel schedule is generated and displayed to the user via the device. During this process, the visit order and schedule are adjusted based on the user's emotion data to provide a more enjoyable experience.

[1523] On the day of the trip, users can use their devices to check real-time information on the congestion status of tourist attractions, weather information, and traffic information. The server collects local information and combines it with the user's emotional data to provide optimal real-time advice, allowing users to flexibly adjust their schedules based on this information.

[1524] While traveling, users upload photos and videos taken with their devices to the server through the application. The server automatically edits and processes the uploaded materials (e.g., applying filters to photos and adding captions to videos). The emotion engine analyzes the user's emotional data to generate more engaging content.

[1525] For example, if a user takes a photo wearing traditional Japanese clothing at Kinkakuji Temple in Kyoto, the photo is instantly uploaded to the server. The server analyzes the photo, selects a filter based on the user's emotional state at the time, automatically generates a caption, and provides it to the user's device. The user can then view the generated content on their device, and if they like it, they can post it directly to social media sites such as Instagram.

[1526] In this way, this system comprehensively supports users' travel experiences from before to after, and by providing personalized content, makes the Japanese clothing experience at travel destinations even more appealing. Furthermore, by combining it with an emotion engine, it is possible to provide an optimal experience according to the user's emotions, increasing travel satisfaction.

[1527] The processing flow will be explained below.

[1528] Step 1:

[1529] The user starts the terminal and accesses the application.

[1530] Step 2:

[1531] The user inputs the tourist spot they want to visit (e.g., Kyoto) and the type of Japanese clothing they are interested in (e.g., ninja).

[1532] Step 3:

[1533] The device sends the input information to the server, and at the same time, the emotion engine recognizes the user's emotions from their input and interactions and collects emotion data.

[1534] Step 4:

[1535] The server receives the user's input information and emotion data.

[1536] Step 5:

[1537] Based on the received information, the server uses AI to analyze the user's interests and emotional state. Based on the analysis results, it generates a personalized list of recommended content, including related tourist spot videos, types of Japanese clothing, and experience content.

[1538] Step 6:

[1539] The terminal displays the generated recommended content list to the user.

[1540] Step 7:

[1541] The user inputs the desired travel dates and the tourist spots they want to visit (e.g., Kinkakuji Temple, Gion, Nijo Castle).

[1542] Step 8:

[1543] The terminal transmits the input itinerary and destination information to the server. The emotion engine also continues to collect the user's emotion data and transmits it to the server.

[1544] Step 9:

[1545] The server receives information on the itinerary and destinations, as well as emotional data, and the AI ​​calculates the optimal order of visits and transportation routes. By taking emotional data into account, the calculations are made to ensure the user has a more enjoyable experience.

[1546] Step 10:

[1547] The server generates a specific travel schedule based on the calculation results.

[1548] Step 11:

[1549] The terminal displays the generated travel schedule to the user.

[1550] Step 12:

[1551] On the day of the trip, the user uses the terminal to check the congestion situation at tourist spots, weather information, and traffic information in real time.

[1552] Step 13:

[1553] The server collects local information and combines it with the user's emotional data to provide optimal real-time advice.

[1554] Step 14:

[1555] Users can flexibly adjust their travel schedules based on real-time information.

[1556] Step 15:

[1557] While traveling, users upload photos and videos taken on their devices to a server through the application.

[1558] Step 16:

[1559] The server automatically edits and processes the uploaded material. Specifically, an emotion engine analyzes the user's emotional data and automatically generates filters and captions based on their emotions at the time.

[1560] Step 17:

[1561] The server generates edited and processed content.

[1562] Step 18:

[1563] The terminal provides the generated shareable content to the user.

[1564] Step 19:

[1565] Users can post the provided content to social media or save it as data.

[1566] Example 2

[1567] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1568] Conventional travel planning systems have struggled to provide a personalized experience that fully reflects users' individual needs and emotions, making it difficult to achieve a satisfying travel experience. Furthermore, there were few systems that comprehensively supported the provision of real-time information during travel or the automatic editing and processing of user-generated content. This meant that users lacked consistent support from trip planning to execution and content sharing.

[1569] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for collecting information on destinations desired to be visited and types of costumes from the user, means using a generative AI model for generating a personalized recommended content list based on the information and emotion data collected from the user, and means for displaying the generated recommended content list to the user. This makes it possible to provide a personalized experience that reflects the individual needs and emotions of the user.

[1570] "User" refers to a person who uses the system to make travel plans.

[1571] "Terminal" refers to an electronic device used by a user, such as a computer, smartphone, or tablet.

[1572] "Server" refers to a computer system for receiving and processing information sent by users.

[1573] "Destination" refers to a place or tourist attraction that the user plans to visit.

[1574] "Outfit" refers to the type of Japanese clothing or specific clothing that the user plans to wear during their trip.

[1575] "Emotional data" refers to data relating to the emotional state recognized through the user's input and operational behavior.

[1576] "Generative AI model" refers to an artificial intelligence model that generates personalized content based on data obtained from users.

[1577] "Recommended content list" refers to a list of tourist attractions and experiences generated based on the user's interests and emotional state.

[1578] "Travel route" refers to the optimal travel route between the tourist destinations to be visited.

[1579] A "travel plan" refers to a plan including the order of tourist spots that a user will visit, the schedule, and transportation methods.

[1580] "Customized content" refers to tourism videos and experience content created to reflect the individual needs and emotions of users.

[1581] "Real-time information" refers to current information such as the congestion situation at tourist spots, weather information, and traffic information on the day of travel.

[1582] "Automatic editing and processing" refers to the process of automatically editing photos and videos taken by users, applying filters and adding captions.

[1583] "Shareable Content" refers to photos and videos that have been edited or enhanced and are in a format that users can share with others.

[1584] The present invention relates to a system that allows travelers to wear costumes and enjoy travel experiences more easily. This system comprehensively supports the user's trip from planning to execution and experience sharing through the user's terminal, server, and emotion engine.

[1585] First, the user starts up the device and accesses the application. The user inputs the destination they want to visit and the type of costume they are interested in. For example, the user inputs "Kyoto" and selects "ninja costume." This information is sent from the device to the server. At the same time, the emotion engine analyzes emotion data from the user's input and operation behavior. This emotion data is also sent to the server.

[1586] The server analyzes the received destination and costume information and emotional data using a generative AI model. Specifically, it uses an AI module built with Python and TensorFlow to accurately analyze the user's interests and emotional state. Based on the analysis results, a personalized recommended content list is generated and displayed to the user via their device. The recommended content list displayed here includes destination videos and costume experience details.

[1587] Next, the user enters their travel itinerary and potential destinations into the application. For example, they might enter, "I'd like to visit Kinkaku-ji Temple, Gion, and Nijo Castle during my three-day trip to Kyoto." The device then sends this information to the server. At the same time, the emotion engine continues to collect the user's emotion data and send it to the server.

[1588] The server uses the received schedule information and emotion data to have the AI ​​module calculate the optimal visit order and travel route. Based on the results of this calculation, a specific travel plan is generated and displayed to the user via their device. The visit order and schedule are adjusted taking into account the user's emotion data.

[1589] On the day of the trip, users can check real-time congestion, weather, and traffic information at their destinations on their devices. The server collects local information and combines it with emotion data to provide optimal real-time advice, allowing users to flexibly adjust their schedules.

[1590] While traveling, users upload photos and videos taken with their device to a server through the application. The server receives the uploaded material, analyzes emotional data, and automatically edits it by applying filters to photos or adding captions to videos. The edited content is then sent back to the device, where the user can review it and post it to social media.

[1591] For example, if a user takes a photo wearing traditional Japanese clothing at Kinkakuji Temple in Kyoto, the photo is instantly uploaded to the server. The server analyzes the photo and automatically generates a filter and caption based on the user's emotional data at the time, and provides it to the device. The user can then view the generated content on their device and post it to social media.

[1592] Here are some example prompts using a generative AI model:

[1593] "I've chosen Kyoto as my next travel destination. I'd like to visit Kinkaku-ji Temple, Gion, and Nijo Castle. What's the best order to visit them in and what are the transportation routes? I'd also like to try on traditional Japanese clothing during my trip."

[1594] "Automatically filter and caption photos taken during your trip. Edit them taking into account emotional data."

[1595] In this way, the system provides a personalized experience that reflects individual needs and emotions, making the user's travel experience even more attractive.

[1596] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1597] Step 1:

[1598] The user starts up the device and accesses the application. The user inputs the destination they wish to visit and the type of costume they are interested in on the application screen. At this time, they input "Kyoto" and "Ninja" as specific actions. The destination and costume information are generated as input data.

[1599] Input: Destination, costume type

[1600] Output: Destination information, costume information

[1601] Step 2:

[1602] The device sends the destination and outfit information entered by the user to the server. At the same time, the emotion engine analyzes the user's input and operational behavior to generate emotion data, which is also sent to the server.

[1603] Input: Destination information, costume information, operation behavior data

[1604] Output: Emotion data

[1605] Step 3:

[1606] The server inputs the received destination, costume information, and emotional data into the generative AI model. The generative AI model analyzes this data and generates a personalized list of recommended content based on the user's interests and emotional state. Specifically, it lists tourist spots and experience courses that are suitable for the destination "Kyoto" and the costume "Ninja."

[1607] Input: Destination information, costume information, emotion data

[1608] Output: Recommended content list

[1609] Step 4:

[1610] The server sends the generated recommended content list to the terminal, which then displays the recommended content list to the user. The user can scroll through the screen to check the recommended tourist spot videos and clothing experience content.

[1611] Input: Recommended content list

[1612] Output: Displayed list of recommended content

[1613] Step 5:

[1614] The user inputs the travel itinerary and desired destinations into the application. For example, "I would like to visit Kinkaku-ji Temple, Gion, and Nijo Castle on a three-day trip to Kyoto." The specific actions are to select the itinerary and add the destinations to be visited.

[1615] Input: Dates, desired destination information

[1616] Output: Travel itinerary information, destination information

[1617] Step 6:

[1618] The terminal transmits the travel itinerary information and the desired destination information to the server. The emotion engine then analyzes the user's emotion data, which is also transmitted to the server.

[1619] Input: Travel itinerary information, destination information, continuous operation behavior data

[1620] Output: Emotion data

[1621] Step 7:

[1622] The server calculates the optimal visit order and travel route based on the received itinerary information and emotion data. Specifically, the AI ​​module calculates the optimal visit order and travel route for Kinkaku-ji Temple, Gion, and Nijo Castle. A specific travel plan is generated based on the calculation results.

[1623] Input: Travel itinerary information, destination information, emotion data

[1624] Output: Optimal visit sequence and travel route

[1625] Step 8:

[1626] The server sends the generated itinerary to the terminal, which displays it to the user, who can review the schedule and make adjustments as necessary.

[1627] Input: Optimal visit sequence, travel route

[1628] Output: A displayed itinerary

[1629] Step 9:

[1630] On the day of the trip, the user uses their device to check real-time information on congestion, weather, and traffic at their destination. The server collects local information and combines it with the user's emotional data to provide optimal real-time advice. The user can then flexibly adjust their schedule based on this information.

[1631] Input: current location information, emotion data

[1632] Output: Real-time congestion, weather, and traffic information

[1633] Step 10:

[1634] While traveling, users upload photos and videos taken with their devices to a server through the application. The server receives the uploaded material, analyzes emotional data, and automatically applies filters to photos and adds captions to videos.

[1635] Input: photo data, video data, emotion data

[1636] Output: Edited and processed photos and videos

[1637] Step 11:

[1638] The edited and processed photos and videos are sent back to the device, where the user can check the generated content and, if they like it, post it to platforms such as social media.Specifically, the user checks the photos and videos on the application and posts them to social media.

[1639] Input: Edited and processed photos and videos

[1640] Output: Shareable content

[1641] (Application example 2)

[1642] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1643] The problem that this invention aims to solve is to make the travel experience richer and more satisfying by providing personalized suggestions using user emotional data in a system that supports travelers in easily enjoying sightseeing experiences in Japanese clothing. Another important problem is to improve the convenience and quality of the experience for travelers by providing information and generating content in real time during the trip.

[1644] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means. In this invention, the server includes: means for collecting information from a user regarding tourist spots that the user wishes to visit and types of Japanese clothing; means for generating a personalized recommended content list based on the information collected from the user; means for displaying the generated recommended content list to the user; means for calculating an optimal visiting order and transportation route based on the travel itinerary and information on tourist spots that the user wishes to visit, means for generating a travel schedule based on the calculated visiting order and transportation route; means for providing the generated travel schedule to the user; means for generating personalized content by combining images of tourist spots, types of Japanese clothing, and experience details based on the travel schedule; means for displaying the generated personalized content to the user; means for collecting congestion status, weather information, and traffic information at visiting destinations in real time on the day of the trip and providing the same to the user's terminal; means for uploading footage taken by the user during the trip and automatically editing and processing it to generate shareable content; This will significantly improve the travel experience by providing personalized sightseeing and dining experiences based on the user's emotions.

[1645] The "means for collecting information from the user regarding the tourist destinations they wish to visit and the type of Japanese clothing they prefer" refers to devices such as interfaces and sensors for inputting information about the tourist destinations they wish to visit and the type of Japanese clothing they prefer.

[1646] "Means for generating a personalized recommended content list" refers to algorithms and software for creating a list of tourist spots and Japanese clothing suggestions optimized for each user based on information and emotional data collected from the user.

[1647] "Means for calculating the optimal order of visits and transportation routes based on travel itinerary and information on desired tourist spots" refers to a system that analyzes the itinerary and information on tourist spots entered by the user, and calculates the optimal order of visits and transportation routes for tourist spots based on that information.

[1648] The "means for generating a travel schedule" is a program or device for generating a specific travel schedule based on the calculated visiting order and transportation route.

[1649] "Means for generating personalized content by combining images of tourist spots, types of Japanese clothing, and experience details based on travel schedules" refers to a system or algorithm that provides appropriate audio guidance and tourist experiences while taking into account each user's individual travel schedule.

[1650] The "means for displaying the personalized content to the user" refers to a device such as an interface or a display for displaying the generated personalized content on the user's terminal.

[1651] "Means of collecting real-time information on congestion, weather, and traffic conditions at destinations and providing it to the user's device" refers to a system that collects real-time information on congestion, weather, and traffic conditions at destinations and provides it to the user's device in order to maximize the user's convenience while traveling.

[1652] "Means for uploading materials taken by users while traveling and automatically editing and processing them to generate shareable content" refers to software or cloud services that allow users to upload photos and video data taken by users while traveling to a server, automatically edit and process them, and convert them into a shareable format.

[1653] "Means for recognizing user emotional data" refers to algorithms and sensors that analyze and determine the user's emotional state at any given time based on their input and behavioral data.

[1654] The "means for generating a personalized dish suggestion list" refers to a system or algorithm that generates a list of dishes that are considered to be optimal at any given time based on the user's emotional data and preferences.

[1655] "Means for displaying the suggested dish list to the user and supporting the user in ordering food" refers to an interface or application that displays the suggested dish list on the user's terminal and supports the user in easily ordering food.

[1656] MODE FOR CARRYING OUT THE INVENTION

[1657] This invention is a system that allows users to enjoy sightseeing experiences in traditional Japanese clothing, enriching the travel experience by making personalized suggestions using the user's emotional data. This system is built based on communication between the user's device and a server, and provides comprehensive support for trip planning, execution, and experience sharing. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it provides a more highly personalized experience.

[1658] System program generation

[1659] The program for this system is implemented using programming languages ​​such as Python and emotion recognition and recommendation engines such as EmotionEngine and FoodRecommender. Users access the system through a device such as a smartphone and enter the necessary information.

[1660] Explanation of program processing

[1661] Hardware and Software Configuration

[1662] User device: Smartphone

[1663] Emotion recognition engine: EmotionEngine

[1664] Suggestion engine: FoodRecommender

[1665] Cloud services and servers: Amazon Web Services (AWS), Google Cloud Platform (GCP), etc.

[1666] Data processing and calculation

[1667] The user inputs tourist destinations, types of Japanese clothing, travel schedule, emotional state, food preferences, etc. from the terminal. This information is sent to the server. The server performs the following processes based on the received information.

[1668] 1. Generate personalized recommendation lists:

[1669] The server uses AI to generate personalized tourist spot videos and experience content lists based on the user's preferred tourist spots, type of Japanese clothing, and emotional data.

[1670] 2. Generate travel schedule:

[1671] Based on the schedule and destination information entered by the user, the server calculates the optimal order of visits and transportation routes, and generates a travel schedule.

[1672] 3. Providing real-time information:

[1673] On the day of the trip, the server collects real-time information on congestion, weather, and traffic conditions at the destinations and provides it to the user's device, allowing the user to adjust their schedule flexibly.

[1674] 4. Automated Content Editing and Sharing:

[1675] Photos and videos taken by users during their trip are uploaded to the server, automatically edited and processed, and provided to users in a shareable format. The emotion engine applies appropriate filters and captions to the images.

[1676] 5. Personalized food suggestions:

[1677] Based on the user's emotional data and food preferences, the server uses an emotion recognition engine to generate and display a personalized list of food suggestions to the user, and also helps the user easily order food.

[1678] Examples of concrete examples and prompts

[1679] Specific examples

[1680] When a user launches the app, inputs "feeling tired" and selects "relaxing food," the emotion engine recognizes the "feeling tired" and sends it to the server, which then generates a list of dishes that are expected to have a relaxing effect (e.g., spicy tacos and beef stroganoff) and displays them on the user's device.

[1681] Prompt Sentence Examples

[1682] Enter the user's current mood, such as "Tired" or "Stressed"

[1683] Enter the type of food you want to eat. For example, "Relaxing food" or "Encouraging food."

[1684] As described above, the present invention is a system that provides personalized sightseeing and dining experiences based on the user's emotions, significantly improving the travel experience.

[1685] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1686] Step 1:

[1687] The user starts up the device and accesses the application. The user inputs the tourist spots they wish to visit, the type of Japanese clothing they would like to wear, their current emotional state, and their food preferences. The input information is then sent from the device to the server.

[1688] Input: tourist destination information, type of Japanese clothing, emotional state, food preferences

[1689] Output: Data sent from the device to the server

[1690] Step 2:

[1691] The server uses AI to generate a personalized list of recommended content based on the information collected from the user. An emotion recognition engine analyzes the emotional data and creates the recommendation list.

[1692] Input: User's tourist destination information, type of Japanese clothing, emotional data

[1693] Output: Recommended Content List

[1694] Step 3:

[1695] The server transmits the generated recommended content list to the terminal and displays it to the user.

[1696] Input: Recommended Content List

[1697] Output: Data displayed by the terminal

[1698] Step 4:

[1699] The user inputs the travel schedule and information on the tourist spots they wish to visit, and sends it from the terminal to the server.

[1700] Input: Travel dates, information on tourist spots you wish to visit

[1701] Output: Data sent from the device to the server

[1702] Step 5:

[1703] The server uses AI to calculate the optimal order of visits and transportation routes based on the date and desired places to visit entered by the user, and generates a travel schedule.

[1704] Input: Travel dates, information on tourist spots you wish to visit

[1705] Output: Travel schedule

[1706] Step 6:

[1707] A travel schedule is generated, transmitted to the terminal, and displayed to the user.

[1708] Input: Travel Schedule

[1709] Output: Data displayed by the terminal

[1710] Step 7:

[1711] On the day of the trip, the server collects real-time information on congestion at the destinations, weather information, and traffic information, and provides it to the user's terminal.

[1712] Input: Real-time information collection (traffic congestion, weather, traffic information)

[1713] Output: Real-time information data

[1714] Step 8:

[1715] Users upload photos and videos taken during their trip from their devices to the server, which then automatically edits and processes them to generate shareable content.

[1716] Input: Photos and videos taken during your trip

[1717] Output: Edited, shareable content

[1718] Step 9:

[1719] Based on the user's emotional data and food preferences, the server uses an emotion recognition engine to generate a personalized list of food suggestions, which are then sent to the device and displayed to the user.

[1720] Input: Emotional data, food preferences

[1721] Output: A personalized list of food suggestions

[1722] Step 10:

[1723] Users can easily order food by checking the list of suggested dishes and selecting from it.

[1724] Input: A list of dish suggestions

[1725] Output: Food order data

[1726] Through these steps, users can enjoy personalized sightseeing and dining experiences based on emotion data.

[1727] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1728] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1729] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1730] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1731] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1732] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1733] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1734] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1735] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1736] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1737] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1738] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1739] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1740] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1741] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1742] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1743] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1744] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1745] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1746] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1747] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1748] The following is further disclosed regarding the above embodiment.

[1749] (Claim 1)

[1750] A means for collecting information from users regarding tourist spots they wish to visit and types of Japanese clothing;

[1751] means for generating a personalized recommended content list based on information collected from the user;

[1752] means for displaying the generated recommended content list to a user;

[1753] A means for calculating an optimal visiting order and transportation route based on the travel schedule and information on tourist spots desired to be visited input by the user;

[1754] means for generating a travel schedule based on the calculated visiting sequence and transportation route;

[1755] means for providing the generated travel schedule to a user;

[1756] A means for generating personalized content by combining images of tourist spots, types of Japanese clothing, and experience details based on the travel schedule;

[1757] means for displaying the generated personalized content to a user;

[1758] A means for collecting real-time information on congestion, weather, and traffic conditions at destinations on the day of travel and providing it to the user's device;

[1759] A means for users to upload footage they have taken while traveling, and automatically edit and process it to generate shareable content;

[1760] means for providing the generated shareable content to a user;

[1761] A system including:

[1762] (Claim 2)

[1763] 2. The system according to claim 1, wherein the recommended content list is composed of a combination of tourist spot videos, types of Japanese clothing, and experience contents.

[1764] (Claim 3)

[1765] The system of claim 1 , wherein the travel schedule is generated by optimizing visit sequences and transportation routes.

[1766] "Example 1"

[1767] (Claim 1)

[1768] A means for collecting information from users regarding tourist spots they wish to visit and types of Japanese clothing;

[1769] means for generating a personalized recommended content list using a generative AI model based on information collected from the user;

[1770] means for displaying the generated recommended content list to a user;

[1771] A means for calculating an optimal visiting order and transportation route based on the travel schedule and information on tourist spots desired to be visited input by the user;

[1772] means for generating a travel schedule based on the calculated visiting sequence and transportation route;

[1773] means for providing the generated travel schedule to a user;

[1774] A means for generating personalized content by combining images of tourist spots, types of Japanese clothing, and experience details based on the travel schedule;

[1775] means for displaying the generated personalized content to a user;

[1776] A means for collecting real-time information on congestion, weather, and traffic conditions at destinations on the day of travel and providing it to the user's device;

[1777] A means for users to upload footage they have taken while traveling and automatically edit and process it using generative AI models to generate shareable content;

[1778] means for providing the generated shareable content to a user;

[1779] A system including:

[1780] (Claim 2)

[1781] 2. The system according to claim 1, wherein the recommended content list is ...

Claims

1. A means for collecting information from users regarding tourist spots they wish to visit and types of Japanese clothing; means for generating a personalized recommended content list based on information collected from the user; means for displaying the generated recommended content list to a user; A means for calculating an optimal visiting order and transportation route based on the travel schedule and information on tourist spots desired to be visited input by the user; means for generating a travel schedule based on the calculated visiting sequence and transportation route; means for providing the generated travel schedule to a user; A means for generating personalized content by combining images of tourist spots, types of Japanese clothing, and experience details based on the travel schedule; means for displaying the generated personalized content to a user; A means for collecting real-time information on congestion, weather, and traffic conditions at destinations on the day of travel and providing it to the user's device; A means for users to upload footage they have taken while traveling, and automatically edit and process it to generate shareable content. means for providing the generated shareable content to a user; A system including:

2. The system according to claim 1 , wherein the recommended content list is made up of a combination of tourist spot videos, types of Japanese clothing, and experience contents.

3. The system of claim 1 , wherein the travel schedule is generated by optimizing visit sequences and transportation routes.

Images