system

Abstract

To provide a system that enables a user to easily obtain information on an advertisement space, select an optimum advertisement after examining a plurality of advertisement creatives, and smoothly advance the advertisement submission process. [Solution] A system including: a means for a user terminal to acquire location information and video information of an object; a means for a server to search for advertising space information based on the location information; a means for the server to transmit the acquired advertising space information to the user terminal; a means for the user terminal to display the advertising space information using AR technology; a means for a user to input advertising theme and brand information; a means for the server to generate advertising creatives based on the theme and brand information; a means for the server to transmit the generated advertising creatives to the user terminal; a means for the user terminal to display the generated advertising creatives; a means for a user to select advertising creatives; and a means for the user to check detailed information about the selected advertising creatives and complete the contract procedure.

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] When placing outdoor advertising, it is difficult to easily search for information on the location of the ad, the contractor, and the price. It is also difficult to get a concrete idea of ​​what the ad will look like after it has been placed, making it difficult to predict its effectiveness. This creates the problem of taking time and effort to decide on the location of the ad and selecting the design. [Means for solving the problem]

[0005] The present invention provides a system including: a means for a user terminal to acquire location information and video information of an object; a means for a server to search for advertising space information based on the location information; a means for the server to transmit the acquired advertising space information to the user terminal; a means for the user terminal to display the advertising space information using AR technology; a means for the user to input advertising theme and brand information; a means for the server to generate advertising creatives based on the theme and brand information; a means for the server to transmit the generated advertising creatives to the user terminal; a means for the user terminal to display the generated advertising creatives; a means for the user to select advertising creatives; and a means for the user to confirm detailed information about the advertising creatives selected by the user and complete a contract procedure. This system allows users to easily acquire advertising space information, review multiple advertising creatives, select the most suitable advertisement, and smoothly proceed with the advertising submission process.

[0006] A "user terminal" is a computer device operated by a user, and includes a smartphone, tablet, PC, etc.

[0007] The term "target object" refers to a location or facility where a user places an advertisement, and includes, for example, a building wall or a signboard.

[0008] "Location information" is data that indicates a geographic location, including GPS coordinates.

[0009] "Video information" refers to image and video data captured using a device such as a camera.

[0010] A "server" refers to a computer system that provides services over a network, including devices that operate databases, AI models, etc.

[0011] "Advertising space" means a space or location where an advertisement can be placed, including the terms of use, price, and contractor information.

[0012] "AR technology" is a technology that displays virtual information overlaid on real scenery, and is also known as augmented reality technology.

[0013] "Advertising theme" refers to the main concept or message emphasized in the advertisement, and includes, for example, "new product launch" or "sale."

[0014] "Brand information" refers to specific information about the services or products offered by the advertiser, including, for example, logos, company names, features, and the like.

[0015] "Advertising Creative" means the specific design and content of an advertisement, including images, text, graphics, etc.

[0016] "Contract procedures" refers to procedures such as contracts and payments related to advertising placement.

[0017] "Database" means a system that manages an organized collection of data and is used to store and manage advertising space information. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0019] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0020] First, the terms used in the following description will be explained.

[0021] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0022] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0023] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0024] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0026] [First embodiment]

[0027] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0028] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0030] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0031] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0034] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0035] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0037] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0038] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0039] The present invention is a system that allows users to easily search for outdoor advertising contractors and prices, and visually check what the advertisement will look like after it is placed using AR and AI technology. Specific embodiments for carrying out the invention are described below.

[0040] First, the user launches the dedicated application on their smartphone. When the app is launched on the user's device, the main screen is displayed. The user then points the smartphone camera at the location where they want to place an ad. At this time, the user's device's camera captures the location information and image information of the target object.

[0041] The user device sends the acquired location information and video information to the server. The server uses this data to search for corresponding ad slot information in its database. This information includes the location of the ad slot, price, available dates and times, and outsourcing information. The server sends the search results to the user device, which then receives this information.

[0042] Next, the user device uses AR technology to overlay the received ad space information onto the camera image, allowing the user to see the ad as if it were actually being displayed in the specified location.

[0043] Once the user has selected an ad slot, they then enter the ad theme and brand information. They then enter this information into a form within the app and submit the information. The user's device then sends the information entered by the user back to the server. The server uses an AI model based on this information to generate multiple ad creatives. The generated ad creatives are then sent from the server to the user's device.

[0044] The user's device displays the received ad creative on the screen. The user can scroll through multiple ad designs and select the most suitable one. Once the user selects an ad creative, detailed information, contractor information, and price information are displayed.

[0045] Finally, the user taps the "Contract" button to complete the transaction and enters payment information, etc. This completes the process for placing the ad.

[0046] As a concrete example, consider the case where a user wants to place an advertisement on the wall of a building. The user points their smartphone camera at the building and the app switches to AR mode. When the user sends their location information, the server searches for the corresponding ad space information and sends it back to the user's device. The user checks the virtual ad space in AR and enters "Summer Sale" as the advertising theme. The server generates multiple ad creatives with the theme "Summer Sale" and displays them on the user's device. The entire advertising process is completed when the user selects the most suitable design and completes the transaction procedure.

[0047] The above is an embodiment of the present invention. This system allows users to easily obtain information about advertising slots and easily get a concrete idea of ​​what advertising placement will be like.

[0048] The processing flow will be explained below.

[0049] Step 1:

[0050] The user launches a dedicated app on their smartphone.

[0051] Users tap on an app to access its main screen.

[0052] Step 2:

[0053] Users point their smartphone camera at the location where they want to place an ad.

[0054] A user uses a camera to capture image information of an object.

[0055] Step 3:

[0056] The device acquires location information and video information through the camera.

[0057] The device receives data from the GPS sensor and camera and analyzes location and video information.

[0058] Step 4:

[0059] The terminal transmits the acquired location information and video information to the server.

[0060] The terminal packs the data into packets and sends them over the Internet to a server.

[0061] Step 5:

[0062] The server receives the location information and video information sent from the terminal.

[0063] The server interprets the received data and prepares a query to the database.

[0064] Step 6:

[0065] The server searches the database for information on the corresponding advertising space.

[0066] The server queries a database based on the location information to retrieve information such as the ad space's supplier, price, and available dates and times.

[0067] Step 7:

[0068] The server transmits advertising space information including search results to the terminal.

[0069] The server converts the acquired information into packets and returns them to the terminal.

[0070] Step 8:

[0071] The terminal analyzes the advertising space information received from the server.

[0072] The device decodes the received data and prepares it for AR display.

[0073] Step 9:

[0074] The device uses AR technology to overlay advertising space information on the camera image.

[0075] The device will display additional information about the location and price of the advertising space on the camera image.

[0076] Step 10:

[0077] The user checks the ad space information displayed in AR and selects the desired ad space.

[0078] The user taps the screen to select an ad slot.

[0079] Step 11:

[0080] The user inputs the advertising theme and brand information.

[0081] Users enter details about their theme and brand into an in-app form.

[0082] Step 12:

[0083] The terminal transmits the input information to the server.

[0084] The terminal collects input data into packets and sends them to the server.

[0085] Step 13:

[0086] The server uses AI to generate advertising creatives based on the information sent by the user.

[0087] The server inputs the received theme and brand information into the AI ​​model and generates multiple advertising creatives.

[0088] Step 14:

[0089] The server transmits the generated advertising creative to the terminal.

[0090] The server packets the generated design and sends it to the terminal.

[0091] Step 15:

[0092] The terminal displays the advertising creative received from the server.

[0093] The terminal displays a number of advertisement designs on the screen for the user to select from.

[0094] Step 16:

[0095] The user selects the best ad creative.

[0096] Users tap the screen to select an ad design.

[0097] Step 17:

[0098] The user checks the details of the selected advertising creative and completes the transaction.

[0099] The user checks the advertisement details, supplier information, and price information, taps the "Contract" button, and enters payment information.

[0100] Using the above processing flow, users can easily search for information on outdoor advertising space, compare advertising creatives generated by AI, select the most suitable advertisement, and smoothly complete the advertising process.

[0101] Example 1

[0102] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0103] In the conventional outdoor advertising process, users had to manually research information about advertising space and repeatedly check and select advertising designs, which required a great deal of time and effort. Furthermore, there were limited ways to check the visual image of the ads beforehand, making it difficult to predict their actual effectiveness. Furthermore, specialized knowledge was required to generate and select advertising creatives, placing a heavy burden on users. The purpose of this invention is to solve these problems and provide a more efficient and effective outdoor advertising process.

[0104] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0105] In this invention, the server includes: means for a user terminal to acquire location information and video information of an object; means for the server to search for advertising space information based on the location information; means for transmitting the acquired advertising space information to the user terminal; means for the user terminal to display the advertising space information using AR technology; means for the user to input advertising theme and brand information; means for the server to generate advertising creatives using a generative AI model based on the theme and brand information; means for the server to transmit the generated advertising creatives to the user terminal; means for the user terminal to display the generated advertising creatives; means for the user to select advertising creatives; and means for the user to confirm detailed information about the advertising creatives selected by the user and complete a contract procedure. This enables users to easily and efficiently perform a series of tasks from acquiring advertising space information to selecting and confirming a design and completing a contract procedure.

[0106] A "user terminal" is a device that is operated by a user to acquire location information and video information and communicate with a server.

[0107] "Location information" is data that indicates the geographic location of an object and is obtained using technologies such as GPS.

[0108] "Video information" refers to image and video data captured through the camera of the user terminal.

[0109] A "server" is a computer system that communicates with user terminals via a network and performs processes such as searching for advertising space information and generating advertising creatives.

[0110] An "advertising space" refers to a specific location or space for displaying outdoor advertising.

[0111] "AR technology" is an abbreviation for augmented reality technology, which is a technology that displays virtual information overlaid on images of the real world.

[0112] A "generative AI model" is an artificial intelligence model that automatically generates advertising creatives based on input data.

[0113] "Advertising creative" refers to content that includes designs and messages displayed as advertisements.

[0114] The "contract procedure" is the process by which the user enters the necessary information regarding the use of advertising space and the ordering of advertising creatives, and finally finalizes the contract.

[0115] The present invention provides a system that allows users to easily and efficiently place outdoor advertisements. The system is composed of a user terminal, a server, and a generative AI model.

[0116] First, the user launches a dedicated application on their device, such as a smartphone. This application displays an initial setup screen and requests permission from the user to obtain location information and access the camera. For example, a general-purpose application such as "OutdoorAdVisualizer" is assumed.

[0117] When a user holds their smartphone camera over the location where they want to place an advertisement, the user's device acquires the location information and image information of the target object through the camera. This location information is acquired using technologies such as GPS, and the image information is acquired using the camera module.

[0118] The acquired location information and video information is sent from the user terminal to a server. The transmitted data is encrypted to ensure secure communication. The server searches a database for advertising space information based on the received location information. This database contains information on the location, price, available dates and times of advertising space, and outsourced party information. The advertising space information acquired by the server is sent back to the user terminal.

[0119] The user's device uses AR technology to display the ad space on the camera image based on the received ad space information. This allows the user to see the ad as if it were actually displayed in the specified location. AR technology uses AR libraries such as "Vuforia."

[0120] Next, the user enters the advertising theme and brand information into a form within the app. For example, themes such as "Summer Sale" or "New Product Release" are entered. The information entered by the user is then sent back to the server via the user's device.

[0121] The server generates ad creatives using a generative AI model based on the theme and brand information. This generative AI model uses, for example, "DALL-E" or "Stable Diffusion." Multiple variations of the generated ad creatives are generated and sent from the server to the user's device.

[0122] The user's device displays the received multiple ad creatives on the screen. The user can scroll through the designs and select the most suitable one. Detailed information about the selected ad creative, as well as information about the contractor and price, are also displayed at the same time.

[0123] Finally, the user completes the transaction process within the app by tapping the "Contract" button and entering payment information to complete the ad placement process. Payment information is encrypted and processed securely on the server.

[0124] Specific examples

[0125] For example, consider the case where a user wants to place a "Summer Sale" advertisement on the wall of a building. The user points their smartphone camera at the building and the app switches to AR mode. When the user sends their location information, the server searches for the corresponding ad space information and sends it back to the user's device. The user checks the virtual ad space in AR and enters "Summer Sale" as the theme. The server generates multiple ad creatives with the "Summer Sale" theme and displays them on the user's device. The entire ad placement process is completed when the user selects the most suitable design and completes the purchase procedure.

[0126] Prompt Sentence Examples

[0127] "We want to advertise our summer sales on the wall of a building. Please create an eye-catching creative with a vibrant design."

[0128] "We would like to advertise a new product on a sign in the shopping district. Please suggest a design that targets young customers in their 20s and 30s."

[0129] The above is an embodiment of the present invention. This system allows users to easily and efficiently obtain information about advertising spaces, select and confirm designs, and complete contract procedures.

[0130] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0131] Step 1:

[0132] The user launches the dedicated application on their smartphone. The user device displays an initial setup screen and requests permission to obtain location information and access the camera (input: none, output: initial setup screen displayed). The user grants these permissions.

[0133] Step 2:

[0134] Users hold their smartphone camera over the location where they want to place an advertisement. The user's device obtains the location information and video information of the target object through the camera (input: camera image, GPS data; output: location information, video information). This location information is obtained using GPS technology, and the video information is obtained using the camera module.

[0135] Step 3:

[0136] The device sends the acquired location information and video information to the server (input: location information, video information; output: transmission of encrypted data). The data sent is encrypted to ensure the security of the communication.

[0137] Step 4:

[0138] The server searches the database for ad space information based on the received location information (input: encrypted data, output: ad space information). The server queries the database and obtains the location, price, available date and time, and contractor information for the relevant ad space.

[0139] Step 5:

[0140] The server sends the acquired advertising space information to the user terminal (input: advertising space information, output: transmission of encrypted data). The user terminal decrypts the received data and acquires the advertising space information.

[0141] Step 6:

[0142] The user's device uses AR technology to display the ad space on the camera image based on the received ad space information (input: ad space information, output: AR overlay display). This allows the user to see the ad as if it were actually displayed in the specified location. AR libraries such as "Vuforia" are used for the AR technology.

[0143] Step 7:

[0144] The user enters the advertising theme and brand information into a form within the app (input: theme, brand information, output: input information). For example, themes such as "Summer sale" or "New product release" are entered. The information entered by the user is then sent back to the server via the user's device (input: input information, output: sending encrypted data).

[0145] Step 8:

[0146] The server uses a generative AI model based on the theme and brand information to generate ad creatives (input: theme, brand information, output: multiple ad creatives). The generative AI model uses "DALL-E" or "Stable Diffusion." The generated ad creatives are sent from the server to the user's device (input: ad creatives, output: transmission of encrypted data).

[0147] Step 9:

[0148] The user's device displays the received multiple ad creatives on the screen (input: encrypted data, output: display of ad creatives), and the user can scroll through these designs. When the user selects the most suitable design, detailed information about the design, the contractor, and price information are also displayed at the same time.

[0149] Step 10:

[0150] To complete the transaction within the app, the user taps the "Contract" button and enters payment information (input: payment information, output: transaction completed). Payment information is encrypted and processed securely on the server.

[0151] (Application example 1)

[0152] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0153] The conventional outdoor advertising process requires a lot of time and effort to search for advertising space, check prices, and confirm the image after advertising. The process of selecting the optimal advertising design from multiple options is also complicated. This can lead to insufficient consideration for maximizing advertising effectiveness, which can result in reduced advertising effectiveness. Furthermore, the entire advertising process is complicated and time-consuming, making it difficult to quickly place advertisements. Therefore, a system that allows for easy and effective outdoor advertising has been sought.

[0154] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0155] In this invention, the server includes: means for a user terminal to acquire location information and image information of an object; means for the server to search for advertising space information based on the location information; means for the server to transmit the acquired advertising space information to the user terminal; means for the user terminal to display the advertising space information using AR technology; means for the user to input advertising theme and brand information; means for the server to generate advertising creatives based on the theme and brand information; means for the server to transmit the generated advertising creatives to the user terminal; means for the user terminal to display the generated advertising creatives; means for the user to select advertising creatives; means for the user to check detailed information about the selected advertising creatives and complete a contract procedure; means for overlaying the advertising space information on camera images using AR technology; and means for scrolling through and selecting the generated advertising creatives. This enables users to quickly acquire advertising space information and easily select and place advertising creatives while visually checking them using AR technology.

[0156] A "user terminal" is an electronic device that allows a user to input information and send and receive data. Examples include smartphones, tablets, and personal computers.

[0157] "Location information" is data that indicates the geographic location of a specific object, including GPS data and address information.

[0158] "Video information" refers to image and video data captured by a camera or other imaging device.

[0159] A "server" is a computer system for processing and storing data over a network.

[0160] "Advertising space information" is detailed data about the space or location for placing advertisements, including location, size, available dates and times, price, and contractor information.

[0161] "AR technology" is a technology that displays computer-generated information overlaid on real-world images.

[0162] "Theme" is information that indicates the main content or concept of the advertisement.

[0163] "Brand information" refers to identifying information and data such as names and logos associated with advertisers and products.

[0164] "Advertising creative" refers to content that includes creative content, such as advertising design and text.

[0165] "Scrolling" is a user interface operation that moves displayed content up and down or left and right.

[0166] A "closing procedure" is a series of procedures for formally concluding a transaction for a service or product.

[0167] MODE FOR CARRYING OUT THE INVENTION

[0168] The present invention provides a system that allows users to easily search for outdoor advertising contractors and prices, and visually check what the advertisement will look like after it is placed, using AR and AI technologies. Specific embodiments are described below.

[0169] System Overview

[0170] The system includes the following means:

[0171] 1. User terminal: This refers to devices such as smartphones and tablets that allow users to input information and send and receive data.

[0172] 2. Server: A computer system for processing and storing data over a network.

[0173] Program processing

[0174] Hardware and Software

[0175] The user device uses a camera, GPS, AR library, and software for data transmission and reception (e.g., OpenCV, Requests library). The server has a database, AI model library, and API server (e.g., Flask or Django).

[0176] Processing flow

[0177] 1. Acquisition of location and video information: When a user points their smartphone camera at the location where they want to place an ad, the camera acquires video information and the GPS acquires location information.

[0178] 2. Sending data to the server: The user device sends the acquired location information and video information to the server.

[0179] 3. Searching and obtaining advertising space information: The server searches the database for advertising space information (location, price, available dates and times, contractor information, etc.) based on the location information and sends it to the user's device.

[0180] 4. Display using AR technology: The user device uses AR technology to overlay the received advertising space information on the camera image.

[0181] 5. Entering theme and brand information: The user enters the ad theme and brand information into a form within the app and sends it to the server.

[0182] 6. Generating advertising creatives using AI: The server uses an AI model to generate multiple advertising creatives based on the theme and brand information sent, and sends them to the user's device.

[0183] 7. Display and selection of ad creatives: The user device displays multiple generated ad creatives, and the user scrolls through them to select the most suitable one.

[0184] 8. Purchase procedure: After the user selects an ad creative, they confirm its details and complete the purchase procedure.

[0185] Specific examples

[0186] Take the example of an advertising agency that conducts area marketing. If a user wants to place a "Summer Sale" ad on the wall of a building in the Shinjuku area, they point their smartphone camera at the building. The app switches to AR mode, and location and video information is sent to the server. The server searches for relevant ad space information and sends it back to the user's device. Using AR technology, the user checks the virtual ad space and enters information on the theme of "Summer Sale." The server uses an AI model to generate multiple ad creatives and displays them on the user's device. The user selects the most suitable design and completes the transaction.

[0187] Prompt Sentence Examples

[0188] "We envision an application that allows users to view ad space information based on the ad theme "Summer Sale" and the coordinate location of the "Shinjuku area," and select from multiple creatives generated using AI. Please generate a summer sale ad that is suitable for the Shinjuku area."

[0189] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0190] A detailed explanation of the program's processing flow

[0191] Processing Steps

[0192] Step 1:

[0193] The user's device points the camera at the desired advertising location, and the camera captures the image of the scenery, while the GPS sensor simultaneously acquires the location information.

[0194] Input: Camera image (image data), GPS location information (latitude and longitude)

[0195] Output: Acquired video information and location information

[0196] Step 2:

[0197] The location information and video information acquired by the user device are sent to the server using HTTP requests via the Internet.

[0198] Input: Video information, location information

[0199] Output: Data sent to the server

[0200] Step 3:

[0201] Based on the location information received, the server searches the database for ad slot information (location, price, available dates and times, agent information, etc.) using SQL or NoSQL queries.

[0202] Input:Location

[0203] Output: Ad space information (location, price, available date and time, agent information)

[0204] Step 4:

[0205] The server sends the searched ad slot information to the user's device. This communication also uses an HTTP response.

[0206] Input: Ad space information

[0207] Output: Ad space information sent to the user's device

[0208] Step 5:

[0209] The ad space information received by the user's device is overlaid on the camera image using AR technology, using an AR library (e.g., ARCore, ARKit).

[0210] Input: Ad space information, camera footage

[0211] Output: Camera image overlaid with AR

[0212] Step 6:

[0213] The user enters the advertising theme and brand information into a form within the app, which is then converted into JSON format.

[0214] Input: Theme, brand information

[0215] Output: Theme and brand information entered

[0216] Step 7:

[0217] The user terminal transmits the input theme and brand information to the server.

[0218] Input: Theme, brand information

[0219] Output: Data sent to the server

[0220] Step 8:

[0221] Based on the theme and brand information received by the server, a generative AI model is used to generate advertising creatives. A generative AI model (e.g., GPT-3 (registered trademark), DALL-E) is used to generate creatives based on prompt statements.

[0222] Input: Theme, brand information (prompt text)

[0223] Output: Generated ad creative

[0224] Step 9:

[0225] The server transmits the generated advertising creatives to the user terminal.

[0226] Input: Generated ad creative

[0227] Output: Ad creative sent to user device

[0228] Step 10:

[0229] The user device displays the received ad creatives, and the user can scroll through multiple creatives to select one.

[0230] Input: Ad creative

[0231] Output: Ad creative selected by the user

[0232] Step 11:

[0233] The user confirms the details of the selected ad creative and completes the transaction. The user enters payment information and other details, and sends them to the server.

[0234] Input: Selected ad creative, payment information

[0235] Output: Notification of completion of contract procedure

[0236] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0237] The present invention combines a system that allows users to easily search for outdoor advertising contractors and prices, and visually confirm the image of the advertisement after it has been placed using AR and AI technology, with an emotion engine that recognizes the user's emotions. Specific embodiments for carrying out the invention are described below.

[0238] First, the user launches the dedicated application on their smartphone. When the app is launched on the user's device, the main screen is displayed. The user then points the smartphone camera at the location where they want to place an ad. At this time, the user's device's camera captures the location information and image information of the target object.

[0239] The user device sends the acquired location information and video information to the server. The server uses this data to search for corresponding ad slot information in its database. This information includes the location of the ad slot, price, available dates and times, and outsourcing information. The server sends the search results to the user device, which then receives this information.

[0240] Next, the user device uses AR technology to overlay the received ad space information onto the camera image, allowing the user to see the ad as if it were actually being displayed in the specified location.

[0241] Once the user has selected an ad slot, they then enter the ad theme and brand information. They then enter this information into a form within the app and submit the information. The user's device then sends the information entered by the user back to the server. The server uses an AI model based on this information to generate multiple ad creatives. The generated ad creatives are then sent from the server to the user's device.

[0242] The user device displays the received advertising creative on the screen, and at the same time, the emotion engine analyzes the user's facial expressions and voice to obtain emotional data. The emotion engine uses a camera and microphone to analyze the user's emotions in real time and obtains emotional data such as joy, surprise, and displeasure.

[0243] The server provides feedback on ad creatives based on the acquired emotional data and proposes designs that suit the user's emotions. Multiple ad creatives are presented, the user's emotional response to each is analyzed, and further optimized ads are proposed accordingly.

[0244] Users can scroll through multiple ad designs and select the most suitable one. Once a user selects an ad creative, detailed information, contractor information, and pricing information are displayed.

[0245] Finally, the user taps the "Contract" button to complete the transaction and enters payment information, etc. This completes the process for placing the ad.

[0246] As a concrete example, consider the case where a user wants to place an advertisement on the wall of a building. The user points their smartphone camera at the building and the app switches to AR mode. When the user sends their location information, the server searches for the corresponding ad space information and sends it back to the user's device. The user checks the virtual ad space in AR and enters "Summer Sale" as the advertising theme. The server generates multiple ad creatives with the theme "Summer Sale" and displays them on the user's device. The emotion engine analyzes the user's facial expressions and suggests the most suitable design. The user selects the most suitable design and completes the contract procedure, completing the entire advertising process.

[0247] The above is an embodiment of the present invention. This system allows users to easily obtain information about advertising slots and easily grasp the specifics of advertising placement. Furthermore, the introduction of an emotion engine makes it possible to select advertising creatives that suit the user's emotions, which is expected to improve advertising effectiveness.

[0248] The processing flow will be explained below.

[0249] Step 1:

[0250] The user launches the dedicated app on their smartphone.

[0251] The user taps to open the app on their smartphone.

[0252] Step 2:

[0253] Users point their smartphone camera at the location where they want to place an ad.

[0254] The user uses the camera to scan an object (for example, the wall of a building).

[0255] Step 3:

[0256] The device acquires location information and video information through the camera.

[0257] The device acquires data from its GPS function and camera sensor and analyzes location information and video information.

[0258] Step 4:

[0259] The terminal transmits the acquired location information and video information to the server.

[0260] The terminal packs this data into packets and sends them to a server via the Internet.

[0261] Step 5:

[0262] The server receives the location information and video information sent from the terminal.

[0263] The server decrypts the received data and prepares a database query.

[0264] Step 6:

[0265] The server searches the database for information about the ad slot.

[0266] The server queries the database using the location information as a key to obtain information about the advertising space's supplier, price, and available dates and times.

[0267] Step 7:

[0268] The server transmits the acquired advertising space information to the terminal.

[0269] The server packets the advertising space information and returns it to the terminal.

[0270] Step 8:

[0271] The terminal analyzes the advertising space information received from the server.

[0272] The terminal decodes the received data and prepares it for display.

[0273] Step 9:

[0274] The device uses AR technology to overlay advertising space information on the camera image.

[0275] The device displays the location and price information of the advertising space overlaid on the camera image.

[0276] Step 10:

[0277] The user checks the ad space information displayed in AR and selects the desired ad space.

[0278] Based on the displayed information, the user taps to select the desired ad space.

[0279] Step 11:

[0280] The user inputs the advertising theme and brand information.

[0281] Users use the in-app input form to enter the ad theme and brand information and press the submit button.

[0282] Step 12:

[0283] The terminal transmits the input information to the server.

[0284] The device assembles data containing theme and brand information into packets and sends them to the server.

[0285] Step 13:

[0286] The server uses AI to generate advertising creatives based on information from users.

[0287] The server inputs the theme and brand information into the AI ​​model and generates multiple advertising designs.

[0288] Step 14:

[0289] The server transmits the generated advertising creative to the terminal.

[0290] The server packetizes the generated advertisement design and transmits it to the terminal.

[0291] Step 15:

[0292] The terminal displays the advertising creative received from the server, and at the same time, the emotion engine acquires the user's emotion data.

[0293] The device displays the advertising design on the screen and uses the device's camera and microphone to analyze the user's facial expressions and voice to obtain emotional data.

[0294] Step 16:

[0295] The server analyzes the acquired emotion data and optimizes the advertising creative based on the user's emotion.

[0296] The server uses the data sent from the emotion engine to recommend designs that users tend to prefer.

[0297] Step 17:

[0298] Users can scroll through multiple optimized ad creatives and select the best one.

[0299] Users can compare the designs displayed on the screen and select the one they like by tapping it.

[0300] Step 18:

[0301] The user checks the details of the selected advertising creative and completes the transaction.

[0302] The user checks the advertisement details, supplier information, and price information, taps the "Contract" button, and enters payment information.

[0303] The above processing flow enables users to easily search for information on outdoor advertising space, optimally select advertising creatives generated by AI based on the analysis results of the emotion engine, and smoothly complete the advertising submission process.

[0304] Example 2

[0305] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0306] Conventional advertising systems have the problem that the process for users to obtain information on ad slots and select ad creatives is complicated and time-consuming.Furthermore, since ad creatives are not optimized based on user emotions, there is also the problem that it is difficult to achieve sufficient advertising effectiveness.

[0307] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0308] In this invention, the server includes a means for a user terminal to acquire location information and video information of an object, a means for the server to search for advertising space information based on the location information, and a means for transmitting the advertising space information acquired by the server to the user terminal. This allows users to easily acquire advertising space information and get a concrete idea of ​​what advertising placement will be like. Furthermore, an emotion analysis engine is used to optimize advertising creatives based on user emotions, which is expected to improve advertising effectiveness.

[0309] A "user terminal" is an electronic device such as a smartphone or tablet that is operated by a user.

[0310] "Object" refers to the location or physical object where you want to place your ad.

[0311] "Location Information" means geographic data of a specific location obtained using GPS or other technologies.

[0312] "Video information" refers to actual video data captured using a camera.

[0313] A "server" is a computer system that manages and processes data on a network.

[0314] "Advertising space information" refers to detailed information such as the location, space, period, price, and contractor where an advertisement can be placed.

[0315] Augmented reality technology (AR technology) is a technology that overlays computer-generated images and information onto real-world images.

[0316] A "theme" is a major concept or idea that defines the content and direction of an advertisement.

[0317] "Brand Information" is specific information related to an advertiser's brand.

[0318] A "generative AI model" is an algorithm or software that uses artificial intelligence to generate various creative content based on user instructions.

[0319] "Advertising creative" refers to specific ideas for the design and content of an advertisement.

[0320] An "emotion analysis engine" is a technology that analyzes a user's facial expressions and voice to recognize their emotional state.

[0321] "Emotion data" is information about the user's emotional state obtained by the emotion analysis engine.

[0322] The "contract procedure" is the final procedure for concluding a contract regarding the advertising creative selected by the user.

[0323] This invention is a system that allows users to easily search for outdoor advertisements and visually check the image before placing an advertisement using augmented reality (AR) technology and artificial intelligence (AI) technology. Furthermore, by combining it with an emotion analysis engine that recognizes user emotions, it is possible to select advertising creatives that suit the user's emotions. This system allows users to place advertisements quickly and effectively.

[0324] This system operates in the following steps:

[0325] First, the user launches the dedicated application on their smartphone. After launching the application, the main screen will appear, and the user points the smartphone camera at the location where they want to place an ad. The user's device (smartphone) will use the camera to obtain location information and video information of the target object. This information is obtained using the camera and GPS.

[0326] Next, the user device sends the acquired location information and video information to the server. Based on the received data, the server searches a database for corresponding ad space information. This ad space information includes the location, price, available dates and times, and outsourcing information of the ad space. The server sends the search results to the user device, which displays the information.

[0327] The user's device uses AR technology based on the received ad space information to virtually overlay the ad space on the camera image. For example, if a user wants to place an advertisement on the wall of a building, they can point their smartphone camera at the building, and the app will switch to AR mode, causing a virtual advertisement to be displayed on the actual wall of the building.

[0328] Next, the user inputs the ad theme and brand information. This information is entered into a form within the app and sent from the user's device to the server. The server uses the received information to generate multiple ad creatives using a generative AI model. This process uses prompts such as:

[0329] "A user wants to advertise 'Summer Sale' on the wall of a building. Please generate advertising creative with a summer sale theme."

[0330] The advertising creative generated by the server is sent to the user's device, which then displays the received creative on the screen. At this time, an emotion analysis engine analyzes the user's facial expressions and voice to obtain emotional data. The emotion analysis engine uses a camera and microphone to analyze the user's emotions in real time, determining, for example, joy, surprise, or displeasure.

[0331] Based on the acquired emotional data, the server provides feedback on the ad creative and suggests a design that best suits the user's emotions. The user can scroll through multiple ad creatives to compare them and select the most suitable one. Once the user selects an ad creative, detailed information (such as price information and contractor information) is displayed.

[0332] Finally, the user taps the "Contract" button and enters payment information to complete the transaction, completing the entire process of placing an ad.

[0333] The above is an embodiment of the present invention. This system allows users to easily obtain information about advertising slots and get a concrete idea of ​​what their advertising placement will look like. Furthermore, the introduction of an emotion analysis engine makes it possible to select advertising creatives that suit the user's emotions, which is expected to improve advertising effectiveness.

[0334] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0335] Step 1:

[0336] The user launches the dedicated application on their smartphone. When the user launches the application, the main screen is displayed. The input is the user's operation, and the output is the application's main screen.

[0337] Step 2:

[0338] Users use their smartphone camera to take a picture of the location where they want to place an advertisement. The camera on the user's device captures the location information and video information of the target object. The input is the actual video captured by the camera and location information from GPS, and the output is location information and video information data.

[0339] Step 3:

[0340] The user device sends the acquired location information and video information to the server. The server searches the database for corresponding ad space information based on the received data. The input is location information and video information, and the output is the corresponding ad space information. Specifically, the server retrieves the location, price, available date and time, and contractor information of the ad space from the database.

[0341] Step 4:

[0342] The server sends the search results to the user terminal, and the user terminal displays the received ad space information on the screen. The input is the ad space information sent from the server, and the output is the ad space information displayed on the screen of the user terminal.

[0343] Step 5:

[0344] The user device uses AR technology to virtually overlay ad space on the camera image based on the received ad space information. The input is the ad space information and the current camera image, and the output is an AR image that combines the two. For example, if a user takes a photo of the wall of a building, a virtual advertisement will be displayed on that wall.

[0345] Step 6:

[0346] The user enters the advertising theme and brand information into a form within the app. The user's device sends the entered information to the server. The input is the theme and brand information entered by the user, and the output is the data sent to the server.

[0347] Step 7:

[0348] The server uses the generative AI model to generate multiple ad creatives based on the received information. The input to this process is a prompt based on the theme and brand information, and the output is multiple generated ad creatives. For example, the prompt could be, "The user wants to place a 'Summer Sale' advertisement on the wall of a building. Please generate ad creatives with a summer sale theme."

[0349] Step 8:

[0350] The server sends the generated ad creative to the user terminal, and the user terminal displays the received creative on the screen. The input is the ad creative sent from the server, and the output is the ad creative displayed on the user terminal.

[0351] Step 9:

[0352] The emotion analysis engine analyzes the user's facial expressions and voice to obtain emotional data. The input is the user's facial expressions and voice captured through the camera and microphone, and the output is the analyzed emotional data. For example, emotions such as joy, surprise, and displeasure are identified.

[0353] Step 10:

[0354] The server provides feedback on the ad creative based on the acquired emotional data. The input is emotional data, and the output is a proposal for an optimized ad design that matches the user's emotions.

[0355] Step 11:

[0356] The user scrolls through multiple ad creatives, compares them, and selects the best one. The input is multiple ad creatives and the user's selection intention, and the output is the selection of the best ad creative.

[0357] Step 12:

[0358] Detailed information (such as price information and supplier information) about the ad creative selected by the user is displayed on the screen. The input is the selected ad creative, and the output is the display of detailed information.

[0359] Step 13:

[0360] To complete the transaction, the user taps the "Contract" button and enters payment information, etc. The input is the information necessary for the user's transaction, and the output is confirmation that the transaction has been completed. This completes the entire advertising process.

[0361] (Application example 2)

[0362] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0363] Conventional advertising systems have the problem that searching and selecting ad slots and checking the image of the actual ad display are complicated and time-consuming.In addition, it is not possible to propose optimal ad creatives that take user emotions into consideration, making it difficult to maximize the effectiveness of advertising.

[0364] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0365] In this invention, the server includes: means for a user terminal to acquire location information and video information of an object; means for the server to search for advertising space information based on the location information; means for transmitting the acquired advertising space information to the user terminal; means for the user terminal to display the advertising space information using AR technology; means for the user to input advertising theme and brand information; means for the server to generate advertising creatives based on the theme and brand information; means for the server to transmit the generated advertising creatives to the user terminal; means for the user terminal to display the generated advertising creatives; means for the user to select advertising creatives; means for the user to confirm detailed information about the selected advertising creatives and complete a contract procedure; means for the user terminal to acquire user emotion data using a camera and microphone; and means for the server to analyze the emotion data and re-propose optimal advertising creatives based on the analysis results. This allows users to easily acquire advertising space information, making it easier to get a concrete idea of ​​advertising placements, and the introduction of an emotion engine makes it possible to select advertising creatives that suit the user's emotions.

[0366] A "user terminal" is a mobile phone, smartphone, tablet, or other mobile device operated by a user.

[0367] "Object" refers to a location or physical structure where a user wishes to place, display, or view an advertisement.

[0368] "Location Information" means the geographic latitude, longitude, and altitude data of an object obtained using GPS, Wi-Fi, beacons, or other technologies.

[0369] "Video information" refers to image or video data captured using the camera function of a user terminal.

[0370] A "server" is a computer system that receives, transmits, and processes data, and in the present invention searches for advertising space information, generates creative content, and analyzes emotional data.

[0371] An "ad inventory" is a physical or digital space in which an advertisement is displayed, with attributes such as location, price, and availability dates and times.

[0372] "AR technology" stands for augmented reality technology, which is a technology that displays virtual information overlaid on real-world images.

[0373] "Theme" refers to the content, concept, or subject matter of the event or campaign being advertised.

[0374] "Brand information" includes information such as the brand name, logo, corporate philosophy, and color scheme promoted by the advertisement.

[0375] "Advertising creative" refers to the visual or audio advertising materials, such as the advertisement design, text, images, and video.

[0376] "Emotion data" is data of emotions such as joy, surprise, and discomfort, obtained by analyzing the user's facial expressions, voice, and body movements.

[0377] An "emotion engine" is software or hardware that uses a camera or microphone to analyze a user's emotions in real time.

[0378] "Optimal advertising creative" refers to advertising creative selected based on user emotional data in order to maximize user satisfaction.

[0379] This invention combines a system that allows users to easily search for outdoor advertising contractors and prices, and visually confirm what the ad will look like after it is placed using AR and AI technology, with an emotion engine that recognizes the user's emotions.

[0380] First, a user uses a smartphone to implement the invention. The user launches the application and points the smartphone camera at the location where they want to place an advertisement. At this time, the user's device acquires the location information and image information of the target object. The location information is obtained using GPS and Wi-Fi data, and the image information is acquired by the smartphone's built-in camera.

[0381] The acquired location information and video information are sent to a server. The server uses the location information to search a database for information on the corresponding ad slot. This information includes the location of the ad slot, price, available dates and times, and contractor information. The server then sends this information to the user's device.

[0382] The user device displays the received ad space information using AR technology. Specifically, ARCore (for ANDROID (registered trademark)) or ARKit (for iOS) is used to overlay virtual ad space on local video, allowing the user to see the ad as if it were actually being displayed.

[0383] Next, the user enters the ad theme and brand information within the app. This information is sent to a server, which uses a generative AI model to generate multiple ad creatives. The generated ad creatives are sent from the server to the user's device and displayed on the device. At this time, the user's device runs an emotion engine, which uses the camera and microphone to analyze the user's facial expressions and voice to obtain emotional data. This emotion analysis uses technologies such as Microsoft® Azure® Cognitive Services and Affectiva.

[0384] The server analyzes the emotional data and, based on the results, re-proposes the most appropriate ad creative. The user can scroll through multiple ad creatives and analyze the emotional response to each, which will then suggest a design optimized for that emotion. Once the user selects the most suitable ad creative, detailed information, contractor information, and pricing information are displayed. Finally, the user completes the contract process and enters payment information to complete the ad placement procedure.

[0385] Specific examples

[0386] For example, consider the case where a user wants to place an advertisement on the wall of a building. The user points their smartphone camera at the building and the app switches to AR mode. When the user sends their location information, the server searches for the corresponding ad space information and sends it back to the user's device. The user checks the virtual ad space in AR and enters "Summer Sale" as the advertising theme. The server uses a generative AI model to generate multiple "Summer Sale" themed ad creatives and displays them on the user's device. The emotion engine analyzes the user's facial expressions and suggests the most suitable design. The user selects the most suitable design and the transaction process is completed.

[0387] Prompt Sentence Examples

[0388] "Generate an effective ad design for a big summer sale. The theme colors are blue and yellow, and the target audience is young people in their 20s and 30s."

[0389] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0390] Step 1:

[0391] The user starts up their smartphone and launches the application. Using the camera on the user's device, they hold it over the location where they want to place the ad, and obtain location information (GPS) and video information (camera images).

[0392] Input: Smartphone camera image, GPS location information

[0393] Data processing / calculation: Camera image data is converted into an image format and sent to the server along with location information

[0394] Output: Location information and video data sent to the server

[0395] Step 2:

[0396] Based on the location information received by the server, advertising space information (location, price, available date and time, and contractor information) is searched from the database.

[0397] Input:Location

[0398] Data processing / calculation: Performing database queries using location information

[0399] Output: Ad space information

[0400] Step 3:

[0401] The server sends the ad space information to the user's device, which then uses AR technology to overlay the received ad space information on the camera image.

[0402] Input: Ad space information

[0403] Data processing / computation: Rendering virtual objects using ARCore or ARKit

[0404] Output: Ad space overlaid on the user's device

[0405] Step 4:

[0406] The user enters the advertising theme and brand information within the app and sends it to the server.

[0407] Input: Theme information, brand information

[0408] Data processing / calculation: Sending input form data

[0409] Output: Theme and branding information sent to the server

[0410] Step 5:

[0411] The server uses a generative AI model to generate multiple ad creatives based on the input theme and brand information.

[0412] Input: Theme information, brand information

[0413] Data processing / calculation: Generating ad creatives using generative AI models (TENSORFLOW (registered trademark) or PyTorch)

[0414] Output: Ad creative

[0415] Step 6:

[0416] The server transmits the generated advertising creatives to the user terminal, which displays them.

[0417] Input: Ad creative

[0418] Data processing / calculation: Displaying advertising creatives in the user interface

[0419] Output: Ad creative displayed on user device

[0420] Step 7:

[0421] The user device uses a camera and microphone to capture the user's facial expressions and voice, and analyzes the emotional data.

[0422] Input: User's facial expression data, voice data

[0423] Data processing / calculation: Sentiment analysis using an emotion engine (Microsoft Azure Cognitive Services or Affectiva)

[0424] Output: Parsed emotion data

[0425] Step 8:

[0426] The server receives the emotional data and, based on the analysis results, selects and re-proposes the most appropriate advertising creative.

[0427] Input: Emotion data, ad creative

[0428] Data processing / calculation: Feedback and regeneration of advertising creatives based on emotional data

[0429] Output: Optimized ad creative suggestions

[0430] Step 9:

[0431] The user selects the most suitable advertising creative, checks its details, contractor information, and price information, and then completes the contract procedure.

[0432] Input: Best ad creative, details

[0433] Data processing / calculation: Confirmation of selected data and transaction processing

[0434] Output: Contract procedure completed, advertising procedure completed

[0435] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0436] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0437] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0438] [Second embodiment]

[0439] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0440] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0441] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0442] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0443] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0444] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0445] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0446] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0447] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0448] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0449] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0450] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0451] The present invention is a system that allows users to easily search for outdoor advertising contractors and prices, and visually check what the advertisement will look like after it is placed using AR and AI technology. Specific embodiments for carrying out the invention are described below.

[0452] First, the user launches the dedicated application on their smartphone. When the app is launched on the user's device, the main screen is displayed. The user then points the smartphone camera at the location where they want to place an ad. At this time, the user's device's camera captures the location information and image information of the target object.

[0453] The user device sends the acquired location information and video information to the server. The server uses this data to search for corresponding ad slot information in its database. This information includes the location of the ad slot, price, available dates and times, and outsourcing information. The server sends the search results to the user device, which then receives this information.

[0454] Next, the user device uses AR technology to overlay the received ad space information onto the camera image, allowing the user to see the ad as if it were actually being displayed in the specified location.

[0455] Once the user has selected an ad slot, they then enter the ad theme and brand information. They then enter this information into a form within the app and submit the information. The user's device then sends the information entered by the user back to the server. The server uses an AI model based on this information to generate multiple ad creatives. The generated ad creatives are then sent from the server to the user's device.

[0456] The user's device displays the received ad creative on the screen. The user can scroll through multiple ad designs and select the most suitable one. Once the user selects an ad creative, detailed information, contractor information, and price information are displayed.

[0457] Finally, the user taps the "Contract" button to complete the transaction and enters payment information, etc. This completes the process for placing the ad.

[0458] As a concrete example, consider the case where a user wants to place an advertisement on the wall of a building. The user points their smartphone camera at the building and the app switches to AR mode. When the user sends their location information, the server searches for the corresponding ad space information and sends it back to the user's device. The user checks the virtual ad space in AR and enters "Summer Sale" as the advertising theme. The server generates multiple ad creatives with the theme "Summer Sale" and displays them on the user's device. The entire advertising process is completed when the user selects the most suitable design and completes the transaction procedure.

[0459] The above is an embodiment of the present invention. This system allows users to easily obtain information about advertising slots and easily get a concrete idea of ​​what advertising placement will be like.

[0460] The processing flow will be explained below.

[0461] Step 1:

[0462] The user launches a dedicated app on their smartphone.

[0463] Users tap on an app to access its main screen.

[0464] Step 2:

[0465] Users point their smartphone camera at the location where they want to place an ad.

[0466] A user uses a camera to capture image information of an object.

[0467] Step 3:

[0468] The device acquires location information and video information through the camera.

[0469] The device receives data from the GPS sensor and camera and analyzes location and video information.

[0470] Step 4:

[0471] The terminal transmits the acquired location information and video information to the server.

[0472] The terminal packs the data into packets and sends them over the Internet to a server.

[0473] Step 5:

[0474] The server receives the location information and video information sent from the terminal.

[0475] The server interprets the received data and prepares a query to the database.

[0476] Step 6:

[0477] The server searches the database for information on the corresponding advertising space.

[0478] The server queries a database based on the location information to retrieve information such as the ad space's supplier, price, and available dates and times.

[0479] Step 7:

[0480] The server transmits advertising space information including search results to the terminal.

[0481] The server converts the acquired information into packets and returns them to the terminal.

[0482] Step 8:

[0483] The terminal analyzes the advertising space information received from the server.

[0484] The device decodes the received data and prepares it for AR display.

[0485] Step 9:

[0486] The device uses AR technology to overlay advertising space information on the camera image.

[0487] The device will display additional information about the location and price of the advertising space on the camera image.

[0488] Step 10:

[0489] The user checks the ad space information displayed in AR and selects the desired ad space.

[0490] The user taps the screen to select an ad slot.

[0491] Step 11:

[0492] The user inputs the advertising theme and brand information.

[0493] Users enter details about their theme and brand into an in-app form.

[0494] Step 12:

[0495] The terminal transmits the input information to the server.

[0496] The terminal collects input data into packets and sends them to the server.

[0497] Step 13:

[0498] The server uses AI to generate advertising creatives based on the information sent by the user.

[0499] The server inputs the received theme and brand information into the AI ​​model and generates multiple advertising creatives.

[0500] Step 14:

[0501] The server transmits the generated advertising creative to the terminal.

[0502] The server packets the generated design and sends it to the terminal.

[0503] Step 15:

[0504] The terminal displays the advertising creative received from the server.

[0505] The terminal displays a number of advertisement designs on the screen for the user to select from.

[0506] Step 16:

[0507] The user selects the best ad creative.

[0508] Users tap the screen to select an ad design.

[0509] Step 17:

[0510] The user checks the details of the selected advertising creative and completes the transaction.

[0511] The user checks the advertisement details, supplier information, and price information, taps the "Contract" button, and enters payment information.

[0512] Using the above processing flow, users can easily search for information on outdoor advertising space, compare advertising creatives generated by AI, select the most suitable advertisement, and smoothly complete the advertising process.

[0513] Example 1

[0514] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0515] In the conventional outdoor advertising process, users had to manually research information about advertising space and repeatedly check and select advertising designs, which required a great deal of time and effort. Furthermore, there were limited ways to check the visual image of the ads beforehand, making it difficult to predict their actual effectiveness. Furthermore, specialized knowledge was required to generate and select advertising creatives, placing a heavy burden on users. The purpose of this invention is to solve these problems and provide a more efficient and effective outdoor advertising process.

[0516] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0517] In this invention, the server includes: means for a user terminal to acquire location information and video information of an object; means for the server to search for advertising space information based on the location information; means for transmitting the acquired advertising space information to the user terminal; means for the user terminal to display the advertising space information using AR technology; means for the user to input advertising theme and brand information; means for the server to generate advertising creatives using a generative AI model based on the theme and brand information; means for the server to transmit the generated advertising creatives to the user terminal; means for the user terminal to display the generated advertising creatives; means for the user to select advertising creatives; and means for the user to confirm detailed information about the advertising creatives selected by the user and complete a contract procedure. This enables users to easily and efficiently perform a series of tasks from acquiring advertising space information to selecting and confirming a design and completing a contract procedure.

[0518] A "user terminal" is a device that is operated by a user to acquire location information and video information and communicate with a server.

[0519] "Location information" is data that indicates the geographic location of an object and is obtained using technologies such as GPS.

[0520] "Video information" refers to image and video data captured through the camera of the user terminal.

[0521] A "server" is a computer system that communicates with user terminals via a network and performs processes such as searching for advertising space information and generating advertising creatives.

[0522] An "advertising space" refers to a specific location or space for displaying outdoor advertising.

[0523] "AR technology" is an abbreviation for augmented reality technology, which is a technology that displays virtual information overlaid on images of the real world.

[0524] A "generative AI model" is an artificial intelligence model that automatically generates advertising creatives based on input data.

[0525] "Advertising creative" refers to content that includes designs and messages displayed as advertisements.

[0526] The "contract procedure" is the process by which the user enters the necessary information regarding the use of advertising space and the ordering of advertising creatives, and finally finalizes the contract.

[0527] The present invention provides a system that allows users to easily and efficiently place outdoor advertisements. The system is composed of a user terminal, a server, and a generative AI model.

[0528] First, the user launches a dedicated application on their device, such as a smartphone. This application displays an initial setup screen and requests permission from the user to obtain location information and access the camera. For example, a general-purpose application such as "OutdoorAdVisualizer" is assumed.

[0529] When a user holds their smartphone camera over the location where they want to place an advertisement, the user's device acquires the location information and image information of the target object through the camera. This location information is acquired using technologies such as GPS, and the image information is acquired using the camera module.

[0530] The acquired location information and video information is sent from the user terminal to a server. The transmitted data is encrypted to ensure secure communication. The server searches a database for advertising space information based on the received location information. This database contains information on the location, price, available dates and times of advertising space, and outsourced party information. The advertising space information acquired by the server is sent back to the user terminal.

[0531] The user's device uses AR technology to display the ad space on the camera image based on the received ad space information. This allows the user to see the ad as if it were actually displayed in the specified location. AR technology uses AR libraries such as "Vuforia."

[0532] Next, the user enters the advertising theme and brand information into a form within the app. For example, themes such as "Summer Sale" or "New Product Release" are entered. The information entered by the user is then sent back to the server via the user's device.

[0533] The server generates ad creatives using a generative AI model based on the theme and brand information. This generative AI model uses, for example, "DALL-E" or "Stable Diffusion." Multiple variations of the generated ad creatives are generated and sent from the server to the user's device.

[0534] The user's device displays the received multiple ad creatives on the screen. The user can scroll through the designs and select the most suitable one. Detailed information about the selected ad creative, as well as information about the contractor and price, are also displayed at the same time.

[0535] Finally, the user completes the transaction process within the app by tapping the "Contract" button and entering payment information to complete the ad placement process. Payment information is encrypted and processed securely on the server.

[0536] Specific examples

[0537] For example, consider the case where a user wants to place a "Summer Sale" advertisement on the wall of a building. The user points their smartphone camera at the building and the app switches to AR mode. When the user sends their location information, the server searches for the corresponding ad space information and sends it back to the user's device. The user checks the virtual ad space in AR and enters "Summer Sale" as the theme. The server generates multiple ad creatives with the "Summer Sale" theme and displays them on the user's device. The entire ad placement process is completed when the user selects the most suitable design and completes the purchase procedure.

[0538] Prompt Sentence Examples

[0539] "We want to advertise our summer sales on the wall of a building. Please create an eye-catching creative with a vibrant design."

[0540] "We would like to advertise a new product on a sign in the shopping district. Please suggest a design that targets young customers in their 20s and 30s."

[0541] The above is an embodiment of the present invention. This system allows users to easily and efficiently obtain information about advertising spaces, select and confirm designs, and complete contract procedures.

[0542] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0543] Step 1:

[0544] The user launches the dedicated application on their smartphone. The user device displays an initial setup screen and requests permission to obtain location information and access the camera (input: none, output: initial setup screen displayed). The user grants these permissions.

[0545] Step 2:

[0546] Users hold their smartphone camera over the location where they want to place an advertisement. The user's device obtains the location information and video information of the target object through the camera (input: camera image, GPS data; output: location information, video information). This location information is obtained using GPS technology, and the video information is obtained using the camera module.

[0547] Step 3:

[0548] The device sends the acquired location information and video information to the server (input: location information, video information; output: transmission of encrypted data). The data sent is encrypted to ensure the security of the communication.

[0549] Step 4:

[0550] The server searches the database for ad space information based on the received location information (input: encrypted data, output: ad space information). The server queries the database and obtains the location, price, available date and time, and contractor information for the relevant ad space.

[0551] Step 5:

[0552] The server sends the acquired advertising space information to the user terminal (input: advertising space information, output: transmission of encrypted data). The user terminal decrypts the received data and acquires the advertising space information.

[0553] Step 6:

[0554] The user's device uses AR technology to display the ad space on the camera image based on the received ad space information (input: ad space information, output: AR overlay display). This allows the user to see the ad as if it were actually displayed in the specified location. AR libraries such as "Vuforia" are used for the AR technology.

[0555] Step 7:

[0556] The user enters the advertising theme and brand information into a form within the app (input: theme, brand information, output: input information). For example, themes such as "Summer sale" or "New product release" are entered. The information entered by the user is then sent back to the server via the user's device (input: input information, output: sending encrypted data).

[0557] Step 8:

[0558] The server uses a generative AI model based on the theme and brand information to generate ad creatives (input: theme, brand information, output: multiple ad creatives). The generative AI model uses "DALL-E" or "Stable Diffusion." The generated ad creatives are sent from the server to the user's device (input: ad creatives, output: transmission of encrypted data).

[0559] Step 9:

[0560] The user's device displays the received multiple ad creatives on the screen (input: encrypted data, output: display of ad creatives), and the user can scroll through these designs. When the user selects the most suitable design, detailed information about the design, the contractor, and price information are also displayed at the same time.

[0561] Step 10:

[0562] To complete the transaction within the app, the user taps the "Contract" button and enters payment information (input: payment information, output: transaction completed). Payment information is encrypted and processed securely on the server.

[0563] (Application example 1)

[0564] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0565] The conventional outdoor advertising process requires a lot of time and effort to search for advertising space, check prices, and confirm the image after advertising. The process of selecting the optimal advertising design from multiple options is also complicated. This can lead to insufficient consideration for maximizing advertising effectiveness, which can result in reduced advertising effectiveness. Furthermore, the entire advertising process is complicated and time-consuming, making it difficult to quickly place advertisements. Therefore, a system that allows for easy and effective outdoor advertising has been sought.

[0566] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0567] In this invention, the server includes: means for a user terminal to acquire location information and image information of an object; means for the server to search for advertising space information based on the location information; means for the server to transmit the acquired advertising space information to the user terminal; means for the user terminal to display the advertising space information using AR technology; means for the user to input advertising theme and brand information; means for the server to generate advertising creatives based on the theme and brand information; means for the server to transmit the generated advertising creatives to the user terminal; means for the user terminal to display the generated advertising creatives; means for the user to select advertising creatives; means for the user to check detailed information about the selected advertising creatives and complete a contract procedure; means for overlaying the advertising space information on camera images using AR technology; and means for scrolling through and selecting the generated advertising creatives. This enables users to quickly acquire advertising space information and easily select and place advertising creatives while visually checking them using AR technology.

[0568] A "user terminal" is an electronic device that allows a user to input information and send and receive data. Examples include smartphones, tablets, and personal computers.

[0569] "Location information" is data that indicates the geographic location of a specific object, including GPS data and address information.

[0570] "Video information" refers to image and video data captured by a camera or other imaging device.

[0571] A "server" is a computer system for processing and storing data over a network.

[0572] "Advertising space information" is detailed data about the space or location for placing advertisements, including location, size, available dates and times, price, and contractor information.

[0573] "AR technology" is a technology that displays computer-generated information overlaid on real-world images.

[0574] "Theme" is information that indicates the main content or concept of the advertisement.

[0575] "Brand information" refers to identifying information and data such as names and logos associated with advertisers and products.

[0576] "Advertising creative" refers to content that includes creative content, such as advertising design and text.

[0577] "Scrolling" is a user interface operation that moves displayed content up and down or left and right.

[0578] A "closing procedure" is a series of procedures for formally concluding a transaction for a service or product.

[0579] MODE FOR CARRYING OUT THE INVENTION

[0580] The present invention provides a system that allows users to easily search for outdoor advertising contractors and prices, and visually check what the advertisement will look like after it is placed, using AR and AI technologies. Specific embodiments are described below.

[0581] System Overview

[0582] The system includes the following means:

[0583] 1. User terminal: This refers to devices such as smartphones and tablets that allow users to input information and send and receive data.

[0584] 2. Server: A computer system for processing and storing data over a network.

[0585] Program processing

[0586] Hardware and Software

[0587] The user device uses a camera, GPS, AR library, and software for data transmission and reception (e.g., OpenCV, Requests library). The server has a database, AI model library, and API server (e.g., Flask or Django).

[0588] Processing flow

[0589] 1. Acquisition of location and video information: When a user points their smartphone camera at the location where they want to place an ad, the camera acquires video information and the GPS acquires location information.

[0590] 2. Sending data to the server: The user device sends the acquired location information and video information to the server.

[0591] 3. Searching and obtaining advertising space information: The server searches the database for advertising space information (location, price, available dates and times, contractor information, etc.) based on the location information and sends it to the user's device.

[0592] 4. Display using AR technology: The user device uses AR technology to overlay the received advertising space information on the camera image.

[0593] 5. Entering theme and brand information: The user enters the ad theme and brand information into a form within the app and sends it to the server.

[0594] 6. Generating advertising creatives using AI: The server uses an AI model to generate multiple advertising creatives based on the theme and brand information sent, and sends them to the user's device.

[0595] 7. Display and selection of ad creatives: The user device displays multiple generated ad creatives, and the user scrolls through them to select the most suitable one.

[0596] 8. Purchase procedure: After the user selects an ad creative, they confirm its details and complete the purchase procedure.

[0597] Specific examples

[0598] Take the example of an advertising agency that conducts area marketing. If a user wants to place a "Summer Sale" ad on the wall of a building in the Shinjuku area, they point their smartphone camera at the building. The app switches to AR mode, and location and video information is sent to the server. The server searches for relevant ad space information and sends it back to the user's device. Using AR technology, the user checks the virtual ad space and enters information on the theme of "Summer Sale." The server uses an AI model to generate multiple ad creatives and displays them on the user's device. The user selects the most suitable design and completes the transaction.

[0599] Prompt Sentence Examples

[0600] "We envision an application that allows users to view ad space information based on the ad theme "Summer Sale" and the coordinate location of the "Shinjuku area," and select from multiple creatives generated using AI. Please generate a summer sale ad that is suitable for the Shinjuku area."

[0601] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0602] A detailed explanation of the program's processing flow

[0603] Processing Steps

[0604] Step 1:

[0605] The user's device points the camera at the desired advertising location, and the camera captures the image of the scenery, while the GPS sensor simultaneously acquires the location information.

[0606] Input: Camera image (image data), GPS location information (latitude and longitude)

[0607] Output: Acquired video information and location information

[0608] Step 2:

[0609] The location information and video information acquired by the user device are sent to the server using HTTP requests via the Internet.

[0610] Input: Video information, location information

[0611] Output: Data sent to the server

[0612] Step 3:

[0613] Based on the location information received, the server searches the database for ad slot information (location, price, available dates and times, agent information, etc.) using SQL or NoSQL queries.

[0614] Input:Location

[0615] Output: Ad space information (location, price, available date and time, agent information)

[0616] Step 4:

[0617] The server sends the searched ad slot information to the user's device. This communication also uses an HTTP response.

[0618] Input: Ad space information

[0619] Output: Ad space information sent to the user's device

[0620] Step 5:

[0621] The ad space information received by the user's device is overlaid on the camera image using AR technology, using an AR library (e.g., ARCore, ARKit).

[0622] Input: Ad space information, camera footage

[0623] Output: Camera image overlaid with AR

[0624] Step 6:

[0625] The user enters the advertising theme and brand information into a form within the app, which is then converted into JSON format.

[0626] Input: Theme, brand information

[0627] Output: Theme and brand information entered

[0628] Step 7:

[0629] The user terminal transmits the input theme and brand information to the server.

[0630] Input: Theme, brand information

[0631] Output: Data sent to the server

[0632] Step 8:

[0633] Based on the theme and brand information received by the server, a generative AI model is used to generate advertising creatives. A generative AI model (e.g., GPT-3, DALL-E) is used to generate creatives based on prompt text.

[0634] Input: Theme, brand information (prompt text)

[0635] Output: Generated ad creative

[0636] Step 9:

[0637] The server transmits the generated advertising creatives to the user terminal.

[0638] Input: Generated ad creative

[0639] Output: Ad creative sent to user device

[0640] Step 10:

[0641] The user device displays the received ad creatives, and the user can scroll through multiple creatives to select one.

[0642] Input: Ad creative

[0643] Output: Ad creative selected by the user

[0644] Step 11:

[0645] The user confirms the details of the selected ad creative and completes the transaction. The user enters payment information and other details, and sends them to the server.

[0646] Input: Selected ad creative, payment information

[0647] Output: Notification of completion of contract procedure

[0648] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0649] The present invention combines a system that allows users to easily search for outdoor advertising contractors and prices, and visually confirm the image of the advertisement after it has been placed using AR and AI technology, with an emotion engine that recognizes the user's emotions. Specific embodiments for carrying out the invention are described below.

[0650] First, the user launches the dedicated application on their smartphone. When the app is launched on the user's device, the main screen is displayed. The user then points the smartphone camera at the location where they want to place an ad. At this time, the user's device's camera captures the location information and image information of the target object.

[0651] The user device sends the acquired location information and video information to the server. The server uses this data to search for corresponding ad slot information in its database. This information includes the location of the ad slot, price, available dates and times, and outsourcing information. The server sends the search results to the user device, which then receives this information.

[0652] Next, the user device uses AR technology to overlay the received ad space information onto the camera image, allowing the user to see the ad as if it were actually being displayed in the specified location.

[0653] Once the user has selected an ad slot, they then enter the ad theme and brand information. They then enter this information into a form within the app and submit the information. The user's device then sends the information entered by the user back to the server. The server uses an AI model based on this information to generate multiple ad creatives. The generated ad creatives are then sent from the server to the user's device.

[0654] The user device displays the received advertising creative on the screen, and at the same time, the emotion engine analyzes the user's facial expressions and voice to obtain emotional data. The emotion engine uses a camera and microphone to analyze the user's emotions in real time and obtains emotional data such as joy, surprise, and displeasure.

[0655] The server provides feedback on ad creatives based on the acquired emotional data and proposes designs that suit the user's emotions. Multiple ad creatives are presented, the user's emotional response to each is analyzed, and further optimized ads are proposed accordingly.

[0656] Users can scroll through multiple ad designs and select the most suitable one. Once a user selects an ad creative, detailed information, contractor information, and pricing information are displayed.

[0657] Finally, the user taps the "Contract" button to complete the transaction and enters payment information, etc. This completes the process for placing the ad.

[0658] As a concrete example, consider the case where a user wants to place an advertisement on the wall of a building. The user points their smartphone camera at the building and the app switches to AR mode. When the user sends their location information, the server searches for the corresponding ad space information and sends it back to the user's device. The user checks the virtual ad space in AR and enters "Summer Sale" as the advertising theme. The server generates multiple ad creatives with the theme "Summer Sale" and displays them on the user's device. The emotion engine analyzes the user's facial expressions and suggests the most suitable design. The user selects the most suitable design and completes the contract procedure, completing the entire advertising process.

[0659] The above is an embodiment of the present invention. This system allows users to easily obtain information about advertising slots and easily grasp the specifics of advertising placement. Furthermore, the introduction of an emotion engine makes it possible to select advertising creatives that suit the user's emotions, which is expected to improve advertising effectiveness.

[0660] The processing flow will be explained below.

[0661] Step 1:

[0662] The user launches the dedicated app on their smartphone.

[0663] The user taps to open the app on their smartphone.

[0664] Step 2:

[0665] Users point their smartphone camera at the location where they want to place an ad.

[0666] The user uses the camera to scan an object (for example, the wall of a building).

[0667] Step 3:

[0668] The device acquires location information and video information through the camera.

[0669] The device acquires data from its GPS function and camera sensor and analyzes location information and video information.

[0670] Step 4:

[0671] The terminal transmits the acquired location information and video information to the server.

[0672] The terminal packs this data into packets and sends them to a server via the Internet.

[0673] Step 5:

[0674] The server receives the location information and video information sent from the terminal.

[0675] The server decrypts the received data and prepares a database query.

[0676] Step 6:

[0677] The server searches the database for information about the ad slot.

[0678] The server queries the database using the location information as a key to obtain information about the advertising space's supplier, price, and available dates and times.

[0679] Step 7:

[0680] The server transmits the acquired advertising space information to the terminal.

[0681] The server packets the advertising space information and returns it to the terminal.

[0682] Step 8:

[0683] The terminal analyzes the advertising space information received from the server.

[0684] The terminal decodes the received data and prepares it for display.

[0685] Step 9:

[0686] The device uses AR technology to overlay advertising space information on the camera image.

[0687] The device displays the location and price information of the advertising space overlaid on the camera image.

[0688] Step 10:

[0689] The user checks the ad space information displayed in AR and selects the desired ad space.

[0690] Based on the displayed information, the user taps to select the desired ad space.

[0691] Step 11:

[0692] The user inputs the advertising theme and brand information.

[0693] Users use the in-app input form to enter the ad theme and brand information and press the submit button.

[0694] Step 12:

[0695] The terminal transmits the input information to the server.

[0696] The device assembles data containing theme and brand information into packets and sends them to the server.

[0697] Step 13:

[0698] The server uses AI to generate advertising creatives based on information from users.

[0699] The server inputs the theme and brand information into the AI ​​model and generates multiple advertising designs.

[0700] Step 14:

[0701] The server transmits the generated advertising creative to the terminal.

[0702] The server packetizes the generated advertisement design and transmits it to the terminal.

[0703] Step 15:

[0704] The terminal displays the advertising creative received from the server, and at the same time, the emotion engine acquires the user's emotion data.

[0705] The device displays the advertising design on the screen and uses the device's camera and microphone to analyze the user's facial expressions and voice to obtain emotional data.

[0706] Step 16:

[0707] The server analyzes the acquired emotion data and optimizes the advertising creative based on the user's emotion.

[0708] The server uses the data sent from the emotion engine to recommend designs that users tend to prefer.

[0709] Step 17:

[0710] Users can scroll through multiple optimized ad creatives and select the best one.

[0711] Users can compare the designs displayed on the screen and select the one they like by tapping it.

[0712] Step 18:

[0713] The user checks the details of the selected advertising creative and completes the transaction.

[0714] The user checks the advertisement details, supplier information, and price information, taps the "Contract" button, and enters payment information.

[0715] The above processing flow enables users to easily search for information on outdoor advertising space, optimally select advertising creatives generated by AI based on the analysis results of the emotion engine, and smoothly complete the advertising submission process.

[0716] Example 2

[0717] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0718] Conventional advertising systems have the problem that the process for users to obtain information on ad slots and select ad creatives is complicated and time-consuming.Furthermore, since ad creatives are not optimized based on user emotions, there is also the problem that it is difficult to achieve sufficient advertising effectiveness.

[0719] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0720] In this invention, the server includes a means for a user terminal to acquire location information and video information of an object, a means for the server to search for advertising space information based on the location information, and a means for transmitting the advertising space information acquired by the server to the user terminal. This allows users to easily acquire advertising space information and get a concrete idea of ​​what advertising placement will be like. Furthermore, an emotion analysis engine is used to optimize advertising creatives based on user emotions, which is expected to improve advertising effectiveness.

[0721] A "user terminal" is an electronic device such as a smartphone or tablet that is operated by a user.

[0722] "Object" refers to the location or physical object where you want to place your ad.

[0723] "Location Information" means geographic data of a specific location obtained using GPS or other technologies.

[0724] "Video information" refers to actual video data captured using a camera.

[0725] A "server" is a computer system that manages and processes data on a network.

[0726] "Advertising space information" refers to detailed information such as the location, space, period, price, and contractor where an advertisement can be placed.

[0727] Augmented reality technology (AR technology) is a technology that overlays computer-generated images and information onto real-world images.

[0728] A "theme" is a major concept or idea that defines the content and direction of an advertisement.

[0729] "Brand Information" is specific information related to an advertiser's brand.

[0730] A "generative AI model" is an algorithm or software that uses artificial intelligence to generate various creative content based on user instructions.

[0731] "Advertising creative" refers to specific ideas for the design and content of an advertisement.

[0732] An "emotion analysis engine" is a technology that analyzes a user's facial expressions and voice to recognize their emotional state.

[0733] "Emotion data" is information about the user's emotional state obtained by the emotion analysis engine.

[0734] The "contract procedure" is the final procedure for concluding a contract regarding the advertising creative selected by the user.

[0735] This invention is a system that allows users to easily search for outdoor advertisements and visually check the image before placing an advertisement using augmented reality (AR) technology and artificial intelligence (AI) technology. Furthermore, by combining it with an emotion analysis engine that recognizes user emotions, it is possible to select advertising creatives that suit the user's emotions. This system allows users to place advertisements quickly and effectively.

[0736] This system operates in the following steps:

[0737] First, the user launches the dedicated application on their smartphone. After launching the application, the main screen will appear, and the user points the smartphone camera at the location where they want to place an ad. The user's device (smartphone) will use the camera to obtain location information and video information of the target object. This information is obtained using the camera and GPS.

[0738] Next, the user device sends the acquired location information and video information to the server. Based on the received data, the server searches a database for corresponding ad space information. This ad space information includes the location, price, available dates and times, and outsourcing information of the ad space. The server sends the search results to the user device, which displays the information.

[0739] The user's device uses AR technology based on the received ad space information to virtually overlay the ad space on the camera image. For example, if a user wants to place an advertisement on the wall of a building, they can point their smartphone camera at the building, and the app will switch to AR mode, causing a virtual advertisement to be displayed on the actual wall of the building.

[0740] Next, the user inputs the ad theme and brand information. This information is entered into a form within the app and sent from the user's device to the server. The server uses the received information to generate multiple ad creatives using a generative AI model. This process uses prompts such as:

[0741] "A user wants to advertise 'Summer Sale' on the wall of a building. Please generate advertising creative with a summer sale theme."

[0742] The advertising creative generated by the server is sent to the user's device, which then displays the received creative on the screen. At this time, an emotion analysis engine analyzes the user's facial expressions and voice to obtain emotional data. The emotion analysis engine uses a camera and microphone to analyze the user's emotions in real time, determining, for example, joy, surprise, or displeasure.

[0743] Based on the acquired emotional data, the server provides feedback on the ad creative and suggests a design that best suits the user's emotions. The user can scroll through multiple ad creatives to compare them and select the most suitable one. Once the user selects an ad creative, detailed information (such as price information and contractor information) is displayed.

[0744] Finally, the user taps the "Contract" button and enters payment information to complete the transaction, completing the entire process of placing an ad.

[0745] The above is an embodiment of the present invention. This system allows users to easily obtain information about advertising slots and get a concrete idea of ​​what their advertising placement will look like. Furthermore, the introduction of an emotion analysis engine makes it possible to select advertising creatives that suit the user's emotions, which is expected to improve advertising effectiveness.

[0746] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0747] Step 1:

[0748] The user launches the dedicated application on their smartphone. When the user launches the application, the main screen is displayed. The input is the user's operation, and the output is the application's main screen.

[0749] Step 2:

[0750] Users use their smartphone camera to take a picture of the location where they want to place an advertisement. The camera on the user's device captures the location information and video information of the target object. The input is the actual video captured by the camera and location information from GPS, and the output is location information and video information data.

[0751] Step 3:

[0752] The user device sends the acquired location information and video information to the server. The server searches the database for corresponding ad space information based on the received data. The input is location information and video information, and the output is the corresponding ad space information. Specifically, the server retrieves the location, price, available date and time, and contractor information of the ad space from the database.

[0753] Step 4:

[0754] The server sends the search results to the user terminal, and the user terminal displays the received ad space information on the screen. The input is the ad space information sent from the server, and the output is the ad space information displayed on the screen of the user terminal.

[0755] Step 5:

[0756] The user device uses AR technology to virtually overlay ad space on the camera image based on the received ad space information. The input is the ad space information and the current camera image, and the output is an AR image that combines the two. For example, if a user takes a photo of the wall of a building, a virtual advertisement will be displayed on that wall.

[0757] Step 6:

[0758] The user enters the advertising theme and brand information into a form within the app. The user's device sends the entered information to the server. The input is the theme and brand information entered by the user, and the output is the data sent to the server.

[0759] Step 7:

[0760] The server uses the generative AI model to generate multiple ad creatives based on the received information. The input to this process is a prompt based on the theme and brand information, and the output is multiple generated ad creatives. For example, the prompt could be, "The user wants to place a 'Summer Sale' advertisement on the wall of a building. Please generate ad creatives with a summer sale theme."

[0761] Step 8:

[0762] The server sends the generated ad creative to the user terminal, and the user terminal displays the received creative on the screen. The input is the ad creative sent from the server, and the output is the ad creative displayed on the user terminal.

[0763] Step 9:

[0764] The emotion analysis engine analyzes the user's facial expressions and voice to obtain emotional data. The input is the user's facial expressions and voice captured through the camera and microphone, and the output is the analyzed emotional data. For example, emotions such as joy, surprise, and displeasure are identified.

[0765] Step 10:

[0766] The server provides feedback on the ad creative based on the acquired emotional data. The input is emotional data, and the output is a proposal for an optimized ad design that matches the user's emotions.

[0767] Step 11:

[0768] The user scrolls through multiple ad creatives, compares them, and selects the best one. The input is multiple ad creatives and the user's selection intention, and the output is the selection of the best ad creative.

[0769] Step 12:

[0770] Detailed information (such as price information and supplier information) about the ad creative selected by the user is displayed on the screen. The input is the selected ad creative, and the output is the display of detailed information.

[0771] Step 13:

[0772] To complete the transaction, the user taps the "Contract" button and enters payment information, etc. The input is the information necessary for the user's transaction, and the output is confirmation that the transaction has been completed. This completes the entire advertising process.

[0773] (Application example 2)

[0774] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0775] Conventional advertising systems have the problem that searching and selecting ad slots and checking the image of the actual ad display are complicated and time-consuming.In addition, it is not possible to propose optimal ad creatives that take user emotions into consideration, making it difficult to maximize the effectiveness of advertising.

[0776] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0777] In this invention, the server includes: means for a user terminal to acquire location information and video information of an object; means for the server to search for advertising space information based on the location information; means for transmitting the acquired advertising space information to the user terminal; means for the user terminal to display the advertising space information using AR technology; means for the user to input advertising theme and brand information; means for the server to generate advertising creatives based on the theme and brand information; means for the server to transmit the generated advertising creatives to the user terminal; means for the user terminal to display the generated advertising creatives; means for the user to select advertising creatives; means for the user to confirm detailed information about the selected advertising creatives and complete a contract procedure; means for the user terminal to acquire user emotion data using a camera and microphone; and means for the server to analyze the emotion data and re-propose optimal advertising creatives based on the analysis results. This allows users to easily acquire advertising space information, making it easier to get a concrete idea of ​​advertising placements, and the introduction of an emotion engine makes it possible to select advertising creatives that suit the user's emotions.

[0778] A "user terminal" is a mobile phone, smartphone, tablet, or other mobile device operated by a user.

[0779] "Object" refers to a location or physical structure where a user wishes to place, display, or view an advertisement.

[0780] "Location Information" means the geographic latitude, longitude, and altitude data of an object obtained using GPS, Wi-Fi, beacons, or other technologies.

[0781] "Video information" refers to image or video data captured using the camera function of a user terminal.

[0782] A "server" is a computer system that receives, transmits, and processes data, and in the present invention searches for advertising space information, generates creative content, and analyzes emotional data.

[0783] An "ad inventory" is a physical or digital space in which an advertisement is displayed, with attributes such as location, price, and availability dates and times.

[0784] "AR technology" stands for augmented reality technology, which is a technology that displays virtual information overlaid on real-world images.

[0785] "Theme" refers to the content, concept, or subject matter of the event or campaign being advertised.

[0786] "Brand information" includes information such as the brand name, logo, corporate philosophy, and color scheme promoted by the advertisement.

[0787] "Advertising creative" refers to the visual or audio advertising materials, such as the advertisement design, text, images, and video.

[0788] "Emotion data" is data of emotions such as joy, surprise, and discomfort, obtained by analyzing the user's facial expressions, voice, and body movements.

[0789] An "emotion engine" is software or hardware that uses a camera or microphone to analyze a user's emotions in real time.

[0790] "Optimal advertising creative" refers to advertising creative selected based on user emotional data in order to maximize user satisfaction.

[0791] This invention combines a system that allows users to easily search for outdoor advertising contractors and prices, and visually confirm what the ad will look like after it is placed using AR and AI technology, with an emotion engine that recognizes the user's emotions.

[0792] First, a user uses a smartphone to implement the invention. The user launches the application and points the smartphone camera at the location where they want to place an advertisement. At this time, the user's device acquires the location information and image information of the target object. The location information is obtained using GPS and Wi-Fi data, and the image information is acquired by the smartphone's built-in camera.

[0793] The acquired location information and video information are sent to a server. The server uses the location information to search a database for information on the corresponding ad slot. This information includes the location of the ad slot, price, available dates and times, and contractor information. The server then sends this information to the user's device.

[0794] The user device then displays the received ad space information using AR technology. Specifically, ARCore (for Android) or ARKit (for iOS) is used to overlay virtual ad space onto local video, allowing the user to see the ad as if it were actually being displayed.

[0795] Next, the user enters the ad theme and brand information within the app. This information is sent to a server, which uses a generative AI model to generate multiple ad creatives. The generated ad creatives are then sent from the server to the user's device, where they are displayed. At this time, the user's device runs an emotion engine, which uses the camera and microphone to analyze the user's facial expressions and voice to obtain emotional data. This emotion analysis uses technologies such as Microsoft Azure Cognitive Services and Affectiva.

[0796] The server analyzes the emotional data and, based on the results, re-proposes the most appropriate ad creative. The user can scroll through multiple ad creatives and analyze the emotional response to each, which will then suggest a design optimized for that emotion. Once the user selects the most suitable ad creative, detailed information, contractor information, and pricing information are displayed. Finally, the user completes the contract process and enters payment information to complete the ad placement procedure.

[0797] Specific examples

[0798] For example, consider the case where a user wants to place an advertisement on the wall of a building. The user points their smartphone camera at the building and the app switches to AR mode. When the user sends their location information, the server searches for the corresponding ad space information and sends it back to the user's device. The user checks the virtual ad space in AR and enters "Summer Sale" as the advertising theme. The server uses a generative AI model to generate multiple "Summer Sale" themed ad creatives and displays them on the user's device. The emotion engine analyzes the user's facial expressions and suggests the most suitable design. The user selects the most suitable design and the transaction process is completed.

[0799] Prompt Sentence Examples

[0800] "Generate an effective ad design for a big summer sale. The theme colors are blue and yellow, and the target audience is young people in their 20s and 30s."

[0801] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0802] Step 1:

[0803] The user starts up their smartphone and launches the application. Using the camera on the user's device, they hold it over the location where they want to place the ad, and obtain location information (GPS) and video information (camera images).

[0804] Input: Smartphone camera image, GPS location information

[0805] Data processing / calculation: Camera image data is converted into an image format and sent to the server along with location information

[0806] Output: Location information and video data sent to the server

[0807] Step 2:

[0808] Based on the location information received by the server, advertising space information (location, price, available date and time, and contractor information) is searched from the database.

[0809] Input:Location

[0810] Data processing / calculation: Performing database queries using location information

[0811] Output: Ad space information

[0812] Step 3:

[0813] The server sends the ad space information to the user's device, which then uses AR technology to overlay the received ad space information on the camera image.

[0814] Input: Ad space information

[0815] Data processing / computation: Rendering virtual objects using ARCore or ARKit

[0816] Output: Ad space overlaid on the user's device

[0817] Step 4:

[0818] The user enters the advertising theme and brand information within the app and sends it to the server.

[0819] Input: Theme information, brand information

[0820] Data processing / calculation: Sending input form data

[0821] Output: Theme and branding information sent to the server

[0822] Step 5:

[0823] The server uses a generative AI model to generate multiple ad creatives based on the input theme and brand information.

[0824] Input: Theme information, brand information

[0825] Data processing / computation: Generating ad creative using generative AI models (TensorFlow or PyTorch)

[0826] Output: Ad creative

[0827] Step 6:

[0828] The server transmits the generated advertising creatives to the user terminal, which displays them.

[0829] Input: Ad creative

[0830] Data processing / calculation: Displaying advertising creatives in the user interface

[0831] Output: Ad creative displayed on user device

[0832] Step 7:

[0833] The user device uses a camera and microphone to capture the user's facial expressions and voice, and analyzes the emotional data.

[0834] Input: User's facial expression data, voice data

[0835] Data processing / calculation: Sentiment analysis using an emotion engine (Microsoft Azure Cognitive Services or Affectiva)

[0836] Output: Parsed emotion data

[0837] Step 8:

[0838] The server receives the emotional data and, based on the analysis results, selects and re-proposes the most appropriate advertising creative.

[0839] Input: Emotion data, ad creative

[0840] Data processing / calculation: Feedback and regeneration of advertising creatives based on emotional data

[0841] Output: Optimized ad creative suggestions

[0842] Step 9:

[0843] The user selects the most suitable advertising creative, checks its details, contractor information, and price information, and then completes the contract procedure.

[0844] Input: Best ad creative, details

[0845] Data processing / calculation: Confirmation of selected data and transaction processing

[0846] Output: Contract procedure completed, advertising procedure completed

[0847] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0848] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0849] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0850] [Third embodiment]

[0851] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0852] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0853] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0854] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0855] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0856] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0857] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0858] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0859] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0860] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0861] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0862] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0863] The present invention is a system that allows users to easily search for outdoor advertising contractors and prices, and visually check what the advertisement will look like after it is placed using AR and AI technology. Specific embodiments for carrying out the invention are described below.

[0864] First, the user launches the dedicated application on their smartphone. When the app is launched on the user's device, the main screen is displayed. The user then points the smartphone camera at the location where they want to place an ad. At this time, the user's device's camera captures the location information and image information of the target object.

[0865] The user device sends the acquired location information and video information to the server. The server uses this data to search for corresponding ad slot information in its database. This information includes the location of the ad slot, price, available dates and times, and outsourcing information. The server sends the search results to the user device, which then receives this information.

[0866] Next, the user device uses AR technology to overlay the received ad space information onto the camera image, allowing the user to see the ad as if it were actually being displayed in the specified location.

[0867] Once the user has selected an ad slot, they then enter the ad theme and brand information. They then enter this information into a form within the app and submit the information. The user's device then sends the information entered by the user back to the server. The server uses an AI model based on this information to generate multiple ad creatives. The generated ad creatives are then sent from the server to the user's device.

[0868] The user's device displays the received ad creative on the screen. The user can scroll through multiple ad designs and select the most suitable one. Once the user selects an ad creative, detailed information, contractor information, and price information are displayed.

[0869] Finally, the user taps the "Contract" button to complete the transaction and enters payment information, etc. This completes the process for placing the ad.

[0870] As a concrete example, consider the case where a user wants to place an advertisement on the wall of a building. The user points their smartphone camera at the building and the app switches to AR mode. When the user sends their location information, the server searches for the corresponding ad space information and sends it back to the user's device. The user checks the virtual ad space in AR and enters "Summer Sale" as the advertising theme. The server generates multiple ad creatives with the theme "Summer Sale" and displays them on the user's device. The entire advertising process is completed when the user selects the most suitable design and completes the transaction procedure.

[0871] The above is an embodiment of the present invention. This system allows users to easily obtain information about advertising slots and easily get a concrete idea of ​​what advertising placement will be like.

[0872] The processing flow will be explained below.

[0873] Step 1:

[0874] The user launches a dedicated app on their smartphone.

[0875] Users tap on an app to access its main screen.

[0876] Step 2:

[0877] Users point their smartphone camera at the location where they want to place an ad.

[0878] A user uses a camera to capture image information of an object.

[0879] Step 3:

[0880] The device acquires location information and video information through the camera.

[0881] The device receives data from the GPS sensor and camera and analyzes location and video information.

[0882] Step 4:

[0883] The terminal transmits the acquired location information and video information to the server.

[0884] The terminal packs the data into packets and sends them over the Internet to a server.

[0885] Step 5:

[0886] The server receives the location information and video information sent from the terminal.

[0887] The server interprets the received data and prepares a query to the database.

[0888] Step 6:

[0889] The server searches the database for information on the corresponding advertising space.

[0890] The server queries a database based on the location information to retrieve information such as the ad space's supplier, price, and available dates and times.

[0891] Step 7:

[0892] The server transmits advertising space information including search results to the terminal.

[0893] The server converts the acquired information into packets and returns them to the terminal.

[0894] Step 8:

[0895] The terminal analyzes the advertising space information received from the server.

[0896] The device decodes the received data and prepares it for AR display.

[0897] Step 9:

[0898] The device uses AR technology to overlay advertising space information on the camera image.

[0899] The device will display additional information about the location and price of the advertising space on the camera image.

[0900] Step 10:

[0901] The user checks the ad space information displayed in AR and selects the desired ad space.

[0902] The user taps the screen to select an ad slot.

[0903] Step 11:

[0904] The user inputs the advertising theme and brand information.

[0905] Users enter details about their theme and brand into an in-app form.

[0906] Step 12:

[0907] The terminal transmits the input information to the server.

[0908] The terminal collects input data into packets and sends them to the server.

[0909] Step 13:

[0910] The server uses AI to generate advertising creatives based on the information sent by the user.

[0911] The server inputs the received theme and brand information into the AI ​​model and generates multiple advertising creatives.

[0912] Step 14:

[0913] The server transmits the generated advertising creative to the terminal.

[0914] The server packets the generated design and sends it to the terminal.

[0915] Step 15:

[0916] The terminal displays the advertising creative received from the server.

[0917] The terminal displays a number of advertisement designs on the screen for the user to select from.

[0918] Step 16:

[0919] The user selects the best ad creative.

[0920] Users tap the screen to select an ad design.

[0921] Step 17:

[0922] The user checks the details of the selected advertising creative and completes the transaction.

[0923] The user checks the advertisement details, supplier information, and price information, taps the "Contract" button, and enters payment information.

[0924] Using the above processing flow, users can easily search for information on outdoor advertising space, compare advertising creatives generated by AI, select the most suitable advertisement, and smoothly complete the advertising process.

[0925] Example 1

[0926] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0927] In the conventional outdoor advertising process, users had to manually research information about advertising space and repeatedly check and select advertising designs, which required a great deal of time and effort. Furthermore, there were limited ways to check the visual image of the ads beforehand, making it difficult to predict their actual effectiveness. Furthermore, specialized knowledge was required to generate and select advertising creatives, placing a heavy burden on users. The purpose of this invention is to solve these problems and provide a more efficient and effective outdoor advertising process.

[0928] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0929] In this invention, the server includes: means for a user terminal to acquire location information and video information of an object; means for the server to search for advertising space information based on the location information; means for transmitting the acquired advertising space information to the user terminal; means for the user terminal to display the advertising space information using AR technology; means for the user to input advertising theme and brand information; means for the server to generate advertising creatives using a generative AI model based on the theme and brand information; means for the server to transmit the generated advertising creatives to the user terminal; means for the user terminal to display the generated advertising creatives; means for the user to select advertising creatives; and means for the user to confirm detailed information about the advertising creatives selected by the user and complete a contract procedure. This enables users to easily and efficiently perform a series of tasks from acquiring advertising space information to selecting and confirming a design and completing a contract procedure.

[0930] A "user terminal" is a device that is operated by a user to acquire location information and video information and communicate with a server.

[0931] "Location information" is data that indicates the geographic location of an object and is obtained using technologies such as GPS.

[0932] "Video information" refers to image and video data captured through the camera of the user terminal.

[0933] A "server" is a computer system that communicates with user terminals via a network and performs processes such as searching for advertising space information and generating advertising creatives.

[0934] An "advertising space" refers to a specific location or space for displaying outdoor advertising.

[0935] "AR technology" is an abbreviation for augmented reality technology, which is a technology that displays virtual information overlaid on images of the real world.

[0936] A "generative AI model" is an artificial intelligence model that automatically generates advertising creatives based on input data.

[0937] "Advertising creative" refers to content that includes designs and messages displayed as advertisements.

[0938] The "contract procedure" is the process by which the user enters the necessary information regarding the use of advertising space and the ordering of advertising creatives, and finally finalizes the contract.

[0939] The present invention provides a system that allows users to easily and efficiently place outdoor advertisements. The system is composed of a user terminal, a server, and a generative AI model.

[0940] First, the user launches a dedicated application on their device, such as a smartphone. This application displays an initial setup screen and requests permission from the user to obtain location information and access the camera. For example, a general-purpose application such as "OutdoorAdVisualizer" is assumed.

[0941] When a user holds their smartphone camera over the location where they want to place an advertisement, the user's device acquires the location information and image information of the target object through the camera. This location information is acquired using technologies such as GPS, and the image information is acquired using the camera module.

[0942] The acquired location information and video information is sent from the user terminal to a server. The transmitted data is encrypted to ensure secure communication. The server searches a database for advertising space information based on the received location information. This database contains information on the location, price, available dates and times of advertising space, and outsourced party information. The advertising space information acquired by the server is sent back to the user terminal.

[0943] The user's device uses AR technology to display the ad space on the camera image based on the received ad space information. This allows the user to see the ad as if it were actually displayed in the specified location. AR technology uses AR libraries such as "Vuforia."

[0944] Next, the user enters the advertising theme and brand information into a form within the app. For example, themes such as "Summer Sale" or "New Product Release" are entered. The information entered by the user is then sent back to the server via the user's device.

[0945] The server generates ad creatives using a generative AI model based on the theme and brand information. This generative AI model uses, for example, "DALL-E" or "Stable Diffusion." Multiple variations of the generated ad creatives are generated and sent from the server to the user's device.

[0946] The user's device displays the received multiple ad creatives on the screen. The user can scroll through the designs and select the most suitable one. Detailed information about the selected ad creative, as well as information about the contractor and price, are also displayed at the same time.

[0947] Finally, the user completes the transaction process within the app by tapping the "Contract" button and entering payment information to complete the ad placement process. Payment information is encrypted and processed securely on the server.

[0948] Specific examples

[0949] For example, consider the case where a user wants to place a "Summer Sale" advertisement on the wall of a building. The user points their smartphone camera at the building and the app switches to AR mode. When the user sends their location information, the server searches for the corresponding ad space information and sends it back to the user's device. The user checks the virtual ad space in AR and enters "Summer Sale" as the theme. The server generates multiple ad creatives with the "Summer Sale" theme and displays them on the user's device. The entire ad placement process is completed when the user selects the most suitable design and completes the purchase procedure.

[0950] Prompt Sentence Examples

[0951] "We want to advertise our summer sales on the wall of a building. Please create an eye-catching creative with a vibrant design."

[0952] "We would like to advertise a new product on a sign in the shopping district. Please suggest a design that targets young customers in their 20s and 30s."

[0953] The above is an embodiment of the present invention. This system allows users to easily and efficiently obtain information about advertising spaces, select and confirm designs, and complete contract procedures.

[0954] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0955] Step 1:

[0956] The user launches the dedicated application on their smartphone. The user device displays an initial setup screen and requests permission to obtain location information and access the camera (input: none, output: initial setup screen displayed). The user grants these permissions.

[0957] Step 2:

[0958] Users hold their smartphone camera over the location where they want to place an advertisement. The user's device obtains the location information and video information of the target object through the camera (input: camera image, GPS data; output: location information, video information). This location information is obtained using GPS technology, and the video information is obtained using the camera module.

[0959] Step 3:

[0960] The device sends the acquired location information and video information to the server (input: location information, video information; output: transmission of encrypted data). The data sent is encrypted to ensure the security of the communication.

[0961] Step 4:

[0962] The server searches the database for ad space information based on the received location information (input: encrypted data, output: ad space information). The server queries the database and obtains the location, price, available date and time, and contractor information for the relevant ad space.

[0963] Step 5:

[0964] The server sends the acquired advertising space information to the user terminal (input: advertising space information, output: transmission of encrypted data). The user terminal decrypts the received data and acquires the advertising space information.

[0965] Step 6:

[0966] The user's device uses AR technology to display the ad space on the camera image based on the received ad space information (input: ad space information, output: AR overlay display). This allows the user to see the ad as if it were actually displayed in the specified location. AR libraries such as "Vuforia" are used for the AR technology.

[0967] Step 7:

[0968] The user enters the advertising theme and brand information into a form within the app (input: theme, brand information, output: input information). For example, themes such as "Summer sale" or "New product release" are entered. The information entered by the user is then sent back to the server via the user's device (input: input information, output: sending encrypted data).

[0969] Step 8:

[0970] The server uses a generative AI model based on the theme and brand information to generate ad creatives (input: theme, brand information, output: multiple ad creatives). The generative AI model uses "DALL-E" or "Stable Diffusion." The generated ad creatives are sent from the server to the user's device (input: ad creatives, output: transmission of encrypted data).

[0971] Step 9:

[0972] The user's device displays the received multiple ad creatives on the screen (input: encrypted data, output: display of ad creatives), and the user can scroll through these designs. When the user selects the most suitable design, detailed information about the design, the contractor, and price information are also displayed at the same time.

[0973] Step 10:

[0974] To complete the transaction within the app, the user taps the "Contract" button and enters payment information (input: payment information, output: transaction completed). Payment information is encrypted and processed securely on the server.

[0975] (Application example 1)

[0976] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0977] The conventional outdoor advertising process requires a lot of time and effort to search for advertising space, check prices, and confirm the image after advertising. The process of selecting the optimal advertising design from multiple options is also complicated. This can lead to insufficient consideration for maximizing advertising effectiveness, which can result in reduced advertising effectiveness. Furthermore, the entire advertising process is complicated and time-consuming, making it difficult to quickly place advertisements. Therefore, a system that allows for easy and effective outdoor advertising has been sought.

[0978] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0979] In this invention, the server includes: means for a user terminal to acquire location information and image information of an object; means for the server to search for advertising space information based on the location information; means for the server to transmit the acquired advertising space information to the user terminal; means for the user terminal to display the advertising space information using AR technology; means for the user to input advertising theme and brand information; means for the server to generate advertising creatives based on the theme and brand information; means for the server to transmit the generated advertising creatives to the user terminal; means for the user terminal to display the generated advertising creatives; means for the user to select advertising creatives; means for the user to check detailed information about the selected advertising creatives and complete a contract procedure; means for overlaying the advertising space information on camera images using AR technology; and means for scrolling through and selecting the generated advertising creatives. This enables users to quickly acquire advertising space information and easily select and place advertising creatives while visually checking them using AR technology.

[0980] A "user terminal" is an electronic device that allows a user to input information and send and receive data. Examples include smartphones, tablets, and personal computers.

[0981] "Location information" is data that indicates the geographic location of a specific object, including GPS data and address information.

[0982] "Video information" refers to image and video data captured by a camera or other imaging device.

[0983] A "server" is a computer system for processing and storing data over a network.

[0984] "Advertising space information" is detailed data about the space or location for placing advertisements, including location, size, available dates and times, price, and contractor information.

[0985] "AR technology" is a technology that displays computer-generated information overlaid on real-world images.

[0986] "Theme" is information that indicates the main content or concept of the advertisement.

[0987] "Brand information" refers to identifying information and data such as names and logos associated with advertisers and products.

[0988] "Advertising creative" refers to content that includes creative content, such as advertising design and text.

[0989] "Scrolling" is a user interface operation that moves displayed content up and down or left and right.

[0990] A "closing procedure" is a series of procedures for formally concluding a transaction for a service or product.

[0991] MODE FOR CARRYING OUT THE INVENTION

[0992] The present invention provides a system that allows users to easily search for outdoor advertising contractors and prices, and visually check what the advertisement will look like after it is placed, using AR and AI technologies. Specific embodiments are described below.

[0993] System Overview

[0994] The system includes the following means:

[0995] 1. User terminal: This refers to devices such as smartphones and tablets that allow users to input information and send and receive data.

[0996] 2. Server: A computer system for processing and storing data over a network.

[0997] Program processing

[0998] Hardware and Software

[0999] The user device uses a camera, GPS, AR library, and software for data transmission and reception (e.g., OpenCV, Requests library). The server has a database, AI model library, and API server (e.g., Flask or Django).

[1000] Processing flow

[1001] 1. Acquisition of location and video information: When a user points their smartphone camera at the location where they want to place an ad, the camera acquires video information and the GPS acquires location information.

[1002] 2. Sending data to the server: The user device sends the acquired location information and video information to the server.

[1003] 3. Searching and obtaining advertising space information: The server searches the database for advertising space information (location, price, available dates and times, contractor information, etc.) based on the location information and sends it to the user's device.

[1004] 4. Display using AR technology: The user device uses AR technology to overlay the received advertising space information on the camera image.

[1005] 5. Entering theme and brand information: The user enters the ad theme and brand information into a form within the app and sends it to the server.

[1006] 6. Generating advertising creatives using AI: The server uses an AI model to generate multiple advertising creatives based on the theme and brand information sent, and sends them to the user's device.

[1007] 7. Display and selection of ad creatives: The user device displays multiple generated ad creatives, and the user scrolls through them to select the most suitable one.

[1008] 8. Purchase procedure: After the user selects an ad creative, they confirm its details and complete the purchase procedure.

[1009] Specific examples

[1010] Take the example of an advertising agency that conducts area marketing. If a user wants to place a "Summer Sale" ad on the wall of a building in the Shinjuku area, they point their smartphone camera at the building. The app switches to AR mode, and location and video information is sent to the server. The server searches for relevant ad space information and sends it back to the user's device. Using AR technology, the user checks the virtual ad space and enters information on the theme of "Summer Sale." The server uses an AI model to generate multiple ad creatives and displays them on the user's device. The user selects the most suitable design and completes the transaction.

[1011] Prompt Sentence Examples

[1012] "We envision an application that allows users to view ad space information based on the ad theme "Summer Sale" and the coordinate location of the "Shinjuku area," and select from multiple creatives generated using AI. Please generate a summer sale ad that is suitable for the Shinjuku area."

[1013] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1014] A detailed explanation of the program's processing flow

[1015] Processing Steps

[1016] Step 1:

[1017] The user's device points the camera at the desired advertising location, and the camera captures the image of the scenery, while the GPS sensor simultaneously acquires the location information.

[1018] Input: Camera image (image data), GPS location information (latitude and longitude)

[1019] Output: Acquired video information and location information

[1020] Step 2:

[1021] The location information and video information acquired by the user device are sent to the server using HTTP requests via the Internet.

[1022] Input: Video information, location information

[1023] Output: Data sent to the server

[1024] Step 3:

[1025] Based on the location information received, the server searches the database for ad slot information (location, price, available dates and times, agent information, etc.) using SQL or NoSQL queries.

[1026] Input:Location

[1027] Output: Ad space information (location, price, available date and time, agent information)

[1028] Step 4:

[1029] The server sends the searched ad slot information to the user's device. This communication also uses an HTTP response.

[1030] Input: Ad space information

[1031] Output: Ad space information sent to the user's device

[1032] Step 5:

[1033] The ad space information received by the user's device is overlaid on the camera image using AR technology, using an AR library (e.g., ARCore, ARKit).

[1034] Input: Ad space information, camera footage

[1035] Output: Camera image overlaid with AR

[1036] Step 6:

[1037] The user enters the advertising theme and brand information into a form within the app, which is then converted into JSON format.

[1038] Input: Theme, brand information

[1039] Output: Theme and brand information entered

[1040] Step 7:

[1041] The user terminal transmits the input theme and brand information to the server.

[1042] Input: Theme, brand information

[1043] Output: Data sent to the server

[1044] Step 8:

[1045] Based on the theme and brand information received by the server, a generative AI model is used to generate advertising creatives. A generative AI model (e.g., GPT-3, DALL-E) is used to generate creatives based on prompt text.

[1046] Input: Theme, brand information (prompt text)

[1047] Output: Generated ad creative

[1048] Step 9:

[1049] The server transmits the generated advertising creatives to the user terminal.

[1050] Input: Generated ad creative

[1051] Output: Ad creative sent to user device

[1052] Step 10:

[1053] The user device displays the received ad creatives, and the user can scroll through multiple creatives to select one.

[1054] Input: Ad creative

[1055] Output: Ad creative selected by the user

[1056] Step 11:

[1057] The user confirms the details of the selected ad creative and completes the transaction. The user enters payment information and other details, and sends them to the server.

[1058] Input: Selected ad creative, payment information

[1059] Output: Notification of completion of contract procedure

[1060] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1061] The present invention combines a system that allows users to easily search for outdoor advertising contractors and prices, and visually confirm the image of the advertisement after it has been placed using AR and AI technology, with an emotion engine that recognizes the user's emotions. Specific embodiments for carrying out the invention are described below.

[1062] First, the user launches the dedicated application on their smartphone. When the app is launched on the user's device, the main screen is displayed. The user then points the smartphone camera at the location where they want to place an ad. At this time, the user's device's camera captures the location information and image information of the target object.

[1063] The user device sends the acquired location information and video information to the server. The server uses this data to search for corresponding ad slot information in its database. This information includes the location of the ad slot, price, available dates and times, and outsourcing information. The server sends the search results to the user device, which then receives this information.

[1064] Next, the user device uses AR technology to overlay the received ad space information onto the camera image, allowing the user to see the ad as if it were actually being displayed in the specified location.

[1065] Once the user has selected an ad slot, they then enter the ad theme and brand information. They then enter this information into a form within the app and submit the information. The user's device then sends the information entered by the user back to the server. The server uses an AI model based on this information to generate multiple ad creatives. The generated ad creatives are then sent from the server to the user's device.

[1066] The user device displays the received advertising creative on the screen, and at the same time, the emotion engine analyzes the user's facial expressions and voice to obtain emotional data. The emotion engine uses a camera and microphone to analyze the user's emotions in real time and obtains emotional data such as joy, surprise, and displeasure.

[1067] The server provides feedback on ad creatives based on the acquired emotional data and proposes designs that suit the user's emotions. Multiple ad creatives are presented, the user's emotional response to each is analyzed, and further optimized ads are proposed accordingly.

[1068] Users can scroll through multiple ad designs and select the most suitable one. Once a user selects an ad creative, detailed information, contractor information, and pricing information are displayed.

[1069] Finally, the user taps the "Contract" button to complete the transaction and enters payment information, etc. This completes the process for placing the ad.

[1070] As a concrete example, consider the case where a user wants to place an advertisement on the wall of a building. The user points their smartphone camera at the building and the app switches to AR mode. When the user sends their location information, the server searches for the corresponding ad space information and sends it back to the user's device. The user checks the virtual ad space in AR and enters "Summer Sale" as the advertising theme. The server generates multiple ad creatives with the theme "Summer Sale" and displays them on the user's device. The emotion engine analyzes the user's facial expressions and suggests the most suitable design. The user selects the most suitable design and completes the contract procedure, completing the entire advertising process.

[1071] The above is an embodiment of the present invention. This system allows users to easily obtain information about advertising slots and easily grasp the specifics of advertising placement. Furthermore, the introduction of an emotion engine makes it possible to select advertising creatives that suit the user's emotions, which is expected to improve advertising effectiveness.

[1072] The processing flow will be explained below.

[1073] Step 1:

[1074] The user launches the dedicated app on their smartphone.

[1075] The user taps to open the app on their smartphone.

[1076] Step 2:

[1077] Users point their smartphone camera at the location where they want to place an ad.

[1078] The user uses the camera to scan an object (for example, the wall of a building).

[1079] Step 3:

[1080] The device acquires location information and video information through the camera.

[1081] The device acquires data from its GPS function and camera sensor and analyzes location information and video information.

[1082] Step 4:

[1083] The terminal transmits the acquired location information and video information to the server.

[1084] The terminal packs this data into packets and sends them to a server via the Internet.

[1085] Step 5:

[1086] The server receives the location information and video information sent from the terminal.

[1087] The server decrypts the received data and prepares a database query.

[1088] Step 6:

[1089] The server searches the database for information about the ad slot.

[1090] The server queries the database using the location information as a key to obtain information about the advertising space's supplier, price, and available dates and times.

[1091] Step 7:

[1092] The server transmits the acquired advertising space information to the terminal.

[1093] The server packets the advertising space information and returns it to the terminal.

[1094] Step 8:

[1095] The terminal analyzes the advertising space information received from the server.

[1096] The terminal decodes the received data and prepares it for display.

[1097] Step 9:

[1098] The device uses AR technology to overlay advertising space information on the camera image.

[1099] The device displays the location and price information of the advertising space overlaid on the camera image.

[1100] Step 10:

[1101] The user checks the ad space information displayed in AR and selects the desired ad space.

[1102] Based on the displayed information, the user taps to select the desired ad space.

[1103] Step 11:

[1104] The user inputs the advertising theme and brand information.

[1105] Users use the in-app input form to enter the ad theme and brand information and press the submit button.

[1106] Step 12:

[1107] The terminal transmits the input information to the server.

[1108] The device assembles data containing theme and brand information into packets and sends them to the server.

[1109] Step 13:

[1110] The server uses AI to generate advertising creatives based on information from users.

[1111] The server inputs the theme and brand information into the AI ​​model and generates multiple advertising designs.

[1112] Step 14:

[1113] The server transmits the generated advertising creative to the terminal.

[1114] The server packetizes the generated advertisement design and transmits it to the terminal.

[1115] Step 15:

[1116] The terminal displays the advertising creative received from the server, and at the same time, the emotion engine acquires the user's emotion data.

[1117] The device displays the advertising design on the screen and uses the device's camera and microphone to analyze the user's facial expressions and voice to obtain emotional data.

[1118] Step 16:

[1119] The server analyzes the acquired emotion data and optimizes the advertising creative based on the user's emotion.

[1120] The server uses the data sent from the emotion engine to recommend designs that users tend to prefer.

[1121] Step 17:

[1122] Users can scroll through multiple optimized ad creatives and select the best one.

[1123] Users can compare the designs displayed on the screen and select the one they like by tapping it.

[1124] Step 18:

[1125] The user checks the details of the selected advertising creative and completes the transaction.

[1126] The user checks the advertisement details, supplier information, and price information, taps the "Contract" button, and enters payment information.

[1127] The above processing flow enables users to easily search for information on outdoor advertising space, optimally select advertising creatives generated by AI based on the analysis results of the emotion engine, and smoothly complete the advertising submission process.

[1128] Example 2

[1129] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1130] Conventional advertising systems have the problem that the process for users to obtain information on ad slots and select ad creatives is complicated and time-consuming.Furthermore, since ad creatives are not optimized based on user emotions, there is also the problem that it is difficult to achieve sufficient advertising effectiveness.

[1131] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1132] In this invention, the server includes a means for a user terminal to acquire location information and video information of an object, a means for the server to search for advertising space information based on the location information, and a means for transmitting the advertising space information acquired by the server to the user terminal. This allows users to easily acquire advertising space information and get a concrete idea of ​​what advertising placement will be like. Furthermore, an emotion analysis engine is used to optimize advertising creatives based on user emotions, which is expected to improve advertising effectiveness.

[1133] A "user terminal" is an electronic device such as a smartphone or tablet that is operated by a user.

[1134] "Object" refers to the location or physical object where you want to place your ad.

[1135] "Location Information" means geographic data of a specific location obtained using GPS or other technologies.

[1136] "Video information" refers to actual video data captured using a camera.

[1137] A "server" is a computer system that manages and processes data on a network.

[1138] "Advertising space information" refers to detailed information such as the location, space, period, price, and contractor where an advertisement can be placed.

[1139] Augmented reality technology (AR technology) is a technology that overlays computer-generated images and information onto real-world images.

[1140] A "theme" is a major concept or idea that defines the content and direction of an advertisement.

[1141] "Brand Information" is specific information related to an advertiser's brand.

[1142] A "generative AI model" is an algorithm or software that uses artificial intelligence to generate various creative content based on user instructions.

[1143] "Advertising creative" refers to specific ideas for the design and content of an advertisement.

[1144] An "emotion analysis engine" is a technology that analyzes a user's facial expressions and voice to recognize their emotional state.

[1145] "Emotion data" is information about the user's emotional state obtained by the emotion analysis engine.

[1146] The "contract procedure" is the final procedure for concluding a contract regarding the advertising creative selected by the user.

[1147] This invention is a system that allows users to easily search for outdoor advertisements and visually check the image before placing an advertisement using augmented reality (AR) technology and artificial intelligence (AI) technology. Furthermore, by combining it with an emotion analysis engine that recognizes user emotions, it is possible to select advertising creatives that suit the user's emotions. This system allows users to place advertisements quickly and effectively.

[1148] This system operates in the following steps:

[1149] First, the user launches the dedicated application on their smartphone. After launching the application, the main screen will appear, and the user points the smartphone camera at the location where they want to place an ad. The user's device (smartphone) will use the camera to obtain location information and video information of the target object. This information is obtained using the camera and GPS.

[1150] Next, the user device sends the acquired location information and video information to the server. Based on the received data, the server searches a database for corresponding ad space information. This ad space information includes the location, price, available dates and times, and outsourcing information of the ad space. The server sends the search results to the user device, which displays the information.

[1151] The user's device uses AR technology based on the received ad space information to virtually overlay the ad space on the camera image. For example, if a user wants to place an advertisement on the wall of a building, they can point their smartphone camera at the building, and the app will switch to AR mode, causing a virtual advertisement to be displayed on the actual wall of the building.

[1152] Next, the user inputs the ad theme and brand information. This information is entered into a form within the app and sent from the user's device to the server. The server uses the received information to generate multiple ad creatives using a generative AI model. This process uses prompts such as:

[1153] "A user wants to advertise 'Summer Sale' on the wall of a building. Please generate advertising creative with a summer sale theme."

[1154] The advertising creative generated by the server is sent to the user's device, which then displays the received creative on the screen. At this time, an emotion analysis engine analyzes the user's facial expressions and voice to obtain emotional data. The emotion analysis engine uses a camera and microphone to analyze the user's emotions in real time, determining, for example, joy, surprise, or displeasure.

[1155] Based on the acquired emotional data, the server provides feedback on the ad creative and suggests a design that best suits the user's emotions. The user can scroll through multiple ad creatives to compare them and select the most suitable one. Once the user selects an ad creative, detailed information (such as price information and contractor information) is displayed.

[1156] Finally, the user taps the "Contract" button and enters payment information to complete the transaction, completing the entire process of placing an ad.

[1157] The above is an embodiment of the present invention. This system allows users to easily obtain information about advertising slots and get a concrete idea of ​​what their advertising placement will look like. Furthermore, the introduction of an emotion analysis engine makes it possible to select advertising creatives that suit the user's emotions, which is expected to improve advertising effectiveness.

[1158] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1159] Step 1:

[1160] The user launches the dedicated application on their smartphone. When the user launches the application, the main screen is displayed. The input is the user's operation, and the output is the application's main screen.

[1161] Step 2:

[1162] Users use their smartphone camera to take a picture of the location where they want to place an advertisement. The camera on the user's device captures the location information and video information of the target object. The input is the actual video captured by the camera and location information from GPS, and the output is location information and video information data.

[1163] Step 3:

[1164] The user device sends the acquired location information and video information to the server. The server searches the database for corresponding ad space information based on the received data. The input is location information and video information, and the output is the corresponding ad space information. Specifically, the server retrieves the location, price, available date and time, and contractor information of the ad space from the database.

[1165] Step 4:

[1166] The server sends the search results to the user terminal, and the user terminal displays the received ad space information on the screen. The input is the ad space information sent from the server, and the output is the ad space information displayed on the screen of the user terminal.

[1167] Step 5:

[1168] The user device uses AR technology to virtually overlay ad space on the camera image based on the received ad space information. The input is the ad space information and the current camera image, and the output is an AR image that combines the two. For example, if a user takes a photo of the wall of a building, a virtual advertisement will be displayed on that wall.

[1169] Step 6:

[1170] The user enters the advertising theme and brand information into a form within the app. The user's device sends the entered information to the server. The input is the theme and brand information entered by the user, and the output is the data sent to the server.

[1171] Step 7:

[1172] The server uses the generative AI model to generate multiple ad creatives based on the received information. The input to this process is a prompt based on the theme and brand information, and the output is multiple generated ad creatives. For example, the prompt could be, "The user wants to place a 'Summer Sale' advertisement on the wall of a building. Please generate ad creatives with a summer sale theme."

[1173] Step 8:

[1174] The server sends the generated ad creative to the user terminal, and the user terminal displays the received creative on the screen. The input is the ad creative sent from the server, and the output is the ad creative displayed on the user terminal.

[1175] Step 9:

[1176] The emotion analysis engine analyzes the user's facial expressions and voice to obtain emotional data. The input is the user's facial expressions and voice captured through the camera and microphone, and the output is the analyzed emotional data. For example, emotions such as joy, surprise, and displeasure are identified.

[1177] Step 10:

[1178] The server provides feedback on the ad creative based on the acquired emotional data. The input is emotional data, and the output is a proposal for an optimized ad design that matches the user's emotions.

[1179] Step 11:

[1180] The user scrolls through multiple ad creatives, compares them, and selects the best one. The input is multiple ad creatives and the user's selection intention, and the output is the selection of the best ad creative.

[1181] Step 12:

[1182] Detailed information (such as price information and supplier information) about the ad creative selected by the user is displayed on the screen. The input is the selected ad creative, and the output is the display of detailed information.

[1183] Step 13:

[1184] To complete the transaction, the user taps the "Contract" button and enters payment information, etc. The input is the information necessary for the user's transaction, and the output is confirmation that the transaction has been completed. This completes the entire advertising process.

[1185] (Application example 2)

[1186] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1187] Conventional advertising systems have the problem that searching and selecting ad slots and checking the image of the actual ad display are complicated and time-consuming.In addition, it is not possible to propose optimal ad creatives that take user emotions into consideration, making it difficult to maximize the effectiveness of advertising.

[1188] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1189] In this invention, the server includes: means for a user terminal to acquire location information and video information of an object; means for the server to search for advertising space information based on the location information; means for transmitting the acquired advertising space information to the user terminal; means for the user terminal to display the advertising space information using AR technology; means for the user to input advertising theme and brand information; means for the server to generate advertising creatives based on the theme and brand information; means for the server to transmit the generated advertising creatives to the user terminal; means for the user terminal to display the generated advertising creatives; means for the user to select advertising creatives; means for the user to confirm detailed information about the selected advertising creatives and complete a contract procedure; means for the user terminal to acquire user emotion data using a camera and microphone; and means for the server to analyze the emotion data and re-propose optimal advertising creatives based on the analysis results. This allows users to easily acquire advertising space information, making it easier to get a concrete idea of ​​advertising placements, and the introduction of an emotion engine makes it possible to select advertising creatives that suit the user's emotions.

[1190] A "user terminal" is a mobile phone, smartphone, tablet, or other mobile device operated by a user.

[1191] "Object" refers to a location or physical structure where a user wishes to place, display, or view an advertisement.

[1192] "Location Information" means the geographic latitude, longitude, and altitude data of an object obtained using GPS, Wi-Fi, beacons, or other technologies.

[1193] "Video information" refers to image or video data captured using the camera function of a user terminal.

[1194] A "server" is a computer system that receives, transmits, and processes data, and in the present invention searches for advertising space information, generates creative content, and analyzes emotional data.

[1195] An "ad inventory" is a physical or digital space in which an advertisement is displayed, with attributes such as location, price, and availability dates and times.

[1196] "AR technology" stands for augmented reality technology, which is a technology that displays virtual information overlaid on real-world images.

[1197] "Theme" refers to the content, concept, or subject matter of the event or campaign being advertised.

[1198] "Brand information" includes information such as the brand name, logo, corporate philosophy, and color scheme promoted by the advertisement.

[1199] "Advertising creative" refers to the visual or audio advertising materials, such as the advertisement design, text, images, and video.

[1200] "Emotion data" is data of emotions such as joy, surprise, and discomfort, obtained by analyzing the user's facial expressions, voice, and body movements.

[1201] An "emotion engine" is software or hardware that uses a camera or microphone to analyze a user's emotions in real time.

[1202] "Optimal advertising creative" refers to advertising creative selected based on user emotional data in order to maximize user satisfaction.

[1203] This invention combines a system that allows users to easily search for outdoor advertising contractors and prices, and visually confirm what the ad will look like after it is placed using AR and AI technology, with an emotion engine that recognizes the user's emotions.

[1204] First, a user uses a smartphone to implement the invention. The user launches the application and points the smartphone camera at the location where they want to place an advertisement. At this time, the user's device acquires the location information and image information of the target object. The location information is obtained using GPS and Wi-Fi data, and the image information is acquired by the smartphone's built-in camera.

[1205] The acquired location information and video information are sent to a server. The server uses the location information to search a database for information on the corresponding ad slot. This information includes the location of the ad slot, price, available dates and times, and contractor information. The server then sends this information to the user's device.

[1206] The user device then displays the received ad space information using AR technology. Specifically, ARCore (for Android) or ARKit (for iOS) is used to overlay virtual ad space onto local video, allowing the user to see the ad as if it were actually being displayed.

[1207] Next, the user enters the ad theme and brand information within the app. This information is sent to a server, which uses a generative AI model to generate multiple ad creatives. The generated ad creatives are then sent from the server to the user's device, where they are displayed. At this time, the user's device runs an emotion engine, which uses the camera and microphone to analyze the user's facial expressions and voice to obtain emotional data. This emotion analysis uses technologies such as Microsoft Azure Cognitive Services and Affectiva.

[1208] The server analyzes the emotional data and, based on the results, re-proposes the most appropriate ad creative. The user can scroll through multiple ad creatives and analyze the emotional response to each, which will then suggest a design optimized for that emotion. Once the user selects the most suitable ad creative, detailed information, contractor information, and pricing information are displayed. Finally, the user completes the contract process and enters payment information to complete the ad placement procedure.

[1209] Specific examples

[1210] For example, consider the case where a user wants to place an advertisement on the wall of a building. The user points their smartphone camera at the building and the app switches to AR mode. When the user sends their location information, the server searches for the corresponding ad space information and sends it back to the user's device. The user checks the virtual ad space in AR and enters "Summer Sale" as the advertising theme. The server uses a generative AI model to generate multiple "Summer Sale" themed ad creatives and displays them on the user's device. The emotion engine analyzes the user's facial expressions and suggests the most suitable design. The user selects the most suitable design and the transaction process is completed.

[1211] Prompt Sentence Examples

[1212] "Generate an effective ad design for a big summer sale. The theme colors are blue and yellow, and the target audience is young people in their 20s and 30s."

[1213] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1214] Step 1:

[1215] The user starts up their smartphone and launches the application. Using the camera on the user's device, they hold it over the location where they want to place the ad, and obtain location information (GPS) and video information (camera images).

[1216] Input: Smartphone camera image, GPS location information

[1217] Data processing / calculation: Camera image data is converted into an image format and sent to the server along with location information

[1218] Output: Location information and video data sent to the server

[1219] Step 2:

[1220] Based on the location information received by the server, advertising space information (location, price, available date and time, and contractor information) is searched from the database.

[1221] Input:Location

[1222] Data processing / calculation: Performing database queries using location information

[1223] Output: Ad space information

[1224] Step 3:

[1225] The server sends the ad space information to the user's device, which then uses AR technology to overlay the received ad space information on the camera image.

[1226] Input: Ad space information

[1227] Data processing / computation: Rendering virtual objects using ARCore or ARKit

[1228] Output: Ad space overlaid on the user's device

[1229] Step 4:

[1230] The user enters the advertising theme and brand information within the app and sends it to the server.

[1231] Input: Theme information, brand information

[1232] Data processing / calculation: Sending input form data

[1233] Output: Theme and branding information sent to the server

[1234] Step 5:

[1235] The server uses a generative AI model to generate multiple ad creatives based on the input theme and brand information.

[1236] Input: Theme information, brand information

[1237] Data processing / computation: Generating ad creative using generative AI models (TensorFlow or PyTorch)

[1238] Output: Ad creative

[1239] Step 6:

[1240] The server transmits the generated advertising creatives to the user terminal, which displays them.

[1241] Input: Ad creative

[1242] Data processing / calculation: Displaying advertising creatives in the user interface

[1243] Output: Ad creative displayed on user device

[1244] Step 7:

[1245] The user device uses a camera and microphone to capture the user's facial expressions and voice, and analyzes the emotional data.

[1246] Input: User's facial expression data, voice data

[1247] Data processing / calculation: Sentiment analysis using an emotion engine (Microsoft Azure Cognitive Services or Affectiva)

[1248] Output: Parsed emotion data

[1249] Step 8:

[1250] The server receives the emotional data and, based on the analysis results, selects and re-proposes the most appropriate advertising creative.

[1251] Input: Emotion data, ad creative

[1252] Data processing / calculation: Feedback and regeneration of advertising creatives based on emotional data

[1253] Output: Optimized ad creative suggestions

[1254] Step 9:

[1255] The user selects the most suitable advertising creative, checks its details, contractor information, and price information, and then completes the contract procedure.

[1256] Input: Best ad creative, details

[1257] Data processing / calculation: Confirmation of selected data and transaction processing

[1258] Output: Contract procedure completed, advertising procedure completed

[1259] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1260] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1261] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1262] [Fourth embodiment]

[1263] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1264] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1265] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1266] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1267] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1268] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1269] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1270] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1271] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1272] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1273] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1274] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1275] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1276] The present invention is a system that allows users to easily search for outdoor advertising contractors and prices, and visually check what the advertisement will look like after it is placed using AR and AI technology. Specific embodiments for carrying out the invention are described below.

[1277] First, the user launches the dedicated application on their smartphone. When the app is launched on the user's device, the main screen is displayed. The user then points the smartphone camera at the location where they want to place an ad. At this time, the user's device's camera captures the location information and image information of the target object.

[1278] The user device sends the acquired location information and video information to the server. The server uses this data to search for corresponding ad slot information in its database. This information includes the location of the ad slot, price, available dates and times, and outsourcing information. The server sends the search results to the user device, which then receives this information.

[1279] Next, the user device uses AR technology to overlay the received ad space information onto the camera image, allowing the user to see the ad as if it were actually being displayed in the specified location.

[1280] Once the user has selected an ad slot, they then enter the ad theme and brand information. They then enter this information into a form within the app and submit the information. The user's device then sends the information entered by the user back to the server. The server uses an AI model based on this information to generate multiple ad creatives. The generated ad creatives are then sent from the server to the user's device.

[1281] The user's device displays the received ad creative on the screen. The user can scroll through multiple ad designs and select the most suitable one. Once the user selects an ad creative, detailed information, contractor information, and price information are displayed.

[1282] Finally, the user taps the "Contract" button to complete the transaction and enters payment information, etc. This completes the process for placing the ad.

[1283] As a concrete example, consider the case where a user wants to place an advertisement on the wall of a building. The user points their smartphone camera at the building and the app switches to AR mode. When the user sends their location information, the server searches for the corresponding ad space information and sends it back to the user's device. The user checks the virtual ad space in AR and enters "Summer Sale" as the advertising theme. The server generates multiple ad creatives with the theme "Summer Sale" and displays them on the user's device. The entire advertising process is completed when the user selects the most suitable design and completes the transaction procedure.

[1284] The above is an embodiment of the present invention. This system allows users to easily obtain information about advertising slots and easily get a concrete idea of ​​what advertising placement will be like.

[1285] The processing flow will be explained below.

[1286] Step 1:

[1287] The user launches a dedicated app on their smartphone.

[1288] Users tap on an app to access its main screen.

[1289] Step 2:

[1290] Users point their smartphone camera at the location where they want to place an ad.

[1291] A user uses a camera to capture image information of an object.

[1292] Step 3:

[1293] The device acquires location information and video information through the camera.

[1294] The device receives data from the GPS sensor and camera and analyzes location and video information.

[1295] Step 4:

[1296] The terminal transmits the acquired location information and video information to the server.

[1297] The terminal packs the data into packets and sends them over the Internet to a server.

[1298] Step 5:

[1299] The server receives the location information and video information sent from the terminal.

[1300] The server interprets the received data and prepares a query to the database.

[1301] Step 6:

[1302] The server searches the database for information on the corresponding advertising space.

[1303] The server queries a database based on the location information to retrieve information such as the ad space's supplier, price, and available dates and times.

[1304] Step 7:

[1305] The server transmits advertising space information including search results to the terminal.

[1306] The server converts the acquired information into packets and returns them to the terminal.

[1307] Step 8:

[1308] The terminal analyzes the advertising space information received from the server.

[1309] The device decodes the received data and prepares it for AR display.

[1310] Step 9:

[1311] The device uses AR technology to overlay advertising space information on the camera image.

[1312] The device will display additional information about the location and price of the advertising space on the camera image.

[1313] Step 10:

[1314] The user checks the ad space information displayed in AR and selects the desired ad space.

[1315] The user taps the screen to select an ad slot.

[1316] Step 11:

[1317] The user inputs the advertising theme and brand information.

[1318] Users enter details about their theme and brand into an in-app form.

[1319] Step 12:

[1320] The terminal transmits the input information to the server.

[1321] The terminal collects input data into packets and sends them to the server.

[1322] Step 13:

[1323] The server uses AI to generate advertising creatives based on the information sent by the user.

[1324] The server inputs the received theme and brand information into the AI ​​model and generates multiple advertising creatives.

[1325] Step 14:

[1326] The server transmits the generated advertising creative to the terminal.

[1327] The server packets the generated design and sends it to the terminal.

[1328] Step 15:

[1329] The terminal displays the advertising creative received from the server.

[1330] The terminal displays a number of advertisement designs on the screen for the user to select from.

[1331] Step 16:

[1332] The user selects the best ad creative.

[1333] Users tap the screen to select an ad design.

[1334] Step 17:

[1335] The user checks the details of the selected advertising creative and completes the transaction.

[1336] The user checks the advertisement details, supplier information, and price information, taps the "Contract" button, and enters payment information.

[1337] Using the above processing flow, users can easily search for information on outdoor advertising space, compare advertising creatives generated by AI, select the most suitable advertisement, and smoothly complete the advertising process.

[1338] Example 1

[1339] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1340] In the conventional outdoor advertising process, users had to manually research information about advertising space and repeatedly check and select advertising designs, which required a great deal of time and effort. Furthermore, there were limited ways to check the visual image of the ads beforehand, making it difficult to predict their actual effectiveness. Furthermore, specialized knowledge was required to generate and select advertising creatives, placing a heavy burden on users. The purpose of this invention is to solve these problems and provide a more efficient and effective outdoor advertising process.

[1341] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1342] In this invention, the server includes: means for a user terminal to acquire location information and video information of an object; means for the server to search for advertising space information based on the location information; means for transmitting the acquired advertising space information to the user terminal; means for the user terminal to display the advertising space information using AR technology; means for the user to input advertising theme and brand information; means for the server to generate advertising creatives using a generative AI model based on the theme and brand information; means for the server to transmit the generated advertising creatives to the user terminal; means for the user terminal to display the generated advertising creatives; means for the user to select advertising creatives; and means for the user to confirm detailed information about the advertising creatives selected by the user and complete a contract procedure. This enables users to easily and efficiently perform a series of tasks from acquiring advertising space information to selecting and confirming a design and completing a contract procedure.

[1343] A "user terminal" is a device that is operated by a user to acquire location information and video information and communicate with a server.

[1344] "Location information" is data that indicates the geographic location of an object and is obtained using technologies such as GPS.

[1345] "Video information" refers to image and video data captured through the camera of the user terminal.

[1346] A "server" is a computer system that communicates with user terminals via a network and performs processes such as searching for advertising space information and generating advertising creatives.

[1347] An "advertising space" refers to a specific location or space for displaying outdoor advertising.

[1348] "AR technology" is an abbreviation for augmented reality technology, which is a technology that displays virtual information overlaid on images of the real world.

[1349] A "generative AI model" is an artificial intelligence model that automatically generates advertising creatives based on input data.

[1350] "Advertising creative" refers to content that includes designs and messages displayed as advertisements.

[1351] The "contract procedure" is the process by which the user enters the necessary information regarding the use of advertising space and the ordering of advertising creatives, and finally finalizes the contract.

[1352] The present invention provides a system that allows users to easily and efficiently place outdoor advertisements. The system is composed of a user terminal, a server, and a generative AI model.

[1353] First, the user launches a dedicated application on their device, such as a smartphone. This application displays an initial setup screen and requests permission from the user to obtain location information and access the camera. For example, a general-purpose application such as "OutdoorAdVisualizer" is assumed.

[1354] When a user holds their smartphone camera over the location where they want to place an advertisement, the user's device acquires the location information and image information of the target object through the camera. This location information is acquired using technologies such as GPS, and the image information is acquired using the camera module.

[1355] The acquired location information and video information is sent from the user terminal to a server. The transmitted data is encrypted to ensure secure communication. The server searches a database for advertising space information based on the received location information. This database contains information on the location, price, available dates and times of advertising space, and outsourced party information. The advertising space information acquired by the server is sent back to the user terminal.

[1356] The user's device uses AR technology to display the ad space on the camera image based on the received ad space information. This allows the user to see the ad as if it were actually displayed in the specified location. AR technology uses AR libraries such as "Vuforia."

[1357] Next, the user enters the advertising theme and brand information into a form within the app. For example, themes such as "Summer Sale" or "New Product Release" are entered. The information entered by the user is then sent back to the server via the user's device.

[1358] The server generates ad creatives using a generative AI model based on the theme and brand information. This generative AI model uses, for example, "DALL-E" or "Stable Diffusion." Multiple variations of the generated ad creatives are generated and sent from the server to the user's device.

[1359] The user's device displays the received multiple ad creatives on the screen. The user can scroll through the designs and select the most suitable one. Detailed information about the selected ad creative, as well as information about the contractor and price, are also displayed at the same time.

[1360] Finally, the user completes the transaction process within the app by tapping the "Contract" button and entering payment information to complete the ad placement process. Payment information is encrypted and processed securely on the server.

[1361] Specific examples

[1362] For example, consider the case where a user wants to place a "Summer Sale" advertisement on the wall of a building. The user points their smartphone camera at the building and the app switches to AR mode. When the user sends their location information, the server searches for the corresponding ad space information and sends it back to the user's device. The user checks the virtual ad space in AR and enters "Summer Sale" as the theme. The server generates multiple ad creatives with the "Summer Sale" theme and displays them on the user's device. The entire ad placement process is completed when the user selects the most suitable design and completes the purchase procedure.

[1363] Prompt Sentence Examples

[1364] "We want to advertise our summer sales on the wall of a building. Please create an eye-catching creative with a vibrant design."

[1365] "We would like to advertise a new product on a sign in the shopping district. Please suggest a design that targets young customers in their 20s and 30s."

[1366] The above is an embodiment of the present invention. This system allows users to easily and efficiently obtain information about advertising spaces, select and confirm designs, and complete contract procedures.

[1367] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1368] Step 1:

[1369] The user launches the dedicated application on their smartphone. The user device displays an initial setup screen and requests permission to obtain location information and access the camera (input: none, output: initial setup screen displayed). The user grants these permissions.

[1370] Step 2:

[1371] Users hold their smartphone camera over the location where they want to place an advertisement. The user's device obtains the location information and video information of the target object through the camera (input: camera image, GPS data; output: location information, video information). This location information is obtained using GPS technology, and the video information is obtained using the camera module.

[1372] Step 3:

[1373] The device sends the acquired location information and video information to the server (input: location information, video information; output: transmission of encrypted data). The data sent is encrypted to ensure the security of the communication.

[1374] Step 4:

[1375] The server searches the database for ad space information based on the received location information (input: encrypted data, output: ad space information). The server queries the database and obtains the location, price, available date and time, and contractor information for the relevant ad space.

[1376] Step 5:

[1377] The server sends the acquired advertising space information to the user terminal (input: advertising space information, output: transmission of encrypted data). The user terminal decrypts the received data and acquires the advertising space information.

[1378] Step 6:

[1379] The user's device uses AR technology to display the ad space on the camera image based on the received ad space information (input: ad space information, output: AR overlay display). This allows the user to see the ad as if it were actually displayed in the specified location. AR libraries such as "Vuforia" are used for the AR technology.

[1380] Step 7:

[1381] The user enters the advertising theme and brand information into a form within the app (input: theme, brand information, output: input information). For example, themes such as "Summer sale" or "New product release" are entered. The information entered by the user is then sent back to the server via the user's device (input: input information, output: sending encrypted data).

[1382] Step 8:

[1383] The server uses a generative AI model based on the theme and brand information to generate ad creatives (input: theme, brand information, output: multiple ad creatives). The generative AI model uses "DALL-E" or "Stable Diffusion." The generated ad creatives are sent from the server to the user's device (input: ad creatives, output: transmission of encrypted data).

[1384] Step 9:

[1385] The user's device displays the received multiple ad creatives on the screen (input: encrypted data, output: display of ad creatives), and the user can scroll through these designs. When the user selects the most suitable design, detailed information about the design, the contractor, and price information are also displayed at the same time.

[1386] Step 10:

[1387] To complete the transaction within the app, the user taps the "Contract" button and enters payment information (input: payment information, output: transaction completed). Payment information is encrypted and processed securely on the server.

[1388] (Application example 1)

[1389] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1390] The conventional outdoor advertising process requires a lot of time and effort to search for advertising space, check prices, and confirm the image after advertising. The process of selecting the optimal advertising design from multiple options is also complicated. This can lead to insufficient consideration for maximizing advertising effectiveness, which can result in reduced advertising effectiveness. Furthermore, the entire advertising process is complicated and time-consuming, making it difficult to quickly place advertisements. Therefore, a system that allows for easy and effective outdoor advertising has been sought.

[1391] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1392] In this invention, the server includes: means for a user terminal to acquire location information and image information of an object; means for the server to search for advertising space information based on the location information; means for the server to transmit the acquired advertising space information to the user terminal; means for the user terminal to display the advertising space information using AR technology; means for the user to input advertising theme and brand information; means for the server to generate advertising creatives based on the theme and brand information; means for the server to transmit the generated advertising creatives to the user terminal; means for the user terminal to display the generated advertising creatives; means for the user to select advertising creatives; means for the user to check detailed information about the selected advertising creatives and complete a contract procedure; means for overlaying the advertising space information on camera images using AR technology; and means for scrolling through and selecting the generated advertising creatives. This enables users to quickly acquire advertising space information and easily select and place advertising creatives while visually checking them using AR technology.

[1393] A "user terminal" is an electronic device that allows a user to input information and send and receive data. Examples include smartphones, tablets, and personal computers.

[1394] "Location information" is data that indicates the geographic location of a specific object, including GPS data and address information.

[1395] "Video information" refers to image and video data captured by a camera or other imaging device.

[1396] A "server" is a computer system for processing and storing data over a network.

[1397] "Advertising space information" is detailed data about the space or location for placing advertisements, including location, size, available dates and times, price, and contractor information.

[1398] "AR technology" is a technology that displays computer-generated information overlaid on real-world images.

[1399] "Theme" is information that indicates the main content or concept of the advertisement.

[1400] "Brand information" refers to identifying information and data such as names and logos associated with advertisers and products.

[1401] "Advertising creative" refers to content that includes creative content, such as advertising design and text.

[1402] "Scrolling" is a user interface operation that moves displayed content up and down or left and right.

[1403] A "closing procedure" is a series of procedures for formally concluding a transaction for a service or product.

[1404] MODE FOR CARRYING OUT THE INVENTION

[1405] The present invention provides a system that allows users to easily search for outdoor advertising contractors and prices, and visually check what the advertisement will look like after it is placed, using AR and AI technologies. Specific embodiments are described below.

[1406] System Overview

[1407] The system includes the following means:

[1408] 1. User terminal: This refers to devices such as smartphones and tablets that allow users to input information and send and receive data.

[1409] 2. Server: A computer system for processing and storing data over a network.

[1410] Program processing

[1411] Hardware and Software

[1412] The user device uses a camera, GPS, AR library, and software for data transmission and reception (e.g., OpenCV, Requests library). The server has a database, AI model library, and API server (e.g., Flask or Django).

[1413] Processing flow

[1414] 1. Acquisition of location and video information: When a user points their smartphone camera at the location where they want to place an ad, the camera acquires video information and the GPS acquires location information.

[1415] 2. Sending data to the server: The user device sends the acquired location information and video information to the server.

[1416] 3. Searching and obtaining advertising space information: The server searches the database for advertising space information (location, price, available dates and times, contractor information, etc.) based on the location information and sends it to the user's device.

[1417] 4. Display using AR technology: The user device uses AR technology to overlay the received advertising space information on the camera image.

[1418] 5. Entering theme and brand information: The user enters the ad theme and brand information into a form within the app and sends it to the server.

[1419] 6. Generating advertising creatives using AI: The server uses an AI model to generate multiple advertising creatives based on the theme and brand information sent, and sends them to the user's device.

[1420] 7. Display and selection of ad creatives: The user device displays multiple generated ad creatives, and the user scrolls through them to select the most suitable one.

[1421] 8. Purchase procedure: After the user selects an ad creative, they confirm its details and complete the purchase procedure.

[1422] Specific examples

[1423] Take the example of an advertising agency that conducts area marketing. If a user wants to place a "Summer Sale" ad on the wall of a building in the Shinjuku area, they point their smartphone camera at the building. The app switches to AR mode, and location and video information is sent to the server. The server searches for relevant ad space information and sends it back to the user's device. Using AR technology, the user checks the virtual ad space and enters information on the theme of "Summer Sale." The server uses an AI model to generate multiple ad creatives and displays them on the user's device. The user selects the most suitable design and completes the transaction.

[1424] Prompt Sentence Examples

[1425] "We envision an application that allows users to view ad space information based on the ad theme "Summer Sale" and the coordinate location of the "Shinjuku area," and select from multiple creatives generated using AI. Please generate a summer sale ad that is suitable for the Shinjuku area."

[1426] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1427] A detailed explanation of the program's processing flow

[1428] Processing Steps

[1429] Step 1:

[1430] The user's device points the camera at the desired advertising location, and the camera captures the image of the scenery, while the GPS sensor simultaneously acquires the location information.

[1431] Input: Camera image (image data), GPS location information (latitude and longitude)

[1432] Output: Acquired video information and location information

[1433] Step 2:

[1434] The location information and video information acquired by the user device are sent to the server using HTTP requests via the Internet.

[1435] Input: Video information, location information

[1436] Output: Data sent to the server

[1437] Step 3:

[1438] Based on the location information received, the server searches the database for ad slot information (location, price, available dates and times, agent information, etc.) using SQL or NoSQL queries.

[1439] Input:Location

[1440] Output: Ad space information (location, price, available date and time, agent information)

[1441] Step 4:

[1442] The server sends the searched ad slot information to the user's device. This communication also uses an HTTP response.

[1443] Input: Ad space information

[1444] Output: Ad space information sent to the user's device

[1445] Step 5:

[1446] The ad space information received by the user's device is overlaid on the camera image using AR technology, using an AR library (e.g., ARCore, ARKit).

[1447] Input: Ad space information, camera footage

[1448] Output: Camera image overlaid with AR

[1449] Step 6:

[1450] The user enters the advertising theme and brand information into a form within the app, which is then converted into JSON format.

[1451] Input: Theme, brand information

[1452] Output: Theme and brand information entered

[1453] Step 7:

[1454] The user terminal transmits the input theme and brand information to the server.

[1455] Input: Theme, brand information

[1456] Output: Data sent to the server

[1457] Step 8:

[1458] Based on the theme and brand information received by the server, a generative AI model is used to generate advertising creatives. A generative AI model (e.g., GPT-3, DALL-E) is used to generate creatives based on prompt text.

[1459] Input: Theme, brand information (prompt text)

[1460] Output: Generated ad creative

[1461] Step 9:

[1462] The server transmits the generated advertising creatives to the user terminal.

[1463] Input: Generated ad creative

[1464] Output: Ad creative sent to user device

[1465] Step 10:

[1466] The user device displays the received ad creatives, and the user can scroll through multiple creatives to select one.

[1467] Input: Ad creative

[1468] Output: Ad creative selected by the user

[1469] Step 11:

[1470] The user confirms the details of the selected ad creative and completes the transaction. The user enters payment information and other details, and sends them to the server.

[1471] Input: Selected ad creative, payment information

[1472] Output: Notification of completion of contract procedure

[1473] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1474] The present invention combines a system that allows users to easily search for outdoor advertising contractors and prices, and visually confirm the image of the advertisement after it has been placed using AR and AI technology, with an emotion engine that recognizes the user's emotions. Specific embodiments for carrying out the invention are described below.

[1475] First, the user launches the dedicated application on their smartphone. When the app is launched on the user's device, the main screen is displayed. The user then points the smartphone camera at the location where they want to place an ad. At this time, the user's device's camera captures the location information and image information of the target object.

[1476] The user device sends the acquired location information and video information to the server. The server uses this data to search for corresponding ad slot information in its database. This information includes the location of the ad slot, price, available dates and times, and outsourcing information. The server sends the search results to the user device, which then receives this information.

[1477] Next, the user device uses AR technology to overlay the received ad space information onto the camera image, allowing the user to see the ad as if it were actually being displayed in the specified location.

[1478] Once the user has selected an ad slot, they then enter the ad theme and brand information. They then enter this information into a form within the app and submit the information. The user's device then sends the information entered by the user back to the server. The server uses an AI model based on this information to generate multiple ad creatives. The generated ad creatives are then sent from the server to the user's device.

[1479] The user device displays the received advertising creative on the screen, and at the same time, the emotion engine analyzes the user's facial expressions and voice to obtain emotional data. The emotion engine uses a camera and microphone to analyze the user's emotions in real time and obtains emotional data such as joy, surprise, and displeasure.

[1480] The server provides feedback on ad creatives based on the acquired emotional data and proposes designs that suit the user's emotions. Multiple ad creatives are presented, the user's emotional response to each is analyzed, and further optimized ads are proposed accordingly.

[1481] Users can scroll through multiple ad designs and select the most suitable one. Once a user selects an ad creative, detailed information, contractor information, and pricing information are displayed.

[1482] Finally, the user taps the "Contract" button to complete the transaction and enters payment information, etc. This completes the process for placing the ad.

[1483] As a concrete example, consider the case where a user wants to place an advertisement on the wall of a building. The user points their smartphone camera at the building and the app switches to AR mode. When the user sends their location information, the server searches for the corresponding ad space information and sends it back to the user's device. The user checks the virtual ad space in AR and enters "Summer Sale" as the advertising theme. The server generates multiple ad creatives with the theme "Summer Sale" and displays them on the user's device. The emotion engine analyzes the user's facial expressions and suggests the most suitable design. The user selects the most suitable design and completes the contract procedure, completing the entire advertising process.

[1484] The above is an embodiment of the present invention. This system allows users to easily obtain information about advertising slots and easily grasp the specifics of advertising placement. Furthermore, the introduction of an emotion engine makes it possible to select advertising creatives that suit the user's emotions, which is expected to improve advertising effectiveness.

[1485] The processing flow will be explained below.

[1486] Step 1:

[1487] The user launches the dedicated app on their smartphone.

[1488] The user taps to open the app on their smartphone.

[1489] Step 2:

[1490] Users point their smartphone camera at the location where they want to place an ad.

[1491] The user uses the camera to scan an object (for example, the wall of a building).

[1492] Step 3:

[1493] The device acquires location information and video information through the camera.

[1494] The device acquires data from its GPS function and camera sensor and analyzes location information and video information.

[1495] Step 4:

[1496] The terminal transmits the acquired location information and video information to the server.

[1497] The terminal packs this data into packets and sends them to a server via the Internet.

[1498] Step 5:

[1499] The server receives the location information and video information sent from the terminal.

[1500] The server decrypts the received data and prepares a database query.

[1501] Step 6:

[1502] The server searches the database for information about the ad slot.

[1503] The server queries the database using the location information as a key to obtain information about the advertising space's supplier, price, and available dates and times.

[1504] Step 7:

[1505] The server transmits the acquired advertising space information to the terminal.

[1506] The server packets the advertising space information and returns it to the terminal.

[1507] Step 8:

[1508] The terminal analyzes the advertising space information received from the server.

[1509] The terminal decodes the received data and prepares it for display.

[1510] Step 9:

[1511] The device uses AR technology to overlay advertising space information on the camera image.

[1512] The device displays the location and price information of the advertising space overlaid on the camera image.

[1513] Step 10:

[1514] The user checks the ad space information displayed in AR and selects the desired ad space.

[1515] Based on the displayed information, the user taps to select the desired ad space.

[1516] Step 11:

[1517] The user inputs the advertising theme and brand information.

[1518] Users use the in-app input form to enter the ad theme and brand information and press the submit button.

[1519] Step 12:

[1520] The terminal transmits the input information to the server.

[1521] The device assembles data containing theme and brand information into packets and sends them to the server.

[1522] Step 13:

[1523] The server uses AI to generate advertising creatives based on information from users.

[1524] The server inputs the theme and brand information into the AI ​​model and generates multiple advertising designs.

[1525] Step 14:

[1526] The server transmits the generated advertising creative to the terminal.

[1527] The server packetizes the generated advertisement design and transmits it to the terminal.

[1528] Step 15:

[1529] The terminal displays the advertising creative received from the server, and at the same time, the emotion engine acquires the user's emotion data.

[1530] The device displays the advertising design on the screen and uses the device's camera and microphone to analyze the user's facial expressions and voice to obtain emotional data.

[1531] Step 16:

[1532] The server analyzes the acquired emotion data and optimizes the advertising creative based on the user's emotion.

[1533] The server uses the data sent from the emotion engine to recommend designs that users tend to prefer.

[1534] Step 17:

[1535] Users can scroll through multiple optimized ad creatives and select the best one.

[1536] Users can compare the designs displayed on the screen and select the one they like by tapping it.

[1537] Step 18:

[1538] The user checks the details of the selected advertising creative and completes the transaction.

[1539] The user checks the advertisement details, supplier information, and price information, taps the "Contract" button, and enters payment information.

[1540] The above processing flow enables users to easily search for information on outdoor advertising space, optimally select advertising creatives generated by AI based on the analysis results of the emotion engine, and smoothly complete the advertising submission process.

[1541] Example 2

[1542] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1543] Conventional advertising systems have the problem that the process for users to obtain information on ad slots and select ad creatives is complicated and time-consuming.Furthermore, since ad creatives are not optimized based on user emotions, there is also the problem that it is difficult to achieve sufficient advertising effectiveness.

[1544] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1545] In this invention, the server includes a means for a user terminal to acquire location information and video information of an object, a means for the server to search for advertising space information based on the location information, and a means for transmitting the advertising space information acquired by the server to the user terminal. This allows users to easily acquire advertising space information and get a concrete idea of ​​what advertising placement will be like. Furthermore, an emotion analysis engine is used to optimize advertising creatives based on user emotions, which is expected to improve advertising effectiveness.

[1546] A "user terminal" is an electronic device such as a smartphone or tablet that is operated by a user.

[1547] "Object" refers to the location or physical object where you want to place your ad.

[1548] "Location Information" means geographic data of a specific location obtained using GPS or other technologies.

[1549] "Video information" refers to actual video data captured using a camera.

[1550] A "server" is a computer system that manages and processes data on a network.

[1551] "Advertising space information" refers to detailed information such as the location, space, period, price, and contractor where an advertisement can be placed.

[1552] Augmented reality technology (AR technology) is a technology that overlays computer-generated images and information onto real-world images.

[1553] A "theme" is a major concept or idea that defines the content and direction of an advertisement.

[1554] "Brand Information" is specific information related to an advertiser's brand.

[1555] A "generative AI model" is an algorithm or software that uses artificial intelligence to generate various creative content based on user instructions.

[1556] "Advertising creative" refers to specific ideas for the design and content of an advertisement.

[1557] An "emotion analysis engine" is a technology that analyzes a user's facial expressions and voice to recognize their emotional state.

[1558] "Emotion data" is information about the user's emotional state obtained by the emotion analysis engine.

[1559] The "contract procedure" is the final procedure for concluding a contract regarding the advertising creative selected by the user.

[1560] This invention is a system that allows users to easily search for outdoor advertisements and visually check the image before placing an advertisement using augmented reality (AR) technology and artificial intelligence (AI) technology. Furthermore, by combining it with an emotion analysis engine that recognizes user emotions, it is possible to select advertising creatives that suit the user's emotions. This system allows users to place advertisements quickly and effectively.

[1561] This system operates in the following steps:

[1562] First, the user launches the dedicated application on their smartphone. After launching the application, the main screen will appear, and the user points the smartphone camera at the location where they want to place an ad. The user's device (smartphone) will use the camera to obtain location information and video information of the target object. This information is obtained using the camera and GPS.

[1563] Next, the user device sends the acquired location information and video information to the server. Based on the received data, the server searches a database for corresponding ad space information. This ad space information includes the location, price, available dates and times, and outsourcing information of the ad space. The server sends the search results to the user device, which displays the information.

[1564] The user's device uses AR technology based on the received ad space information to virtually overlay the ad space on the camera image. For example, if a user wants to place an advertisement on the wall of a building, they can point their smartphone camera at the building, and the app will switch to AR mode, causing a virtual advertisement to be displayed on the actual wall of the building.

[1565] Next, the user inputs the ad theme and brand information. This information is entered into a form within the app and sent from the user's device to the server. The server uses the received information to generate multiple ad creatives using a generative AI model. This process uses prompts such as:

[1566] "A user wants to advertise 'Summer Sale' on the wall of a building. Please generate advertising creative with a summer sale theme."

[1567] The advertising creative generated by the server is sent to the user's device, which then displays the received creative on the screen. At this time, an emotion analysis engine analyzes the user's facial expressions and voice to obtain emotional data. The emotion analysis engine uses a camera and microphone to analyze the user's emotions in real time, determining, for example, joy, surprise, or displeasure.

[1568] Based on the acquired emotional data, the server provides feedback on the ad creative and suggests a design that best suits the user's emotions. The user can scroll through multiple ad creatives to compare them and select the most suitable one. Once the user selects an ad creative, detailed information (such as price information and contractor information) is displayed.

[1569] Finally, the user taps the "Contract" button and enters payment information to complete the transaction, completing the entire process of placing an ad.

[1570] The above is an embodiment of the present invention. This system allows users to easily obtain information about advertising slots and get a concrete idea of ​​what their advertising placement will look like. Furthermore, the introduction of an emotion analysis engine makes it possible to select advertising creatives that suit the user's emotions, which is expected to improve advertising effectiveness.

[1571] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1572] Step 1:

[1573] The user launches the dedicated application on their smartphone. When the user launches the application, the main screen is displayed. The input is the user's operation, and the output is the application's main screen.

[1574] Step 2:

[1575] Users use their smartphone camera to take a picture of the location where they want to place an advertisement. The camera on the user's device captures the location information and video information of the target object. The input is the actual video captured by the camera and location information from GPS, and the output is location information and video information data.

[1576] Step 3:

[1577] The user device sends the acquired location information and video information to the server. The server searches the database for corresponding ad space information based on the received data. The input is location information and video information, and the output is the corresponding ad space information. Specifically, the server retrieves the location, price, available date and time, and contractor information of the ad space from the database.

[1578] Step 4:

[1579] The server sends the search results to the user terminal, and the user terminal displays the received ad space information on the screen. The input is the ad space information sent from the server, and the output is the ad space information displayed on the screen of the user terminal.

[1580] Step 5:

[1581] The user device uses AR technology to virtually overlay ad space on the camera image based on the received ad space information. The input is the ad space information and the current camera image, and the output is an AR image that combines the two. For example, if a user takes a photo of the wall of a building, a virtual advertisement will be displayed on that wall.

[1582] Step 6:

[1583] The user enters the advertising theme and brand information into a form within the app. The user's device sends the entered information to the server. The input is the theme and brand information entered by the user, and the output is the data sent to the server.

[1584] Step 7:

[1585] The server uses the generative AI model to generate multiple ad creatives based on the received information. The input to this process is a prompt based on the theme and brand information, and the output is multiple generated ad creatives. For example, the prompt could be, "The user wants to place a 'Summer Sale' advertisement on the wall of a building. Please generate ad creatives with a summer sale theme."

[1586] Step 8:

[1587] The server sends the generated ad creative to the user terminal, and the user terminal displays the received creative on the screen. The input is the ad creative sent from the server, and the output is the ad creative displayed on the user terminal.

[1588] Step 9:

[1589] The emotion analysis engine analyzes the user's facial expressions and voice to obtain emotional data. The input is the user's facial expressions and voice captured through the camera and microphone, and the output is the analyzed emotional data. For example, emotions such as joy, surprise, and displeasure are identified.

[1590] Step 10:

[1591] The server provides feedback on the ad creative based on the acquired emotional data. The input is emotional data, and the output is a proposal for an optimized ad design that matches the user's emotions.

[1592] Step 11:

[1593] The user scrolls through multiple ad creatives, compares them, and selects the best one. The input is multiple ad creatives and the user's selection intention, and the output is the selection of the best ad creative.

[1594] Step 12:

[1595] Detailed information (such as price information and supplier information) about the ad creative selected by the user is displayed on the screen. The input is the selected ad creative, and the output is the display of detailed information.

[1596] Step 13:

[1597] To complete the transaction, the user taps the "Contract" button and enters payment information, etc. The input is the information necessary for the user's transaction, and the output is confirmation that the transaction has been completed. This completes the entire advertising process.

[1598] (Application example 2)

[1599] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1600] Conventional advertising systems have the problem that searching and selecting ad slots and checking the image of the actual ad display are complicated and time-consuming.In addition, it is not possible to propose optimal ad creatives that take user emotions into consideration, making it difficult to maximize the effectiveness of advertising.

[1601] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1602] In this invention, the server includes: means for a user terminal to acquire location information and video information of an object; means for the server to search for advertising space information based on the location information; means for transmitting the acquired advertising space information to the user terminal; means for the user terminal to display the advertising space information using AR technology; means for the user to input advertising theme and brand information; means for the server to generate advertising creatives based on the theme and brand information; means for the server to transmit the generated advertising creatives to the user terminal; means for the user terminal to display the generated advertising creatives; means for the user to select advertising creatives; means for the user to confirm detailed information about the selected advertising creatives and complete a contract procedure; means for the user terminal to acquire user emotion data using a camera and microphone; and means for the server to analyze the emotion data and re-propose optimal advertising creatives based on the analysis results. This allows users to easily acquire advertising space information, making it easier to get a concrete idea of ​​advertising placements, and the introduction of an emotion engine makes it possible to select advertising creatives that suit the user's emotions.

[1603] A "user terminal" is a mobile phone, smartphone, tablet, or other mobile device operated by a user.

[1604] "Object" refers to a location or physical structure where a user wishes to place, display, or view an advertisement.

[1605] "Location Information" means the geographic latitude, longitude, and altitude data of an object obtained using GPS, Wi-Fi, beacons, or other technologies.

[1606] "Video information" refers to image or video data captured using the camera function of a user terminal.

[1607] A "server" is a computer system that receives, transmits, and processes data, and in the present invention searches for advertising space information, generates creative content, and analyzes emotional data.

[1608] An "ad inventory" is a physical or digital space in which an advertisement is displayed, with attributes such as location, price, and availability dates and times.

[1609] "AR technology" stands for augmented reality technology, which is a technology that displays virtual information overlaid on real-world images.

[1610] "Theme" refers to the content, concept, or subject matter of the event or campaign being advertised.

[1611] "Brand information" includes information such as the brand name, logo, corporate philosophy, and color scheme promoted by the advertisement.

[1612] "Advertising creative" refers to the visual or audio advertising materials, such as the advertisement design, text, images, and video.

[1613] "Emotion data" is data of emotions such as joy, surprise, and discomfort, obtained by analyzing the user's facial expressions, voice, and body movements.

[1614] An "emotion engine" is software or hardware that uses a camera or microphone to analyze a user's emotions in real time.

[1615] "Optimal advertising creative" refers to advertising creative selected based on user emotional data in order to maximize user satisfaction.

[1616] This invention combines a system that allows users to easily search for outdoor advertising contractors and prices, and visually confirm what the ad will look like after it is placed using AR and AI technology, with an emotion engine that recognizes the user's emotions.

[1617] First, a user uses a smartphone to implement the invention. The user launches the application and points the smartphone camera at the location where they want to place an advertisement. At this time, the user's device acquires the location information and image information of the target object. The location information is obtained using GPS and Wi-Fi data, and the image information is acquired by the smartphone's built-in camera.

[1618] The acquired location information and video information are sent to a server. The server uses the location information to search a database for information on the corresponding ad slot. This information includes the location of the ad slot, price, available dates and times, and contractor information. The server then sends this information to the user's device.

[1619] The user device then displays the received ad space information using AR technology. Specifically, ARCore (for Android) or ARKit (for iOS) is used to overlay virtual ad space onto local video, allowing the user to see the ad as if it were actually being displayed.

[1620] Next, the user enters the ad theme and brand information within the app. This information is sent to a server, which uses a generative AI model to generate multiple ad creatives. The generated ad creatives are then sent from the server to the user's device, where they are displayed. At this time, the user's device runs an emotion engine, which uses the camera and microphone to analyze the user's facial expressions and voice to obtain emotional data. This emotion analysis uses technologies such as Microsoft Azure Cognitive Services and Affectiva.

[1621] The server analyzes the emotional data and, based on the results, re-proposes the most appropriate ad creative. The user can scroll through multiple ad creatives and analyze the emotional response to each, which will then suggest a design optimized for that emotion. Once the user selects the most suitable ad creative, detailed information, contractor information, and pricing information are displayed. Finally, the user completes the contract process and enters payment information to complete the ad placement procedure.

[1622] Specific examples

[1623] For example, consider the case where a user wants to place an advertisement on the wall of a building. The user points their smartphone camera at the building and the app switches to AR mode. When the user sends their location information, the server searches for the corresponding ad space information and sends it back to the user's device. The user checks the virtual ad space in AR and enters "Summer Sale" as the advertising theme. The server uses a generative AI model to generate multiple "Summer Sale" themed ad creatives and displays them on the user's device. The emotion engine analyzes the user's facial expressions and suggests the most suitable design. The user selects the most suitable design and the transaction process is completed.

[1624] Prompt Sentence Examples

[1625] "Generate an effective ad design for a big summer sale. The theme colors are blue and yellow, and the target audience is young people in their 20s and 30s."

[1626] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1627] Step 1:

[1628] The user starts up their smartphone and launches the application. Using the camera on the user's device, they hold it over the location where they want to place the ad, and obtain location information (GPS) and video information (camera images).

[1629] Input: Smartphone camera image, GPS location information

[1630] Data processing / calculation: Camera image data is converted into an image format and sent to the server along with location information

[1631] Output: Location information and video data sent to the server

[1632] Step 2:

[1633] Based on the location information received by the server, advertising space information (location, price, available date and time, and contractor information) is searched from the database.

[1634] Input:Location

[1635] Data processing / calculation: Performing database queries using location information

[1636] Output: Ad space information

[1637] Step 3:

[1638] The server sends the ad space information to the user's device, which then uses AR technology to overlay the received ad space information on the camera image.

[1639] Input: Ad space information

[1640] Data processing / computation: Rendering virtual objects using ARCore or ARKit

[1641] Output: Ad space overlaid on the user's device

[1642] Step 4:

[1643] The user enters the advertising theme and brand information within the app and sends it to the server.

[1644] Input: Theme information, brand information

[1645] Data processing / calculation: Sending input form data

[1646] Output: Theme and branding information sent to the server

[1647] Step 5:

[1648] The server uses a generative AI model to generate multiple ad creatives based on the input theme and brand information.

[1649] Input: Theme information, brand information

[1650] Data processing / computation: Generating ad creative using generative AI models (TensorFlow or PyTorch)

[1651] Output: Ad creative

[1652] Step 6:

[1653] The server transmits the generated advertising creatives to the user terminal, which displays them.

[1654] Input: Ad creative

[1655] Data processing / calculation: Displaying advertising creatives in the user interface

[1656] Output: Ad creative displayed on user device

[1657] Step 7:

[1658] The user device uses a camera and microphone to capture the user's facial expressions and voice, and analyzes the emotional data.

[1659] Input: User's facial expression data, voice data

[1660] Data processing / calculation: Sentiment analysis using an emotion engine (Microsoft Azure Cognitive Services or Affectiva)

[1661] Output: Parsed emotion data

[1662] Step 8:

[1663] The server receives the emotional data and, based on the analysis results, selects and re-proposes the most appropriate advertising creative.

[1664] Input: Emotion data, ad creative

[1665] Data processing / calculation: Feedback and regeneration of advertising creatives based on emotional data

[1666] Output: Optimized ad creative suggestions

[1667] Step 9:

[1668] The user selects the most suitable advertising creative, checks its details, contractor information, and price information, and then completes the contract procedure.

[1669] Input: Best ad creative, details

[1670] Data processing / calculation: Confirmation of selected data and transaction processing

[1671] Output: Contract procedure completed, advertising procedure completed

[1672] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1673] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1674] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1675] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1676] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1677] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1678] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1679] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1680] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1681] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1682] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1683] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1684] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1685] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1686] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1687] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1688] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1689] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1690] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1691] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1692] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1693] The following is further disclosed regarding the above embodiment.

[1694] (Claim 1)

[1695] A means for a user terminal to acquire location information and image information of an object;

[1696] A means for a server to search for information on an advertisement frame based on the location information;

[1697] a means for transmitting the advertisement space information acquired by the server to the user terminal;

[1698] a means for displaying the advertising space information by the user terminal using AR technology;

[1699] A means for the user to input advertising theme and brand information;

[1700] A means for the server to generate advertising creatives based on the theme and brand information;

[1701] A means for transmitting the generated advertising creative to the user terminal by the server;

[1702] a means for displaying the generated advertising creative on the user terminal;

[1703] means for the user to select an advertising creative;

[1704] a means for confirming detailed information about the advertising creative selected by the user and completing a contract procedure;

[1705] A system including:

[1706] (Claim 2)

[1707] 2. The system according to claim 1, wherein the advertising space information includes price information and outsourcing information.

[1708] (Claim 3)

[1709] 2. The system according to claim 1, wherein the generated advertising creative includes multiple variations, which the user can compare and consider.

[1710] "Example 1"

[1711] (Claim 1)

[1712] A means for a user terminal to acquire location information and image information of an object;

[1713] A means for a server to search for information on an advertisement frame based on the location information;

[1714] a means for transmitting the advertisement space information acquired by the server to the user terminal;

[1715] a means for displaying the advertising space information by the user terminal using AR technology;

[1716] A means for the user to input advertising theme and brand information;

[1717] A means for the server to generate advertising creatives using a generative AI model based on the theme and brand information;

[1718] A means for transmitting the generated advertising creative to the user terminal by the server;

[1719] a means for displaying the generated advertising creative on the user terminal;

[1720] means for the user to select an advertising creative;

[1721] a means for confirming detailed information about the advertising creative selected by the user and completing a contract procedure;

[1722] A system including:

[1723] (Claim 2)

[1724] 2. The system according to claim 1, wherein the advertising space information includes price information and outsourcing information.

[1725] (Claim 3)

[1726] 2. The system according to claim 1, wherein the generated advertising creative includes multiple variations, which the user can compare and consider.

[1727] "Application Example 1"

[1728] (Claim 1)

[1729] A means for a user terminal to acquire location information and image information of an object;

[1730] A means for a server to search for information on an advertisement frame based on the location information;

[1731] a means for transmitting the advertisement space information acquired by the server to the user terminal;

[1732] a means for displaying the advertising space information by the user terminal using AR technology;

[1733] A means for the user to input advertising theme and brand information;

[1734] A means for the server to generate advertising creatives based on the theme and brand information;

[1735] A means for transmitting the generated advertising creative to the user terminal by the server;

[1736] a means for displaying the generated advertising creative on the user terminal;

[1737] means for the user to select an advertising creative;

[1738] a means for confirming detailed information about the advertising creative selected by the user and completing a contract procedure;

[1739] a means for overlaying and displaying the advertising space information on a camera image using AR technology;

[1740] means for scrolling through and selecting the generated advertising creatives;

[1741] A system including:

[1742] (Claim 2)

[1743] 2. The system according to claim 1, wherein the advertising space information includes price information and outsourcing information.

[1744] (Claim 3)

[1745] 2. The system according to claim 1, wherein the generated advertising creative includes multiple variations, which the user can compare and consider.

[1746] "Example 2: Combining Emotion Engines"

[1747] (Claim 1)

[1748] A means for a user terminal to acquire location information and image information of an object;

[1749] A means for a server to search for information on an advertisement frame based on the location information;

[1750] a means for transmitting the advertisement space information acquired by the server to the user terminal;

[1751] a means for displaying the advertising space information by the user terminal using augmented reality technology;

[1752] A means for the user to input advertising theme and brand information;

[1753] A means for the server to generate advertising creatives using a generative AI model based on the theme and brand information;

[1754] A means for transmitting the generated advertising creative to the user terminal by the server;

[1755] A means for the user terminal to display the generated advertising creative and at the same time, a sentiment analysis engine to analyze the sentiment of the user;

[1756] a means for the server to provide feedback on advertising creatives based on the emotion data and propose optimized advertising designs;

[1757] means for the user to select an advertising creative;

[1758] a means for confirming detailed information about the advertising creative selected by the user and completing a contract procedure;

[1759] A system including:

[1760] (Claim 2)

[1761] 2. The system according to claim 1, wherein the advertising space information includes price information and outsourcing information.

[1762] (Claim 3)

[1763] 2. The system according to claim 1, wherein the generated advertising creative includes multiple variations, which the user can compare and consider.

[1764] "Application example 2 when combining emotion engines"

[1765] (Claim 1)

[1766] A means for a user terminal to acquire location information and image information of an object;

[1767] A means for a server to search for information on an advertisement frame based on the location information;

[1768] a means for transmitting the advertisement space information acquired by the server to the user terminal;

[1769] a means for displaying the advertising space information by the user terminal using AR technology;

[1770] A means for the user to input advertising theme and brand information;

[1771] A means for the server to generate advertising creatives based on the theme and brand information;

[1772] A means for transmitting the generated advertising creative to the user terminal by the server;

[1773] a means for displaying the generated advertising creative on the user terminal;

[1774] means for the user to select an advertising creative;

[1775] a means for confirming detailed information about the advertising creative selected by the user and completing a contract procedure;

[1776] means for acquiring user emotion data using a camera and a microphone in the user terminal;

[1777] a means for the server to analyze the emotion data and re-propose optimal advertising creatives based on the analysis results;

[1778] A system including:

[1779] (Claim 2)

[1780] 2. The system according to claim 1, wherein the advertising space information includes price information and outsourcing information.

[1781] (Claim 3)

[1782] 2. The system according to claim 1, wherein the generated advertising creative includes multiple variations, which the user can compare and consider. [Explanation of symbols]

[1783] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. A means for a user terminal to acquire location information and image information of an object; A means for a server to search for information on an advertisement frame based on the location information; a means for transmitting the advertisement space information acquired by the server to the user terminal; a means for displaying the advertising space information by the user terminal using AR technology; A means for the user to input advertising theme and brand information; A means for the server to generate advertising creatives based on the theme and brand information; A means for transmitting the generated advertising creative to the user terminal by the server; a means for displaying the generated advertising creative on the user terminal; means for the user to select an advertising creative; a means for confirming detailed information about the advertising creative selected by the user and completing a contract procedure; A system including:

2. 2. The system according to claim 1, wherein the advertising space information includes price information and outsourcing information.

3. The system according to claim 1, wherein the generated advertising creative includes multiple variations, which the user can compare and consider.

Images