Information processing device, information processing method, and information processing program

Abstract

To support a color blind person.SOLUTION: An information processing device 100 includes an acquisition unit 131, a generation unit 133, and an output unit 135. The acquisition unit 131 obtains image data. The generation unit 133 generates image data whose color has been changed and to which text has been added, by using a first learned model that outputs image data whose color has been changed and to which text for calling attention has been added according to an input of image data, with an input of the image data obtained by the acquisition unit 131. The output unit 135 outputs the image data generated by the generation unit 133.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] Conventionally, there are known techniques for supporting people with color vision deficiency by using different colors to represent colors that are difficult for people with color vision deficiency to recognize. For example, there is a technique (for example, Patent Document 1) for outputting a plurality of display areas so that each area can be distinguished and recognized by both people with color vision deficiency and people with normal color vision. There is also a technique (for example, Patent Document 2) for converting an image so that pairs of different types of colors that are perceived as the same by people with color vision deficiency can be distinguished, and displaying the converted image on a head-mounted display. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2023-121480 [Patent Document 2] Japanese Patent Application Laid-Open No. 2016-105555 Summary of the Invention [Problem to be solved by the invention]

[0004] However, conventional technologies may not be able to support people with color vision deficiencies. For example, conventional technologies may only change the color without properly alerting people to situations involving the changed color. For example, people with type 1 color vision deficiency may miss red traffic lights or road signs that use red because a color that attracts attention, such as red, is changed to a less eye-catching color.

[0005] The present invention has been made in view of the above, and has an object to provide an information processing device, an information processing method, and an information processing program that support people with color vision deficiency. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the object, the information processing device of the present invention is characterized by having an acquisition unit that acquires image data, a generation unit that uses the image data acquired by the acquisition unit as input and generates image data in which the color of the image data has been changed and text has been added using a trained model that outputs image data in which the color has been changed and attention-grabbing text has been added in accordance with the image data input, and an output unit that outputs the image data generated by the generation unit. [Effects of the Invention]

[0007] According to the present invention, it is possible to support people with color vision deficiency. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of the configuration of the information processing device according to the embodiment. [Figure 3] FIG. 3 is a diagram illustrating an example of information stored in a target information storage unit according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of information stored in a text information storage unit according to the embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of a generation process performed by the generation unit according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of an output process by the output unit according to the embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of an output process by the output unit according to the embodiment. [Figure 8]FIG. 8 is a diagram illustrating an example of processing by the information processing device according to the embodiment. [Figure 9] FIG. 9 is a flowchart showing an example of the flow of processing by the information processing device according to the embodiment. [Figure 10] FIG. 10 is a diagram illustrating an example of a computer that executes an information processing program. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, with reference to the drawings, an information processing device, an information processing method, and an information processing program according to the present application will be described in detail. Note that the present invention is not limited to these embodiments. In addition, in the description of the drawings, the same parts are denoted by the same reference numerals, and duplicated explanations will be omitted.

[0010] (Embodiment) [1. Information Processing System Configuration] An information processing system 1 shown in Fig. 1 will be described. Fig. 1 is a diagram showing an example of the configuration of the information processing system 1 according to the embodiment. As shown in Fig. 1, the information processing system 1 includes a terminal device 10 and an information processing device 100. The terminal device 10 and the information processing device 100 are connected to each other via a predetermined communication network (network N) so as to be able to communicate with each other via wired or wireless communication.

[0011] 1 is a terminal equipped with Augmented Reality (AR) technology, such as smart glasses, etc. The terminal device 10 may also be a smartphone, a tablet terminal, a notebook PC, a desktop PC, a mobile phone, a PDA, or the like.

[0012] The terminal device 10 includes a display, an imaging device, a speaker, a microphone, a vibrator, etc. For example, the terminal device 10 captures image data using the imaging device provided therein and transmits the captured image data to the information processing device 100. Furthermore, the terminal device 10 can receive output from the information processing device 100 and display an image, play audio, or vibrate.

[0013] 1 is a computer that can communicate with any terminal device 10 connected by wire or wirelessly. The information processing device 100 processes image data acquired from the terminal device 10 and outputs the processed information to the terminal device 10.

[0014] The information processing device 100 is a computer intended to support people with color vision deficiency, and may be any device as long as it can implement the processing in the embodiment.

[0015] For example, the information processing device 100 acquires image data, and generates image data in which the color of the image data has been changed and text has been added, using a trained model that uses the acquired image data as input and outputs image data in which the color of the image data has been changed and attention-grabbing text has been added in accordance with the input image data.

[0016] As a result, the information processing device 100 can change colors that are difficult for people with color vision deficiency to colors that are easy to recognize, and further add text to the image data that draws attention to the situation and display it on the terminal device 10 such as smart glasses, thereby appropriately drawing attention to people with color vision deficiency and supporting them.

[0017] In other words, the information processing device 100 can support people with color vision deficiency by displaying text that alerts them to situations involving the object whose color has been changed, in addition to the color change, thereby appropriately alerting them to the change in color vision and the dangers that may lurk in the situation in which the user is placed.

[0018] 2. Configuration of Information Processing Device Next, the configuration of the information processing device 100 will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the configuration of the information processing device 100 according to the embodiment. As shown in Fig. 2, the information processing device 100 includes a communication unit 110, a control unit 130, and a storage unit 120. Note that these units may be held in a distributed manner in multiple devices. The processing of these units will be described below.

[0019] (Communication unit 110) The communication unit 110 is realized by a NIC (Network Interface Card) or the like, and enables communication between an external device and the control unit 130 via an electric communication line such as a LAN or the Internet. For example, the communication unit 110 enables communication between the external device and the control unit 130.

[0020] (Storage unit 120) The storage unit 120 is realized by a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 120 has a user information storage unit 121, a target information storage unit 122, a text information storage unit 123, a model storage unit 124, and an image storage unit 125. Each unit of the storage unit 120 will be described below.

[0021] (User information storage unit 121) The user information storage unit 121 stores information about the user, such as the user's name, gender, age, and type and severity of color vision deficiency.

[0022] (Target information storage unit 122) The target information storage unit 122 stores information about targets for which color changes and warning text additions are to be performed. Targets for which color changes and warning text additions are to be performed include, for example, predetermined signs, predetermined traffic lights, predetermined characters, predetermined backgrounds, etc. Note that information about targets for which color changes and warning text additions are to be performed is prepared for each type and severity of color vision deficiency.

[0023] Here, the data stored in the target information storage unit 122 will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of data stored in the target information storage unit 122 according to the embodiment. As shown in Fig. 3, the target information storage unit 122 stores, for example, items of "type" and "target."

[0024] The "Type" field indicates the type of color vision deficiency. The "Target" field indicates the target for which a color change and warning text are to be added. For example, when the type is "Type 1 color vision deficiency," the target information storage unit 122 stores that "red, traffic lights that are lit red, stop road signs, ..." and the like are targets for which a color change and warning text are to be added. Note that the information stored in FIG. 3 is merely an example, and the information stored in the target information storage unit 122 is not limited to this.

[0025] (Text information storage unit 123) The text information storage unit 123 stores information about text to be added to an object to draw attention to the object. The information about text to draw attention to the object may be prepared for each type and intensity of color vision deficiency.

[0026] Here, the data stored in the text information storage unit 123 will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of data stored in the text information storage unit 123 according to the embodiment. As shown in Fig. 4, the text information storage unit 123 stores, for example, items of "target" and "text to be added."

[0027] The "target" item indicates the target for which the color is to be changed and for which a text to draw attention is to be added. The "text to add" item indicates the text to draw attention to the target.

[0028] For example, the text information storage unit 123 stores that a cautionary text "The light is red!" is to be added to a "traffic light that is red." Also, the text information storage unit 123 stores that a cautionary text "There is a stop sign!" is to be added to a "stop road sign."

[0029] On the other hand, the text information storage unit 123 stores information that no warning text is added to the “non-target red.” Note that the information stored in FIG. 4 is merely an example, and the information stored in the text information storage unit 123 is not limited to this.

[0030] (Model storage unit 124) The model storage unit 124 stores trained models and prompts. The trained models stored in the model storage unit 124 are models trained to take image data as input, change the color of the input image data, and generate an image with added text that alerts the user to a situation in the image related to the changed color. An example of a model is a generation AI.

[0031] For example, the trained model stored in the model storage unit 124 is a model that outputs image data in which the color is changed and warning text is added in response to input image data in accordance with a set prompt. Here, the model storage unit 124 can store a model that has learned the relationship between pre-change and post-change colors for each type and intensity of color vision deficiency. For example, a trained model corresponding to the type and intensity of the user's color vision deficiency is used.

[0032] (Image storage unit 125) The image storage unit 125 stores image data. For example, the image storage unit 125 acquires image data acquired by the acquisition unit 131. For example, the image storage unit 125 stores image data generated by the generation unit 133.

[0033] (control unit 130) Control unit 130 is implemented using a CPU (Central Processing Unit), NP (Network Processor), FPGA (Field Programmable Gate Array), etc., and executes processing programs stored in memory. As shown in Fig. 2, control unit 130 has an acquisition unit 131, a prompt creation unit 132, a generation unit 133, a voice creation unit 134, and an output unit 135. Each unit of control unit 130 will be described below.

[0034] (Acquisition part 131) The acquisition unit 131 acquires image data. For example, the acquisition unit 131 acquires image data captured at a predetermined interval. More specifically, the acquisition unit 131 acquires image data captured at 30 fps (frames per second). The acquisition unit 131 acquires image data captured by an imaging device provided in the terminal device 10 or an imaging device capable of communicating with the terminal device 10. The image data acquired by the acquisition unit 131 may include date and location information.

[0035] Furthermore, the acquisition unit 131 further acquires information about a target to which a color change and attention-grabbing text will be made. For example, the acquisition unit 131 acquires information about a target to which a color change and attention-grabbing text will be made by referring to the text information storage unit 123. Note that the acquisition unit 131 may acquire information about a target to which a color change and attention-grabbing text will be made by receiving input from a user.

[0036] (Prompt creation unit 132) The prompt creation unit 132 uses the information about the object acquired by the acquisition unit 131 to create a prompt that instructs the trained model to change the color of the object contained in the image data input to the trained model and add text to draw attention to it, and sets the created prompt in the trained model.

[0037] More specifically, the prompt creation unit 132 refers to the text information storage unit 123 using the information on the object acquired by the acquisition unit 131, creates a prompt that instructs the trained model to change the color of the object "a traffic light that is red" contained in the image data input to the trained model and to add the warning text "Red light!", and sets the created prompt in the trained model.

[0038] The prompt creation unit 132 may create and set a prompt that instructs the trained model to change the color and add text to draw attention only to objects for which input has been received from the user. This prevents the color of all objects in the image from being changed and text from being added, which may confuse persons with color vision deficiency, and enables the generation of image data that draws attention only to objects that the user deems necessary, thereby providing appropriate support to persons with color vision deficiency.

[0039] (Generation unit 133) The generation unit 133 receives the image data acquired by the acquisition unit 131 as input, and generates image data in which the color of the image data has been changed and text has been added, using a trained model that outputs image data in which the color has been changed and attention-grabbing text has been added in accordance with the input image data. For example, the generation unit 133 inputs the image data acquired by the acquisition unit 131 into a trained model that has learned the correspondence between the color before the change and the color after the change, and the trained model generates image data in which the color has been changed and attention-grabbing text has been added, in accordance with the set prompt.

[0040] Examples of color changes made by the model include, for example, if a person viewing the color-changed image data has type 1 color vision deficiency, changing the red area to orange, increasing the difference in brightness between the red area and adjacent areas, bordering the red area, or adding a pattern to the red area, changing the color so that the design is easy to recognize even for people with color vision deficiency.

[0041] The attention-grabbing text is text that draws the user's attention to a situation in the image related to a color change. For example, the generation unit 133 adds text such as "Red light!", "The light has turned red!", or "The traffic light is indicating a stop!" to a traffic light that is lit red.

[0042] The model used by the generation unit 133 is learned by learning the correspondence between pre-change colors and post-change colors for each type and intensity of color vision deficiency, such as protanopia, deutanopia, and tritanopia. This allows the generation unit 133 to use a trained model according to the type and intensity of color vision deficiency. For example, the generation unit 133 generates image data in which the colors of the image data have been changed and text has been added, using a trained model according to the type and intensity of the user's color vision deficiency.

[0043] Here, the generation process by the generation unit 133 will be described with reference to Fig. 5. Fig. 3 is a diagram showing an example of changing the color and adding a text to call attention, which is performed by the generation unit 133 according to the embodiment. Fig. 5(1) shows a traffic light that is lit red and a text to call attention. Fig. 5(2) shows a road sign indicating a stop and a text to call attention.

[0044] For example, the generation unit 133 receives as input image data including a "traffic light with its light on red" acquired by the acquisition unit 131, and uses a trained model that changes the color of a specific object included in the image data and adds warning text in accordance with the input image data, to generate image data in which the color of the "traffic light with its light on red" included in the image data is changed from "red" to "orange" as shown in Figure 5(1), and the warning text "Red light!" is also added.

[0045] In addition, the generation unit 133 receives image data containing a "stop sign" acquired by the acquisition unit 131 as input, and uses a trained model that changes the color of a specific sign included in the image data and adds warning text in accordance with the input image data, to generate image data in which the color of the "stop road sign" included in the image data is changed from "red" to "orange" as shown in Figure 5 (2), and the warning text "There is a stop sign!" is added.

[0046] Furthermore, the generation unit 133 receives as input image data containing the word "Danger" acquired by the acquisition unit 131, and uses a trained model that changes the color of a specific object contained in the image data and adds warning text in accordance with the input of the image data to change the color of the word "Danger" contained in the image data to an "easy-to-recognize color," and also generates image data that adds the warning text "There is a danger sign!"

[0047] (Audio Creation Unit 134) The audio creation unit 134 creates audio data that reads out the attention-calling text added to the image data. For example, the audio creation unit 134 first compares the image data acquired by the acquisition unit 131 with the image data generated by the generation unit 133 to identify the attention-calling text. Then, the audio creation unit 134 creates audio data that reads out the attention-calling text by using a speech conversion technology that converts input text into speech.

[0048] Note that the above description is an example of identifying text that calls attention by comparing the image of input data for a trained model with the output data, but the method of identification by the audio creation unit 134 is not limited to the above example, and may also be a method that applies existing character recognition technology.

[0049] (output unit 135) The output unit 135 outputs the image data. For example, the output unit 135 displays the image data generated by the generation unit 133 on the display of the terminal device 10. Note that the output unit 135 may also display the image data acquired by the acquisition unit 131 on the display of the terminal device 10.

[0050] Here, an example of output processing by the output unit 135 will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example of output processing by the output unit 135 according to the embodiment. Fig. 6 shows the field of view of a user wearing smart glasses, which are the terminal device 10, and the field of view includes the smart glasses, traffic lights, crosswalks, pedestrians, vehicles, and road signs.

[0051] For example, as shown in FIG. 6, the output unit 135 changes the red of traffic lights and stop signs to orange, adds the text "Red light!" near the traffic lights to warn people about the traffic lights, and also adds the text "There is a stop sign!" near the stop signs to warn people about the stop signs, and displays the resulting image data on the display of the terminal device 10.

[0052] As another example, the output unit 135 outputs audio data that reads out text that further calls attention. For example, the output unit 135 displays the image data generated by the generation unit 133 on the display of the terminal device 10, and also plays the audio data generated by the audio generation unit 134 through a speaker of the terminal device 10.

[0053] Here, an example of output processing by the output unit 135 will be shown using Fig. 7. Fig. 7 is a diagram showing an example of output processing by the output unit 135 according to the embodiment. Fig. 7(1) and (2) show a traffic light, a crosswalk, and a user wearing the terminal device 10. Fig. 7(1) shows a green light situation, and in the example of Fig. 7(1), there is no target for which a color change or cautionary text is to be added, so the generation unit 133 does not generate image data for which a color change or cautionary text is to be added.

[0054] 7(2) shows a situation in which the red light of the traffic light is on, and in this situation, the generation unit 133 generates image data with a change in color and with added cautionary text, and the output unit 135 displays the generated image data on the display of the terminal device 10. At this time, the output unit 135 outputs the image data and also plays, through the speaker of the terminal device 10, audio data that is generated by the audio generation unit 134 and reads out the cautionary text, "The light is red!"

[0055] For the purpose of explanation, it has been stated above that in the green light situation shown in the example of Figure 7(1), there is no target for which the generation unit 133 will change the color and add warning text. However, depending on the type of trained model used by the generation unit 133, the generation unit 133 may change the color and generate an image with warning text added in the same situation.

[0056] As another example, the output unit 135 further outputs vibration. For example, the output unit 135 displays the image data generated by the generation unit 133 on the display of the terminal device 10 and drives a vibrator mounted on the terminal device 10.

[0057] [3. Processing] Next, an example of processing realized by the information processing device 100 according to the present embodiment will be described with reference to Fig. 8. Fig. 8 is a diagram illustrating an example of processing by the information processing device 100 according to the embodiment. Fig. 8 shows an example of executing processing to change acquired image data and output it to the terminal device 10.

[0058] First, the information processing device 100 acquires image data including "a traffic light lit in red, a crosswalk, a pedestrian, a vehicle, and a stop sign" captured by an imaging device provided in the terminal device 10, and acquires information about the "traffic light lit in red, a stop sign" that is to have its color changed and warning text added and that is stored in the target information storage unit 122.

[0059] Next, the information processing device 100 uses information about the target to be changed in color and to have warning text added to create prompts such as "Change the color and add warning text 'Red light!' to the target 'Traffic light that is red'" and "Change the color and add warning text 'There is a stop sign!' to the target 'Stop sign'" that instruct the trained model to change the color and add warning text to the target included in the image data input to the trained model. Then, the information processing device 100 sets the created prompts in the trained model that generates image data.

[0060] Next, the information processing device 100, in accordance with the set prompts, inputs the acquired image data into a trained model that outputs an image with color changes and attention-grabbing text added in accordance with the input of image data, thereby changing the "red" in the "traffic light lit red" contained in the image data to "orange" and adding attention-grabbing text such as "Red light!", and also changing the "red" in the "stop sign" to "orange" and adding attention-grabbing text such as "There is a stop sign!", to generate image data.

[0061] Then, the information processing device 100 displays the image data, in which the color has been changed and the attention-grabbing text has been added, on the display of the terminal device 10.

[0062] [4. Flowchart] Next, the flow of processing by the information processing system 1 will be described with reference to Fig. 9. Note that the steps below may be executed in a different order, and some processing may be omitted.

[0063] First, the acquisition unit 131 acquires information on image data and a target to which color change and attention-grabbing text are to be performed (step S101).

[0064] Next, the prompt creation unit 132 creates a prompt that instructs the trained model to change the color of an object contained in the image data input to the trained model and add text to draw attention to it (step S102).

[0065] Next, the prompt generator 132 sets the generated prompt in the trained model (step S103).

[0066] Next, the generation unit 133 inputs the image data into the trained model (step S104).

[0067] Next, the generation unit 133 uses the trained model to generate image data in which the color of the object included in the image data has been changed and attention-grabbing text has been added (step S105).

[0068] Next, the voice creation unit 134 creates voice data for reading out the attention-grabbing text (step S106).

[0069] Then, the output unit 135 outputs the image data generated by the generation unit 133 (step S107).

[0070] At this time, the output unit 135 outputs sound and vibration (step S108). For example, the output unit 135 plays a sound that reads out the attention-grabbing text through a speaker provided in the terminal device 10, and also drives a vibrator provided in the terminal device 10.

[0071] [5. Effects] The information processing device 100 according to the embodiment includes an acquisition unit 131 that acquires image data, a generation unit 133 that uses the image data acquired by the acquisition unit 131 as input and generates image data in which the color of the image data has been changed and text has been added using a trained model that outputs image data in which the color has been changed and attention-grabbing text has been added in accordance with the input image data, and an output unit 135 that outputs the image data generated by the generation unit 133.

[0072] As a result, the information processing device 100 can change colors that are difficult for people with color vision deficiency to colors that are easy to recognize, and further add text to the image data that draws attention to the situation and display it on the terminal device 10 such as smart glasses, thereby appropriately drawing attention to people with color vision deficiency and supporting them.

[0073] In other words, the information processing device 100 can support people with color vision deficiency by displaying text that alerts them to situations involving the object whose color has been changed, in addition to the color change, thereby appropriately alerting them to the change in color vision and the dangers that may lurk in the situation in which the user is placed.

[0074] The acquisition unit 131 of the information processing device 100 according to the embodiment further acquires information about a target to be changed in color and to have warning text added, and uses the information about the target acquired by the acquisition unit 131 to create a prompt that instructs the trained model to change the color and add warning text to the target included in the image data input to the trained model, and further includes a prompt creation unit 132 that sets the created prompt in the trained model.

[0075] This allows the information processing device 100 to create prompts to set in the model using information about objects that require color changes and text additions, change the color of a specific object that is difficult for people with color vision deficiency to a color that is easy to recognize, and further display text that calls attention to the situation on the terminal device 10, adding it to the image data, thereby more appropriately supporting people with color vision deficiency.

[0076] The information processing device 100 according to the embodiment further includes an audio creation unit 134 that creates audio data for reading out the attention-grabbing text, and the output unit 135 causes the terminal device 10 to display the image data generated by the generation unit 133 and to play out the audio data for reading out the attention-grabbing text.

[0077] As a result, the information processing device 100 can, for example, play back audio data that reads out the attention-calling text, thereby preventing the attention-calling text from being overlooked and more appropriately supporting people with color vision deficiency.

[0078] The output unit 135 of the information processing device 100 according to the embodiment displays the image data generated by the generation unit 133 on the terminal device 10, and also drives a vibrator included in the terminal device 10.

[0079] As a result, the information processing device 100 can more appropriately support people with color vision deficiency by, for example, outputting a vibration to notify the user of changes in color and warning text.

[0080] [6. Program] It is also possible to create a program written in a computer-executable language that executes the processes executed by the information processing device 100 described in the above embodiment. In this case, the same effects as those of the above embodiment can be achieved by having a computer execute the program. Furthermore, such a program may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read and executed by a computer to achieve the same processes as those of the above embodiment.

[0081] Fig. 10 is a diagram showing an example of a computer that executes an information processing program. As shown in Fig. 10, a computer 1000 includes, for example, a memory 1010, a CPU 1020, a hard disk drive interface 1030, a disk drive interface 1040, a serial port interface 1050, a video adapter 1060, and a network interface 1070. These components are connected by a bus 1080.

[0082] The memory 1010 includes a ROM (Read Only Memory) 1011 and a RAM 1012. The ROM 1011 stores, for example, a boot program such as a BIOS (Basic Input Output System). The hard disk drive interface 1030 is connected to a hard disk drive 1090. The disk drive interface 1040 is connected to a disk drive 1100. A removable storage medium such as a magnetic disk or optical disk is inserted into the disk drive 1100. The serial port interface 1050 is connected to, for example, a mouse 1110 and a keyboard 1120. The video adapter 1060 is connected to, for example, a display 1130.

[0083] 10, the hard disk drive 1090 stores, for example, an OS (Operating System) 1091, an application program 1092, a program module 1093, and program data 1094. The tables described in the above embodiments are stored in the hard disk drive 1090 or memory 1010, for example.

[0084] The information processing program is stored in the hard disk drive 1090 as a program module in which instructions to be executed by the computer 1000 are written. Specifically, the hard disk drive 1090 stores a program module 1093 in which each process executed by the computer 1000 described in the above embodiment is written.

[0085] Furthermore, data used for information processing by the information processing program is stored as program data, for example, in the hard disk drive 1090. Then, the CPU 1020 reads out the program module 1093 and program data 1094 stored in the hard disk drive 1090 into the RAM 1012 as necessary, and executes each of the above-described procedures.

[0086] The program module 1093 and program data 1094 related to the information processing program are not limited to being stored in the hard disk drive 1090, but may be stored in a removable storage medium and read by the CPU 1020 via the disk drive 1100, etc. Alternatively, the program module 1093 and program data 1094 related to the control program may be stored in another computer connected via a network such as a LAN or a WAN (Wide Area Network), and read by the CPU 1020 via the network interface 1070.

[0087] [7. Other] Although various embodiments have been described in detail herein with reference to the drawings, these embodiments are merely examples and are not intended to limit the present invention. The features described herein can be realized in various ways, including various modifications and improvements based on the knowledge of those skilled in the art.

[0088] Furthermore, the above-mentioned "module (-er suffix, -or suffix)" can be read as a unit, means, circuit, etc. For example, a communication module, a control module, and a storage module can be read as a communication unit, a control unit, and a storage unit, respectively. [Explanation of symbols]

[0089] 1. Information Processing Systems 100 Information processing device 110 Communications Department 120 Storage section 121 User information storage unit 122 Target information storage unit 123 Text information storage unit 124 Model Memory Unit 125 Image storage unit 130 control section 131 Acquisition Department 132 Prompt Creation Section 133 Generation part 134 Audio Creation Department 135 Output section

Claims

1. an acquisition unit that acquires image data; A generation unit that uses the image data acquired by the acquisition unit as input and generates image data in which the color of the image data has been changed and text has been added, using a trained model that outputs image data in which the color has been changed and attention-grabbing text has been added in accordance with the input image data; and an output unit that outputs the image data generated by the generation unit; An information processing device comprising:

2. The acquisition unit further acquires information on a target to which a color change and an attention-grabbing text are to be added; a prompt creation unit that uses the information about the object acquired by the acquisition unit to create a prompt that instructs the trained model to change the color of the object included in the image data to be input to the trained model and add text to draw attention to the object, and sets the created prompt in the trained model; 2. The information processing apparatus according to claim 1, further comprising:

3. a voice generating unit that generates voice data for reading out the text that calls attention; 2. The information processing apparatus according to claim 1, wherein the output unit displays the image data generated by the generation unit on a terminal device, and reproduces the audio data generated by the audio generation unit on the terminal device.

4. The information processing apparatus according to claim 1 , wherein the output unit displays the image data generated by the generation unit on a terminal device and drives a vibrator provided in the terminal device.

5. 1. A computer-implemented information processing method, comprising: an acquisition step of acquiring image data; a generation step of generating image data in which the color of the image data has been changed and text has been added using a trained model that receives the image data acquired by the acquisition step as input and outputs image data in which the color has been changed and attention-grabbing text has been added in accordance with the input image data; an output step of outputting the image data generated by the generation step; An information processing method comprising:

6. an acquisition step of acquiring image data; a generating step of generating image data in which the color of the image data has been changed and text has been added using a trained model that receives the image data acquired by the acquiring step as input and outputs image data in which the color has been changed and attention-grabbing text has been added in accordance with the input image data; an output step of outputting the image data generated by the generating step; An information processing program characterized by causing a computer to execute the above.

Images