Program, recording medium, design project management device, design project management system, and design project management method

JP2026165410APending Publication Date: 2026-10-14KONICA MINOLTA INC
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2025057786
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2025-03-31
Publication Date
2026-10-14

Smart Images

  • Figure 2026165410000001_ABST
    Figure 2026165410000001_ABST
Patent Text Reader

Abstract

This invention provides a program, recording medium, design project management device, design project management system, and design project management method that can reduce the man-hours and costs associated with design production. [Solution] The program causes the computer of the design project management device 10 to function as an acquisition unit for acquiring audio data, a conversion unit for recognizing the audio data and converting it into text data, an extraction unit for extracting design requirements from the text data, an image generation control unit for generating images using an image generation AI based on the design requirements, and a display control unit for displaying the generated images on the display unit 32.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a program, a recording medium, a design project management apparatus, a design project management system, and a design project management method.

Background Art

[0002] Conventionally, a client who requests design creation often does not have a specific image in mind, and even when production is performed based on the contents of business negotiations, retakes may occur due to discrepancies in recognition, leading to increased man-hours and costs.

[0003] Accordingly, an information processing system is known, as disclosed for example in Patent Document 1, that performs speech recognition on voice data of business negotiations to convert the data into text and then executes analysis. By sharing the text-formatted contents of business negotiations with the client based on such an information processing system, it is possible to suppress the occurrence of retakes caused by discrepancies in recognition with the client.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, such an information processing system is not specialized for design creation, and merely outputs text data. Therefore, even if recognition can be shared with the client on the text level, there may be discrepancies in the image associated with the text, and retakes may still occur.

[0006] This disclosure is made in view of the circumstances described herein. Its purpose is to provide a program, recording medium, design project management device, design project management system, and design project management method that can reduce the man-hours and costs involved in design creation. [Means for solving the problem]

[0007] To solve the above problems, this disclosure provides a program, The computer for the design project management system Acquisition unit for acquiring audio data, A conversion unit that recognizes the aforementioned audio data and converts it into text data. An extraction unit that extracts requirements from the aforementioned text data, An image generation control unit that generates images using an image generation AI based on the design requirements included in the above requirements, This unit functions as a display control unit that displays the generated image on the display unit.

[0008] Furthermore, in order to solve the above problems, this disclosure provides a computer-readable recording medium, The program described in any one of claims 1 to 7 is stored.

[0009] Furthermore, in order to solve the above problems, this disclosure provides a design project management device, An acquisition unit that acquires audio data, A conversion unit that recognizes the aforementioned audio data and converts it into text data, An extraction unit that extracts requirements from the aforementioned text data, An image generation control unit that generates an image using an image generation AI based on the design requirements included in the above requirements, The system includes a display control unit that displays the generated image on a display unit.

[0010] Furthermore, in order to solve the above problems, this disclosure provides a design project management system, The design project management device according to claim 9, an image generation server that causes the image generation AI to generate a generated image, and a user terminal comprising a sound collection unit that converts audio into audio data and a display unit that displays the generated image.

[0011] Further, to solve the above problems, the present disclosure relates to a design project management method performed by a computer of a design project management apparatus, the method comprising: an audio acquisition step of acquiring audio data; a conversion step of recognizing the audio data and converting it into text data; an extraction step of extracting requirements from the text data; an image generation step of causing an image generation AI to generate a generated image based on the design requirements included in the requirements; and a display step of displaying the generated image on a display unit. [Advantageous Effects of the Invention]

[0012] According to the present disclosure, it is possible to reduce the man-hours and costs associated with design production. [Brief Description of the Drawings]

[0013] [Figure 1] This is a block diagram of a design project management system. [Figure 2] This is a flowchart of a design project management process. [Figure 3] This is a screen example of an image generation screen. [Figure 4] This is a screen example of an image generation screen. [Figure 5] This is a screen example of a generation condition setting screen. [Figure 6] This is a screen example of a generation condition setting screen. [Figure 7] This is a screen example of a generation condition setting screen. [Figure 8] This is a screen example of an image generation screen. [Figure 9] This is a screen example of an image generation screen. [Figure 10]This is an example of a report. [Modes for carrying out the invention]

[0014] The embodiments of this disclosure will be described below with reference to the drawings. However, the scope of this disclosure is not limited to those described in the following embodiments and drawings.

[0015] [Design Project Management System] Figure 1 is a block diagram showing the functional configuration of the design project management system (hereinafter referred to as "the system") 100. As shown in Figure 1, the system 100 comprises a design project management device (hereinafter referred to as "device") 10, an image generation server (hereinafter referred to as "server") 20, and a user terminal (hereinafter referred to as "terminal") 30. The device 10, server 20, and terminal 30 send and receive information via a communication network 40. The communication network 40 is a LAN (Local Area Network), WAN (Wide Area Network), or the Internet, etc.

[0016] (Design project management system) The device 10 performs various processes related to design project management based on operation instructions received from the terminal 30. The device 10 comprises a control unit 11, a display unit 12, an operation input unit 13, a communication unit 14, and a storage unit 15.

[0017] {control unit} The control unit 11 is composed of a CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), etc. The CPU of the control unit 11 reads various programs stored in the memory unit 15, loads them into the RAM, executes various processes according to the loaded programs, and controls the operation of each part of the device 10.

[0018] <Acquisition part> In particular, the control unit 11 functions as an acquisition unit that acquires audio data of business negotiations with clients that generate images from the terminal 30, as well as user operation data. Specifically, the acquisition unit receives instructions for setting the client to generate images and instructions for setting the conditions for generating those images.

[0019] <Conversion section> Furthermore, the control unit 11 functions as a conversion unit that converts acquired voice data and operation data into text data. As a conversion unit, the control unit 11 converts voice data into text data using, for example, a dictionary database stored in the storage unit 15. Also, as a conversion unit, the control unit 11 converts user operation data from the operation input unit 33, described later, on the image generation screen 51, described later, into text data using known log recording software or a JavaScript® library, etc.

[0020] <Extraction part> Furthermore, the control unit 11 functions as an extraction unit that extracts requirements from text data. As an extraction unit, the control unit 11 obtains text data from the conversion unit and uses natural language processing programs such as syntactic analysis programs and morphological analysis programs, as well as LLM (Large Language Model), to extract various requirements.

[0021] The requirements extracted by the extraction department can be broadly divided into two categories: design requirements and meeting requirements. Design requirements include the request overview, purpose, goals, selling points, media to which competitive information will be applied, target products, target audience, concept, style, number of pages, number of copies, whether or not bleed is required, processing details, and paper preferences. Meeting requirements include the deadline, delivery destination, and schedule.

[0022] <Image generation control unit, style generation unit> Furthermore, the control unit 11 functions as an image generation control unit that causes the server 20 to generate generated images based on generation conditions, based on user operation instructions. In addition, the control unit 11 functions as a style generation unit that causes the learning model 153 (described later) to generate style data corresponding to the client based on the contents stored in the storage unit 15.

[0023] <Learning Department> Furthermore, the control unit 11 functions as a learning unit that learns the selection trends of generation conditions set when generating generated images for each client, based on the contents stored in the output management table 1512, which will be described later. For example, the learning unit refers to a record in the output management table 1512 that includes a predetermined client and stores the generation conditions that have been selected a predetermined number of times and / or a predetermined percentage or more in the storage unit 15, associating them with that client.

[0024] <Display Control Section> Furthermore, the control unit 11 functions as a display control unit that displays various screens for executing design project management processing, including the generation of generated images, on the display unit 32 of the terminal 30, which will be described later. At this time, the display control unit controls the display content of the display unit 32 so that the generation conditions for generating generated images differ for each client.

[0025] <Report generation and sending departments> Furthermore, the control unit 11 functions as a report generation unit that generates report 52 (see Figure 10) based on the requirements extracted by the extraction unit. The control unit 11 also functions as a sending unit that sends the generated report 52 or information related to report 52 to the client. The design project management process and report 52 will be described later.

[0026] {Display section} The display unit 12 is composed of a monitor such as an LCD (Liquid Crystal Display) and displays various screens, etc., according to the instructions of the display signals input from the control unit 11.

[0027] {Operation Input Section} The operation input unit 13 includes a keyboard equipped with cursor keys, number input keys, various function keys, a pointing device such as a mouse, and a touch panel laminated on the surface of the display unit 12. The operation input unit 13 is configured to be operable by the operator. The operation input unit 13 also outputs various signals to the control unit 11 based on the operations performed by the operator.

[0028] {Communications Department} The communication unit 14 is capable of sending and receiving various signals and data with other devices connected via the communication network 40.

[0029] {Storage section} The storage unit 15 is composed of non-volatile semiconductor memory or a hard disk, and stores various programs executed by the control unit 11, parameters necessary for program execution, and various data. The storage unit 15 includes a database 151, an image storage area 152, and a learning model 153.

[0030] <database> Database 151 stores various types of information related to the design project management process in a searchable format. Database 151 includes, for example, a project management table 1511, an output management table 1512, an option management table 1513, and a learning management table 1514.

[0031] The deal management table 1511 stores data related to each business negotiation. The deal management table 1511 stores the client name of the negotiation, the path to the generated image, the concept, the date and time of the negotiation, the last update date and time, and the text data generated during the negotiation, all linked together. As will be described later, the text data generated during the negotiation includes operational data related to feedback on the generated image.

[0032] The output management table 1512 stores the generation conditions for each generated image. The output management table 1512 stores the client name that generated the image, the path to the generated image, and the settings for each generation condition, all linked together.

[0033] The option management table 1513 stores the client name and the display settings for the generation options described later, linked together. The learning management table 1514 stores the client name, keyword (style name), path to the training image, and style data, linked together. The contents stored in the option management table 1513 and the learning management table 1514 can be added, modified, and deleted at any time by the user.

[0034] <Image storage area> The image storage area 152 stores generated images that the image generation control unit has generated on the server 20, as well as training images received from the terminal 30, etc.

[0035] <Learning Model> A learning model 153 is provided for each client. The learning model 153 uses the generated images for each client stored in the image storage area 152 and the operation data related to feedback on the generated images stored in the case management table 1511 as training data to generate style data for that client. The learning model 153 may be a regression model such as polynomial regression, multiple regression, support vector regression, or random forest regression. The learning model 153 may also be another model such as a neural network. Furthermore, the learning model 153 may be further trained with generated images generated after the generation of style data or with training images stored in the image storage area 152, according to instructions from the style generation unit.

[0036] Furthermore, the memory unit 15 stores a web server program, application programs, and the like. The web server program communicates with a web browser or program installed on the terminal 30 using the HTTP protocol, etc., to provide a website for using the design project management system 100, thereby realizing the function of a web server. The application programs run on the web server and perform various processes. In addition, the memory unit 15 stores natural language processing programs and LLMs used by the conversion unit.

[0037] (Image generation server) Server 20 functions as an image generation AI and generates images. Server 20 comprises a control unit 21, a communication unit 22, and a storage unit 23.

[0038] {control unit} The control unit 21 is composed of a CPU, RAM, ROM, etc. The CPU of the control unit 21 reads various programs stored in the memory unit 23, loads them into the RAM, executes various processes according to the loaded programs, and controls the operation of each part of the server 20.

[0039] The control unit 21 generates prompts based on data acquired from the device 10 using a text generation AI. The control unit 21 also generates generated images from the prompts using an image generation AI. Details regarding the image generation process will be described later.

[0040] Examples of text generation AI include ChatGPT, Bard, Gemini, and Bloom. Examples of image generation AI include Stable Diffusion, DALL·E2, Midjourney, starryai, and Dream by WOMBO. However, image and text generation AI are not limited to those mentioned above.

[0041] {Communications Department} The communication unit 22 is configured to send and receive various signals and data with other devices connected via the communication network 40.

[0042] {Storage section} The storage unit 23 is composed of non-volatile semiconductor memory, a hard disk, or the like. The storage unit 23 stores various programs executed by the control unit 11, parameters necessary for program execution, and various data.

[0043] (User terminal) Terminal 30 inputs and outputs various types of data to the design project management system 100. It is preferable for the user to bring Terminal 30 to client meetings and display generated images immediately based on the content of the meeting (voice data). Therefore, Terminal 30 is preferably a mobile device such as a smartphone, tablet, or notebook PC. However, if the user and client conduct the meeting remotely, Terminal 30 may be a fixed-type terminal such as a desktop PC. Terminal 30 comprises a control unit 31, a display unit 32, an operation input unit 33, a communication unit 34, and a storage unit 35.

[0044] {control unit} The control unit 31 is composed of a CPU, RAM, ROM, etc. The CPU of the control unit 31 reads various programs stored in the memory unit 35, loads them into the RAM, executes various processes according to the loaded programs, and controls the operation of each part of the terminal 30.

[0045] {Display section} The display unit 32 is comprised of a monitor such as an LCD, and displays various screens and the like according to the instructions of the display signals input from the control unit 31.

[0046] {Operation Input Section} The operation input unit 33 includes a keyboard equipped with cursor keys, number input keys, various function keys, a pointing device such as a mouse, and a touch panel laminated on the surface of the display unit 32. In particular, the operation input unit 33 includes a sound collection unit 331 such as a microphone that acquires audio data during business negotiations between the user and the client. The operation input unit 33 is configured to be operable by the operator. The operation input unit 33 also outputs various signals to the control unit 31 based on the operations performed by the operator.

[0047] The communication unit 34 is capable of sending and receiving various signals and data with other devices connected via the communication network 40.

[0048] The storage unit 35 is composed of non-volatile semiconductor memory, a hard disk, or the like. The storage unit 35 stores various programs executed by the control unit 11, parameters necessary for program execution, and various data.

[0049] [Design project management process] The design project management process in this design project management system 100 will be explained with the flowchart in Figure 2 and the example screens and screen transitions in Figures 3 to 10. First, when a user of terminal 30 enters a specific URL, represented by the IP information of device 10, into a web browser, the display control unit displays a predetermined login screen on the display unit 32 to perform login authentication. Upon successful login authentication, the display control unit displays a project list screen based on the contents stored in the project management table 1511 and accepts project selection or creation of a new project.

[0050] When a new project is requested, the display control unit of the device 10 displays an image generation screen 51, as shown in Figure 3, on the display unit 32 of the terminal 30. The user enters the client name ("AA Company") in the client input field 511. The acquisition unit of the device 10 acquires the client settings (step S101).

[0051] The user then issues a command to start recording and begins the business negotiation with the client. The control unit 31 of the terminal 30 converts the audio of the negotiation collected by the sound collection unit 331 into audio data. The communication unit 34 then transmits the audio data to the device 10.

[0052] The acquisition unit of the device 10 acquires voice data from the terminal 30 (step S102; voice acquisition step). Once the acquisition unit acquires the voice data, the conversion unit converts the voice data into text data (step S103; conversion step). The display control unit displays the converted text data on the negotiation memo display unit 512 of the image generation screen 51, as shown in Figure 4. The extraction unit then extracts requirements from the text data (step S104; extraction step). The display control unit displays the design requirements in the design requirements column 513, as shown in Figure 4, from among the requirements extracted by the extraction unit.

[0053] Furthermore, if the volume of user and client feedback is insufficient, or if the content of the design requirements extracted by the extraction unit does not match the actual content of the business negotiation, the content displayed in the design requirements field 513 may be changed as appropriate by the user's operation input unit 33 of the terminal 30.

[0054] When the device 10 receives instructions from the user to set generation conditions, the display control unit displays a generation condition setting screen 515, as shown in Figure 5, on the display unit 32 of the terminal 30. At this time, the display control unit displays only the generation options and keywords (style names) to be displayed on the generation condition setting screen 515, making them selectable by the user (step S105).

[0055] For example, the display control unit of device 10 refers to the record in the option management table 1513 where the client name is "AA Company" based on the client settings. The display control unit then displays only the generation options that are set to be displayable in that record, making them available for selection by the user on the generation condition setting screen 515.

[0056] More specifically, let's assume that in the record where the client name in the option management table 1513 is "AA Company", the generation option "High Quality" is set to be displayable. In this case, as shown in Figure 6, "High Quality" is displayed and set in the output mode setting field of the generation condition setting screen 515. On the other hand, let's assume that in the record where the client name in the option management table 1513 is "AA Company", "High Quality" is set to be hidden. In this case, as shown in Figure 7, "High Quality" is hidden and set in the output mode setting field of the generation condition setting screen 515.

[0057] Some clients may request a reduction in design fees if the AI ​​generates high-quality designs automatically. To mitigate this, it's possible to prevent such requests by pre-configuring the system to only display low-quality design options, such as line drawings or rough sketches, rather than the output mode that produces high-quality designs.

[0058] Furthermore, the display control unit of the device 10 refers to the record in the learning management table 1514 where the client name is "AA Company" and displays only the relevant style data on the generation condition setting screen 515 so that it can be selected.

[0059] For example, when creating separate designs for multiple different clients, using AA's style data to create BB's design is undesirable because it could unintentionally lead to design leaks. On the other hand, this risk can be avoided by making style data for specific clients only available for those specific clients.

[0060] The user inputs (selects) generation conditions such as output mode (generation options), output style, image style data, aspect ratio, composition, color tone, and target area, as well as setting reference images, on the generation condition setting screen 515. At this time, the display control unit of the device 10 may save the user the trouble of making selections by initially setting the generation conditions according to the client in each selection field of the generation condition setting screen 515 based on the learning results of the learning unit as described above.

[0061] The control unit 11 determines whether or not an image generation instruction has been received from the terminal 30 by operating the image generation button 514 on the image generation screen 51 (step S106). If no image generation instruction has been received (step S106; No), the process proceeds to step S102, and the business negotiation continues. If an image generation instruction has been received (step S106; Yes), the acquisition unit of the device 10 acquires the generation conditions for the generated image based on the settings on the generation condition setting screen 515 (step S107). The image generation control unit of the device 10 then sends the design requirements, reference image, and generation conditions to the server 20 to generate the generated image (step S108; image generation step). In detail, the control unit 21 of the server 20 causes the text generation AI to generate a prompt based on the design requirements, generation conditions, and reference image acquired from the device 10, and uses this prompt to cause the image generation AI to generate the generated image.

[0062] When the server 20 generates an image, the display control unit of the device 10 displays the generated image on the display unit 32 of the terminal 30, as shown in Figure 8 (step S109; display step). The user presents the generated image displayed on the display unit 32 to the client and receives feedback on the generated image from the client. The user then inputs the received feedback as operation data using the operation input unit 33 of the terminal 30. The feedback received from the client is not limited to simple evaluations of the quality of the generated image, but also includes, for example, requests to adjust or change the priority of the design elements that formed the basis of the generated image, or requests to add text or images.

[0063] The acquisition unit of the device 10 acquires operation data from the terminal 30 (step S110). When the conversion unit acquires operation data from the terminal 30, it converts the operation data into text data, similar to audio data (step S111). The display control unit then displays the converted text data on the negotiation memo display unit 512 of the image generation screen 51, as shown in Figure 9. As shown in Figure 9, by converting audio data and operation data into text data in chronological order, the history of the negotiation can be accurately reproduced. Note that the operation data that the conversion unit converts into text data is not limited to data related to feedback on the generated image.

[0064] The control unit 11 determines whether the report generation button 516 on the image generation screen 51 has been operated and whether a report generation instruction has been received from the terminal 30 (step S112). If the negotiation has not ended and no report generation instruction has been received (step S112; No), the process proceeds to step S102 and the negotiation continues. If the negotiation has ended and a report generation instruction has been received (step S112; Yes), the report generation unit generates a report 52 as shown in Figure 10 based on the requirements extracted by the extraction unit (step S113).

[0065] Report 52 is an output file that summarizes the contents of a business negotiation by placing the text data, which is the result of the extraction of requirements and operation data extracted by the extraction unit, into pre-set locations. For example, in Report 52 shown in Figure 10, "[Project Objective / Concept]" and "[Production / Specification Information]" are fields where design requirements are placed in their respective designated locations. Also, "[Image Selection Information]" is a field where each generated image is placed in its designated location based on the text data of the operation data for feedback on each generated image. Furthermore, "[Delivery Schedule]" is a field where meeting requirements are placed in their respective designated locations.

[0066] If the content of the generated report 52 does not match the content of the business negotiation, the user may correct the output content in the business negotiation memo display unit 512 by operating the operation input unit 33 of the terminal 30, and then regenerate the report 52 by operating the report generation button 516 again. Alternatively, the user may appropriately correct the output content of the report 52 by operating the operation input unit 33.

[0067] Once the user completes report 52, they operate the report submission button 521. Upon receiving the operation of the report submission button 521, the submission unit sends report 52 or the information related to report 52 to the client (step S114).

[0068] For example, the sending unit sends report 52 to the client in a predetermined file format (such as a PDF file or spreadsheet). Alternatively, the sending unit sends the client information related to report 52, such as a URL where report 52 can be viewed or a URL to an uploader where the report in the predetermined file format has been uploaded. The control unit 11 also stores the data of the business deal in the case management table 1511 of the storage unit 15.

[0069] [Effects of the Embodiment] As described above, the program according to this embodiment causes the computer of the device 10 to function as an acquisition unit for acquiring audio data, a conversion unit for recognizing audio data and converting it into text data, and an extraction unit for extracting requirements from the text data. The program also functions as an image generation control unit that generates generated images using an image generation AI based on the design requirements included in the requirements, and a display control unit that displays the generated images on the display unit 32. With this configuration, it is possible to generate generated images based on the audio data of business negotiations, and by displaying them on the display unit 32, the user and the client can share an image, thereby suppressing the occurrence of discrepancies and reducing the man-hours and costs related to design production.

[0070] Furthermore, the conversion unit converts audio data into text data using natural language processing or LLM. This configuration enables real-time, high-precision conversion.

[0071] Furthermore, the conversion unit recognizes the user's operation data when acquiring audio data and converts it into text data along with the audio data. This configuration allows for greater reproducibility of business negotiations based on text data.

[0072] Furthermore, the program causes the computer of device 10 to function as a report generation unit that generates report 52 based on requirements. This configuration reduces the amount of work required for the user to reorganize the sales negotiation details from text data.

[0073] Furthermore, the operation data includes the user's input of evaluations of the generated images, and the report generation unit generates a report 52 that includes the evaluations. With this configuration, the client's evaluation of the generated images becomes clear and can be effectively utilized in design production after the business negotiation.

[0074] Furthermore, the report generation unit generates a report 52 that classifies the generated images for each evaluation. This configuration makes the evaluation of each generated image clearer.

[0075] Furthermore, the program includes a sending unit that sends report 52 or information related to report 52 to the client via the computer of device 10. This configuration makes it easier to align understanding and image with the client.

[0076] [Other configurations] The above description has been based on embodiments relating to this disclosure, but this disclosure is not limited to the embodiments described above. It goes without saying that this disclosure is subject to various modifications, including the scope of the invention as described in the claims and its equivalents.

[0077] For example, the above example illustrates a case where device 10 is a physical device and server 20 is a cloud server, but it is not limited to this, and the reverse is also possible. Furthermore, the above example illustrates a configuration in which the design project management system 100 consists of three devices: device 10, server 20, and terminal 30, but it is not limited to this.

[0078] Furthermore, while the above example illustrates a case where the conversion unit of device 10 converts audio data acquired during a business negotiation into text data in real time, it is not limited to this. For example, the conversion unit may convert audio data recorded during a business negotiation into text data.

[0079] Furthermore, while examples of using hard disks and semiconductor non-volatile memory as computer-readable media for the program related to this disclosure have been disclosed above, the disclosure is not limited to these examples. Portable recording media such as CD-ROMs can also be used as other computer-readable media. In addition, carrier waves can be used as a medium for providing the data of the program related to this disclosure via a communication line. [Explanation of symbols]

[0080] 100 Design Project Management System 10. Design Project Management System 11 Control Unit (Acquisition Unit, Conversion Unit, Extraction Unit, Image Generation Control Unit, Display Control Unit, Report Generation Unit, Sending Unit) 20 Image generation servers 30 user terminals 32 Display section 331 Sound collection section 52 Reports

Claims

1. The computer for the design project management system Acquisition unit for acquiring audio data, A conversion unit that recognizes the aforementioned audio data and converts it into text data. An extraction unit that extracts requirements from the aforementioned text data, An image generation control unit that generates an image using an image generation AI based on the design requirements included in the above requirements, A program that functions as a display control unit that displays the generated image on the display unit.

2. The program according to claim 1, wherein the conversion unit converts the audio data into text data by natural language processing or LLM.

3. The program according to claim 1, wherein the conversion unit recognizes user operation data at the time of acquiring the voice data and converts it into text data in combination with the voice data.

4. The computer for the design project management system The program according to claim 3, which functions as a report generation unit that generates a report based on the above requirements.

5. The aforementioned operation data includes the user's input operation for evaluating the generated image, The program according to claim 4, wherein the report generation unit generates the report including the evaluation.

6. The program according to claim 5, wherein the report generation unit generates a report classifying the generated images generated for each evaluation.

7. The computer for the design project management system The program according to claim 4, which functions as a sending unit that sends the aforementioned report or information relating to the aforementioned report to a client.

8. A computer-readable recording medium storing a program as described in any one of claims 1 to 7.

9. An acquisition unit that acquires audio data, A conversion unit that recognizes the aforementioned audio data and converts it into text data, An extraction unit that extracts requirements from the aforementioned text data, An image generation control unit that generates an image using an image generation AI based on the design requirements included in the above requirements, A design project management device comprising a display control unit that displays the generated image on a display unit.

10. The design project management device according to claim 9, An image generation server that causes the aforementioned image generation AI to generate images, A design project management system comprising a user terminal equipped with a sound collection unit that converts sound into audio data and a display unit that displays the generated image.

11. A computer-based design project management method for a design project management device, The audio acquisition step involves acquiring audio data, A conversion step of recognizing the aforementioned audio data and converting it into text data, An extraction step to extract requirements from the aforementioned text data, An image generation step in which an image generation AI generates an image based on the design requirements included in the above requirements, A design project management method comprising a display step of displaying the generated image on a display unit.

Citation Information

Patent Citations

  • Information processing device, information processing method, and program

    JP2021120709A