Information processing device, information processing method, and information processing program

The information processing device simplifies image editing by using a chatbot to analyze user messages and generate multiple edited images, addressing the inefficiencies of manual parameter adjustments and enabling quick selection of desired images.

JP7578038B2Active Publication Date: 2024-11-06KYOCERA DOCUMENT SOLUTIONS INC
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2021052813
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-03-26
Publication Date
2024-11-06
Estimated Expiration
2041-03-26

AI Technical Summary

Technical Problem

Users face challenges in efficiently editing images due to the need to repeatedly adjust parameters without knowing their effects, leading to time-consuming and effort-intensive processes.

Method used

An information processing device that utilizes a chatbot module to analyze user messages, extract key values from linguistic expressions, and generate multiple edited images based on registered parameter sets, allowing users to select and output the desired image without specifying settings.

Benefits of technology

Enables user-friendly image editing by generating and displaying multiple edited images for comparison, reducing the need for repetitive adjustments and saving time by allowing users to select images through linguistic expressions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007578038000001
    Figure 0007578038000001
  • Figure 0007578038000002
    Figure 0007578038000002
  • Figure 0007578038000003
    Figure 0007578038000003
Patent Text Reader

Abstract

To edit an image.SOLUTION: An information processing apparatus includes: a chatbot module which receives an image sent from a terminal apparatus to a chat system, and a message indicating that the image is to be edited; a message determination module which extracts a key value from the message; a database which registers a plurality of different key values, and a plurality of different parameter sets corresponding to each of the key values; and an image editing module which reads, from the database, a plurality of different parameter sets corresponding to the key value extracted from the message, and edits the image in accordance with each of the plurality of different parameter sets, thereby generating a plurality of different edited images. The chatbot module sends the plurality of different edited images to the chat system, and determines the edited image selected on the chat system by the terminal apparatus.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, an information processing method, and an information processing program that edit and output an image received from a terminal device. [Background technology]

[0002] When editing an image, the user inputs parameter values ​​for each editing item such as highlight and contrast so that the image has the user's desired brightness, etc., to obtain the desired image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-52507 A [Patent Document 2] JP 2019-207513 A Summary of the Invention [Problem to be solved by the invention]

[0004] When editing an image, in order to obtain the desired image, the user needs to know in advance the effect of the parameters for each editing item. If the user does not know this, it is time-consuming to repeatedly change and check the parameters.

[0005] In Patent Document 1, in order to prevent the user from repeatedly setting the same print settings, the user's print settings are saved in a print control device (chatbot server). In this method, the user must first set the setting values, so the user must know the items to be set.

[0006] In Patent Document 2, a chatbot asks a user about setting items, and the user registers the settings by answering the questions, but it is time-consuming to register multiple parameters.

[0007] In view of the above circumstances, an object of the present disclosure is to edit images in a more user-friendly manner. [Means for solving the problem]

[0008] An information processing device according to an embodiment of the present disclosure includes: A chatbot module that receives an image sent from a terminal device to a chat system and a message indicating that the image is to be edited; a message judgment module for extracting a key value from the message; A database for registering a plurality of different key values ​​and a plurality of different parameter sets corresponding to each of the key values; retrieving from said database a plurality of different parameter sets corresponding to said key values ​​extracted from said message; Editing the image in accordance with the plurality of different parameter sets to generate a plurality of different edited images. an image editing module; The chatbot module includes: transmitting the plurality of different edited images to the chat system; determining an edited image selected on the chat system from the terminal device; When a post indicating that the edited image is to be output, which is transmitted from the terminal device to the chat system, is received, the selected edited image is output.

[0009] According to this embodiment, when a user edits an image and prints it, the user can edit and print it by sending the image and a message to the chat system. That is, when a user sends a message on the chat system, the user does not need to consider and specify the setting items and parameter values ​​to be changed. The user can create a desired edited image by simply sending a message including a linguistic expression that represents the desired image. The information processing device analyzes the message, creates multiple patterns of edited images for the image, and transmits them to the user's terminal device via the chat system. As a result, the user can create multiple edited images by simply sending a message including a linguistic expression that represents the desired image, which saves the user the trouble of sending messages multiple times and repeating editing one pattern each time.

[0010] The chatbot module may send the different edited images in a single post.

[0011] According to this embodiment, multiple edited images are included in a single post and displayed in parallel, allowing users to easily compare multiple edited images proposed on the chat system and output the desired edited image.

[0012] The message judgment module includes: morphologically analyzing the message; Adjectives or morphological terms obtained by the morphological analysis may be extracted as key values.

[0013] According to this embodiment, when a user sends a message on the chat system, there is no need to consider and specify the setting items and parameter values ​​to be changed. The user can create a desired edited image simply by sending a message including a linguistic expression that expresses the desired image.

[0014] When a plurality of adjectives and / or form words are detected, the message judgment module may extract a phrase including all of the plurality of adjectives and / or form words as a key value.

[0015] This allows a parameter set that is closer to the linguistic expression expressing the image the user desires to be subdivided and registered, making it possible to create an edited image that is closer to the image the user desires to be.

[0016] Registered in the database, a plurality of different parameter sets corresponding to a first key value; a plurality of different parameter sets corresponding to a second key value different from the first key value; a plurality of different parameter sets corresponding to a third key value including the first key value and the second key value; may be different from.

[0017] This allows a parameter set that is closer to the linguistic expression expressing the image the user desires to be subdivided and registered, making it possible to create an edited image that is closer to the image the user desires to be.

[0018] The message judgment module includes: When a plurality of adjectives and / or morphological terms are detected, the plurality of adjectives and / or morphological terms are extracted as a plurality of key values, respectively; The image editing module includes: retrieving from the database at least a portion of a plurality of different parameter sets respectively corresponding to the extracted plurality of key values; A plurality of different edited images may be generated by editing the image in accordance with at least a portion of the plurality of different parameter sets respectively.

[0019] This makes it possible to create an edited image that is close to the image the user desires, while proposing a wide variety of edited images to the user.

[0020] The parameter set is a combination of parameters for a plurality of editing items.

[0021] In contrast, according to this embodiment, when a user edits an image and prints it, the user can edit and print it by sending the image and a message to the chat system. That is, when a user sends a message on the chat system, there is no need for the user to consider and specify the setting items (contrast, etc.) and parameter values ​​to be changed. The user can create a desired edited image simply by sending a message including a linguistic expression that expresses the desired image (brighter, more vivid, etc.).

[0022] An information processing method according to an embodiment of the present disclosure includes: receiving an image transmitted from the terminal device to the chat system and a message indicating that the image is to be edited; Extracting a key value from the message; Reading out a plurality of different parameter sets corresponding to the key values ​​extracted from the message from a database in which a plurality of different key values ​​and a plurality of different parameter sets corresponding to each key value are registered; editing the image in accordance with the plurality of different parameter sets to generate a plurality of different edited images; transmitting the plurality of different edited images to the chat system; determining an edited image selected on the chat system from the terminal device; When a post indicating that the edited image is to be output, which is transmitted from the terminal device to the chat system, is received, the selected edited image is output.

[0023] An information processing program according to an embodiment of the present disclosure includes: A processor of the information processing device, A chatbot module that receives an image sent from a terminal device to a chat system and a message indicating that the image is to be edited; a message judgment module for extracting a key value from the message; A database for registering a plurality of different key values ​​and a plurality of different parameter sets corresponding to each of the key values; retrieving from said database a plurality of different parameter sets corresponding to said key values ​​extracted from said message; Editing the image in accordance with the plurality of different parameter sets to generate a plurality of different edited images. It operates as an image editing module, The chatbot module includes: transmitting the plurality of different edited images to the chat system; determining an edited image selected on the chat system from the terminal device; When a post indicating that the edited image is to be output, which is transmitted from the terminal device to the chat system, is received, the selected edited image is output. Effect of the Invention

[0024] According to the present disclosure, image editing can be made more user-friendly.

[0025] Note that the effects described herein are not necessarily limited to those described herein, and may be any of the effects described in this disclosure. [Brief description of the drawings]

[0026] [Figure 1] 1 shows a configuration of an information processing device according to an embodiment of the present disclosure. [Diagram 2] 3 shows an operation flow of the information processing device. [Diagram 3] 1 shows an example of a chat screen displayed on a terminal device. [Figure 4] An example of a database is shown. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0028] 1. Configuration of information processing device

[0029] FIG. 1 shows a configuration of an information processing device according to an embodiment of the present disclosure.

[0030] The information processing device 100 can communicate with the terminal device 200 and the image forming device 300 via a network such as the Internet. The terminal device 200 is a smartphone, tablet computer, personal computer, etc. used by a user. The image forming device 300 is, for example, an MFP (Multifunction Peripheral). The information processing device 100 is a print control device that can receive an image from the terminal device 200, edit the image, and output the edited image to the image forming device 300.

[0031] In the control circuit of the information processing device 100, a processor such as a CPU loads an information processing program stored in a ROM into a RAM and executes it to operate as a chatbot module 101, a message judgment module 102, and an image editing module 103. The information processing device 100 has a database 110 stored in a large-capacity non-volatile storage medium such as an HDD or SSD.

[0032] 2. Operation flow of information processing device

[0033] Fig. 2 shows an operation flow of the information processing device, and Fig. 3 shows an example of a chat screen displayed on a terminal device.

[0034] The terminal device 200 transmits an image C210 that the user wishes to edit and print to the chat system. The image C210 is displayed on a chat screen of the terminal device 200. The chat system may be provided by the information processing device 100 or an external chat application supplier.

[0035] The chatbot module 101 of the information processing device 100 receives the image C210 transmitted from the terminal device 200 to the chat system (step S101). Then, the chatbot module 101 transmits a post C110 to the chat system, asking whether to print or edit the image C210. ​​For example, the chatbot module 101 transmits a post C110 including "@print" and "@edit" to the chat system.

[0036] A post C110 is displayed on the chat screen of the terminal device 200. The user operates "@print" or "@edit" included in the post C110 displayed on the chat screen of the terminal device 200. In this example, the user selects "@edit" included in the post C110, and further inputs a message "brighten up", which is a linguistic expression representing a target image. The terminal device 200 transmits a post C220 including "@edit" and "brighten up" to the chat system.

[0037] The chatbot module 101 of the information processing device 100 receives the post C220 transmitted from the terminal device 200 to the chat system. The chatbot module 101 determines whether the post C220 includes "@print" or "@edit" included in the post C110 transmitted by the chatbot module 101 (step S102). The chatbot module 101 determines that the post C220 includes "@edit". Next, the chatbot module 101 determines whether the post C220 includes a message indicating that the image C210 is to be edited (step S103). In this example, the post C220 includes the message "brighten it up", and thus determines that the post C220 includes a message indicating that the image C210 is to be edited (step S103, YES).

[0038] The message judgment module 102 of the information processing device 100 extracts a key value from a message included in the post C220. Specifically, the message judgment module 102 performs morphological analysis on the message and extracts an adjective or a form of verb obtained by the morphological analysis as a key value. In this example, the message judgment module 102 performs morphological analysis on the message "Brighten up" and divides it into the adjective "bright", the verb "shi" and the particle "te" (step S104). The message judgment module 102 extracts the adjective "bright" obtained by the morphological analysis as a key value (step S105, YES).

[0039] When multiple adjectives and / or morphological terms are detected, the message judgment module 102 extracts a phrase including all of the multiple adjectives and / or morphological terms as a key value. For example, assume that the message is "bright and vivid" (not shown). In this example, the message judgment module 102 performs morphological analysis on the message "bright and vivid" and divides it into the adjective "bright", the morphological term "vivid", and the auxiliary verb "to" (step S104). The message judgment module 102 extracts "bright and vivid", which is a phrase including all of the adjective "bright" and the morphological term "vivid" obtained by the morphological analysis, as a key value (step S105, YES).

[0040] FIG. 4 shows an example of the database.

[0041] The database 110 includes a first table 114 and a plurality of second tables 115. The first table 114 registers a plurality of different key values ​​111 and setting values ​​112 corresponding to each of the key values ​​111. In this example, the first table 114 registers a plurality of different key values ​​111 "bright" and "vivid" and setting values ​​112 "a" and "b" corresponding to the key values ​​111 "bright" and "vivid", respectively.

[0042] The multiple second tables 115 correspond to the multiple setting values ​​112 "a" and "b", respectively. In other words, there is one second table 115 for one setting value 112. Multiple different parameter sets 113 are registered in the second table 115 for one setting value 112. For example, multiple different parameter sets 113a, 113b, 113c, and 113d are registered in the second table 115 for the setting value 112 "a" corresponding to the key value 111 "bright".

[0043] The parameter set 113 is a combination of parameters for multiple editing items. For example, one parameter set 113a is a combination of a parameter "20" for the editing item "contrast," a parameter "30" for the editing item "brightness," and a parameter "20" for the editing item "highlight." The multiple different parameter sets 113a, 113b, 113c, and 113d registered for one setting value 112 are all different.

[0044] That is, even if the combination of editing items of a parameter set (contrast, brightness, and highlight) is the same in one second table 115, the combinations of parameters (numeric values) of these three editing items are all different. Alternatively, the combinations of editing items of a parameter set may be different in the first place in one second table 115. For example, in one second table 115, the combination of editing items of a certain parameter set (e.g., contrast and highlight) may be different from the combination of editing items of another parameter set (e.g., brightness and highlight).

[0045] The multiple different parameter sets corresponding to the first key value, the multiple different parameter sets corresponding to the second key value different from the first key value, and the multiple different parameter sets corresponding to the third key value including the first key value and the second key value, all registered in the database 110, are different. For example, the multiple different parameter sets 113 corresponding to the first key value 111 "bright", the multiple different parameter sets 113 corresponding to the second key value 111 "vivid", and the multiple different parameter sets 113 corresponding to the third key value 111 "bright and vivid" are all different. This allows the parameter sets closer to the linguistic expression expressing the image desired by the user to be subdivided and registered, and an edited image closer to the image desired by the user can be created.

[0046] With a structure including this first table 114 and multiple second tables 115, the database 110 registers multiple different key values ​​111 and multiple different parameter sets 113 corresponding to each key value 111. For example, the database 110 registers the key value 111 "bright" and multiple different parameter sets 113a, 113b, 113c, and 113d corresponding to the key value 111 "bright".

[0047] The image editing module 103 of the information processing device 100 reads out from the database 110 a plurality of different parameter sets corresponding to the key value "bright" extracted by the message judgment module 102 from the message "brighten" (step S106). In this example, the image editing module 103 reads out the setting value 112 "a" corresponding to the key value 111 "brighten" from the first table 114 of the database 110. The image editing module 103 selects one second table 115 corresponding to the read setting value 112 "a" from the database 110. The image editing module 103 reads out the plurality of different parameter sets 113a, 113b, 113c, and 113d from the selected second table 115.

[0048] The image editing module 103 of the information processing device 100 edits the image C210 in accordance with the different parameter sets 113a, 113b, 113c, and 113d that correspond to the key value "bright." As a result, the image editing module 103 generates different edited images 121, 122, 123, and 124 (step S107).

[0049] The chatbot module 101 of the information processing device 100 transmits a post C120 including the multiple different edited images 121, 122, 123, and 124 generated by the image editing module 103 to the chat system (step S108). That is, the multiple different edited images 121, 122, 123, and 124 are included in one post C120 and displayed in parallel.

[0050] A post C120 including a plurality of different edited images 121, 122, 123, and 124 is displayed on the chat screen of the terminal device 200. The user compares the edited images 121, 122, 123, and 124 and selects one image that is closest to the desired image. In this example, the user selects the edited image 122 on the chat system. A check mark is displayed on the selected edited image 122.

[0051] The chatbot module 101 of the information processing device 100 determines the edited image 122 selected on the chat system by the terminal device 200. Then, the chatbot module 101 sends a post C130 to the chat system asking whether to print or edit the edited image 122. For example, the chatbot module 101 sends a post C130 including "@print" and "@edit" to the chat system. For example, the post C130 is the same as the post C110.

[0052] A post C130 is displayed on the chat screen of the terminal device 200. The user operates "@ print" or "@ edit" included in the post C130 displayed on the chat screen of the terminal device 200. In this example, the user selects "@ print" included in the post C130. The terminal device 200 transmits a post C230 including "@ print" to the chat system.

[0053] The chatbot module 101 of the information processing device 100 receives the post C230 transmitted from the terminal device 200 to the chat system. The chatbot module 101 determines whether the post C230 includes "@print" or "@edit" contained in the post C130 transmitted by the chatbot module 101 (step S102). The chatbot module 101 determines that the post C230 includes "@print". As a result, the chatbot module 101 receives the post transmitted from the terminal device 200 to the chat system, indicating that the edited image 122 is to be output (printed in this example).

[0054] The information processing device 100 transmits a print command and the edited image 122 to the image forming device 300 (step S109). The image forming device 300 receives the print command and the edited image 122, and prints the edited image 122.

[0055] After posting the post C120 including the multiple different edited images 121, 122, 123, and 124, if the chatbot module 101 of the information processing device 100 receives a post C230 including "@edit", the chatbot module 101 repeats the operations from step S103 onwards.

[0056] 3. Variations

[0057] A modified example in which a message includes a plurality of adjectives and / or adjectives will be described. In the above embodiment, the message judgment module 102 extracts one key value, "bright and vivid", from the message "bright and vivid", instead of two key values, "bright" and "vivid". In the database 110, "bright", "vivid", and "bright and vivid" are registered as key values ​​111. The image editing module 103 reads out the parameter set 113 corresponding to "bright and vivid" as the key value 111.

[0058] Instead, when a plurality of adjectives and / or morphological terms are detected, the message judgment module 102 according to the modified example extracts the plurality of adjectives and / or morphological terms as a plurality of key values. The image editing module 103 reads out at least a part of a plurality of different parameter sets corresponding to the extracted plurality of key values ​​from the database 110, and edits the image according to at least a part of the plurality of different parameter sets, thereby generating a plurality of different edited images.

[0059] In this example, the message judgment module 102 extracts two key values, "bright" and "vivid", from the message "bright and vivid". The image editing module 103 reads, for example, two parameter sets corresponding to the key value 111 "bright" from the database 110, and reads, for example, two parameter sets corresponding to the key value 111 "vivid". The image editing module 103 generates four different edited images by editing the image according to each of the four parameter sets read out. This makes it possible to create an edited image close to the image the user desires, while proposing a wide variety of edited images to the user.

[0060] 4. Conclusion

[0061] In a typical method, when editing an image, the user must know in advance the effect of the parameters for each editing item in order to obtain the desired image. Only one pattern of the image edited according to the parameters set by the user is displayed. If the user does not have knowledge of the effect of the parameters for each editing item, or if the edited image displayed is not the desired image, the user will change the parameters many times and repeat the editing. This method requires a lot of time and effort to check, and does not allow the edited images to be compared simultaneously in parallel.

[0062] In contrast, according to the present embodiment, when a user edits an image and prints it, the user can edit and print it by sending the image C210 and the message C220 to the chat system. That is, when the user sends the message C220 on the chat system, the user does not need to consider and specify the setting items (contrast, etc.) and parameter values ​​to be changed. For the user, a desired edited image is created simply by sending the message C220 including a language expression (brighter, vivid, etc.) that represents the desired image. The information processing device 100 analyzes the message, creates multiple patterns of edited images for the image, and transmits them to the user's terminal device 200 via the chat system. As a result, for the user, multiple edited images are created simply by sending the message C220 including a language expression (brighter, vivid, etc.) that represents the desired image, so that the user can save the trouble of sending messages multiple times and repeating editing one pattern at a time. In particular, the information processing device 100 displays multiple patterns of edited images in parallel by including them in one post. As a result, the user can easily compare multiple patterns of edited images proposed on the chat system, and output (print, etc.) the desired edited image.

[0063] Although the embodiments and modified examples of the present technology have been described above, the present technology is not limited to the above-described embodiments, and it goes without saying that various modifications can be made within the scope of the gist of the present technology. [Explanation of symbols]

[0064] 100 Information processing device 101 Chatbot Module 102 Message Judgment Module 103 Image Editing Module 110 Database 111 Key Value 112 Setting value 113 Parameter Set 114 First Table 115 Second Table 200 Terminal Equipment 300 Image forming device

Claims

1. A chatbot module that receives an image sent from a terminal device to a chat system and a message indicating that the image is to be edited; a message judgment module for extracting a key value from the message; A database for registering a plurality of different key values ​​and a plurality of different parameter sets corresponding to each of the key values; retrieving from said database a plurality of different parameter sets corresponding to said key values ​​extracted from said message; Editing the image in accordance with the plurality of different parameter sets to generate a plurality of different edited images. an image editing module; The chatbot module includes: transmitting the plurality of different edited images to the chat system; determining an edited image selected on the chat system from the terminal device; When a post indicating that the edited image is to be output, which is transmitted from the terminal device to the chat system, is received, the selected edited image is output. Information processing device.

2. 2. The information processing device according to claim 1, The chatbot module transmits the plurality of different edited images in a single post. Information processing device.

3. 3. The information processing device according to claim 1, The message judgment module includes: morphologically analyzing the message; The adjective or morphological noun obtained by the morphological analysis is extracted as a key value. Information processing device.

4. 4. The information processing device according to claim 3, When the message judgment module detects a plurality of adjectives and / or morphological terms, the message judgment module extracts a phrase including all of the plurality of adjectives and / or morphological terms as a key value. Information processing device.

5. 5. The information processing device according to claim 1, Registered in the database, a plurality of different parameter sets corresponding to a first key value; a plurality of different parameter sets corresponding to a second key value different from the first key value; a plurality of different parameter sets corresponding to a third key value including the first key value and the second key value; is different from Information processing device.

6. 4. The information processing device according to claim 3, The message judgment module includes: When a plurality of adjectives and / or morphological terms are detected, the plurality of adjectives and / or morphological terms are extracted as a plurality of key values, respectively; The image editing module includes: retrieving from the database at least a portion of a plurality of different parameter sets respectively corresponding to the extracted plurality of key values; Editing the image in accordance with at least a portion of the plurality of different parameter sets to generate a plurality of different edited images. Information processing device.

7. 7. The information processing device according to claim 1, The parameter set is a combination of parameters for multiple editing items. Information processing device.

8. receiving an image transmitted from the terminal device to the chat system and a message indicating that the image is to be edited; Extracting a key value from the message; Reading out a plurality of different parameter sets corresponding to the key values ​​extracted from the message from a database in which a plurality of different key values ​​and a plurality of different parameter sets corresponding to each key value are registered; editing the image in accordance with the plurality of different parameter sets to generate a plurality of different edited images; transmitting the plurality of different edited images to the chat system; determining an edited image selected on the chat system from the terminal device; When a post indicating that the edited image is to be output, which is transmitted from the terminal device to the chat system, is received, the selected edited image is output. Information processing methods.

9. A processor of the information processing device, A chatbot module that receives an image sent from a terminal device to a chat system and a message indicating that the image is to be edited; a message judgment module for extracting a key value from the message; A database for registering a plurality of different key values ​​and a plurality of different parameter sets corresponding to each of the key values; retrieving from said database a plurality of different parameter sets corresponding to said key values ​​extracted from said message; Editing the image in accordance with the plurality of different parameter sets to generate a plurality of different edited images. It operates as an image editing module, The chatbot module includes: transmitting the plurality of different edited images to the chat system; determining an edited image selected on the chat system from the terminal device; When a post indicating that the edited image is to be output, which is transmitted from the terminal device to the chat system, is received, the selected edited image is output. Information processing program.

Citation Information

Patent Citations

  • Image composition device, image composition method, image composition program and recording medium storing the program

    JP2016170465A

  • Printing assistance system and chatbot device

    JP2019207513A

  • Print control apparatus and print control program

    JP2020052507A

  • Control apparatus and control program

    JP2020052581A

  • Information processing device and program

    JP2020155030A