Program and recording medium on which said program is recorded

The program and recording medium support diverse user intentions by providing suggestion lists for picture displays, enabling efficient integration of emoticons and stamps in messages, thus improving user experience.

JP7626653B2Active Publication Date: 2025-02-04LY CORP
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2021066749
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-04-09
Publication Date
2025-02-04
Estimated Expiration
2041-04-09

AI Technical Summary

Technical Problem

Existing technologies fail to support diverse user intentions for incorporating picture displays in messages with simple operations, such as emoticons and stamps, leading to inadequate reflection of user input in message creation.

Method used

A program and recording medium that facilitate the display of suggestion lists for picture displays based on user input text, allowing users to select and integrate emoticons or stamps through specified operations, including preview and confirmation processes.

Benefits of technology

Enables users to accurately reflect their intentions in message creation by simplifying the integration of picture displays like emoticons and stamps, enhancing user experience and operational efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007626653000001
    Figure 0007626653000001
  • Figure 0007626653000002
    Figure 0007626653000002
  • Figure 0007626653000003
    Figure 0007626653000003
Patent Text Reader

Abstract

To correctly reflect a user's intention on a message with a simple operation when generating the message including pictographs, related to a program and a recording medium having the program recorded therein.SOLUTION: Input of a text is received, and the input text is displayed in a message generation area 40. A suggestion object is determined in a display of the message generation area 40. If one or more pictographs corresponding to the suggestion object exist, a suggestion list of the pictographs is displayed in a suggestion area 44. In response to receiving a designation operation of designating one pictograph included in the suggestion list, use of the pictograph is settled. In response to receiving change operations 52-1, 52-2, or 52-3 on the suggestion object, the suggestion object is changed to a pictograph corresponding to the change operations (50-1→50-2, 50-2→50-3, or 50-2→50-4) in the display of the message generation area 40.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a program and a recording medium having the program recorded thereon, and more particularly to a program and a recording medium suitable for supporting the creation of a message including a pictorial display. [Background technology]

[0002] The following Patent Document 1 discloses an input support device that supports message creation. This input support device accepts input of characters and emojis by a user. When a specific emoji is input, other emojis that can be linked with the emoji are searched for, and if a linkable emoji exists, the emojis are suggested to the user as input candidates. As a result, when the user performs an input operation on the presented emoji, the emoji is added to the existing emojis and becomes part of the message. With such an input support device, the user can easily create a message using emojis. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-88925 A Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, a possible method of supporting inclusion of emoticons or stamps (hereinafter, when there is no need to distinguish between the two, they will be referred to as "emoticons") in messages is to suggest emoticons matching the contents of the input text to the user as input candidates. More specifically, a possible method is to compare undetermined characters or character strings in the input text with a list of available emoticons, and if there are emoticons corresponding to the former, to display them as input candidates.

[0005] Generally, when creating a message including pictorial symbols in text, a user performs input operations with various intentions. For example, a user may want to convert all or only a part of an input string of characters into a pictorial symbol. In addition, a user may want to use a pictorial symbol by replacing it with a character or a string of characters, or may want to add a pictorial symbol to existing text. However, in the past, including the support method described in Patent Document 1, no support method for correctly reflecting such various user intentions in a message with simple operations has been proposed.

[0006] This disclosure has been made to solve the problems described above, and its primary objective is to provide a program that enables a user to correctly reflect his or her intentions in a message that includes pictorial displays with simple operations.

[0007] A second object of this disclosure is to provide a computer-readable recording medium storing a program for allowing a user to correctly reflect his or her intentions in a message that includes a pictorial display with simple operations when creating the message. [Means for solving the problem]

[0008] In order to achieve the above-mentioned object, a first aspect of the present disclosure includes a program that causes a computer to execute the following processes: a process for accepting text input; a process for displaying the input text on a display; a process for determining a suggested target within the display; a list display process for displaying a suggestion list of pictorial displays on the display if there are one or more pictorial displays corresponding to the suggested target; a process for accepting a designation operation for designating one of the pictorial displays included in the suggestion list; a display confirmation process for confirming the use of the pictorial display that has received the designation operation; and a process for accepting an operation to change the suggested target, and it is preferable that the suggested target determination process is a program that includes a target change process for changing the suggested target within the display to one that corresponds to the change operation, or a recording medium having the program recorded thereon.

[0009] Furthermore, a second aspect of the present disclosure is a program that causes a computer to execute the following processes: a process for accepting input of text, a process for displaying the input text on a display, a process for determining a suggested target within the display of the display, a list display process for displaying a suggestion list of pictorial displays on the display when one or more pictorial displays corresponding to the suggested target are present, a process for accepting a designation operation for designating one pictorial display included in the suggestion list, and a display confirmation process for confirming use of the pictorial display that has received the designation operation, wherein the designation operation includes a first designation operation for designating the one pictorial display by a first method, and a second designation operation for designating the one pictorial display by a second method different from the first method, and the display confirmation process preferably includes a first confirmation process for replacing the pictorial display that has received the first designation operation with the suggested target and confirming its use, and a second confirmation process for adding the pictorial display that has received the second designation operation to the suggested target and confirming its use, or a recording medium having the program recorded thereon. Effect of the Invention

[0010] According to the first and second aspects of the present disclosure, when creating a message including a pictorial display, the user's intention can be correctly reflected in the message with a simple operation. [Brief description of the drawings]

[0011] [Figure 1] FIG. 2 is a diagram for explaining the configuration of a user terminal used in the first embodiment of the present disclosure. [Diagram 2] FIG. 2 is a diagram for explaining an input support technique according to the first embodiment of the present disclosure. [Diagram 3] 4 is a flowchart for explaining a flow of processing executed inside a user terminal in the first embodiment of the present disclosure. [Figure 4] FIG. 11 is a diagram for explaining an input support method according to the second embodiment of the present disclosure. [Diagram 5]11 is a flowchart for explaining the flow of processing executed inside a user terminal in the second embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Embodiment 1 [Configuration of the first embodiment] 1 is a diagram for explaining the configuration of a user terminal 10 used in the first embodiment of the present disclosure. In this embodiment, a case will be explained in which the user terminal 10 is a smartphone. However, the user terminal 10 is not limited to a smartphone, and may be a tablet terminal or a general-purpose computer system.

[0013] The user terminal 10 includes a CPU (Central Processing Unit) 18. The CPU 18 is connected to various hardware elements included in the user terminal 10 via a bus wiring 20. To the bus wiring 20, various memory devices such as a ROM (Read Only Memory) 22, a RAM (Random Access Memory) 24, and a storage 26 are connected.

[0014] The storage 26 includes a non-volatile memory such as a flash ROM. Programs and data required for executing various applications are stored in the storage 26. The CPU 18 performs processing in accordance with the programs stored in the storage 26, thereby realizing the input support function in this embodiment.

[0015] The user terminal 10 also includes a communication interface 28. The user terminal 10 can establish wireless communication with an external device via the communication interface 28.

[0016] The user terminal 10 further includes an operation unit 30 and a display unit 32. The operation unit 30 includes various mechanical switch mechanisms and electronic sensor mechanisms, as well as a touch panel integrated with the display unit 32. In the following description, the touch panel will be considered as part of the "display unit 32."

[0017] [Operation of the first embodiment] FIG. 2 is a diagram for explaining an input support technique provided by the user terminal 10. A messaging service application is installed in the user terminal 10. Hereinafter, this application is referred to as a "message app." The message app program is stored in a recording medium provided in an external server. The program downloaded from the server is installed in the user terminal 10.

[0018] The upper part of FIG. 2 shows a first screen example 32-1 displayed on the display unit 32 of the user terminal 10 after the above-mentioned message application is launched. The first screen example 32-1 includes a message creation area 40. The message creation area 40 is located approximately in the center of the display unit 32. A message in the process of being created is displayed in the message creation area 40. The individual characters constituting the message can be input by tapping the desired character in the keyboard area displayed below the first screen example 32-1. Specifically, the character string "hello" is input in the message creation area 40.

[0019] A conversion candidate area 42 is shown below the message creation area 40. In the conversion candidate area 42, a list of conversion candidates that can be predicted from the undetermined part of the text entered in the message creation area 40 is displayed. In the first screen example 32-1, "hello," "Hello," "HELLO," etc. are listed in the conversion candidate area 42 as conversion candidates for the input of "hello." A database related to conversion candidates is built in the storage 26. Conversion candidates are predicted by comparing the undetermined characters or character string with the database.

[0020] In the first screen example 32-1, a suggestion area 44 is displayed above the message creation area 40. In the message app of this embodiment, in addition to characters, pictograms and stamps can be used as elements that make up a message. Here, a picture to which a character code is assigned is called an "emoticon," and a picture made up of an image is called a "stamp." Also, when there is no need to distinguish between emoticons and stamps, they are called "pictograms."

[0021] The storage 26 stores a database that defines the correspondence between characters or character strings and pictorial displays. When an unconfirmed portion exists in the text displayed in the message creation area 40, the user terminal 10 searches the database for a pictorial display corresponding to that portion. As a result, if a corresponding pictorial display is not found, the suggestion area 44 is not displayed. On the other hand, if a corresponding pictorial display is found, the suggestion area 44 is displayed as a pop-up, and the pictorial display is shown therein.

[0022] 2 shows a second screen example 32-2 of the display unit 32. The second screen example 32-2 is displayed when a first designation operation 46 is performed on one of the picture display candidates shown in the suggestion area 44 of the first screen example 32-1.

[0023] The first designation operation 46 is an operation for replacing a designated pictorial display with a character or character string corresponding to the pictorial display and making the character or character string a part of the message. For example, the first designation operation 46 is realized by the following operation.

[0024] 1. Tap a pictogram you want to use (for example, a rabbit emoji) from among the pictograms displayed in the suggestion area 44. In response to this tap, the tapped pictogram may be temporarily enlarged and displayed as a preview display.

[0025] 2. The emoticon tapped in the above process is tapped again. If the target of the tap is an emoticon, this tap replaces the display in the message creation area 40 from "hello" to "rabbit emoticon" as shown in the second screen example 32-2. If the target of the tap is a stamp, "hello" disappears from the message creation area 40, and the tapped stamp is sent as a message to the communication partner instead.

[0026] 2 shows a third screen example 32-3 of the display unit 32. The third screen example 32-3 is displayed when a second designation operation 48 is performed on one of the picture display candidates shown in the suggestion area 44 of the first screen example 32-1.

[0027] The second designation operation 48 is an operation for adding the designated pictorial representation to the existing text to make the pictorial representation a part of the message. For example, the second designation operation 48 is realized by the following operation.

[0028] 1. As in the case of the first designation operation, first, one of the pictorial displays displayed in the suggestion area 44 is tapped. As a result, the tapped pictorial display may be temporarily enlarged as a preview display. 2. Swipe the emoticon tapped in the above process to the right or left. Alternatively, double-tap the emoticon. If the tapped target is an emoticon, this operation adds a "rabbit emoticon" after "hello" in the message creation area 40, as shown in the third screen example 32-3. If the tapped target is a stamp, "hello" remains in the message creation area 40, and the tapped stamp is sent as a message to the communication partner.

[0029] Thereafter, when text input is resumed, the newly input characters are displayed as unconfirmed portions following the existing message in message composition area 40. Then, when a default send operation is performed, the message displayed in message composition area 40 at that time is sent to the intended recipient.

[0030] [Processing flow in the first embodiment] Fig. 3 is a diagram for explaining the flow of processing executed in the user terminal 10 of the present embodiment to realize the input assistance described with reference to Fig. 2. The routine shown in Fig. 3 is repeatedly executed after a message application is launched in the user terminal 10.

[0031] 3, first, it is determined whether or not new text input has been performed (step 100). If new text input is not recognized, the processes of steps 102 to 106 are skipped and the process of step 108, which will be described later, is executed immediately.

[0032] On the other hand, if new text input is recognized, the input characters are added and displayed in the message composition area 40. Also, conversion candidates are predicted from the undetermined characters or character string, and a list of the predicted conversion candidates is displayed in the conversion candidate area 42 (step 102).

[0033] Next, it is determined whether or not there is a suggested candidate pictorial display corresponding to the undetermined character or character string displayed in the message creation area 40 (step 104). As a result, if there is no suggested candidate, the process of step 106 is skipped and the process of step 108 is immediately executed.

[0034] On the other hand, if the presence of a suggestion candidate is found, a suggestion area 44 is popped up and a suggestion list of pictorial representations is displayed therein (step 106).

[0035] Next, it is determined whether or not a confirmation operation has been performed on the unconfirmed characters or character strings displayed in the message creation area 40 (step 108). For example, it is determined whether or not a "return key" included in the keyboard area of ​​the display unit 32 has been tapped. If the result indicates that the confirmation operation has not been performed, the process of step 110 is skipped and the process of step 112 is executed next.

[0036] On the other hand, if the execution of the confirmation operation is permitted, the characters or character strings that had been left in an unconfirmed state until then are confirmed as part of the message. Also, the list of conversion candidates that was displayed corresponding to the unconfirmed characters or character strings is reset (step 110). In the above reset process, for example, the display in the conversion candidate area 42 can be erased. Alternatively, the display in the conversion candidate area 42 may be replaced with a list of conversion candidates that are generally frequently used. Furthermore, the display in the conversion candidate area 42 may be replaced with a list of conversion candidates predicted from the user's conversion history.

[0037] Next, it is determined whether or not a first designation operation has been performed on one of the pictorial representations included in the suggestion list (step 112). Specifically, it is determined whether or not the first designation operation described with reference to FIG. 2 has been performed on one of the pictorial representation candidates displayed in the suggestion area 44.

[0038] As a result, if the execution of the first designation operation is recognized, the designated pictorial candidate is confirmed as part of the message, replacing the unconfirmed character or character string displayed in the message creation area 40 (step 114). Specifically, if the pictorial display is a pictorial symbol, the pictorial symbol replaces the unconfirmed character or character string in the message creation area 40. If the pictorial display is a stamp, the unconfirmed character or character string is erased, and the stamp is sent to the communication partner instead. Simultaneously with the above process, the pictorial display suggestion area 44 disappears from the display unit 32.

[0039] When the process of step 114 is executed, there are no undetermined characters or character strings in the message creation area 40. Therefore, when the process is completed, the display of the conversion candidate area 42 is reset (step 116), similar to the case of step 110 above.

[0040] If the suggestion list of pictorial displays is not displayed at the time when step 112 is executed, there is no possibility that the first specifying operation will be executed. In this case, the determination in step 112 is negative. Also, even if the suggestion list is displayed at the time when step 112 is executed, if a certain period of time has passed or the execution of another process is recognized, the determination in step 112 is negative. In these cases, it is then determined whether or not the second specifying operation has been executed (step 118).

[0041] In this step 118, specifically, it is determined whether or not the second designation operation described with reference to FIG. 2 has been performed on one of the pictorial display candidates displayed in the suggestion area 44. Here, as in the case of the above step 112, if the suggestion list is not displayed, if a certain amount of time has elapsed, or if other processing has been performed, it is determined that the execution of the second designation operation is not permitted. In this case, the current routine is promptly terminated. Thereafter, the processing from step 100 onwards is executed again with the displays in each place maintained.

[0042] If the execution of the second designation operation is recognized in step 118 above, the designated pictorial representation candidate is added to the unconfirmed characters or character string displayed in the message creation area 40 and confirmed as part of the message (step 120).

[0043] Specifically, if the designated pictorial display is a pictorial symbol, the pictorial symbol is added to the message composition area 40 following the existing text. If the designated pictorial display is a stamp, the existing text is confirmed as the message, and the designated stamp is sent to the communication partner. Thereafter, the display in the suggestion area 44 disappears, as in step 114.

[0044] Furthermore, when the above process is completed, the undetermined characters or character strings disappear, similar to when step 116 is executed, and the display of the predicted conversion candidate area 42 is reset.

[0045] As described above, according to this embodiment, after inputting characters, the user can selectively execute an operation of replacing an unconfirmed part of the text with a pictorial representation and an operation of adding a pictorial representation to the text. Therefore, according to this embodiment, it is possible to provide input assistance for correctly reflecting the user's intention in a message with a simple operation.

[0046] [Modification of the first embodiment] Incidentally, in the above-mentioned first embodiment, the first designation operation is "tap" + "tap", and the second designation operation is "tap" + "swipe" or "tap" + "double tap". However, these operations are not limited to the above operations as long as they are different from each other.

[0047] In addition, in the first embodiment, the first and second designation operations are each a two-step operation on the premise that a preview display is performed before the use of the pictorial display is confirmed, but the present disclosure is not limited to this. For example, the operations may be completed in a one-step operation by omitting the preview display before confirmation.

[0048] In the above-described first embodiment, the database related to the suggestion list of pictorial indications and the database for predicting conversion candidates are both stored in the storage 26 of the user terminal 10. However, the present disclosure is not limited to such a configuration. For example, one or both of these databases may be placed on a cloud, and the suggestion list and the conversion candidate list may be created via communication.

[0049] Embodiment 2 Next, a second embodiment of the present disclosure will be described with reference to Fig. 1, Fig. 4 and Fig. 5. The input support function in this embodiment can be realized in a user terminal 10 having the hardware configuration shown in Fig. 1, as in the first embodiment. Also, the input support in this embodiment is realized in the user terminal 10 shown in Fig. 1 by the CPU 18 proceeding with processing according to a message application program stored in the storage 26, as in the first embodiment.

[0050] [Features of the second embodiment] In the input assistance of the first embodiment, a pictorial suggestion list is provided for undetermined characters or character strings in the text entered in the message creation area 40. In this assistance method, the characters or character strings that are compared with the pictorial database change every time new characters are entered in the message creation area 40. Hereinafter, such characters or character strings, that is, the objects that are shown the pictorial suggestion list, are referred to as "suggestion objects."

[0051] According to such an input assistance method, when the emoticon that the user wants to use is displayed, the user must stop inputting text and confirm the use of the emoticon. After confirming the use of the emoticon, the user must start inputting text again. If further character input is performed while the emoticon that the user wants to use is displayed as part of the suggestion list, the "intended suggestion target" + "new input characters" become new suggestion targets, and the emoticon that the user wants to use disappears from the suggestion list. In this case, in order to use the emoticon that the user wants to use, the unconfirmed character string must be erased and the "intended suggestion target" must be input again.

[0052] The input support of this embodiment is characterized in that it overcomes the above-mentioned inconveniences of embodiment 1. Specifically, in a state where text including undetermined characters or character strings is displayed in the message creation area 40 by inputting a series of characters, the input support is characterized in that a suggestion list that matches the user's intention can be displayed after the fact by changing the "suggestion target" at the user's request.

[0053] [Operation of the second embodiment] FIG. 4 is a diagram for explaining the input support method in this embodiment. The top part of FIG. 4 shows an example of a screen displayed on the display unit 32 after launching a message application on the user terminal 10. Here, this screen is referred to as a "fourth screen example 32-4". In the fourth screen example 32-4, the characters "Hello!" are displayed in the message creation area 40. Here, the entire character string of "Hello!" is unconfirmed, and the entire string is considered to be a "suggested target". In the message creation area 40, a suggested target mark 50-1 is displayed so as to overlap the entire "Hello!" in order to clearly indicate that the entire "Hello!" is a suggested target.

[0054] In the message application of this embodiment, a pictorial display corresponding to "Hello" and a pictorial display corresponding to "!" are prepared, but a pictorial display corresponding to "Hello!" is not prepared. Therefore, the fourth example screen 32-4 does not display a suggested list of pictorial displays.

[0055] In the present embodiment, a change operation of the suggested target by the user is accepted during the message creation process. For example, a right or left swipe operation performed in the message creation area 40 is accepted as a change operation.

[0056] The middle part of FIG. 4 shows a fifth screen example 32-5 displayed by performing a change operation 52-1 on the fourth screen example 32-4. In a situation where the suggestion list is not displayed, whether a right swipe or a left swipe is performed, the operation is accepted as the change operation 52-1. When this operation is accepted, a new "suggested target" is determined according to a predetermined rule. In this embodiment, specifically, the "suggested target" is determined according to the following rule.

[0057] 1. It is all or part of an unconfirmed character or character string displayed in the message composition area 40. 2. It must be a block of characters or letters with a corresponding pictorial symbol. 3. It must be the rightmost block of characters or characters. 4. It must be the smallest block that satisfies conditions 1 to 3.

[0058] In the fifth example screen 32-5, following this rule, "!" is set as the suggested object. Also, to clearly indicate this state, the suggested object mark 50-2 is displayed so that it overlaps with "!".

[0059] The fifth screen example 32-5 displays a suggestion area 44, in which a suggestion list corresponding to the suggestion target "!" is displayed. If the user finds the pictogram they want to use in the suggestion area 44, they can confirm the pictogram as part of the message. On the other hand, if the user does not find the suggestion target they want to use in the suggestion area 44 of the fifth screen example 32-5, they can further change the suggestion target.

[0060] The lower left side of FIG. 4 shows a sixth example screen 32-6 displayed by performing a left swipe change operation 52-2 on the suggestion area 44 of the fifth example screen 32-5. A new suggestion list is displayed in the suggestion area 44 of the sixth example screen 32-6, as if the suggestion list hidden on the right side of the suggestion area 44 in the fifth example screen 32-5 was dragged to the left by the swipe. In synchronization with this operation, the suggestion target mark moves to the right in the message creation area 40. Specifically, a cursor-shaped suggestion target mark 50-3 is displayed in the input waiting area located to the right of Hello! In this way, according to the change operation 52-2, the suggestion target can be changed from the state of the fifth example screen 32-5 in a direction according to the type of change operation, and as a result, a new suggestion list can be made to appear.

[0061] The lower right side of FIG. 4 shows a seventh example screen 32-7 displayed by performing a right swipe change operation 52-3 on the suggestion area 44 of the fifth example screen 32-5. A new suggestion list is displayed in the suggestion area 44 of the seventh example screen 32-7, as if the suggestion list hidden on the left side of the suggestion area 44 in the fifth example screen 32-5 was dragged to appear by the right swipe. In synchronization with this operation, a suggestion target mark 50-4 is displayed in the message creation area 40 so as to overlap with "Hello", which is a character string block located to the left of "!". In this way, the right swipe change operation 52-3 can also change the suggestion target from the state of the fifth example screen 32-5 in a direction according to the type of change operation, and a new suggestion list can be made to appear.

[0062] According to the above operation, by changing the "suggested target", it is possible to later display a suggestion list that matches the user's intention, and also to provide the following user experience. 1. The swipe direction of the change operation (e.g., 52-2, 52-3) matches the direction in which the suggestion list appears. 2. The direction in which the new suggestion list appears matches the direction in which the suggestion target marks (e.g. 50-2, 50-3, 50-4) move. This allows the user to accept the movement direction of the suggested object without feeling uncomfortable in relation to the direction of the change operation.

[0063] In this embodiment, as shown in the sixth screen example 32-6, a place waiting for character input (a place where no character is input) is assumed to be a suggested target. Furthermore, in this embodiment, a place where no character is input located to the left of an undetermined character or character string is also assumed to be a suggested target. When these places are set as suggested targets, pictorial displays that are generally used frequently or pictorial displays that are used frequently in the user's conversion history are displayed as a suggestion list. In this way, the input support of this embodiment makes it even easier for users to use pictorial displays.

[0064] [Processing flow in the second embodiment] Fig. 5 is a diagram for explaining the flow of processing executed in the user terminal 10 of the present embodiment to realize the input support described with reference to Fig. 4. The routine shown in Fig. 5 is repeatedly executed after a message application is launched in the user terminal 10. In Fig. 5, elements that are the same as those shown in Fig. 3 above are given the same reference numerals, and their explanations are omitted or simplified.

[0065] In the routine shown in Fig. 5, similarly to the routine shown in Fig. 3, first, the processes of steps 100 to 110 are executed. As a result, if there are suggestion candidates for pictorial representations for the undetermined part of the input text, a suggestion list is displayed in the suggestion area 44. Also, if there are no suggestion candidates for pictorial representations for the undetermined part, the suggestion list is not displayed.

[0066] In either situation, following the processing of steps 100 to 110, it is determined whether or not a change operation that requests a change of the suggested target has been performed (step 130). If a certain period of time has passed or if another operation has been performed, it is determined that the execution of the change operation is not permitted. In this case, the processing of steps 132 to 136 is skipped, and the processing from step 112 onwards is promptly performed.

[0067] On the other hand, if the execution of the change operation is recognized in step 130, a search is first performed to extract a suggested target from within the message creation area 40 (step 132). More specifically, within the message creation area 40, a search is performed for character blocks having corresponding pictorial display candidates, as well as non-input character portions. For example, if "Hello!" is input into the message creation area 40, "!", "Hello", "Hell", "H", and the non-input portions to the right and left of Hello! are extracted as suggested target candidates. An identifier is assigned to each of the suggested target candidates extracted in this manner.

[0068] Next, it is determined which of the candidates obtained as a result of the search should be the suggested target. Specifically, the identifier i of the candidate to be the suggested target is determined based on the current display state of the suggestion list and the accepted change operation (step 134). For example, when the change operation 52-1 is executed in the state of the fourth screen example 32-4, the identifier attached to the "!" that satisfies the above-mentioned conditions 1 to 4 becomes i. Also, when the change operation 52-2 of a left swipe is executed in the state of the fifth screen example 32-5, the identifier attached to the non-input part located to the right of the "!" becomes i. Also, for example, when the suggested target is "H" located at the left end of the text and the change operation 52-3 of a right swipe that moves the suggested target further to the left is performed, the identifier of the non-input part to the left of the text becomes i.

[0069] When the above process is completed, a suggestion list corresponding to the suggested object having the determined i as an identifier, that is, the i-th suggestion list, is displayed in the suggestion area 44 (step 136). This allows the user to change the suggested object as intended, and the suggestion list corresponding to the suggested object can be made to appear on the display unit 32 of the user terminal 10.

[0070] Thereafter, the processes of steps 112 to 120 are executed in the same manner as in embodiment 1. In this manner, like in embodiment 1, replacement of a pictorial display by a first designating operation and addition of a pictorial display by a second designating operation can be realized.

[0071] [Modification of the second embodiment] Incidentally, in the above-mentioned second embodiment, when the change operation 52-2 of the left swipe is executed, the suggested object is moved to the right in accordance with the appearance direction (right) of the suggestion list (see the change from 50-2 to 50-3). Similarly, when the change operation 52-3 of the right swipe is executed, the suggested object is moved to the left in accordance with the appearance direction (left) of the suggestion list (see the change from 50-2 to 50-4). However, the movement direction of the suggested object may be made to match the direction of the swipe, not the appearance direction of the suggestion list. According to such a specification, an intuitive sense of operation can be provided to a user who pays attention to the match between the direction of the swipe and the movement direction of the suggested object, rather than the match between the appearance direction of the suggestion list and the movement direction of the suggested object.

[0072] In the above-described second embodiment, the technique for ex post changing the pictorial suggestion list is combined with the technique described in the first embodiment, that is, the technique for enabling selection between replacing and adding pictorials. However, the present disclosure is not limited to this, and the former technique may be used alone without being combined with the latter technique.

[0073] In the above-mentioned second embodiment, a subsequent change of the suggested target is permitted in the unconfirmed part of the input text. However, the present disclosure is not limited to this. A subsequent change of the suggested target may be permitted within a range including the confirmed characters in the text.

[0074] In the above-mentioned second embodiment, the suggestion area 44 including 12 pictorial displays is popped up in the fifth screen example 32-5, the sixth screen example 32-6, and the seventh screen example 32-7. However, the number of pictorial displays corresponding to each suggestion target is not necessarily the same. For this reason, the suggestion area 44 may be enlarged or reduced according to the number of corresponding pictorial displays. For example, when there are four corresponding pictorial displays, the suggestion area 44 may be reduced to a size sufficient to show the four pictorial displays. When there are 16 corresponding pictorial displays, the suggestion area 44 may be enlarged so that they can be suggested on one screen.

[0075] Alternatively, when the number of pictorial displays corresponding to the suggested target is less than the predetermined number, pictorial displays corresponding to the user's usage history and pictorial displays that are generally used frequently may be included in the suggestion list in addition to pictorial displays corresponding to the suggested target. For example, when the standard size of the suggestion area 44 is set to a size that shows 12 pictorial displays and there are only four pictorial displays corresponding to the suggested target, eight pictorial displays corresponding to the usage history and the like may be displayed in the suggestion area 44 together with the four pictorial displays. [Explanation of symbols]

[0076] 10 User terminal 18 CPU 26 Storage 30 Control section 32 Display section 32-1 First screen example 32-2 Second screen example 32-3 Third screen example 32-4 Fourth screen example 32-5 Fifth screen example 32-6 Sixth screen example 32-7 Seventh screen example 40 Message composition area 42 Conversion candidate area 44 Suggested Area 46 First specified operation 48 Second specified operation 50-1~50-4 Suggested target mark 52-1~52-3 Change operation

Claims

1. On the computer, A process for accepting text input; Displaying the entered text on a display; A suggested object determination process for determining a suggested object in the display; a list display process for displaying a suggestion list of the pictorial representations on the display when one or more pictorial representations corresponding to the suggestion target are present; A process of receiving a designation operation for designating one pictorial representation included in the suggestion list; a display confirmation process for confirming the use of the pictorial display for which the designation operation has been performed; A process of receiving a change operation of the suggested target; and a program for executing the process, The suggested target determination process includes a target change process for changing the suggested target in the display to one corresponding to the change operation, The change operation is An operation for making at least a part of the text displayed on the display the suggested target; and an operation for making a non-input portion of text on the display the suggested target.

2. The display determination process includes: a process of replacing the pictorial representation subjected to the designation operation with the text and confirming its use when the suggested target includes the text; 2. The program according to claim 1, further comprising a process for, when the suggested target is the non-input area, adding the pictorial representation that has been subjected to the designated operation to the text and confirming its use.

3. A computer comprising: A process for accepting text input; Displaying the entered text on a display; A suggested object determination process for determining a suggested object in the display; a list display process for displaying a suggestion list of the pictorial representations on the display when one or more pictorial representations corresponding to the suggestion target are present; A process of receiving a designation operation for designating one pictorial representation included in the suggestion list; a display confirmation process for confirming the use of the pictorial display for which the designation operation has been performed; A process of receiving a change operation of the suggested target; and a program for executing the process, The suggested target determination process includes a target change process for changing the suggested target in the display to one corresponding to the change operation, The computer further includes a program for causing the computer to execute a process of displaying a mark indicating the suggested object on the display, the change operation includes an operation of swiping right on the display and an operation of swiping left on the display; The list display process includes a process of displaying a new suggestion list on the display from the left side of the currently displayed suggestion list in response to the right swipe operation, and a process of displaying a new suggestion list on the display from the right side of the currently displayed suggestion list in response to the left swipe operation, The object change process is a program including a process of changing the suggested object so that the mark moves to the left in response to the right swipe operation, and a process of changing the suggested object so that the mark moves to the right in response to the left swipe operation.

4. A computer comprising: A process for accepting text input; Displaying the entered text on a display; A suggested object determination process for determining a suggested object in the display; a list display process for displaying a suggestion list of the pictorial representations on the display when one or more pictorial representations corresponding to the suggestion target are present; A process of receiving a designation operation for designating one pictorial representation included in the suggestion list; a display confirmation process for confirming the use of the pictorial display for which the designation operation has been performed; A process of receiving a change operation of the suggested target; and a program for executing the process, The suggested target determination process includes a target change process for changing the suggested target in the display to one corresponding to the change operation, The computer further includes a program for causing the computer to execute a process of displaying a mark indicating the suggested object on the display, the change operation includes an operation of swiping right on the display and an operation of swiping left on the display; The list display process includes a process of displaying a new suggestion list on the display from the left side of the currently displayed suggestion list in response to the right swipe operation, and a process of displaying a new suggestion list on the display from the right side of the currently displayed suggestion list in response to the left swipe operation, The object change process is a program including a process of changing the suggested object so that the mark moves to the right in response to the right swipe operation, and a process of changing the suggested object so that the mark moves to the left in response to the left swipe operation.

5. On the computer, Further performing a process to determine the use of the input text; 5. The program according to claim 1, wherein the list display process displays the suggested list of pictorial representations at a position different from a list of conversion candidates for unconfirmed text whose use has not been confirmed.

6. The pictorial representation is: Emojis with assigned character codes, A stamp comprising an image; The display determination process includes: When the pictorial display that has been subjected to the designation operation is a pictorial symbol, a process of immediately confirming the use of the pictorial symbol; a process of displaying a preview of the stamp on the display when the pictorial representation subjected to the designation operation is a stamp; A process of accepting an approval operation for the previewed stamp; 6. The program according to claim 1, further comprising a process of confirming the use of the stamp upon receipt of the approval operation.

7. The computer includes: A process for determining the use of the entered text; and receiving a confirmed display designation operation for designating a part or all of the confirmed text and the confirmed pictorial display, The program according to claim 1 , wherein the process of determining the suggested target includes a process of determining a part designated by the confirmed display designation operation as the suggested target.

8. On the computer, A process for accepting text input; Displaying the entered text on a display; A suggested object determination process for determining a suggested object in the display; a list display process for displaying a suggestion list of the pictorial representations on the display when one or more pictorial representations corresponding to the suggestion target are present; A process of receiving a designation operation for designating one pictorial representation included in the suggestion list; a display confirmation process for confirming the use of the pictorial display for which the designation operation has been performed, The designation operation is a first designation operation for designating the one pictorial representation in a first manner; a second designation operation for designating the one pictorial representation by a second method different from the first method, The display determination process includes: a first determination process for replacing the pictorial indication subjected to the first designation operation with the suggested target and determining its use; and a second confirmation process for adding the pictorial display that received the second designation operation to the suggested target and confirming its use.

9. The pictorial representation is: Emojis with assigned character codes, A stamp comprising an image; The first determination process and the second determination process each include: When the pictorial display that has been subjected to the designation operation is a pictorial symbol, a process of immediately confirming the use of the pictorial symbol; a process of displaying a preview of the stamp on the display when the pictorial representation subjected to the designation operation is a stamp; A process of accepting an approval operation for the previewed stamp; 9. The program according to claim 8, further comprising a process of confirming the use of the stamp in response to the approval operation.

10. A computer-readable recording medium having the program according to any one of claims 1 to 9 recorded thereon.

Citation Information

Patent Citations

  • Character string conversion device, retrieval device, character string conversion method, and character string conversion program

    JP2011210149A

  • Input support device, program and pictograph input support method

    JP2013088925A

  • Conversion device, conversion program, and conversion method

    JP2016012196A