Information processor, information processing method, and program

Abstract

To reduce operation loads of a user for retrieving meanings of a plurality of word phrases.SOLUTION: A word phrase specification part 104 specifies a first retrieval object phrase and a second retrieval object phrase specified by a user on a basic screen. A retrieval part 105 retrieves meanings of the first retrieval object phrase and the second retrieval object phrase. A display control part 102 allows a display part 13 to display a first retrieval screen including a retrieval result to the first retrieval object phrase and a second retrieval screen including a retrieval result to the second retrieval object.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] For example, Patent Document 1 describes a technology in which a user specifies a word or phrase to be searched for in a sentence displayed on a screen, and an information processing device searches for the meaning of the specified word or phrase using a dictionary.In this technology, methods of specifying the word or phrase to be searched for include using a touch pen to circle the word or phrase to be searched for, and using a touch pen to trace the word or phrase to be searched for. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-114955 Summary of the Invention [Problem to be solved by the invention]

[0004] Here, a user who is referring to a sentence displayed on a screen may wish to search for multiple words. However, with the method described in Patent Document 1, the user must specify each word or phrase they wish to search for, which places a heavy operational burden on the user in searching for the meanings of multiple words or phrases. For this reason, there is a demand for a technology that reduces the operational burden on the user in searching for the meanings of multiple words or phrases.

[0005] The present disclosure has been made in consideration of the above problem, and aims to provide an information processing device, an information processing method, and a program that reduce the operational burden on a user when searching for the meanings of multiple words. [Means for solving the problem]

[0006] In order to achieve the above object, the information processing device according to the present disclosure includes: a phrase specifying means for specifying a first search target phrase and a second search target phrase specified by a user on the basic screen; a search means for searching the meanings of the first search target phrase and the second search target phrase; a display control means for causing a display unit to display a first search screen including search results for the first search target phrase and a second search screen including search results for the second search target phrase. 。 [Effects of the Invention]

[0007] According to the present disclosure, it is possible to reduce the operational burden on the user when searching for the meanings of multiple words and phrases. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a block diagram of an information processing device according to a first embodiment; [Figure 2] Functional configuration diagram of an information processing device according to the first embodiment [Figure 3] FIG. 10 is a diagram showing a basic screen displayed by the information processing device according to the first embodiment; [Figure 4] FIG. 1 is a diagram showing a procedure in which the information processing device according to the first embodiment identifies search target words from a partial image. [Figure 5] FIG. 10 is a diagram showing a state in which the information processing device according to the first embodiment displays a plurality of search screens superimposed on a basic screen; [Figure 6] FIG. 10 is a diagram showing a state in which the information processing device according to the first embodiment has pasted a sticky object on the basic screen; [Figure 7] 1 is a flowchart showing a search process executed by the information processing device according to the first embodiment; [Figure 8] FIG. 10 is a diagram showing a state in which an information processing device according to a second embodiment displays a plurality of search screens superimposed on a basic screen; [Figure 9] FIG. 10 is a diagram showing a state in which the information processing device according to the second embodiment has pasted a sticky object on the basic screen. [Figure 10] FIG. 10 is a diagram showing a basic screen displayed by an information processing device according to a third embodiment. [Figure 11] FIG. 10 is a diagram showing a procedure in which an information processing device according to a third embodiment identifies a search target phrase from a partial image. [Figure 12] FIG. 10 is a diagram showing a state in which an information processing device according to a third embodiment displays a plurality of search screens superimposed on a basic screen. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In the drawings, the same or corresponding parts are designated by the same reference numerals.

[0010] (Embodiment 1) FIG. 1 is a diagram showing the configuration of an information processing device 100 according to the first embodiment. The information processing device 100 is a device that executes various information processes related to searching for search target terms. Specifically, the information processing device 100 is a device that identifies multiple search target terms included in an area specified by the user on a screen presented to the user, and presents to the user search results for the meanings of the identified multiple search target terms. The information processing device 100 functions as an electronic dictionary. An electronic dictionary is an electronic device or software that reads dictionary information stored in a storage medium, searches for the meanings of words and phrases, and displays the search results.

[0011] The information processing device 100 has an operation reception function for receiving various operations, a display function for displaying various information, a communication function for communicating with various devices, etc. The information processing device 100 is, for example, a tablet terminal, a smartphone, a laptop computer, etc. The information processing device 100 is an example of an information processing device. As shown in FIG. 1 , the information processing device 100 has a control unit 11, a storage unit 12, a display unit 13, an operation reception unit 14, and a communication unit 15.

[0012] The control unit 11 includes a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), RTC (Real Time Clock), etc. The CPU is also called a central processing unit, central arithmetic unit, processor, microprocessor, microcomputer, DSP (Digital Signal Processor), etc., and functions as a central processing unit that executes processes and calculations related to the control of the information processing device 100. In the control unit 11, the CPU reads programs and data stored in the ROM and uses the RAM as a work area to perform overall control of the information processing device 100. The RTC is, for example, an integrated circuit with a timekeeping function. The CPU can determine the current date and time from the time information read from the RTC.

[0013] The storage unit 12 includes a nonvolatile semiconductor memory such as a flash memory, an EPROM (Erasable Programmable ROM), or an EEPROM (Electrically Erasable Programmable ROM), and serves as a so-called auxiliary storage device. The storage unit 12 stores programs and data used by the control unit 11 to execute various processes. The storage unit 12 also stores data generated or acquired by the control unit 11 as a result of executing various processes.

[0014] The display unit 13 displays various images under the control of the control unit 11. For example, the display unit 13 displays a screen for accepting various operations from the user. The display unit 13 includes a touch screen, a liquid crystal display, etc. The operation accepting unit 14 accepts various operations from the user and supplies information indicating the contents of the accepted operations to the control unit 11. The operation accepting unit 14 includes a touch screen, a button, a lever, etc.

[0015] The communication unit 15 communicates with devices connected to various communication networks under the control of the control unit 11. The communication unit 15 communicates with various devices in accordance with various wireless communication standards or wired communication standards. Examples of various wireless communication standards include Wi-Fi (registered trademark), LTE (Long Term Evolution), 4G (4th Generation), 5G (5th Generation), Bluetooth (registered trademark), Zigbee (registered trademark), etc. Examples of various wired communication standards include USB (Universal Serial Bus, registered trademark), Thunderbolt (registered trademark), etc. The communication unit 15 has a communication interface that complies with various communication standards.

[0016] Next, functions of the information processing device 100 will be described with reference to Fig. 2. Functionally, the information processing device 100 includes an image generation unit 101, a display control unit 102, a partial image extraction unit 103, a word / phrase identification unit 104, a search unit 105, and a sticky note instruction unit 106. Each of these functions is realized by software, firmware, or a combination of software and firmware. The software and firmware are written as programs and stored in the ROM or storage unit 12. Then, a CPU executes the programs stored in the ROM or storage unit 12 to realize each of these functions.

[0017] The image generation unit 101 generates a display image corresponding to a screen that the display control unit 102 displays on the display unit 13. Here, the display control unit 102 displays a basic screen, a search screen, etc. on the display unit 13. Therefore, the image generation unit 101 generates display images corresponding to the basic screen, the search screen, etc. The basic screen is a basic screen that is displayed on the entire display unit 13. In this embodiment, the basic screen is a screen on which handwritten characters can be input and displayed, typed characters can be input and displayed, sticky note objects can be attached, etc. Handwritten characters are characters written by handwriting input. Typed characters are characters written by typing.

[0018] A sticky note object is an object that resembles a sticky note and can be attached to the basic screen. A sticky note object is an object that allows for the input and display of handwritten characters and typed characters. The basic screen has a notebook-like function and is therefore also called a notebook screen. A search screen is a screen for presenting various information related to searching for the meaning of words. The search screen includes a search box that accepts input of search target words, an area that presents the dictionary used for the search, an area that presents the search results, and the like.

[0019] The display control unit 102 controls the display unit to display a basic screen including a character string. In this embodiment, the display unit is the display unit 13. Therefore, the display control unit 102 controls the display unit 13 to display the basic screen including the character string on the display unit 13. The concept of the basic screen including a character string not only includes a case where a character string is directly drawn on the basic screen, but also a case where a character string is drawn on a sticky note object attached to the basic screen, a case where a character string is included in an image attached to the basic screen, etc. The display control unit 102 is an example of a display control means.

[0020] The partial image extraction unit 103 extracts a partial image corresponding to a specified range from an image corresponding to the basic screen. The specified range is a range specified by the user on the basic screen. The specified range is a range that includes multiple search target terms. The partial image extraction unit 103 can identify the specified range based on operation information supplied from the operation acceptance unit 14. The operation information is information indicating an operation accepted by the operation acceptance unit 14 from the user, and is information that can identify the range specified by the user on the basic screen.

[0021] The phrase identification unit 104 identifies first and second search target terms specified by the user on the basic screen. In this embodiment, the phrase identification unit 104 identifies first and second search target terms included in a specified range, which is a range specified by the user on the basic screen. That is, the phrase identification unit 104 identifies first and second search target terms included in the partial image extracted by the partial image extraction unit 103. The first and second search target terms are search target terms. Hereinafter, the first and second search target terms will be collectively referred to as search target terms, as appropriate. The phrase identification unit 104 identifies search target terms by performing a series of processes based on the partial image. For example, the phrase identification unit 104 identifies search target terms by performing background removal processing, annotation processing, character type identification processing, character recognition processing, natural language processing, and the like. Various information used in each of these processes is stored, for example, in the storage unit 12.

[0022] The background removal process is a process of removing the background from a partial image. For example, the background removal process is a process of identifying pixels that constitute characters by binarizing the luminance values ​​of each pixel that constitutes the partial image using a luminance threshold. The luminance threshold may be a predetermined fixed value, or a value calculated from the luminance values ​​of each pixel that constitutes the partial image. The annotation process is a process of adding additional information to each part of the partial image. In this embodiment, the annotation process is a process of identifying a drawing area in the partial image and adding identification information to this drawing area. If a partial image contains multiple drawing areas, identification information is added to each drawing area. A drawing area is an area in a partial image where a group of characters, pictures, patterns, etc. are drawn. In this embodiment, a drawing area is basically a character string drawing area where a character string is drawn.

[0023] The character type identification process is a process for identifying the type of target character. In this embodiment, the character type identification process is a process for identifying whether the character drawn in the drawing area is a handwritten character or a typed character. The character recognition process is a process for recognizing characters through image processing. Specifically, the character recognition process is a process for analyzing the image of the drawing area, detecting patterns corresponding to characters contained in this image, and identifying the characters drawn in this image.

[0024] In this embodiment, character recognition processing for handwritten characters is performed on an image of a drawing area in which handwritten characters are drawn, and character recognition processing for typed characters is performed on an image of a drawing area in which typed characters are drawn. For example, assume that the first search target phrase is composed of handwritten characters drawn by handwriting input, and the second search target phrase is composed of typed characters drawn by typing. In this case, the phrase identification unit 104 performs character recognition processing for handwritten characters on the range in the specified range in which the first search target phrase is drawn to identify the first search target phrase. Furthermore, the phrase identification unit 104 performs character recognition processing for typed characters on the range in the specified range in which the second search target phrase is drawn to identify the second search target phrase.

[0025] Natural language processing is a process in which a computer analyzes natural language that humans use on a daily basis. In this embodiment, natural language processing is a process in which character strings that constitute phrases to be searched for are extracted from character strings identified by character recognition processing. The phrase identification unit 104 performs the above-described series of processes to identify first and second search target phrases that are included in the specified range. The phrase identification unit 104 is an example of a phrase identification means.

[0026] The search unit 105 searches for the meanings of the first search target phrase and the second search target phrase. For example, the search unit 105 searches for the meanings of the first search target phrase and the second search target phrase based on dictionary information stored in the storage unit 12. The dictionary information is information indicating the contents of a dictionary, and is information in which, for each of a large number of phrases, the phrase is associated with its meaning. Dictionary information is provided for each dictionary. Examples of dictionaries that can be used include Japanese dictionaries, encyclopedias, Chinese-Japanese dictionaries, Japanese-English dictionaries, English-Japanese dictionaries, and English-English dictionaries.

[0027] In this embodiment, both the first search target phrase and the second search target phrase are composed of Japanese characters. Therefore, the search unit 105 searches for the meanings of the first search target phrase and the second search target phrase using dictionary information from a Japanese dictionary. The Japanese dictionary can be a Japanese dictionary, an encyclopedia, a Chinese-Japanese dictionary, a Japanese-English dictionary, etc. The search unit 105 is an example of a search means.

[0028] The display control unit 102 causes the display unit to display a first search screen including search results for the first search target phrase and a second search screen including search results for the second search target phrase. In this embodiment, the display control unit 102 controls the display unit to display the first search screen and the second search screen superimposed on the basic screen. The image generation unit 101 generates an image corresponding to the first search screen based on the search results for the first search target phrase, and generates an image corresponding to the second search screen based on the search results for the second search target phrase.

[0029] The sticky note instructing unit 106 instructs the image generating unit 101 to sticky note the search screen based on the operation information supplied from the operation accepting unit 14. The search screen is a general term for the first search screen and the second search screen. For example, it is assumed that the first search screen has a first button that accepts an operation to instruct to sticky note the first search screen, and the second search screen has a second button that accepts an operation to instruct to sticky note the second search screen.

[0030] In this case, in response to the first button being pressed, the operation accepting unit 14 supplies operation information indicating that the first button has been pressed to the sticky note instructing unit 106. Upon acquiring this operation information, the sticky note instructing unit 106 instructs the image generating unit 101 to sticky the first search screen. In accordance with this instruction, the image generating unit 101 generates an image corresponding to the basic screen to which the first sticky note object containing the search result for the first search target phrase has been pasted. Therefore, in response to the first button being pressed, the display control unit 102 ends the display of the first search screen and displays the basic screen to which the first sticky note object containing the search result for the first search target phrase has been pasted.

[0031] Furthermore, in response to the second button being pressed, the operation accepting unit 14 supplies operation information indicating that the second button has been pressed to the sticky note instructing unit 106. Upon acquiring this operation information, the sticky note instructing unit 106 instructs the image generating unit 101 to sticky the second search screen. In accordance with this instruction, the image generating unit 101 generates an image corresponding to the basic screen to which a second sticky note object containing the search results for the second search target phrase has been pasted. Therefore, in response to the second button being pressed, the display control unit 102 ends the display of the second search screen and displays the basic screen to which a second sticky note object containing the search results for the second search target phrase has been pasted.

[0032] In this embodiment, the display control unit 102 displays a basic screen on which the first sticky note object and the second sticky note object are pasted in a manner that they are visually associated with each other.

[0033] Next, the search process executed by the information processing device 100 will be specifically described with reference to Figures 3, 4, 5, and 6. Figure 3 shows a basic screen 500 displayed by the information processing device 100. The basic screen 500 includes a toolbox 510 and a tag object 520.

[0034] The toolbox 510 is a box that stores various tools for operating the basic screen 500. In the present embodiment, the toolbox 510 includes tools for selecting an area on the basic screen 500. The toolbox 510 includes a rectangular area designation tool 511 and an arbitrary area designation tool 512. For example, if the information processing device 100 includes a touch screen, the user can select the rectangular area designation tool 511 or the arbitrary area designation tool 512 by tapping with a fingertip or a touch pen.

[0035] The rectangular area designation tool 511 is a tool for selecting a rectangular area on the basic screen 500. For example, after selecting the rectangular area designation tool 511, the user can select a rectangular area by sliding the contact position of a fingertip or a touch pen on the basic screen 500. In this case, a rectangular area having opposite vertices at the contact start position and contact end position is selected.

[0036] The arbitrary area designation tool 512 is a tool for selecting an area of ​​an arbitrary shape on the basic screen 500. For example, after selecting the arbitrary area designation tool 512, the user can select an area of ​​an arbitrary shape by moving the contact position of a fingertip or a touch pen on the basic screen 500 until it returns to the contact start position. In this case, an area enclosed by a locus drawn by the contact position is selected.

[0037] The sticky note object 520 is an object attached to the basic screen 500, and is an object on which handwritten characters and typed characters can be drawn. A character string 521 made up of handwritten characters and a character string 522 made up of typed characters are drawn on the sticky note object 520. In this embodiment, it is assumed that the sticky note object 520 on which the character string 522 is drawn is provided by the teacher to the student who is the user, and the student attaches the sticky note object 520 to the basic screen 500 and then draws the character string 521 on the sticky note object 520.

[0038] The following describes a case where a user uses the arbitrary area designation tool 512 to designate an area surrounding character string 521, which is a character string of handwritten characters for "kumo" (spider), and the typed character string ". Goshaka-sama" (Buddha) from character string 522. Line 523 is a line that indicates the outer edge of the designated area, which is the area designated by the user. In other words, the area surrounded by line 523 is the designated area. In this case, multiple search target words are identified based on the image within the designated area on the basic screen 500.

[0039] 4 shows a procedure in which the information processing device 100 identifies a search target word from the partial image 50. The partial image 50 is an image of a portion of the basic screen 500 that corresponds to a specified area. The partial image extraction unit 103 can generate the partial image 50 by extracting the image of the portion that corresponds to the specified area from the image showing the basic screen 500.

[0040] First, the word / phrase identification unit 104 performs background removal processing on the partial image 50 to generate a background-removed partial image 51. The background removal processing is expected to improve the accuracy of annotation processing, character type identification processing, character recognition processing, and the like.

[0041] Next, the word and phrase identification unit 104 identifies a drawing area in the partial image 51 by performing annotation processing on the partial image 51. For example, the word and phrase identification unit 104 identifies the drawing area based on the distribution of luminance values ​​of each pixel in the partial image 51. For example, if the average luminance value of an area in which a character string is drawn is high, the word and phrase identification unit 104 identifies the area with the high average luminance value as the drawing area. In this embodiment, the word and phrase identification unit 104 identifies the drawing area 52, the drawing area 53, and the drawing area 54 as the drawing areas. The drawing area 52 is an area in which the handwritten character string "kumo" (spider) is drawn. The drawing area 53 is an area in which the typed character string "goshaka-sama" (Buddha) is drawn. The drawing area 54 is an area in which the typed character "." (period) is drawn.

[0042] Next, the phrase identification unit 104 recognizes the character strings drawn in the drawing areas 52, 53, and 54, respectively, by performing character recognition processing on the drawing areas 52, 53, and 54. For example, the phrase identification unit 104 can recognize the character strings drawn in each drawing area using well-known OCR (Optical Character Recognition) technology. However, applying a common OCR technology to both handwritten characters and typed characters may result in low character recognition accuracy. Therefore, in this embodiment, OCR for handwritten characters is applied to drawing areas in which handwritten characters are drawn, and OCR for typed characters is applied to drawing areas in which typed characters are drawn.

[0043] OCR for handwritten characters is OCR with high accuracy in character recognition for handwritten characters, that is, OCR specialized for character recognition of handwritten characters. OCR for handwritten characters is a technology that recognizes characters drawn in a drawing area using, for example, a recognition dictionary for handwritten characters. OCR for typed characters is OCR with high accuracy in character recognition for typed characters, that is, OCR specialized for character recognition of typed characters. OCR for typed characters is a technology that recognizes characters drawn in a drawing area using, for example, a recognition dictionary for typed characters. The recognition dictionary for handwritten characters and the recognition dictionary for typed characters are stored, for example, in the storage unit 12.

[0044] The word / phrase identification unit 104 executes a character type identification process to identify the type of character drawn in each drawing area in order to perform OCR according to the character type indicating either handwritten characters or typed characters. The type of character type identification process can be adjusted as appropriate. For example, the word / phrase identification unit 104 can determine the character type of a character drawn in a drawing area based on the blurring of the lines that make up the character drawn in the drawing area. For example, the word / phrase identification unit 104 can determine a character having a blurred line in the direction in which the line extends as a handwritten character, and a character having a line that does not blur in the direction in which the line extends as a typed character.

[0045] The word and phrase identification unit 104 identifies the character types of the characters drawn in each of the drawing areas 52, 53, and 54 through character type identification processing. In this embodiment, the word and phrase identification unit 104 determines that the characters drawn in the drawing area 52 are handwritten characters, and performs OCR for handwritten characters on the drawing area 52. The word and phrase identification unit 104 also determines that the characters drawn in the drawing areas 53 and 54 are typed characters, and performs OCR for typed characters on the drawing areas 53 and 54. Through character recognition processing, the word and phrase identification unit 104 identifies that the character string "kumo" (spider) is drawn in the drawing area 52, the character string "Oshaka-sama" (Buddha) is drawn in the drawing area 53, and a period "." is drawn in the drawing area 54.

[0046] The phrase identification unit 104 identifies search target phrases by performing natural language processing on each character string identified by the character identification process. For example, in the natural language processing, the phrase identification unit 104 extracts word bases by excluding prefixes and suffixes from the character strings, and identifies the word bases as search target phrases. For example, for the character string "kumo" (spider), the phrase identification unit 104 determines "kumo" as the word base and identifies "kumo" as the search target phrase. Furthermore, for the character string "Goshaka-sama" (Go-Shaka-sama), the phrase identification unit 104 determines "Go" as the prefix, "sama" as the suffix, and "Shaka" as the word base and identifies "Shaka" as the search target phrase. Furthermore, the phrase identification unit 104 determines that the character "." does not have a word base and therefore does not identify the search target phrase. In this way, the phrase identification unit 104 identifies "kumo" and "Shaka" as search target phrases. "Spider" is an example of a first search target phrase. "Buddha" is an example of a second search target phrase.

[0047] The search unit 105 searches for the meanings of the first search target phrase and the second search target phrase. For example, the search unit 105 searches for the meaning of the first search target phrase by referring to dictionary information of at least one dictionary. In this embodiment, the meaning of a phrase is a concept that includes not only the explanation of the phrase but also translations in languages ​​different from the language of the phrase. For example, if the first search target phrase is Japanese, the meaning of the first search target phrase includes the explanation of the first search target phrase in Japanese, the English translation of the first search target phrase, etc. Furthermore, the search unit 105 searches for the meaning of the second search target phrase by referring to dictionary information of at least one dictionary.

[0048] 5, the display control unit 102 displays a search screen 610 including search results for the first search target phrase and a search screen 620 including search results for the second search target phrase, superimposed on the basic screen 500. The search screen 610 is a screen for presenting various information related to the search for the first search target phrase. The search screen 620 is a screen for presenting various information related to the search for the second search target phrase. The search screen 610 and the search screen 620 are displayed superimposed on the basic screen 500, superimposed on each other.

[0049] The search screen 610 includes a search result presentation area 611, a list presentation area 612, a search box 613, and a sticky note button 614. The search result presentation area 611 is an area for presenting the search results of the first search target phrase, i.e., the meaning of the first search target phrase. The list presentation area 612 is an area for presenting a list of dictionaries used to search for the first search target phrase and phrases related to the first search target phrase stored in each dictionary. The search result presentation area 611 presents the search results of a dictionary selected from the dictionaries presented in the list presentation area 612. More specifically, the search result presentation area 611 presents the meaning of a phrase selected from the phrases presented in the list presentation area 612, that is, the meaning in the dictionary used to search for the selected phrase. Phrases related to the first search target phrase include, in addition to the first search target phrase itself, phrases including the first search target phrase, for example.

[0050] The search box 613 is a box for displaying search target terms in a search using the search screen 610, accepting input of search target terms, and accepting search instructions. The search box 613 displays a first search target term as an initial value. The user can rewrite the term displayed in the search box 613 with a new term and execute a search for the new term. The sticky note button 614 is a button for accepting an operation to instruct to sticky note the search screen 610. By sticky note-ifying the search screen 610, the display of the search screen 610 is terminated, and a sticky note object including information contained in the search screen 610 is pasted on the basic screen 500. The search screen 610 is an example of a first search screen. The sticky note button 614 is an example of a first sticky note button.

[0051] The search screen 620 includes a search result presentation area 621, a list presentation area 622, a search box 623, and a sticky note button 624. The search result presentation area 621 is an area for presenting the search results of the second search target phrase, i.e., the meaning of the second search target phrase. The list presentation area 622 is an area for presenting a list of dictionaries used to search for the second search target phrase and phrases related to the second search target phrase stored in each dictionary. The search result presentation area 621 presents the search results of a dictionary selected from the dictionaries presented in the list presentation area 622. More specifically, the search result presentation area 621 presents the meaning of a phrase selected from the phrases presented in the list presentation area 622, that is, the meaning in the dictionary used to search for the selected phrase. Phrases related to the second search target phrase include, in addition to the second search target phrase itself, phrases including the second search target phrase, for example.

[0052] Search box 623 is a box for displaying search target terms in a search using search screen 620, accepting input of search target terms, and accepting search instructions. Search box 623 displays second search target terms as initial values. The user can rewrite the terms displayed in search box 623 with new terms and execute a search for the new terms. Sticky note button 624 is a button for accepting an operation to instruct to make search screen 620 sticky. By making search screen 620 sticky, the display of search screen 620 ends, and a sticky note object including information contained in search screen 620 is pasted on basic screen 500. Search screen 620 is an example of a second search screen. Sticky note button 624 is an example of a second sticky note button.

[0053] 6 shows a basic screen 500A generated by adding sticky notes to a search screen 610 and a search screen 620. The basic screen 500A is a screen in which a sticky note object 530 and a sticky note object 540 are attached to the basic screen 500. The basic screen 500A includes a toolbox 510, a sticky note object 520, a sticky note object 530, and a sticky note object 540.

[0054] The sticky note object 530 is an object generated by stickying the search screen 610. The sticky note object 530 presents information that was presented by the search screen 610. For example, the sticky note object 530 presents the search results that the search screen 610 presented in the search result presentation area 611 at the time the search screen 610 was stickyed. The sticky note object 530 may present a summary of the search results, or may present the dictionary used for the search in addition to the search results. Note that the user can change the content presented by the sticky note object 530 by rewriting the content written in the sticky note object 530. The sticky note object 530 is an example of a first sticky note object.

[0055] The sticky note object 540 is an object generated by stickying the search screen 620. The sticky note object 540 presents information that was presented by the search screen 620. For example, the sticky note object 540 presents the search results that the search screen 620 presented in the search result presentation area 621 at the time the search screen 620 was stickyed. The sticky note object 540 may present a summary of the search results, or may present the dictionary used for the search in addition to the search results. Note that the user can change the content presented by the sticky note object 540 by rewriting the content written in the sticky note object 540. The sticky note object 540 is an example of a second sticky note object.

[0056] The sticky note object 520 and the sticky note object 530 are connected by an arrow 531. The arrow 531 is an arrow for visually associating the sticky note object 520 and the sticky note object 530. The arrow 531 indicates that the sticky note object 530 presents the meaning of the word in the sticky note object 520.

[0057] Sticky note object 530 and sticky note object 540 are connected by line 541. Line 532 is a line for visually associating sticky note object 530 and sticky note object 540. Line 532 indicates that the meaning of the word presented by sticky note object 530 and the meaning of the word presented by sticky note object 540 have been searched simultaneously. Note that arrow 531 and line 532 indicate that sticky note object 540 is presenting the meaning of the word in sticky note object 520.

[0058] Next, the search process executed by the information processing device 100 will be described with reference to the flowchart of Fig. 7. The information processing device 100 starts execution of the search process after presenting the basic screen 500, for example.

[0059] First, the control unit 11 included in the information processing device 100 determines whether or not an area designation operation has been performed (step S101). The area designation operation is an operation of designating an area including a search target phrase on the basic screen 500 using the rectangular area designation tool 511 or the arbitrary area designation tool 512. When the control unit 11 determines that an area designation operation has been performed (step S101: YES), it extracts the partial image 50 (step S102). For example, the control unit 11 extracts, as the partial image 50, an image corresponding to the designated area designated by the area designation operation from the image showing the basic screen 500.

[0060] Upon completing the process of step S102, control unit 11 executes background removal processing (step S103). That is, control unit 11 removes the background from partial image 50 to generate partial image 51. Upon completing the process of step S103, control unit 11 executes annotation processing (step S104). That is, control unit 11 analyzes partial image 51 to identify drawing area 52, drawing area 53, and drawing area 54.

[0061] Upon completing the process of step S104, control unit 11 selects a drawing area (step S105). That is, control unit 11 selects one drawing area from drawing area 52, drawing area 53, and drawing area 54. Upon completing the process of step S105, control unit 11 identifies the character type (step S106). That is, control unit 11 determines whether the character type of the character drawn in the selected drawing area is a handwritten character or a typed character.

[0062] When the control unit 11 completes the process of step S106, it executes character recognition processing according to the character type (step S107). That is, if the identified character type is handwritten characters, the control unit 11 executes OCR for handwritten characters. On the other hand, if the identified character type is typed characters, the control unit 11 executes OCR for typed characters.

[0063] Upon completing the process of step S107, control unit 11 executes natural language processing (step S108). That is, control unit 11 identifies the search target phrase by executing natural language processing on the character string obtained by the character recognition process. Upon completing the process of step S108, control unit 11 searches for the search target phrase in a dictionary (step S109). That is, control unit 11 searches for the meaning of the search target phrase by referring to dictionary information of at least one dictionary.

[0064] Upon completing the processing of step S109, control unit 11 determines whether or not there is an unselected drawing area (step S110). If control unit 11 determines that there is an unselected drawing area (step S110: YES), control unit 11 returns the processing to step S105. If control unit 11 determines that there is no unselected drawing area (step S110: NO), control unit 11 displays a search screen including the search results (step S111). That is, control unit 11 displays search screen 610 including the search results of the first search target phrase and search screen 620 including the search results of the second search target phrase, superimposed on basic screen 500.

[0065] When the process of step S111 is completed, the control unit 11 determines whether or not there is an operation to instruct to end the display of the search screen (step S112). The operation to instruct to end the display includes an operation to make the search screen non-sticky that instructs to end the display of the search screen without making the search screen sticky, and an operation to make the search screen sticky that instructs to end the display of the search screen with making the search screen sticky. When the control unit 11 determines that there is no operation to instruct to end the display of the search screen (step S112: NO), the control unit 11 returns the process to step S112.

[0066] When the control unit 11 determines that an operation to instruct to end the display of the search screen has been performed (step S112: YES), the control unit 11 ends the display of the search screen (step S113). When the control unit 11 completes the process of step S113, the control unit 11 determines whether the operation to instruct to end the display is a sticky note operation (step S114). When the control unit 11 determines that the operation to instruct to end the display is a sticky note operation (step S114: YES), the control unit 11 pastes a sticky note object on the basic screen 500 (step S115).

[0067] If the control unit 11 determines that there is no area designation operation (step S101: NO), if it determines that the display termination instruction operation is not a sticky note instruction operation (step S114: NO), or if it completes the processing of step S115, it returns the processing to step S101.

[0068] Note that the processes from step S111 to step S115 are executed for each of the multiple search screens. That is, for each of the multiple search screens, when a sticky note instruction operation is performed, the display is terminated after sticky notes are added, and when an unsticky note instruction operation is performed, the display is terminated without sticky notes being added. For example, when a sticky note instruction operation is performed for search screen 610 and an unsticky note instruction operation is performed for search screen 620, only search screen 610 is sticky. That is, in this case, only sticky note object 530 corresponding to search screen 610 is affixed to basic screen 500, and sticky note object 540 corresponding to search screen 620 is not affixed to basic screen 500.

[0069] In this embodiment, the meanings of a first search target phrase and a second search target phrase specified by a user are searched for, and a first search screen containing search results for the first search target phrase and a second search screen containing search results for the second search target phrase are displayed. In this embodiment, the meanings of multiple search target phrases are searched for and presented together through a simple user operation. Specifically, in this embodiment, the meanings of multiple phrases are searched for and presented simply by the user specifying a range that includes multiple phrases. Therefore, according to this embodiment, it is possible to reduce the operational burden on the user when searching for the meanings of multiple phrases.

[0070] In this embodiment, character recognition processing for handwritten characters is performed on the area where handwritten characters are written, and character recognition processing for typed characters is performed on the area where typed characters are written. Therefore, according to this embodiment, it is possible to improve the recognition accuracy of character recognition even when handwritten characters and typed characters are mixed in the specified area.

[0071] In this embodiment, a first search screen or a second search screen including a list of dictionaries for which search results are found among a plurality of dictionaries is displayed. Therefore, according to this embodiment, it is possible to inform the user of dictionaries for which search results are found.

[0072] In addition, in this embodiment, a first search screen or a second search screen including search results in a dictionary specified by a user from among a plurality of dictionaries is displayed. Therefore, according to this embodiment, search results from a plurality of dictionaries can be efficiently notified to the user.

[0073] Furthermore, in this embodiment, the first search screen and the second search screen are displayed overlapping each other, so that the sizes of the first search screen and the second search screen can be increased.

[0074] In addition, in this embodiment, the first search screen and the second search screen can be made sticky. Therefore, according to this embodiment, the search results of the search target phrase can be recorded on the basic screen 500 with a small operational burden.

[0075] In addition, in this embodiment, the first sticky object and the second sticky object are attached in a manner that they are visually associated with each other. Therefore, according to this embodiment, it is possible to notify the user that the first sticky object and the second sticky object are presenting search results for the words that were searched for simultaneously.

[0076] (Embodiment 2) In the first embodiment, an example in which the language of the search target phrase is limited to a single language has been described. In the present embodiment, an example in which the language of the search target phrase is not limited to a single language will be described. Note that the description of the same configurations and functions as those in the first embodiment will be omitted or simplified as appropriate.

[0077] In this embodiment, the first search target phrase is composed of characters for a first language, and the second search target phrase is composed of characters for a second language different from the first language. In this embodiment, the search unit 105 searches for the meaning of the first search target phrase using dictionary information in a dictionary for the first language, and searches for the meaning of the second search target phrase using dictionary information in a dictionary for the second language. In this embodiment, the first language is English, and the second language is Japanese. In this way, in this embodiment, the search unit 105 searches for the meaning of the search target phrase using dictionary information in a dictionary corresponding to the language of the search target phrase. The dictionary for Japanese is a Japanese dictionary, an encyclopedia, a Chinese-Japanese dictionary, a Japanese-English dictionary, etc. The dictionary for English is an English-Japanese dictionary, an English-English dictionary, etc.

[0078] 8, the basic screen 502 displayed by the information processing device 100 includes Japanese character strings and English character strings. The basic screen 502 includes a toolbox 510 and a tag object 550.

[0079] The sticky note object 550 is an object attached to the basic screen 502, and is an object on which handwritten characters and typed characters can be drawn. The sticky note object 550 has drawn thereon a character string 551 made up of handwritten characters and a character string 552 made up of typed characters. The character string 551 is the English character string "Buddha." The character string 552 is a Japanese character string.

[0080] The following describes a case where a user uses rectangular area designation tool 511 to designate an area that surrounds character string 551, which is the English character string "Buddha," and the Japanese character string ". Goshakasama" from character string 552. Dashed line 553 indicates the outer edge of the designated area, which is the area designated by the user. In other words, the area surrounded by dashed line 553 is the designated area. In this case, multiple search target words are identified based on the image within the designated area on basic screen 502.

[0081] The procedure by which the information processing device 100 identifies search target phrases from a partial image corresponding to a specified area on the basic screen 502 is basically the same as the procedure described in embodiment 1. That is, the information processing device 100 identifies search target phrases by performing background removal processing, annotation processing, character type identification processing, character recognition processing, natural language processing, etc. For example, the phrase identification unit 104 identifies the phrase "Buddha" as the first search target phrase and the phrase "Shakyamuni" as the second search target phrase.

[0082] The search unit 105 searches for the meanings of the first search target phrase and the second search target phrase. For example, the search unit 105 refers to dictionary information of at least one English dictionary to search for the meaning of the first search target phrase. Also, the search unit 105 refers to dictionary information of at least one Japanese dictionary to search for the meaning of the second search target phrase.

[0083] 8, the display control unit 102 displays a search screen 630 including search results for the first search target phrase and a search screen 620 including search results for the second search target phrase, superimposed on the basic screen 502. The search screen 630 is a screen for presenting various information related to the search for the first search target phrase. The search screen 620 is a screen for presenting various information related to the search for the second search target phrase. The search screen 630 and the search screen 620 are displayed superimposed on the basic screen 502, superimposed on each other.

[0084] The search screen 630 includes a search result presentation area 631, a list presentation area 632, a search box 633, and a sticky note button 634. The search result presentation area 631, the list presentation area 632, the search box 633, and the sticky note button 634 have the same functions as the search result presentation area 611, the list presentation area 612, the search box 613, and the sticky note button 614, respectively. The configuration of the search screen 620 is as shown in the first embodiment. In this way, even if the specified area contains search target terms in different languages, the information processing device 100 can perform an appropriate search according to the language of the search target terms. The search screen 630 is an example of a first search screen. The sticky note button 634 is an example of a first sticky note button.

[0085] 9 shows a basic screen 502A generated by adding sticky notes to the search screen 630 and the search screen 620. The basic screen 502A is a screen in which a sticky note object 560 and a sticky note object 540 are attached to the basic screen 502. The basic screen 502A includes a toolbox 510, a sticky note object 540, a sticky note object 550, and a sticky note object 560. The sticky note object 540 is an object generated by adding sticky notes to the search screen 620, as described in the first embodiment.

[0086] The sticky note object 560 is an object generated by stickying the search screen 630. The sticky note object 560 presents information that was presented by the search screen 630. For example, the sticky note object 560 presents the search results that the search screen 630 presented in the search result presentation area 631 at the time the search screen 630 was stickyed. The sticky note object 560 may present a summary of the search results, or may present the dictionary used for the search in addition to the search results. Note that the user can change the content presented by the sticky note object 560 by rewriting the content written in the sticky note object 560. The sticky note object 560 is an example of a first sticky note object.

[0087] In the present embodiment, the sticky note object 540 and the sticky note object 560 are pasted on the basic screen 502A in a visually associated manner. Specifically, the sticky note object 540 and the sticky note object 560 are pasted on the basic screen 502A in an overlapping state. The fact that the sticky note object 540 and the sticky note object 560 are overlapping indicates that the meaning of the word presented by the sticky note object 540 and the meaning of the word presented by the sticky note object 560 have been searched for simultaneously.

[0088] Furthermore, in this embodiment, the sticky note object 540 and the sticky note object 550 are pasted on the basic screen 502A in a visually associated manner. Specifically, the sticky note object 540 and the sticky note object 550 are pasted on the basic screen 502A in an overlapping state. The fact that the sticky note object 540 and the sticky note object 550 are overlapping indicates that the sticky note object 540 presents the meaning of a word or phrase in the sticky note object 550. Furthermore, the fact that the sticky note object 540 and the sticky note object 550 are overlapping, and the fact that the sticky note object 540 and the sticky note object 560 are overlapping indicates that the sticky note object 560 presents the meaning of a word or phrase in the sticky note object 550.

[0089] In this embodiment, the meaning of a first search target phrase is searched for using dictionary information in a dictionary for a first language, and the meaning of a second search target phrase is searched for using dictionary information in a dictionary for a second language. Therefore, according to this embodiment, it is possible to appropriately search for the meaning of a search target phrase depending on the language of the search target phrase.

[0090] (Embodiment 3) In the first embodiment, an example of detecting a single search target phrase from one drawing area has been described. In the present embodiment, an example of detecting multiple search target phrases from one drawing area will be described. Note that the description of the same configurations and functions as those in the first and second embodiments will be omitted or simplified as appropriate.

[0091] In this embodiment, the first search target phrase and the second search target phrase are words included in a series of character strings included in the specified range. In this embodiment, the phrase identification unit 104 performs character recognition processing on the range in the specified range in which the series of character strings is drawn, thereby identifying the series of character strings. The phrase identification unit 104 also performs word segmentation processing on the identified series of character strings, thereby identifying the first search target phrase and the second search target phrase.

[0092] 10, the basic screen 503 displayed by the information processing device 100 includes a toolbox 510 and a sticky note object 570. The sticky note object 570 is an object attached to the basic screen 503, and is an object on which handwritten characters and typed characters can be drawn. A character string 572 made up of typed characters is drawn on the sticky note object 570.

[0093] The following describes a case where the user uses rectangular area designation tool 511 to designate an area surrounding the character string "Lotus Pond in Paradise" in character string 572. Dashed line 573 indicates the outer edge of the designated area, which is the area designated by the user. In other words, the area surrounded by dashed line 573 is the designated area. In this case, multiple search target words are identified based on the image within the designated area on basic screen 503.

[0094] 11 shows the procedure by which the information processing device 100 identifies a search target word from the partial image 60. The partial image 60 is an image of a portion of the basic screen 503 that corresponds to a specified area. The partial image extraction unit 103 can generate the partial image 60 by extracting the image of the portion that corresponds to the specified area from the image showing the basic screen 503.

[0095] First, the word and phrase identification unit 104 performs background removal processing on the partial image 60 to generate a partial image 61 from which the background has been removed. Next, the word and phrase identification unit 104 performs annotation processing on the partial image 61 to identify a drawing area in the partial image 61. In this embodiment, the word and phrase identification unit 104 identifies the drawing area 62 as the drawing area. The drawing area 62 is an area in which a series of characters, "Lotus Pond in Paradise," is drawn. Next, the word and phrase identification unit 104 performs character recognition processing on the drawing area 62 to recognize the character string drawn in the drawing area 62.

[0096] Here, the phrase identification unit 104 performs word segmentation processing on the series of character strings "Lotus Pond in Paradise." The word segmentation processing is processing for dividing the series of character strings into a plurality of words. The phrase identification unit 104 divides the series of character strings into a plurality of words, for example, by referring to word dictionary information indicating a large number of words. The word dictionary information is stored in the storage unit 12, for example.

[0097] In this embodiment, the phrase identification unit 104 divides the string of characters "Gokuraku no Hasuike" into three words: "Gokuraku", "no", and "Hasuike". In this embodiment, one of "Gokuraku", "no", and "Hasuike" is the first search target phrase, and one of "Gokuraku", "no", and "Hasuike" other than the first search target phrase is the second search target phrase.

[0098] The search unit 105 searches for the meaning of each word by referring to dictionary information of at least one dictionary. Specifically, the search unit 105 searches for the meanings of "gokuraku," "no," and "hasuike" by referring to dictionary information of at least one Japanese dictionary.

[0099] 12, the display control unit 102 displays a search screen 640 containing the search results for "gokuraku", a search screen 650 containing the search results for "no", and a search screen 660 containing the search results for "hasuike" superimposed on the basic screen 503. The search screens 640, 650, and 660 are displayed superimposed on the basic screen 503, superimposed on each other.

[0100] The configurations of search screens 640, 650, and 660 are basically the same as that of search screen 620. For example, search screen 640 includes a search result presentation area 641, a list presentation area 642, a search box 643, and a sticky note button 644. Search result presentation area 641 presents search results for "paradise." List presentation area 642 presents a list of dictionaries used in the search, a list of words related to "paradise," etc. Search box 643 is a box that displays search target words in a search using search screen 640, accepts input of search target words, and also accepts search instructions. Sticky note button 644 is a button that accepts an operation to instruct to sticky note search screen 640. One of search screen 640, search screen 650, and search screen 660 is the first search screen, and the other of search screen 640, search screen 650, and search screen 660 other than the first search screen is the second search screen.

[0101] In this embodiment, a word segmentation process is performed on a series of character strings in a specified range to identify first and second search target terms. Therefore, according to this embodiment, it is possible to search for the meanings of multiple words included in a series of character strings with little operational burden.

[0102] (Variation) Although the embodiments have been described above, modifications and applications in various forms are possible. It is up to the discretion of the individual to adopt any of the configurations, functions, and operations described in the above embodiments. Furthermore, in addition to the above-described configurations, functions, and operations, additional configurations, functions, and operations may be adopted. Furthermore, the configurations, functions, and operations described in the above embodiments can be freely combined.

[0103] For example, by combining embodiment 1 and embodiment 3, if multiple drawing areas are detected in a specified area, a word segmentation process may be performed on a series of character strings in each drawing area, and multiple search target terms may be identified for each drawing area.

[0104] Furthermore, the types of search target phrases are not limited to those shown in embodiments 1-3. For example, the specified multiple search target phrases may be a single type of phrase rather than multiple types of phrases. Specifically, for example, multiple typed phrases in a single language may be specified as multiple search target phrases, or multiple handwritten phrases in a single language may be specified as multiple search target phrases. Furthermore, typed phrases in multiple languages ​​may be specified as multiple search target phrases, or handwritten phrases in multiple languages ​​may be specified as multiple search target phrases.

[0105] In the first to third embodiments, an example has been described in which a user specifies a search target phrase by specifying an area. The method by which a user specifies a search target phrase is not limited to this example. For example, a user may specify a search target phrase by using the arbitrary area specification tool 512 to draw a line through the search target phrase or check the search target phrase.

[0106] In the first embodiment, an example has been described in which dictionary information is stored in the storage unit 12 included in the information processing device 100. The dictionary information may be stored in another device. For example, the dictionary information may be stored in a server connected to the information processing device 100 via a communication network.

[0107] In the first and second embodiments, the meanings of two words and phrases are searched, and in the third embodiment, the meanings of three words and phrases are searched. The meanings of four or more words and phrases may be searched. Furthermore, for words for which it is considered that there is little need to display search results, a search or display of search results may not be performed. For example, for parts of speech such as particles and auxiliary verbs, a search or display of search results may not be performed. Specifically, for example, in the third embodiment, the particle "no" may not be searched, and search results may not be displayed.

[0108] The number of search target words may be one, not two or more. For example, if the specified area contains one search target word, a search for the meaning of the word, presentation of a search screen, etc. may be performed for this one search target word.

[0109] In any embodiment, the search result presentation area presents search results (meanings of words and phrases) searched in the dictionary selected in the list presentation area. This is not limited to selection by user operation, and a candidate may be selected as an initial value by the control unit 11. Specifically, for example, when an English word in a character string mainly composed of Japanese is the search target word, the search results from an English-Japanese dictionary may be selected, and when an English word in a character string mainly composed of English is the search target word, the search results from an English-English dictionary may be selected. In this case, too, the search results to be displayed can be switched by selection by user operation. Furthermore, any method may be used to determine the constituent language of the character string, and for example, a method may be used in which a process of identifying the character type is performed for the entire sticky note object.

[0110] The method for identifying the part of speech of the search target phrase can be adjusted as appropriate. For example, if the word dictionary information includes information indicating the part of speech of each word, the part of speech of the search target phrase can be identified by referring to the word dictionary information. Also, if the dictionary information includes information indicating the part of speech of each word, the part of speech of the search target phrase can be identified by referring to the dictionary information, and whether or not to present search results can be determined based on the part of speech of the search target phrase.

[0111] In the above embodiment, the CPU in the control unit 11 executes a program stored in the ROM or the storage unit 12, thereby functioning as each unit shown in FIG. 2 . However, in the present disclosure, the control unit 11 may be dedicated hardware. Dedicated hardware may be, for example, a single circuit, a composite circuit, a programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a combination thereof. When the control unit 11 is dedicated hardware, the functions of each unit may be realized by individual hardware, or the functions of each unit may be realized collectively by a single piece of hardware. Furthermore, some of the functions of each unit may be realized by dedicated hardware, and the other functions may be realized by software or firmware. In this way, the control unit 11 can realize each of the above-described functions by hardware, software, firmware, or a combination thereof.

[0112] By applying an operation program that defines the operation of the information processing device 100 according to the present disclosure to a computer such as an existing personal computer or information terminal device, it is also possible to cause the computer to function as the information processing device 100 according to the present disclosure. In addition, the method of distributing such a program is arbitrary, and for example, the program may be distributed by being stored on a computer-readable recording medium such as a CD-ROM (Compact Disk ROM), a DVD (Digital Versatile Disk), an MO (Magneto Optical Disk), or a memory card, or may be distributed via a communication network such as the Internet.

[0113] The present disclosure allows various embodiments and modifications without departing from the broad spirit and scope of the present disclosure. Furthermore, the above-described embodiments are intended to explain the present disclosure and do not limit the scope of the present disclosure. That is, the scope of the present disclosure is defined by the claims, not the embodiments. Various modifications made within the scope of the claims and the meaning of equivalent disclosures are considered to be within the scope of the present disclosure. [Explanation of symbols]

[0114] 11 control unit, 12 memory unit, 13 display unit, 14 operation reception unit, 15 communication unit, 50, 51, 60, 61 partial image, 52, 53, 54, 62 drawing area, 100 information processing device, 101 image generation unit, 102 display control unit, 103 partial image extraction unit, 104 phrase identification unit, 105 search unit, 106 sticky note instruction unit, 500, 500A, 502, 502A, 503 basic screen, 510 toolbox, 511 rectangular area designation tool, 512 arbitrary area designation tool, 520, 530, 540, 550, 560, 570 sticky note object, 521, 522, 551, 552, 572 character string, 523, 541 line, 531 arrow, 553, 573 Dashed lines, 610, 620, 630, 640, 650, 660 Search screen, 611, 621, 631, 641 Search result display area, 612, 613, 614, 615 List display area, 613, 623, 633, 643 Search box, 614, 624, 634, 644 Sticky note button

Claims

1. a phrase specifying means for specifying a first search target phrase and a second search target phrase specified by a user on the basic screen; A search means for searching the meanings of the first search target phrase and the second search target phrase; a display control means for causing a display unit to display a first search screen including a search result for the first search target phrase and a second search screen including a search result for the second search target phrase, Information processing device.

2. the first search target phrase is a handwritten character, the second search target phrase is typed characters; the phrase identification means performs character recognition processing for handwritten characters on a range in which the first search target phrase is drawn within a specified range designated by a user, thereby identifying the first search target phrase, and performs character recognition processing for typed characters on a range in which the second search target phrase is drawn within the specified range, thereby identifying the second search target phrase. The information processing device according to claim 1 .

3. the first search target phrase is composed of characters for a first language; the second search target phrase is composed of characters for a second language different from the first language, the search means searches for the meaning of the first search target phrase by using dictionary information of the dictionary for the first language, and searches for the meaning of the second search target phrase by using dictionary information of the dictionary for the second language; The information processing device according to claim 1 .

4. the first search target phrase and the second search target phrase are words included in a series of character strings included in a specified range specified by a user, the phrase identification means performs a character recognition process on a range including the series of character strings in the specified range to identify the series of character strings, and performs a word segmentation process on the identified series of character strings to identify the first search target phrase and the second search target phrase. The information processing device according to claim 1 .

5. the search means searches for the meaning of the first search target phrase or the second search target phrase using dictionary information of a plurality of dictionaries; the display control means displays the first search screen or the second search screen including a list of dictionaries for which search results are found among the plurality of dictionaries. The information processing device according to claim 1 .

6. the display control means displays the first search screen or the second search screen including a search result in a dictionary designated by the user from among the plurality of dictionaries. The information processing device according to claim 5 .

7. the display control means displays the first search screen and the second search screen in an overlapping manner. The information processing device according to claim 1 .

8. the first search screen includes a first button configured to receive an operation for instructing to make the first search screen sticky; the second search screen includes a second button configured to receive an operation for instructing to make the second search screen sticky; the display control means, in response to the first button being pressed, terminates the display of the first search screen and displays the basic screen to which a first sticky note object including a search result for the first search target phrase has been attached, and, in response to the second button being pressed, terminates the display of the second search screen and displays the basic screen to which a second sticky note object including a search result for the second search target phrase has been attached. The information processing device according to claim 1 .

9. the display control means displays the basic screen on which the first sticky note object and the second sticky note object are attached in a visually associated manner. The information processing device according to claim 8.

10. Identifying a first search target phrase and a second search target phrase specified by a user on the basic screen; Searching for the meanings of the first search target phrase and the second search target phrase; displaying, on a display unit, a first search screen including a search result for the first search target phrase and a second search screen including a search result for the second search target phrase; Information processing methods.

11. Computer, A phrase specifying means for specifying a first search target phrase and a second search target phrase specified by a user on the basic screen; a search means for searching the meanings of the first search target phrase and the second search target phrase; a display control means for causing a first search screen including a search result for the first search target phrase and a second search screen including a search result for the second search target phrase to be displayed on a display unit; program.

Images