Information processing apparatus, information processing method, and information processing program

Abstract

To enable a user to simply and easily take action later on information in which the user is interested.SOLUTION: An information processing apparatus according to the present application includes a reception unit configured to receive, from a user, designation of a word included in content and an action to be performed later in relation to the word, a management unit configured to manage the designated word and the action in association with each other, and an execution unit configured to execute the action designated as the action to be performed later by the user for the word designated by the user in response to an operation of the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] A technology for supporting operations on an operation screen has been disclosed (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Re-table 2010 / 067618 Summary of the Invention [Problem to be solved by the invention]

[0004] However, there is room for improvement in the above-mentioned conventional technologies. For example, currently, it takes a lot of time and effort for users to obtain information on the Web, become interested in that information, and take action (e.g., page navigation, copy and paste, input, etc.). Furthermore, service providers are also limited by the display area (especially on smartphone screens) when trying to simplify the above. Therefore, there is a need for a means to enable users to easily and effortlessly take action on information that interests them later, even on a small screen.

[0005] The present invention has been made in view of the above, and aims to enable a user to take action on information that interests him or her simply and easily later. [Means for solving the problem]

[0006] The information processing device of the present application is characterized by comprising: a reception unit that receives from a user designation of words contained in content and actions to be taken later in relation to the words; a management unit that associates and manages the designated words and the actions; and an execution unit that, in response to the user's operation, executes the action designated by the user as an action to be taken later for the words designated by the user. [Effects of the Invention]

[0007] According to one aspect of the embodiment, it is possible to allow a user to take action on information that interests him or her simply and easily later. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is an explanatory diagram showing an overview of an information processing system according to an embodiment. [Figure 2] FIG. 2 is a diagram showing an example of the basic screen of the "Word List" in the "Later Box." [Figure 3] FIG. 3 is an explanatory diagram showing an outline of an example of immediate action execution. [Figure 4] FIG. 4 is an explanatory diagram showing an overview of variations in text visualization. [Figure 5] FIG. 5 is an explanatory diagram showing an overview of UI variations including action buttons. [Figure 6] FIG. 6 is an explanatory diagram showing an overview of variations in 3D space. [Figure 7] FIG. 7 is a diagram illustrating an example of the configuration of a terminal device according to the embodiment. [Figure 8] FIG. 8 is a diagram illustrating an example of the configuration of a server device according to the embodiment. [Figure 9] FIG. 9 is a flowchart showing a processing procedure according to the embodiment. [Figure 10] FIG. 10 is a diagram illustrating an example of a hardware configuration. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an information processing device, an information processing method, and an information processing program according to the present application (hereinafter referred to as "embodiments") will be described in detail with reference to the drawings. Note that the information processing device, the information processing method, and the information processing program according to the present application are not limited to these embodiments. Furthermore, the same components in the following embodiments will be denoted by the same reference numerals, and duplicated descriptions will be omitted.

[0010] [1. Overview of the information processing system] First, an overview of an information processing system according to an embodiment will be described with reference to Fig. 1. Fig. 1 is an explanatory diagram showing an overview of an information processing system according to an embodiment. As shown in Fig. 1, an information processing system 1 according to an embodiment includes a terminal device 10 and a server device 100. The terminal device 10 and the server device 100 are connected to each other via a network N in a wired or wireless manner so as to be able to communicate with each other. This enables the terminal device 10 to cooperate with the server device 100. The network N is, for example, a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, etc.

[0011] Terminal device 10 is an information processing device used by a user U. For example, terminal device 10 may be a smart device such as a smartphone or tablet terminal, a desktop or notebook (laptop) type PC (Personal Computer), a mobile phone such as a feature phone (Gala-ke or Gala-ho), a PDA (Personal Digital Assistant), a game console or AV device with communication functions, an information appliance or digital appliance, a car navigation system, a wearable device such as a smart watch, a head-mounted display, or smart glasses. Terminal device 10 may also be a house or building, a car, a home appliance, an electronic device, or the like that is compatible with the Internet of Things (IOT).

[0012] In this embodiment, the terminal device 10 is a smart device such as a smartphone or tablet used by a user U, and is a portable terminal device capable of communicating with any server device via a wireless communication network such as LTE (Long Term Evolution), 4G (4th Generation), or 5G (5th Generation: fifth generation mobile communication system), Bluetooth (registered trademark), or wireless LAN. The terminal device 10 has a screen such as a liquid crystal display with a touch panel function, and accepts various operations on displayed data such as content, such as tapping, sliding, and scrolling, performed by the user U with a finger or a stylus. An operation performed on an area of ​​the screen where content is displayed may be considered an operation on the content. The terminal device 10 may be not only a smart device, but also an information processing device such as a desktop PC or a laptop PC.

[0013] The server device 100 is, for example, a computer such as a PC or a blade server, or a mainframe or a workstation, etc. The server device 100 may be realized by cloud computing.

[0014] In this embodiment, the server device 100 is an information processing device that works in conjunction with the terminal device 10 of each user U and provides API (Application Programming Interface) services for various applications (hereinafter referred to as apps) and various data to the terminal device 10 of each user U, and is realized by a computer, a cloud system, etc.

[0015] The server device 100 may also be an information processing device that provides some kind of online service to the terminal device 10 of each user U. For example, the server device 100 may provide the following online services: internet connection, search service, chat service, interactive service using voice, images, videos, etc., social networking service (SNS), electronic commerce (EC), electronic payment, online games, online banking, online trading, hotel and ticket reservations, video and music distribution, news, maps, route search, route guidance, line information, operation information, weather forecast, etc. In practice, the server device 100 may cooperate with various servers that provide the above-mentioned online services and act as an intermediary for the online services or may be responsible for processing the online services.

[0016] The server device 100 can acquire user information about the user U. For example, the server device 100 acquires, as the user information, information (attribute information) about the attributes of the user U, such as the gender, age, and residential area of ​​the user U. The server device 100 can also acquire information about the attributes of the user U, such as demographic attributes, psychographic attributes, geographic attributes, and behavioral attributes. The server device 100 may also acquire, as the user information, a segment to which the user U belongs in the marketing field or a persona (personality). The server device 100 then stores and manages the information (attribute information) about the attributes of the user U together with identification information (such as a user ID) that identifies the user U.

[0017] The server device 100 also acquires various types of history information (log data) indicating the behavior of the user U from the terminal device 10 of the user U or from various servers based on the user ID, etc. For example, the server device 100 acquires a location history, which is a history of the user U's location and date and time, from the terminal device 10. The server device 100 also acquires a search history, which is a history of search queries entered by the user U, from a search server (search engine). The server device 100 also acquires a browsing history, which is a history of content viewed by the user U, from a content server. The server device 100 also acquires a purchase history (payment history), which is a history of the user U's product purchases and payment processes, from an e-commerce server or a payment processing server. The server device 100 may also acquire a listing history and a sales history, which are a history of the user U's listings on the marketplace, from the e-commerce server or the payment processing server. The server device 100 also acquires a posting history, which is a history of the user U's posts, from a posting server or SNS server that provides a word-of-mouth posting service. The various servers and the like described above may be the server device 100 itself. That is, the server device 100 may function as the various servers and the like described above.

[0018] Furthermore, the number of devices included in the information processing system 1 shown in Fig. 1 is not limited to that shown in the figure. For example, in Fig. 1, for the sake of simplicity, only one terminal device 10 is shown, but this is merely an example and is not limiting, and two or more devices may be included.

[0019] [2. From Text to Action] Currently, it takes a lot of time and effort for users to obtain information on the Web, become interested in that information, and take action (e.g., page transitions, copy and paste, input, etc.). Furthermore, even if service providers try to simplify the above, they are limited by the display area (especially on smartphone screens). Therefore, this embodiment allows users to easily and effortlessly take action on information that interests them later, even with a small display area.

[0020] [2-1. Putting it into the box later] For example, as shown in (A) of Fig. 1, the server device 100 cooperates with the terminal device 10 of the user U, and visually displays (distinguishable from other parts) words (operable words) that can lead to the next action, such as "search," "follow," and "purchase," among words included in the text information (content) (step S1). Note that the words (operable words) that can lead to the next action may be predetermined, or may be extracted from the words included in the text information using a machine learning model of pairs of words and actions.

[0021] Examples of types of text information that include the word include article content, such as news, messages included in messenger services, text information (e.g., tags) accompanying videos, images (photos, illustrations, etc.), music, etc., and text information included in manga, novels, etc. that can be viewed online or through apps, etc. The text information may also be articles or posted comments on social media, Q&A sites, life advice sites, specialized field sites, etc. However, these are merely examples. In reality, the text information is not limited to these examples.

[0022] Then, as shown in FIG. 1B, when the user U operates (e.g., taps or presses and holds) the word (operable word), the server device 100 causes an operable UI (User Interface) of the second layer (a layer above the text information layer) to appear on the screen of the user U's terminal device 10 (step S2). This UI displays action buttons (action buttons) indicating the next action, such as "search," "follow," and "purchase," surrounding the operated word (operable word) at the center. However, this is merely an example. In practice, this is not limited to this example. For example, a pattern in which "n buttons are displayed horizontally" on the edge of the screen (top, bottom, left, right) is also conceivable. Note that the type of action displayed as the action button varies depending on the content or category of the word (operable word). However, in practice, the type of action may be the same.

[0023] Possible examples of types of actions (examples of results when an action is performed) include search (transition to search results screen), follow / subscribe / settings (relevant action), related videos / music / audio / images (transition to search results screen narrowed down to the above format), dictionary (transition to dictionary page such as Wikipedia), coupon (obtaining coupon), purchase (transition to purchase screen or payment screen), reservation (transition to reservation screen or payment screen), application, billing (transition to application screen, billing screen or payment screen), map (transition to map screen), etc. However, these are just a few examples. In reality, it is not limited to these examples.

[0024] An example of a condition for displaying an action button for each action content could be when the number of actions or action rate of other users exceeds a threshold. For example, if the action content is a search, it could be displayed when the number of searches for the corresponding word exceeds a threshold, or if the action content is the number of follows, it could be displayed when the follow rate for the corresponding word (e.g., the number of times the corresponding word is displayed as the denominator and the number of corresponding follows set as the numerator) exceeds a threshold.

[0025] It is also possible to release an alert when other users' action FB (Feedback) ratings (ratings on the destination page) exceed a threshold. For example, (if the action is video or music) it could be released when the number of plays or the number of likes at the destination exceed a threshold, (if the action is coupons) it could be released when the number of acquisitions / discount rate / usage rate at the destination exceed a threshold, or (if the action is purchase / reservation / application) it could be released when the number of purchases / purchase rate at the destination exceed a threshold.

[0026] If an action linked to the word satisfies at least one of the above conditions, the server device 100 may display all action buttons for other actions linked to the word, or may display only the action buttons that satisfy the conditions. Also, if there is an action whose action FB does not reach a threshold, the server device 100 may control the display of the action that does not reach the threshold. However, the above conditions are merely examples. In practice, the present invention is not limited to these examples.

[0027] Furthermore, as shown in FIG. 1B, the server device 100 causes a "Later Box" (word input box) to appear on the screen of the terminal device 10 of the user U together with a UI including action buttons (step S3). In practice, the server device 100 may cause the "Later Box" to appear on the screen of the terminal device 10 of the user U when the user U drags (holds down and moves) a word so that it overlaps with or passes over an action button such as "Search," "Follow," or "Purchase." Furthermore, if the action buttons are not arranged to surround the word, the "Later Box" may also appear on the screen of the terminal device 10 of the user U at the moment the user U drags (holds down and moves) the word or after dragging for a certain period of time.

[0028] Next, as shown in FIG. 1C, when a word passes over an action button and enters the "Add Later Box," the server device 100 registers the word in the "Word List" of the "Add Later Box" (step S4). At this time, the user U drags the word on the second layer (without changing screens) and places (drops) it in the "Add Later Box" displayed on the screen, passing over (via) action buttons such as "Search," "Follow," and "Purchase." The user U can also drag (hold down and move) the word and place (drop) it in the "Add Later Box" without passing over any action buttons.

[0029] In this way, when user U places a word in the "Later Box" via the "Action Button," the server device 100 associates the word with the action to be performed later and saves it, so that the above action related to the word can be performed later (after consideration). Note that if user U places (drops) the word in the "Later Box" by hovering over multiple action buttons, the server device 100 associates the word with multiple actions to be performed later and saves it. Also, if user U places (drops) the word in the "Later Box" without hovering over any action button, only the word is saved.

[0030] In practice, when user U drags a word on the second layer and moves it over an action button to the edge of the screen (off the screen), server device 100 may regard the edge of the screen (off the screen) as the "Add Later Box" and determine that the word has been added to the "Add Later Box." In other words, server device 100 may determine that the word has been added to the "Add Later Box" when user U specifies a word and performs a predetermined action that is considered to be adding the word to the "Add Later Box." In this case, server device 100 does not need to make the "Add Later Box" appear on the screen of user U's terminal device 10.

[0031] Furthermore, when user U puts a word in the "Add to Cart" box, server device 100 may stop displaying the second layer UI and the "Add to Cart" box (delete the UI and the "Add to Cart" box), and return to the screen displaying the text information (the screen before the word operation). Furthermore, when user U drags a word but does not put it in the "Add to Cart" box (does not drag the word off the screen), and stops the drag operation by, for example, lifting his / her finger from the screen, server device 100 may stop displaying the second layer UI and the "Add to Cart" box (delete the UI and the "Add to Cart" box), and return to the screen displaying the text information (the screen before the word operation).

[0032] Next, in response to an operation by the user U, the server device 100 displays a "word list" for the "Later BOX" on the screen of the terminal device 10 of the user U, and displays a list of pairs of words and actions registered in the "word list" (step S5). The "word list" for the "Later BOX" will be described in detail later.

[0033] In addition, the server device 100 executes the actions of multiple words registered in the "Word List" of the "Later Box" in bulk in response to the operation of the user U or by automatic control based on predetermined conditions (step S6).

[0034] This allows user U to perform the actions corresponding to the action button pressed when adding the word to the "Later BOX" all at once or individually on the "Word List" screen of the "Later BOX," and to check the combination of word and action added to the "Later BOX."

[0035] [2-2. Basic screen of "Word List" in "Later Box"] The basic screen of "Word List" in the "Later Box" will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the basic screen of "Word List" in the "Later Box".

[0036] For example, as shown in Fig. 2A, user U can perform or check the "actions selected when adding to the box" all at once on the screen of the "Actions to Add Later" tab in the "Word List" of the "Box to Add Later" displayed on the terminal device 10. In this way, by temporarily adding the selected actions to the "Box to Add Later," user U can avoid interrupting (and continue) his / her original action (reading the article).

[0037] In the example shown in FIG. 2A, the "Action Later" tab screen displays a set of [Word], [Action When Added], [Action Operation / Execution], and [Note Information] for each word. [Word] indicates the word added to the "Action Later" box. [Action When Added] indicates the action indicated by the action button pressed when adding the word to the "Action Later" box. [Action Operation / Execution] indicates information regarding the timing and content of the action. For example, if the action is purchase, actions related to the purchase (purchase immediately, add to cart, add to list, etc.) are displayed in a selectable format. [Note Information] indicates information regarding notes. For example, if the action is purchase, information such as "*Low stock" is displayed. Note that the server device 100 may also display note information corresponding to the word (whether or not there is an update, low stock, sold out, currently on sale, etc.) on the "Action Later" tab screen.

[0038] As shown in FIG. 2B, the user U can also check "executable actions other than the action selected when adding to the BOX" on the screen of the "Action List" tab of the "Word List" in the "Add to BOX" displayed on the terminal device 10. In the example shown in FIG. 2B, in the list displaying each action as an item, for each word, a "○" is displayed in the column for the associated action (executable action) and a "-" is displayed in the column for other actions (actions that cannot be executed). Note that the server device 100 may make it possible to identify actions taken when adding a word to the BOX later (actions taken when the word was first registered) (e.g., by color-coding or highlighting the column). The server device 100 may also display status changes (e.g., a change from a "reserve" action at the time of adding to the BOX later to a "purchase" action) on this page.

[0039] The basic screen of the "Word List" in the "Later Box" shown in Figure 2 is just an example. In reality, it is not limited to these examples.

[0040] [2-3. Immediate execution] In this embodiment, on the second layer, the user U can stop the word on an action button such as "Search," "Follow," or "Purchase" displayed on the UI (drop onto one of the action buttons) instead of dragging the word to the "Later Box," or if action buttons are arranged surrounding the word, flick in the direction of one of the action buttons to transition to the action corresponding to that action button (to immediately execute that action). Note that if the user drags over multiple action buttons, the action will ultimately transition to the action of the action button on which the user stopped.

[0041] An example of immediate action execution will be described with reference to Fig. 3. Fig. 3 is an explanatory diagram showing an overview of an example of immediate action execution.

[0042] For example, as shown in (A) of Fig. 3, the server device 100 cooperates with the terminal device 10 of the user U to visually display (distinguishable from other parts) words (operable words) that can lead to the next action, such as "search," "follow," and "purchase," among words contained in the text information (step S11). This process is the same as step S1 of Fig. 1.

[0043] 3B, when the user U operates (e.g., taps or presses and holds) the word (operable word), the server device 100 causes an operable UI of the second layer (a layer above the text information layer) to appear on the screen of the terminal device 10 of the user U (step S12). This process is the same as step S2 in FIG. 1.

[0044] Note that the "Later Box" is not shown in Fig. 3. In reality, the server device 100 may or may not make the "Later Box" appear on the screen of the terminal device 10 of the user U.

[0045] 3C, when a word is moved onto an action button of the UI, the server device 100 identifies an action corresponding to the action button (step S13). That is, when a word is dropped or flicked onto the action button, the server device 100 identifies an action corresponding to the action button.

[0046] Then, the server device 100 immediately executes the identified action (step S14).

[0047] In addition, user U can cancel the operation by stopping the dragging of the word (releasing his / her finger or dropping it) on the second layer, on an action button or anywhere other than the "Later Box."

[0048] [2-4. Variations] [2-4-1. Text visualization variations] First, text visualization variations will be described with reference to Fig. 4. Fig. 4 is an explanatory diagram showing an overview of text visualization variations.

[0049] In this embodiment, various display formats are possible to visually identify words contained in the text information that can lead to the next action (operable words), such as "search," "follow," and "purchase."

[0050] For example, as shown in (A) of Figure 4, the server device 100 may attach a badge to the word (operable word) on the screen of the text information, underline it, make it bold, make it a different color from other words, add a background color or pattern, blink it, or make the letters shake (move in small increments).

[0051] 4B, the server device 100 may place an ON / OFF button on the screen of the text information, and when the ON state is reached, the server device 100 may perform control so as to clearly indicate words for which an action can be specified. Then, when the server device 100 receives an operation for a word in response to a long press or selection (tap) of the word by the user U, the server device 100 displays a UI including action buttons indicating actions that can be specified for the word.

[0052] [2-4-2. UI variations including action buttons] Next, UI variations including action buttons will be described with reference to Fig. 5. Fig. 5 is an explanatory diagram showing an overview of UI variations including action buttons.

[0053] In this embodiment, when user U operates a word (operable word), various display modes are possible for the operable UI (User Interface) of the second layer (a layer above the text information layer) that appears on the screen of user U's terminal device 10.

[0054] 5A, the server device 100 may display action buttons in the number of selectable actions for each word when displaying the second layer UI on the screen of the terminal device 10 of the user U. For example, if eight (N) actions are selectable for the operated word, the server device 100 may display action buttons in eight directions (N directions) around the word.

[0055] Furthermore, as shown in FIG. 5B, when a word is dropped or flicked onto an action button, the server device 100 may cause an action button indicating a more detailed action for the action corresponding to the action button to appear. For example, when a word is dropped or flicked onto the action button for "image," the server device 100 may cause an action button for "video" to appear adjacent to (the outer periphery of) the action button for "image." Note that "video" is merely one example. For example, two action buttons, "video" and "still image (photo)," may appear adjacent to the action button for "image" (so that either or both can be selected).

[0056] 5C, the server device 100 may change the display mode of an action button when a word is dropped or flicked onto the action button. The server device 100 may change the background or size of the action button when a word is dropped or flicked onto the action button. For example, the server device 100 may change the color of the background or text of the action button, or may display the action button itself larger.

[0057] In addition, in this embodiment, the UI including the action buttons is circular and the action buttons are each fan-shaped, but in reality, this is not limited to this example. For example, the UI including the action buttons and the action buttons may each be rectangular. In other words, the shape is not important.

[0058] [2-4-3. Variations in 3D space] Next, variations in a 3D (three dimensions) space will be described with reference to Fig. 6. Fig. 6 is an explanatory diagram showing an overview of variations in a 3D space. In Fig. 6, a case of 3D computing such as AR glasses will be described as a variation in a 3D space.

[0059] For example, the server device 100 displays words (operable words) that can lead to the next action, such as "search," "follow," and "purchase," contained in text information displayed in a 3D space such as AR glasses, in a visually understandable manner (distinguishable from other parts).

[0060] 6A, when the user U presses a word and then pulls it out, the server device 100 accepts a drag action on the word. At this time, when the user U presses the word with his / her finger and then lifts his / her finger, the server device 100 causes the word to float up to the second layer (a layer above the text information layer) and causes a UI including an action button to appear around the word.

[0061] Alternatively, as shown in operation pattern 2 in (B) of Fig. 6, when the user U pinches a word with his / her fingers (pinch-in on the word) to extract it, the server device 100 accepts a drag action on the word. In this case, when the user U pinches the word with his / her fingers, the server device 100 makes the word float up on the second layer (a layer above the text information layer) and causes a UI including an action button to appear around the word.

[0062] It should be noted that the above variations are merely examples, and in reality, the present invention is not limited to these examples.

[0063] [2-5. Supplementary Information] As described above, in this embodiment, the server device 100 cooperates with the terminal device 10 of the user U and receives from the user U specifications of words included in the content (text information) and actions to be taken later in relation to the words. The server device 100 stores the specified words and the actions in association with each other. In response to an operation by the user U, the server device 100 provides content (word list) for carrying out the actions specified by the user U for the words specified by the user U.

[0064] The server device 100 also provides the results of the action (thumbnails of maps, search results, etc.). The server device 100 also provides content (action buttons) for accepting input of more detailed actions. The server device 100 also estimates the action to be taken for each word and provides candidates for the estimated action. The server device 100 then provides the candidate actions and accepts designation.

[0065] The server device 100 may implement the mechanism of the present embodiment using AI (Artificial Intelligence) such as GPT (Generative Pre-trained Transformer). GPT is a text generation AI and a language model capable of generating sentences using natural language processing.

[0066] [3. Example of terminal device configuration] Next, the configuration of the terminal device 10 will be described with reference to Fig. 7. Fig. 7 is a diagram showing an example of the configuration of the terminal device 10 according to the embodiment. As shown in Fig. 7, the terminal device 10 includes a communication unit 11, a display unit 12, an input unit 13, a positioning unit 14, a sensor unit 20, a control unit 30 (controller), and a storage unit 40.

[0067] (Communications Department 11) The communication unit 11 is connected to the network N by wire or wirelessly, and transmits and receives information to and from the server device 100 via the network N. For example, the communication unit 11 is realized by a NIC (Network Interface Card), an antenna, etc.

[0068] (Display section 12) Display unit 12 is a display device that displays various information such as position information. For example, display unit 12 is a liquid crystal display (LCD) or an organic electro-luminescent display (OLED). Display unit 12 is also a touch panel display, but is not limited to this.

[0069] (Input section 13) The input unit 13 is an input device that accepts various operations from the user U. For example, the input unit 13 has buttons for inputting characters, numbers, etc. The input unit 13 may be an input / output port (I / O port), a USB (Universal Serial Bus) port, etc. If the display unit 12 is a touch panel display, a part of the display unit 12 functions as the input unit 13. The input unit 13 may be a microphone that accepts voice input from the user U. The microphone may be wireless.

[0070] (Positioning unit 14) The positioning unit 14 receives signals (radio waves) transmitted from satellites of a GPS (Global Positioning System), and acquires position information (e.g., latitude and longitude) indicating the current position of the terminal device 10, which is the device itself, based on the received signals. That is, the positioning unit 14 positions the position of the terminal device 10. Note that GPS is merely an example of a GNSS (Global Navigation Satellite System).

[0071] The positioning unit 14 can also measure the position using various methods other than GPS. For example, the positioning unit 14 may measure the position by using various communication functions of the terminal device 10 as an auxiliary positioning means for position correction, etc., as described below.

[0072] (Wi-Fi positioning) For example, the positioning unit 14 uses a Wi-Fi (registered trademark) communication function of the terminal device 10 or a communication network provided by each communication company to measure the position of the terminal device 10. Specifically, the positioning unit 14 performs Wi-Fi communication or the like and measures the distance to a nearby base station or access point, thereby measuring the position of the terminal device 10.

[0073] (Beacon positioning) The positioning unit 14 may also measure the position by using a Bluetooth (registered trademark) function of the terminal device 10. For example, the positioning unit 14 measures the position of the terminal device 10 by connecting to a beacon transmitter connected by the Bluetooth (registered trademark) function.

[0074] (geomagnetic positioning) The positioning unit 14 also measures the position of the terminal device 10 based on a geomagnetic pattern of a structure that has been measured in advance and a geomagnetic sensor that the terminal device 10 has.

[0075] (RFID positioning) Furthermore, for example, if the terminal device 10 has a function of an RFID (Radio Frequency Identification) tag equivalent to a contactless IC card used at station ticket gates, in stores, etc., or has a function of reading an RFID tag, the location where the terminal device 10 was used is recorded together with information on the payment or the like made by the terminal device 10. The positioning unit 14 may obtain such information to determine the location of the terminal device 10. Alternatively, the location may be determined by an optical sensor, an infrared sensor, or the like provided in the terminal device 10.

[0076] The positioning unit 14 may measure the position of the terminal device 10 using one or a combination of the above-mentioned positioning means, as needed.

[0077] (Sensor unit 20) The sensor unit 20 includes various sensors mounted on or connected to the terminal device 10. The connection may be wired or wireless. For example, the sensors may be detection devices other than the terminal device 10, such as wearable devices or wireless devices. In the example shown in FIG. 7 , the sensor unit 20 includes an acceleration sensor 21, a gyro sensor 22, a barometric pressure sensor 23, a temperature sensor 24, a sound sensor 25, a light sensor 26, a magnetic sensor 27, and an image sensor (camera) 28.

[0078] The above-described sensors 21 to 28 are merely examples and are not intended to be limiting. That is, the sensor unit 20 may be configured to include some of the sensors 21 to 28, or may include other sensors such as a humidity sensor in addition to or instead of the sensors 21 to 28.

[0079] The acceleration sensor 21 is, for example, a three-axis acceleration sensor, and detects physical movements of the terminal device 10, such as the direction of movement, speed, and acceleration of the terminal device 10. The gyro sensor 22 detects physical movements of the terminal device 10, such as tilt in three axial directions, based on the angular velocity of the terminal device 10. The air pressure sensor 23 detects, for example, the air pressure around the terminal device 10.

[0080] Since the terminal device 10 includes the acceleration sensor 21, the gyro sensor 22, the atmospheric pressure sensor 23, etc., it is possible to measure the position of the terminal device 10 using a technique such as Pedestrian Dead-Reckoning (PDR) that uses these sensors 21 to 23. This makes it possible to obtain indoor position information that is difficult to obtain using a positioning system such as GPS.

[0081] For example, the number of steps, walking speed, and distance walked can be calculated using a pedometer that uses the acceleration sensor 21. In addition, the direction of travel, line of sight, and body tilt of the user U can be determined using the gyro sensor 22. In addition, the altitude and floor on which the terminal device 10 of the user U is located can be determined from the air pressure detected by the air pressure sensor 23.

[0082] The temperature sensor 24 detects, for example, the temperature around the terminal device 10. The sound sensor 25 detects, for example, the sound around the terminal device 10. The light sensor 26 detects the illuminance around the terminal device 10. The magnetic sensor 27 detects, for example, the geomagnetism around the terminal device 10. The image sensor 28 captures an image around the terminal device 10.

[0083] The above-mentioned air pressure sensor 23, temperature sensor 24, sound sensor 25, light sensor 26, and image sensor 28 can detect the air pressure, temperature, sound, and illuminance, respectively, and capture images of the surroundings, thereby detecting the environment and situation around the terminal device 10. Furthermore, the accuracy of the location information of the terminal device 10 can be improved based on the environment and situation around the terminal device 10.

[0084] (control unit 30) The control unit 30 includes, for example, a microcomputer having a CPU (Central Processing Unit) or MPU (Micro Processing Unit), ROM (Read Only Memory), RAM, input / output ports, etc., and various other circuits. The control unit 30 may also be configured with hardware such as an integrated circuit, for example, an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The control unit 30 includes a transmitting unit 31, a receiving unit 32, and a processing unit 33.

[0085] (Transmitter 31) The transmission unit 31 can transmit, for example, various information input by the user U using the input unit 13, various information detected by each sensor 21 to 28 mounted on or connected to the terminal device 10, and location information of the terminal device 10 measured by the positioning unit 14 to the server device 100 via the communication unit 11.

[0086] (Receiver 32) The receiving unit 32 can receive various types of information provided by the server device 100 and requests for various types of information from the server device 100 via the communication unit 11.

[0087] (Processing unit 33) The processing unit 33 controls the entire terminal device 10, including the display unit 12. For example, the processing unit 33 can output various information transmitted by the transmitting unit 31 and various information received from the server device 100 by the receiving unit 32 to the display unit 12 for display.

[0088] (Storage unit 40) The storage unit 40 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), an optical disk, etc. The storage unit 40 stores various programs, various data, etc.

[0089] [4. Server device configuration example] Next, the configuration of the server device 100 according to the embodiment will be described with reference to Fig. 8. Fig. 8 is a diagram showing an example of the configuration of the server device 100 according to the embodiment. As shown in Fig. 8, the server device 100 includes a communication unit 110, a storage unit 120, and a control unit 130.

[0090] (Communication unit 110) The communication unit 110 is realized by, for example, a network interface card (NIC), etc. The communication unit 110 is connected to a network N by wire or wirelessly.

[0091] (Storage unit 120) The storage unit 120 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as an HDD, an SSD, an optical disk, etc. The storage unit 120 may store attribute information and history information (log data) of the user U together with identification information (such as a user ID) indicating the user U.

[0092] (control unit 130) The control unit 130 is a controller, and is realized by, for example, a central processing unit (CPU), a micro processing unit (MPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or the like, by executing various programs (corresponding to an example of an information processing program) stored in a storage device inside the server device 100 using a storage area such as a RAM as a working area. In the example shown in FIG. 8, the control unit 130 has an acquisition unit 131, a presentation unit 132, a reception unit 133, a management unit 134, and an execution unit 135.

[0093] (Acquisition part 131) The acquisition unit 131 acquires a search query input by a user U. For example, when the user U inputs a search query into a search engine or the like to perform a keyword search, the acquisition unit 131 acquires the search query via the communication unit 110. That is, the acquisition unit 131 acquires, via the communication unit 110, the keywords input by the user U into the search box of a search engine, website, or app.

[0094] Furthermore, the acquisition unit 131 acquires user information about the user U via the communication unit 110. For example, the acquisition unit 131 acquires identification information (such as a user ID) indicating the user U, location information of the user U, attribute information of the user U, etc. from the terminal device 10 of the user U. Furthermore, the acquisition unit 131 may acquire the identification information indicating the user U, attribute information of the user U, etc. when the user U is registered. Then, the acquisition unit 131 stores the user information in the storage unit 120.

[0095] Furthermore, the acquisition unit 131 acquires various types of history information (log data) indicating the behavior of the user U via the communication unit 110. For example, the acquisition unit 131 acquires various types of history information indicating the behavior of the user U from the terminal device 10 of the user U or from various servers based on the user ID or the like. Then, the acquisition unit 131 stores the various types of history information in the storage unit 120.

[0096] (Presentation part 132) The presentation unit 132 cooperates with the terminal device 10 of the user U via the communication unit 110, and presents (indicates) to the terminal device 10 of the user U words that can lead to the next action among words contained in the content (text information) that the user U is viewing, in a display format that makes the words visually distinguishable from other words. Note that the presentation unit 132 may be a display control unit that controls the information displayed on the screen of the terminal device 10 of the user U.

[0097] In addition, when user U operates a word contained in the content that can lead to the next action while browsing the content, the presentation unit 132 presents an action button (action button) around the word to specify the action to be taken later.

[0098] In addition, the presentation unit 132 presents a word input box (later BOX) for inputting the word operated by the user U, together with the action button.

[0099] Furthermore, the presentation unit 132 presents, adjacent to the action button, a detailed action button for specifying a more detailed action for the action of the action button.

[0100] (Reception Department 133) The reception unit 133 cooperates with the terminal device 10 of the user U via the communication unit 110, and receives from the user U designation of words included in the content and subsequent actions related to the words. Note that the reception unit 133 may be integrated with the acquisition unit 131. That is, the acquisition unit 131 may have the function of the reception unit 133.

[0101] For example, when a word operated by user U while viewing content passes over an action button and is entered into a word entry box (later BOX), the reception unit 133 receives the word and the action corresponding to the action button as having been specified.

[0102] (Management Department 134) The management unit 134 manages the words specified by the user U in association with the actions specified by the user U. For example, the management unit 134 lists pairs of the words specified by the user U and the actions specified by the user U and stores the list in the storage unit 120.

[0103] In addition, the management unit 134 cooperates with the user U's terminal device 10 via the communication unit 110 and provides the user U's terminal device 10 with a confirmation screen (word list) for confirming the combination of the word specified by the user U and the action specified by the user U.

[0104] (Executive Division 135) The execution unit 135 executes the action designated by the user U as an action to be performed later for the word designated by the user U, in response to an operation by the user U. For example, after the user U finishes viewing the content, the execution unit 135 opens a confirmation screen and performs an operation on a word displayed on the confirmation screen, and then executes one or more actions associated with the word collectively in response to the operation by the user U on the word displayed on the confirmation screen.

[0105] Furthermore, when the word operated by the user U stops on an action button, the execution unit 135 immediately executes the action corresponding to the action button for the word.

[0106] [5. Processing Procedure] Next, a processing procedure by the server device 100 according to the embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing the processing procedure according to the embodiment. Note that the processing procedure shown below is repeatedly executed by the control unit 130 of the server device 100.

[0107] For example, as shown in FIG. 9, the presentation unit 132 of the server device 100 cooperates with the terminal device 10 of the user U via the communication unit 110, and identifies words (operable words) that can lead to the next action from among the words contained in the content (text information) that the user U is viewing on the terminal device 10 of the user U, and presents (displays) the words in a display manner that makes them visually distinguishable from other words (step S101).

[0108] Next, the reception unit 133 of the server device 100 cooperates with the terminal device 10 of the user U via the communication unit 110 and receives an operation (e.g., tap or long press) from the user U regarding a word contained in the content that can lead to the next action (step S102).

[0109] Next, when user U operates a word contained in the content that can lead to the next action while viewing the content, the presentation unit 132 of the server device 100 presents an action button (action button) around the word to specify the action to be taken later (step S103).

[0110] Next, the presentation unit 132 of the server device 100 presents, together with the action button, a word input box (later BOX) into which the user U can drag and input a word (step S104).

[0111] Next, the reception unit 133 of the server device 100 checks whether the word dragged by the user U while browsing the content has passed over an action button and been added to the word input box (later BOX) (step S105). Note that the reception unit 133 may determine that the word dragged by the user U has been added to the word input box (later BOX) when the user U drags the word and moves it over the action button to the edge of the screen (off the screen). In other words, the reception unit 133 may determine that the word specified by the user U has been added to the word input box (later BOX) when the user U specifies a word and performs a predetermined action that is considered to be adding the word to the word input box (later BOX). In this case, in step S104, the presentation unit 132 does not need to present the word input box (later BOX) into which the user U drags and adds the word.

[0112] Next, when the word dragged by user U is input into the word input box (later BOX) (step S105; Yes), the management unit 134 of the server device 100 associates the word dragged by user U with the action corresponding to the action button passed through and manages them (step S106).

[0113] Thereafter, the management unit 134 of the server device 100 cooperates with the terminal device 10 of the user U via the communication unit 110, and at any timing, in response to the operation of the user U, provides the terminal device 10 of the user U with a confirmation screen (word list) for confirming the pair of words specified by the user U and the action specified by the user U (step S107).

[0114] Next, when user U performs an operation on a word displayed on the confirmation screen, the execution unit 135 of the server device 100 executes one or more actions associated with the word in response to user U's operation on the word displayed on the confirmation screen (step S108).

[0115] Furthermore, if the word dragged by the user U is not input into the word input box (later BOX) (step S105; No), the receiving unit 133 of the server device 100 checks whether the word dragged by the user U has stopped on an action button (step S109). For example, the receiving unit 133 checks whether the user U has dropped the dragged word on an action button (at a position overlapping the action button). Note that the receiving unit 133 may determine that the word has stopped on the action button if the word and the action button overlap even partially when the word stopped.

[0116] Next, when the word dragged by user U moves onto an action button and stops on the action button (step S109; Yes), the execution unit 135 of the server device 100 immediately executes the action corresponding to the action button for the word (step S110).

[0117] Furthermore, if the word dragged by the user U is not on the word input box or the action button, but is stopped elsewhere (on the screen) (step S109; No), the execution unit 135 of the server device 100 determines that the operation on the word is canceled, and returns to the screen before the operation (step S111). That is, if the word dragged by the user U is not input into the word input box (later BOX) (step S105; No) and is not stopped on the action button (step S109; No), the execution unit 135 determines that the operation on the word is canceled, and returns to the screen before the operation.

[0118] [6. Modifications] The terminal device 10 and the server device 100 described above may be implemented in various different forms other than the above embodiment. Therefore, modifications of the embodiment will be described below.

[0119] In the above embodiment, some or all of the processing executed by the server device 100 may actually be executed by the terminal device 10 (or an application running on the terminal device 10). For example, the processing may be completed in a stand-alone manner (by the terminal device 10 alone). In this case, the terminal device 10 is assumed to have the functions of the server device 100 in the above embodiment. Furthermore, in the above embodiment, the terminal device 10 cooperates with the server device 100, and therefore, from the perspective of the user U, it appears that the processing of the server device 100 is also being executed by the terminal device 10. In other words, from another perspective, the terminal device 10 can also be said to be equipped with the server device 100.

[0120] In the above embodiment, user U may drag a word (operable word) on the second layer and place it in the "Add Later Box" by passing it over multiple (two or more) action buttons. When user U places a word in the "Add Later Box" via multiple action buttons, server device 100 associates the word with the corresponding multiple actions and registers it in a "word list" in the "Add Later Box." Note that if the actions of multiple action buttons are contradictory (if they cannot be executed simultaneously or consecutively, or if an action cancels a previous action), server device 100 may prevent the word from being entered in the "Add Later Box," warn user U when (or after) entering the action in the "Add Later Box" and request a retry, or may validate only the action of the action button passed last (or first) and notify user U of this (the action that will be validated, etc.). Furthermore, if the multiple actions include a comprehensive action that includes (contains) other actions, server device 100 may execute the comprehensive action to count as executing the other actions. Furthermore, whether or not a function via multiple action buttons is enabled may be changeable by settings.

[0121] In addition, in the above embodiment, when user U drags a word (operable word) and passes it over one or more action buttons, the server device 100 may change the display mode of the action button that has been passed over to make it clear that the action button has been passed over.

[0122] Furthermore, in the above embodiment, the server device 100 may not only target words contained in text information but also words contained in image information as operation targets. For example, the server device 100 uses character recognition technology such as OCR (Optical Character Recognition / Reader) to read characters from images or scanned documents, convert them into text data, and then visually display (distinguishable from other parts) words that can lead to the next action (operational words) such as "search," "follow," and "purchase" from among the words contained in the data. In this case, the server device 100 may superimpose the words that can lead to the next action (operational words) on the original image.

[0123] Furthermore, in the above embodiment, the server device 100 may be configured to immediately execute an action corresponding to an action button even when the user U directly presses the action button without moving the word. For example, when the user U operates (e.g., taps or presses and holds) a word (operable word) with his / her finger, the server device 100 causes an operable UI (User Interface) of the second layer (a layer above the text information layer) to appear on the screen of the user U's terminal device 10. The server device 100 then keeps the UI displayed (continues to display the UI) even after the user U removes his / her finger from the word, and immediately executes the action corresponding to the action button when the user U presses an action button included in the UI. Note that the server device 100 may also erase the UI (end the display of the UI) and return to the original text information screen when the user U taps anywhere other than the word or action button on the screen where the UI is displayed.

[0124] [7. Effects] As described above, the information processing device (terminal device 10 and server device 100) according to the present application is characterized by comprising a reception unit 133 that receives from user U designation of words contained in content and actions to be taken later in relation to the words, a management unit 134 that manages the designated words in association with the actions, and an execution unit 135 that, in response to user U's operation, executes the action designated by user U as an action to be taken later for the words designated by user U.

[0125] The information processing device according to the present application further includes a presentation unit 132 that presents words that can lead to the next action among words included in the content in a display format that allows them to be visually distinguished from other words.

[0126] When a user U operates a word contained in the content that can lead to the next action, the presentation unit 132 presents an action button around the word for specifying the action to be taken later.

[0127] The presentation unit 132 presents, together with the action button, a word input box into which the user U inputs the word operated by the user U. When the word operated by the user U passes over the action button and is input into the word input box, the reception unit 133 receives the word and the action corresponding to the action button as having been designated.

[0128] The presentation unit 132 presents, adjacent to the action button, a detailed action button for specifying a more detailed action for the action of the action button.

[0129] When the word operated by the user U stops on an action button, the execution unit 135 immediately executes the action corresponding to the action button for the word.

[0130] The management unit 134 provides a confirmation screen for confirming the combination of the word specified by the user U and the action specified by the user U.

[0131] The execution unit 135 executes one or more actions associated with a word displayed on the confirmation screen in response to an operation by the user U on the word.

[0132] By using any one or a combination of the above-described processes, the information processing device according to the present application can enable the user to take action on information that interests the user later simply and easily.

[0133] [8. Hardware Configuration] The terminal device 10 and the server device 100 according to the above-described embodiments are realized by a computer 1000 having a configuration as shown in Fig. 10, for example. The following description will be given taking the server device 100 as an example. Fig. 10 is a diagram showing an example of a hardware configuration. The computer 1000 is connected to an output device 1010 and an input device 1020, and has a configuration in which a calculation device 1030, a primary storage device 1040, a secondary storage device 1050, an output I / F (Interface) 1060, an input I / F 1070, and a network I / F 1080 are connected via a bus 1090.

[0134] The arithmetic device 1030 operates based on programs stored in the primary storage device 1040 and the secondary storage device 1050, programs read from the input device 1020, and the like, and executes various processes. The arithmetic device 1030 is realized by, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or the like.

[0135] The primary storage device 1040 is a memory device such as a RAM (Random Access Memory) that temporarily stores data used by the arithmetic device 1030 for various calculations. The secondary storage device 1050 is a storage device in which data used by the arithmetic device 1030 for various calculations and various databases are registered, and is realized by a ROM (Read Only Memory), an HDD (Hard Disk Drive), an SSD (Solid State Drive), a flash memory, or the like. The secondary storage device 1050 may be an internal storage device or an external storage device. The secondary storage device 1050 may also be a removable storage medium such as a USB (Universal Serial Bus) memory or an SD (Secure Digital) memory card. The secondary storage device 1050 may also be cloud storage (online storage), a NAS (Network Attached Storage), a file server, or the like.

[0136] The output I / F 1060 is an interface for transmitting information to be output to an output device 1010 that outputs various types of information, such as a display, a projector, a printer, etc., and is realized by a connector conforming to a standard such as USB (Universal Serial Bus), DVI (Digital Visual Interface), or HDMI (High Definition Multimedia Interface), etc. The input I / F 1070 is an interface for receiving information from various input devices 1020, such as a mouse, a keyboard, a keypad, a button, a scanner, etc., and is realized by a USB, etc.

[0137] Furthermore, the output I / F 1060 and the input I / F 1070 may be wirelessly connected to the output device 1010 and the input device 1020, respectively. That is, the output device 1010 and the input device 1020 may be wireless devices.

[0138] The output device 1010 and the input device 1020 may be integrated into one device, such as a touch panel. In this case, the output I / F 1060 and the input I / F 1070 may also be integrated into one device as an input / output I / F.

[0139] The input device 1020 may be a device that reads information from, for example, an optical recording medium such as a CD (Compact Disc), a DVD (Digital Versatile Disc), or a PD (Phase Change Rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0140] The network I / F 1080 receives data from other devices via the network N and sends it to the arithmetic device 1030, and also transmits data generated by the arithmetic device 1030 to other devices via the network N.

[0141] The arithmetic unit 1030 controls the output device 1010 and the input device 1020 via the output I / F 1060 and the input I / F 1070. For example, the arithmetic unit 1030 loads a program from the input device 1020 or the secondary storage device 1050 onto the primary storage device 1040 and executes the loaded program.

[0142] For example, when the computer 1000 functions as the server device 100, the arithmetic unit 1030 of the computer 1000 executes a program loaded onto the primary storage device 1040 to realize the functions of the control unit 130. The arithmetic unit 1030 of the computer 1000 may also load a program acquired from another device via the network I / F 1080 onto the primary storage device 1040 and execute the loaded program. The arithmetic unit 1030 of the computer 1000 may also cooperate with the other device via the network I / F 1080 to call and use the functions and data of a program from another program of the other device.

[0143] [9. Other] Although the embodiments of the present application have been described above, the present invention is not limited to the contents of these embodiments. Furthermore, the above-described components include those that can be easily imagined by a person skilled in the art, those that are substantially the same, and those that are within the scope of so-called equivalents. Furthermore, the above-described components can be combined as appropriate. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the spirit of the above-described embodiments.

[0144] Furthermore, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using a known method. In addition, the information including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.

[0145] Furthermore, the components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

[0146] For example, the above-mentioned server device 100 may be realized by multiple server computers, and depending on the function, the configuration can be flexibly changed, such as by calling an external platform using an API (Application Programming Interface) or network computing.

[0147] Furthermore, the above-described embodiments and modifications can be combined as appropriate within the scope of not causing any contradiction in the processing content.

[0148] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit," etc. For example, an acquisition unit can be read as an acquisition means or an acquisition circuit. [Explanation of symbols]

[0149] 1. Information Processing Systems 10 Terminal Equipment 100 Server device 110 Communications Department 120 Storage section 130 control section 131 Acquisition Department 132 Presentation section 133 Reception Department 134 Management Department 135 Executive Department

Claims

1. a receiving unit that receives from a user a designation of a word contained in the content and an action to be taken later in relation to the word; a management unit that manages the designated words and the actions in association with each other; an execution unit that executes an action designated by the user as an action to be performed later for the word designated by the user in response to an operation by the user; An information processing device comprising:

2. a presentation unit that presents words that can lead to a next action among words included in the content in a display manner that makes them visually distinguishable from other words; The information processing apparatus according to claim 1 , further comprising:

3. The presentation unit presents, when the user operates a word that can lead to a next action among words included in the content, an action button for specifying the action to be taken later around the word.

3. The information processing apparatus according to claim 2, wherein:

4. the presentation unit presents, together with the action button, a word input box into which the user inputs the word operated by the user; When the word operated by the user passes over the action button and is input into the word input box, the receiving unit receives the word and the action corresponding to the action button as being designated.

4. The information processing apparatus according to claim 3,

5. The presenting unit presents a detailed action button adjacent to the action button for specifying a more detailed action for the action of the action button.

4. The information processing apparatus according to claim 3,

6. When the word operated by the user stops on the action button, the execution unit immediately executes the action corresponding to the action button for the word.

4. The information processing apparatus according to claim 3,

7. The management unit provides a confirmation screen for confirming a combination of a word designated by the user and an action designated by the user.

2. The information processing apparatus according to claim 1, wherein:

8. The execution unit executes one or more actions associated with a word displayed on the confirmation screen in response to an operation by the user on the word.

8. The information processing apparatus according to claim 7,

9. An information processing method executed by an information processing device, a receiving step of receiving from a user a designation of a word contained in the content and an action to be performed later in relation to the word; a management step of managing the designated words and the actions in association with each other; an execution step of executing an action designated by the user as an action to be performed later for the word designated by the user in response to an operation by the user; An information processing method comprising:

10. a receiving step for receiving from a user a designation of a word contained in the content and an action to be taken later in relation to the word; a management procedure for managing the designated words and the actions in association with each other; an execution procedure for executing an action designated by the user as an action to be performed later for the word designated by the user in response to an operation by the user; An information processing program characterized by causing a computer to execute the above.

Images