Electronic apparatus, display control method, and application program

Abstract

The present invention provides an electronic apparatus equipped with a display device and a control circuit that switches the display on the display device so as to display a first functional object and a plurality of first media objects respectively indicating different media information around the first functional object, and when one first media object is operated toward the first functional object, display a plurality of new first media objects respectively indicating different media information related to the media information indicated by the operated one first media object around the first functional object instead of the plurality of displayed first media objects.

Description

Electronic device, display control method, and application program

[0001] The present disclosure relates to an electronic device, a display control method, and an application program capable of displaying a plurality of objects representing a plurality of different media information.

[0002] 2. Description of the Related Art There is known a technique for displaying a plurality of objects representing a plurality of different media information (still images, moving images, audio, text, etc.) that reflects a user's interests and preferences.

[0003] Japanese Patent Laid-Open No. 2002-175317 Japanese Patent Laid-Open No. 2006-018843 Japanese Patent Laid-Open No. 2007-517317 Japanese Patent Laid-Open No. 2009-003637 Japanese Patent Laid-Open No. 2010-186214

[0004] The multimedia search systems in each of the patent documents, when given a search query, output multimedia directly related to the search query as search results. For example, if the query is a keyword, the system outputs multimedia containing the keyword. For example, if the query is an image, the system outputs multimedia containing images with similar image characteristics or information about subjects. Furthermore, these conventional multimedia search systems require a user to first input a search query, and aim to produce search results that match the explicitly stated search needs.

[0005] In such a multimedia search system, it is impossible to provide users with information other than the information they expect in response to a search query. In other words, the system can only provide information within the range expected by the user. This situation is considered to involve the following problems:

[0006] - The system assumes that the user is aware of their search needs and can spontaneously describe them in words. (Image searches and multimedia searches simply show results that match the subject of the search. In other words, they are the same in that they aim to match the subject.) - As a result, the system cannot provide a breadth of information that goes beyond the explicit search needs, and therefore cannot satisfy the user's unconscious, sensory search needs that cannot be put into words.

[0007] In light of the above circumstances, the purpose of this disclosure is to enable users to perform searches even when they are unaware of their search needs, and to provide users with the opportunity to discover new connections and expand their exploration by including multimedia in the search results that the user may not have anticipated but that is guaranteed to be relevant to the search target.

[0008] An electronic device according to one embodiment of the present disclosure comprises: a display device; and a control circuit that displays, on the display device, a first functional object and a plurality of first media objects around the first functional object, each of the first media objects indicating different media information; and when one first media object is operated toward the first functional object, switches the display so that, in place of the plurality of displayed first media objects, a plurality of new first media objects each indicating different media information related to the media information indicated by the operated one first media object are displayed around the first functional object.

[0009] According to the present disclosure, a user can perform a search even if he or she is unaware of his or her search needs, and by including multimedia in the search results that the user did not expect but that is guaranteed to be relevant to the search target, the user can be provided with the opportunity to discover new connections and expand their exploration.

[0010] The effects described here are not necessarily limited to those described herein, and may be any of the effects described in this disclosure.

[0011] 1 shows an information processing system according to an embodiment of the present disclosure; FIG. 1 shows an example of a top screen of the GUI of an electronic device; FIG. 2 shows an example of a screen after a transition of the GUI of an electronic device (operation toward a first functional object); FIG. 3 shows another example of a screen after a transition of the GUI of an electronic device (operation from bottom to top); FIG. 4 shows another example of a screen after a transition of the GUI of an electronic device (operation from top to bottom); FIG. 5 shows another example of a screen after a transition of the GUI of an electronic device (detailed display); FIG. 6 shows another example of a screen after a transition of the GUI of an electronic device (second functional object); FIG. 7 shows a functional configuration of an information system; FIG. 8 shows an operation flow of an information processing device; FIG. 9 shows a media information database; FIG. 10 shows a configuration of a media information analysis unit; FIG. 11 shows a concept database; FIG. 12 shows a concept relationship database; FIG. 13 shows an analysis information database; FIG. 14 shows a configuration of a concept relationship calculation unit; FIG. 15 shows a configuration of an account creation unit; FIG. 16 shows an account database; FIG. 17 shows a configuration of an account usage history analysis unit; FIG. 18 shows a configuration of a startup recommendation unit; FIG. 19 shows a configuration of a search recommendation unit; 1 is an example of a screen after a transition in the GUI of an electronic device (autoplay); FIG. 2 is a modified example of the top screen; FIG. 3 is a modified example of the top screen; FIG. 4 is a modified example of the top screen; FIG. 5 is another example of the top screen of the GUI of an electronic device; FIG. 6 shows a modified example of the configuration of the recommendation unit at startup; FIG. 7 is a diagram for explaining an example of the operation of the recommendation unit at search; FIG. 8 is a diagram for explaining an example of the operation of the recommendation unit at search; FIG. 9 is a schematic diagram showing a comparison between a conventional search and a search of this embodiment; FIG. 10 shows a modified example of the configuration of the recommendation unit at search.

[0012] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0013] 1. Information processing system

[0014] FIG. 1 illustrates an information processing system according to an embodiment of the present disclosure.

[0015] The information processing system 1 includes an information processing device 10, a storage device 20, and a web server 30, all of which are communicatively connected via a network or the like. The information processing device 10 functions as a back-end computing server and performs arithmetic processing. The storage device 20 is a large-capacity non-volatile storage device that functions as a server-side database server. The information processing device 10 and the storage device 20 may be independently connected via a network or the like (as shown), or may be configured as an integrated information processing device (not shown). The web server 30 is a front-end web server that provides data generated by the information processing device 10 through arithmetic processing and stored in the storage device 20 in response to a request from an electronic device 40, which is a client. The information processing device 10 is configured to select multiple pieces of media information for the electronic device 40 and provide display data for displaying the selected pieces of media information to the electronic device 40 via the web server 30.

[0016] The electronic device 40 is a device having a display device 41, such as a smartphone, tablet computer, personal computer, head-mounted display, or VR glasses, and is a terminal device used by an end user. The control circuit 42 of the electronic device 40 changes the GUI displayed on the display device 41 by executing an application program in cooperation with the web server 30. The application program may be executed via a web browser or may be installed and executed on the electronic device 40. By executing the application program, the electronic device 40 recommends a plurality of pieces of media information to the user on the display device 41 upon startup, and further recommends a plurality of different pieces of media information related to the media information selected by the user on the display device 41 from among the plurality of pieces of media information upon search. This aims to provide the user with a user experience such as discovering new connections and expanding their exploration. The display device 41 may be a touch panel, a display without a touch panel, a head-mounted display, a display unit built into VR glasses, or the like.

[0017] In this embodiment, the media information is composed of at least one of a plurality of different modalities (formats), such as still images, moving images, music, text, location information, and tag information. The type of modality is not limited to this example and may be any format. The media information is linked to web pages on the network, such as videos, magazines, auctions, e-commerce, art exhibitions, encyclopedias, SNS, and advertisements. The media information is not limited to data on the network and may be data stored in the storage device 20.

[0018] 2. GUI of electronic devices

[0019] The GUI displayed on the display device 41 by the control circuit 42 of the electronic device 40 executing an application program and the transition of the GUI will be described below.

[0020] FIG. 2 shows an example of a top screen of the GUI of an electronic device.

[0021] In this embodiment, the electronic device 40 is a smartphone, and the display device 41 is a vertically long rectangle. In this embodiment, the terms rectangle, square, quadrilateral, polygon, etc., also include approximate rectangles, approximate squares, approximate quadrilaterals, approximate polygons, etc. that have rounded corners (R's) but visually give the impression of the figure.

[0022] The control circuit 42 of the electronic device 40 sets a first display area 401 and a second display area 402 on the display device 41 .

[0023] The first display area 401 is, for example, a square with each side having a length of 3L or more. When the display device 41 is, for example, a touch panel of a smartphone, the length of one side of the first display area 401 may be equal to or approximately equal to the short side of the display device 41.

[0024] The second display area 402 is a rectangle having a first side 403 and a second side 404. The first side 403 is adjacent to one side of the first display area 401 and has a length of, for example, 3L or more. The second side 404 is perpendicular to the first side 403 and has a length of, for example, L or more. The length of the second side 404 of the second display area 402 may be an integer multiple of L, for example.

[0025] The control circuit 42 of the electronic device 40 displays on the display device 41 a top screen 400 including a plurality of first media objects 410 , a plurality of second media objects 420 , a first functional object 430 , and an account object 440 .

[0026] The first functional object 430 is, for example, a square with each side having a length of L. The first functional object 430 is placed in the center of the first display area 401 (i.e., a square with each side having a length of 3L or more).

[0027] Each of the multiple (four in this example) first media objects 410 is, for example, a rectangle with a short side length of L and a long side length of 2L or more (e.g., 2.02L). The four first media objects 410 are displayed around the first functional object 430 within the first display area 401. More specifically, the first functional object 430 and the four first media objects 410 form a square with each side length of 3L or more. That is, the first functional object 430 and the four first media objects 410 are arranged without any gaps in the square first display area 401 with each side length of 3L or more.

[0028] A plurality of second media objects 420 are displayed in second display area 402. Second media objects 420 are, for example, squares with sides each having a length L. Control circuit 42 of electronic device 40 displays three second media objects 420 in a first direction, which is the length direction of first side 403, and one or more second media objects 420 in a second direction, which is the length direction of second side 404, in a matrix such that the second media objects 420 are adjacent to first display area 401 and all of second media objects 420 are adjacent to each other.

[0029] The first media objects 410 each represent a different piece of media information. Each first media object 410 includes, for example, a square image 411 with each side having a length of L or less, and non-image information 412 that is adjacent to the image 411 and is included in a square with each side having a length of L. For example, the first media object 410 includes the image 411 and text information 412 that is included in the square with each side having a length of L. The non-image information 412 (for example, text information) is information associated with the image 411, such as the name, description, and link information of the image 411.

[0030] Each second media object 420 represents media information that is different from the media information of the first media object 410. For example, each second media object 420 includes a square image 421 with each side having a length L or less.

[0031] "Different media information related to each other" refers to, for example, media information related to a chair designed by a certain designer, a table designed by that designer or a designer with whom the designer has a connection, a building designed by that designer, a museum where that designer's work is exhibited, places the designer has visited, still images or videos that the designer has taken as subjects, works that the designer has been influenced by, or works that have influenced the designer, and is media information that is directly or indirectly related to each other. The relationship does not have to be a direct, unique relationship that anyone can understand. How to select "different media information related to each other" to be displayed as first media object 410 and second media object 420 will be explained later.

[0032] The first functional object 430 functions as a search window. The first functional object 430 has a functional button 431. The specific functions of the first functional object 430 and the functional button 431 will be described in detail later.

[0033] The account object 440 may be displayed outside the first display area 401 and the second display area 402 .

[0034] FIG. 26 shows another example of the top screen of the GUI of an electronic device.

[0035] Alternatively, the first media object 410 may include one or more active action buttons 470. The active action buttons 470 allow the user to actively perform actions such as saving (clip), favorite, or share the article.

[0036] Next, the transition of the GUI based on the user operation will be described.

[0037] FIG. 3 shows an example of a screen after the GUI of the electronic device has changed (operation toward the first functional object).

[0038] As shown in (A), the control circuit 42 of the electronic device 40 detects that a user has performed an operation (a first action for the user to display new information) of moving one first media object 410 or one second media object 420 toward a first functional object 430 on the display device 41. Then, as shown in (B), the control circuit 42 of the electronic device 40 switches the display so that, in place of the multiple first media objects 410 and the second media objects 420 that are being displayed, multiple new first media objects 410 and new second media objects 420 each representing different media information related to the media information represented by the one first media object 410 or the second media object 420 that has been moved toward. In addition, the "operation of moving the first media object 410 or the second media object 420 toward the first functional object 430" may be a drag operation using an operator (a finger, a stylus pen, a mouse, etc.), or if the electronic device 40 is a head-mounted display or VR glasses, an operation using a handheld controller, a part of the human body, or movement of the gaze, etc.

[0039] The arrangement of the multiple new first media objects 410 and second media objects 420 is the same as that of the top screen 400. That is, the multiple new first media objects 410 are displayed around the first functional object 430 in the first display area 401. The multiple new second media objects 420 are displayed in the second display area 402. The method of selecting the new first media objects 410 and second media objects 420 will be described in detail later.

[0040] In the new display screen, a back button 432 is displayed within the first functional object 430. When the user operates the back button 432 within the first functional object 430, the first media object 410 and the second media object 420 that were originally displayed are displayed in their original arrangement, as shown in (A). In this way, the media information displayed in the multiple first media objects 410 and the multiple second media objects 420 is prioritized according to the user's preferences and is used when selecting media information to be posted.

[0041] As described above, the GUI of the top screen 400 is composed of multiple shapes. A first functional object 430 used for searching is arranged in the center of the screen, and first media objects 410 displaying media information are arranged surrounding the first functional object 430. A combination of multiple types of media information, such as still images and text, can be displayed within the first media object 410, and one or more pieces of media information can be displayed. A search is performed by moving the first media object 410 or the second media object 420 toward the first functional object 430. When transitioning from the top screen 400, the first functional object 430 does not change from its designated position, but the information within the first media object 410 and the second media object 420 does change.

[0042] As a result, according to this embodiment, a search can be performed by moving the surrounding first media object 410 or the second media object 420 toward the central first functional object 430. Because a search can be performed simply by moving the first media object 410 or the second media object 420 toward the first functional object 430 (e.g., dragging and dropping), no additional operation steps are required after moving the first media object 410 or the second media object 420 (e.g., dragging and dropping), providing a highly intuitive user experience. Furthermore, because the destination first functional object 430 is located equidistant from all first media objects 410 and in the center, there is no variation in the moving distance depending on the first media object 410 to be moved, eliminating the need for long-distance movement and providing a highly intuitive user experience.

[0043] As a modified example, the first media object 410, the second media object 420, and the first functional object 430 may be ellipses, circles, polygons (including those with rounded corners), etc. The colors of the first media object 410, the second media object 420, and the first functional object 430 may be composed of one or more colors. The color of the first media object 410 may change depending on the information (posted information) displayed by the graphic. For example, the color may change depending on the category of media information. The boundaries of the first media object 410, the second media object 420, and the first functional object 430 do not need to be explicit. When the first media object 410 or the second media object 420 is held to move it, the user may be notified that the first media object 410 or the second media object 420 has been held by playing a sound effect, changing the shape of the graphic, displaying an animation such as a color change or a shaking of the graphic, vibrating the electronic device 20, etc.

[0044] FIG. 4 shows another example of a screen after a transition of the GUI of an electronic device (operation from bottom to top).

[0045] As shown in (A), the control circuit 42 of the electronic device 40 detects that a user is operating (a second action by the user to display new information) on the display device 41 in the direction (the direction of the arrow from bottom to top) from the second display area 402 toward the first display area 401. Then, as shown in (B), the control circuit 42 of the electronic device 40 displays N new first media objects 410 in the first display area 401, each of which indicates media information indicated by the N second media objects 420 closest to the first display area 401, in place of N (N is an integer between 1 and 4) (three in this example) first media objects 410 out of the four first media objects 410 displayed in the first display area 401. The control circuit 42 of the electronic device 40 switches the display so that, instead of the N (three in this example) second media objects 420 displayed in the second display area 402, N new second media objects 420 each indicating different media information related to the N new first media objects 410 are displayed in the second display area 402. The control circuit 42 of the electronic device 40 caches the media information in advance, and when the cached media information runs out, it displays an update mark (e.g., a substantially circular arrow), reads in new media information, and displays it as new second media objects 420.

[0046] FIG. 5 shows another example of a screen after a GUI transition of an electronic device (operation from top to bottom).

[0047] As shown in (A), the control circuit 42 of the electronic device 40 detects that the user is operating the display device 41 in the direction (the direction of the arrow from top to bottom) from the first display area 401 toward the second display area 402. Then, as shown in (G), the control circuit 42 of the electronic device 40 displays N new second media objects 420 in the second display area 402, each of which indicates media information indicated by the N first media objects 410 closest to the second display area 402, in place of N (N is an integer between 1 and 4) (four in this example) second media objects 420 out of the three or more second media objects 420 displayed in the second display area 402. The control circuit 42 of the electronic device 40 switches the display so that, instead of the N (four in this example) first media objects 410 displayed in the first display area 401, N new first media objects 410 each indicating different media information related to the N new second media objects 420 are displayed in the first display area 401. The control circuit 42 of the electronic device 40 caches the media information in advance, and when the cached media information runs out, displays an update mark, reads new media information, and displays it as the new first media object 410. The "bottom-up operation" and the "top-down operation" may be a drag-and-drop operation using an operator (such as a finger, a stylus pen, or a mouse), or, if the electronic device 40 is a head-mounted display or VR glasses, an operation using a handheld controller, a part of the human body, or movement of the line of sight.

[0048] FIG. 6 shows another example of the screen after the GUI of the electronic device has changed (detailed display).

[0049] The control circuit 42 of the electronic device 40 detects that one first media object 410 is operated on the display device 41 by a method other than a movement operation (e.g., a long press, a tap, etc.) (a third operation for displaying a details page of the media information represented by the one first media object or the second media object). The control circuit 42 of the electronic device 40 then displays a details page 452 that shows in detail the media information represented by the operated one first media object 410 or the second media object 420, and is larger than the one first media object 410 and the second media object 420. As shown in the figure, the layout of the details page 452 may be changed depending on the modality of the media information (text, video, still image, etc.).

[0050] New functions may be added to the first functional object 430. Examples of such functions include media information search by directing the surrounding first media object 410 or second media object 420 toward the first functional object 430, image-based media information search by capturing an image, and text-based media information search by inputting text. The display method of the searched media information can be changed. Examples include displaying the media information on the first media object 410 surrounding the first functional object 430 (the same as the normal top screen), displaying it in the same graphical configuration, displaying a list of media information combining one or more media, or displaying a list of media information limited to specific media. Details of the media information can be displayed by performing a specified action (e.g., clicking, double-clicking, or tapping) on ​​the first media object 410 or the second media object 420. One or more pieces of media information are displayed on the details page 452.

[0051] In this manner, the display size of the media information can be changed from the first media object 410 or the second media object 420 to the details page 452. The enlarged first media object 410 can display images and text using more pixels than the standard-sized first media object 410 or the second media object 420. Methods for changing the information display include increasing the text size, increasing the amount of information displayed, and increasing the variety of media information. Active operations can be performed on the first media object 410 or the second media object 420. Active operations include saving (clipping) favorite information, posting to other SNSs, sharing media information, and leaving comments. Interfaces for executing each of these active operation functions are displayed as icons, either individually or in a group, on or near the first media object 410 or the second media object 420. When the first media object 410 or the second media object 420 is grouped, operating the grouped icon opens a menu listing active operations.

[0052] Active operations similar to those of the first media object 410 are also possible from the details page 452. The user can post comments on each piece of media information. The user can view the comments along with the media information from which they were posted. The user can add a reaction and rate the comment by clicking or tapping a designated icon for the comment. Information that the user can view regarding a posted comment includes information about the commenter, the content of the comment, and a rating for the comment. When the user selects a commenter from this viewable information, the screen may transition to the commenter's My Page. The commenter's My Page may display a free-form comment field (e.g., self-introduction), comment history, the number of users the commenter follows (following count), and the number of users who follow them (followers count). The user may be able to follow other users. Comments, article posts, advertisements, etc. posted by users the user follows may be preferentially displayed on the user's screen.

[0053] FIG. 7 shows another example of a screen after the GUI of the electronic device has changed (second functional object).

[0054] When the first functional object 430 is operated (a fourth operation for the user to perform a text search for information) on the display device 41, the control circuit 42 of the electronic device 40 displays a second functional object 451. The second functional object 451 functions as a text search field. The control circuit 42 of the electronic device 40 displays one or more third media objects 450, each representing media information related to the text entered in the second functional object 451. The "media information related to the text" may be selected using the method of selecting "different media information related to each other" displayed as the first media object 410 and the second media object 420, as described above, or may be selected using another method.

[0055] In addition to a text search field, the second functional object 451 has the same function as the search window of the first functional object 430. When an operation is performed to move one third media object 450 toward the second functional object 451, the control circuit 42 of the electronic device 40 displays, in the layout of the top screen 400, a plurality of first media objects 410 each indicating different media information related to the media information indicated by the third media object 450 that has been operated to move toward it.

[0056] 3. Functional configuration of the information processing system

[0057] FIG. 8 shows the functional configuration of the information system.

[0058] The information processing device 10 operates as a collection unit 110, a media information analysis unit 120, a concept relationship calculation unit 130, an account creation unit 140, an account usage history analysis unit 150, a startup recommendation unit 160, and a search recommendation unit 170 by the processor of the control circuit 100 loading various information processing programs recorded in the auxiliary storage device into the main storage device and executing them.

[0059] The storage device 20 stores a media information database 210 , a concept database 220 , a concept relationship database 230 , an analysis information database 240 , and an account database 250 .

[0060] 4. Operation of the information processing device

[0061] FIG. 9 shows the operation flow of the information processing device.

[0062] The collection unit 110 collects media information (step S1). The media information is composed of at least one of a plurality of different modalities (formats), such as still images, moving images, music, text, location information, and tag information. The media information is linked to all data that exists in the real world and the virtual world. For example, data stored on the web (also called the Internet or network), data stored in personal devices, and data measured using predetermined sensors in the real world or the virtual world are subject to the media information collection. The collection unit 110 stores the collected media information in the media information database 210.

[0063] FIG. 10 shows the media information database.

[0064] A plurality of media data 210A are registered in the media information database 210. Each media data 210A is registered with a media ID 211, a title 212, text 213, an image identifier 214, a sender account ID 215, and an update date 216, all of which are associated with one another.

[0065] The media ID 211 may be a serial number that uniquely identifies one piece of media information within the media information database 210. The title 212 may be defined by meta information included in the collected media information. The text 213 is included in the collected media information. The image identifier 214 may be a URL (link address) uniquely assigned to the media information, or may be actual data. Each piece of media data 210A may include either the text 213 or the image identifier 214, or may include both. If the media information is music, the media information may not include both the text 213 and the image identifier 214, but may include a URL or a music identifier (not shown) indicating the actual data.

[0066] The sender account ID 215 is the account ID of the end user who sent the media information. In addition to the sender account ID 215, a sender classification may be registered, such as whether the sender is a member of the service or a Know Your Customer (KYC). The update date 216 is the date on which the media information was updated. The update date 216 may be classified according to whether the update date was sent within a specified time period from the collection date.

[0067] The types and number of types of the plurality of media data 210A may be classified according to the type and number of media by which the media data 210A is configured and provided. If an individual address is set for each piece of media data 210A (for example, SNS), this address information may also be collected.

[0068] FIG. 11 shows the configuration of the media information analysis unit.

[0069] The media information analysis unit 120 calculates media features, which are feature quantities of each piece of media information present on the network, using a model learned by, for example, machine learning (step S2). Specifically, the media information includes multiple pieces of sub-media information M1, M2 (e.g., text M1 and image M2). The media information analysis unit 120 calculates media feature quantities 245, 246 for each piece of sub-media information M1, M2 (step S21). That is, the media information has multiple media feature quantities 245, 246 for each piece of sub-media information M1, M2.

[0070] The media information analysis unit 120 extracts concepts from each piece of media information (step S3). Specifically, the media information analysis unit 120 refers to the concept database 220 to extract concepts from each piece of media information, and then breaks the extracted concepts down into dominant concepts 243 and sub-concepts 244 (step S22). For example, the media information analysis unit 120 may classify concepts from objects that appear frequently in a piece of media information as dominant concepts 243, and concepts from objects that appear relatively less frequently as sub-concepts 244. That is, the concept of a piece of media information includes the dominant concepts 243 and the sub-concepts 244. The set of the dominant concepts 243 and sub-concepts 244 from a piece of media information is defined as the concept of that piece of media information.

[0071] FIG. 12 shows the concept database.

[0072] A plurality of concept data 220A are registered in the concept database 220. Each concept data 220A is registered with a serial ID 221, a concept ID 222, and a concept name 223, which are associated with each other. The concept data 220A registered in the concept database 220 does not distinguish between dominant concepts 243 and sub-concepts 244. For example, the concept data 220A does not have a flag or the like that distinguishes between the dominant concepts 243 and sub-concepts 244.

[0073] FIG. 13 shows the concept relationship database.

[0074] A plurality of concept relationship data 230A are registered in the concept relationship database 230. A "concept" is a concept expressed in media information such as text or an image. Each concept relationship data 230A is registered with a serial ID 231, a concept relationship ID 232, a concept from 233, a concept to 234, and a relationship strength 235, which are associated with each other. The relationship strength 235 indicates the strength of a directional connection (strength of a connection).

[0075] For example, the strength of relationship 235 from the concept "today" with concept ID "0" to the concept "event" with concept ID "1" in Fig. 12 is "0.61." Also, just because the strength of relationship 235 from the concept "today" to the concept "event" is registered, the strength of relationship 235 in the reverse direction, from the concept "event" to the concept "today," does not necessarily have to be registered. Also, the strength of relationship 235 from the concept "today" to the concept "event" does not necessarily match the strength of relationship 235 in the reverse direction, from the concept "event" to the concept "today."

[0076] The media information analysis unit 120 refers to the concept database 220 and the concept relationship database 230, and determines concepts that have a predetermined strength of concept relationship 235 with the extracted dominant concept 243 as additional sub-concepts 244 of the media information (step S23). For example, when the extracted dominant concept 243 is the concept from 233, the media information analysis unit 120 determines the concept to 234 whose strength of relationship 235 from this concept from 233 is equal to or greater than a predetermined value as an additional sub-concept 244. The media information analysis unit 120 registers the media feature quantities 245, 246, the dominant concept 243, and the sub-concept 244 in the analysis information database 240.

[0077] FIG. 14 shows the analysis information database.

[0078] A plurality of analysis information data 240A are registered in the analysis information database 240. Each analysis information data 240A is a collection of associated data including a serial ID 241, a media ID 242, a dominant concept set 243, a sub-concept set 244, text features 245, image features 246, and features 247 of other media (e.g., music). The media ID 242 is the same as the media ID 211 in the media information database 210. The dominant concept set 243 includes concept IDs 222 ( FIG. 12 ) of all dominant concepts extracted for the media information of the media ID 242. The sub-concept set 244 includes concept IDs 222 ( FIG. 12 ) of all sub-concepts extracted for the media information of the media ID 242. The text features 245, image features 246, and features 247 of other media include features of all sub-media included in the media information. The text feature 245, the image feature 246, and the feature of other media (for example, music) 247 are collectively referred to as “media feature.” One form of the feature is a vector, but any form is acceptable.

[0079] FIG. 15 shows the configuration of the concept relationship calculation unit.

[0080] The concept database 220 and the concept relationship database 230 are created in advance and updated as needed by the concept relationship calculation unit 130. That is, the concept relationship calculation unit 130 calculates and updates the concept relationships between concepts of multiple pieces of media information present on the network.

[0081] Specifically, the concept relationship calculation unit 130 reads out the media information database 210 and the analysis information database 240. The concept relationship calculation unit 130 extracts, from the media information database 210, the sender account ID 215 and update date 216 of media data 210A identified by a certain media ID 212. The concept relationship calculation unit 130 extracts, from the analysis information database 240, a dominant concept set 243, a sub-concept set 244, a text feature 245, an image feature 246, and a feature of other media 247 of analyzed information data 240A identified by a certain media ID 242. The concept relationship calculation unit 130 calculates the concept relationship for each dominant concept set 243 and sub-concept set 244. The conceptual relationship calculation unit 130 may use the sender account ID 215, the update date 216, the text feature 245, the image feature 246, and the feature of other media 247 to affect the calculation of the conceptual relationship. The conceptual relationship calculation unit 130 updates the concept database 220 and the conceptual relationship database 230 as needed based on the calculation results.

[0082] FIG. 16 shows the configuration of the account creation unit.

[0083] Meanwhile, the account creation unit 140 registers an account for a user who will use the electronic device 40 to log in to a service provided by the information processing system 1 (step S4). The user uses the electronic device 40 to input user information (step S41).

[0084] By logging in, a user is assigned a unique account and can use the unique services provided by the information processing system 1. The unique services include history management, tagging of media information, viewing of tagged media information, writing comments, provision of content tailored to user preferences, and distribution of advertisements. When initially registering, the user may be asked for their name (user name), email address, mobile phone number, SNS account, personal certificate, payment information, and other information as needed. When initially registering, the user may specify one or more keywords to be used as criteria for determining preference information. When defining keywords, preference information may be classified using simple questions. The preference information may be calculated using a model trained by machine learning from the network usage history of the user, such as the media information viewed by the user, other users the user follows, and other users the user follows. When a user logs in, two-step authentication may be required based on the registered information. Information about the device the user logs in with is registered on the server operating the service, and two-step authentication may be required if the user logs in using a device with no previous history. Account information is stored in the account database 250.

[0085] FIG. 17 shows the account database.

[0086] A plurality of account data 250A are registered in the account database 250. Each account data 250A is registered in association with each other, including an account ID 251, a user name 252, a preference feature 253, a browsing history media ID list 254, a following account list 255, and a follower account list 256.

[0087] The account creation unit 140 calculates preference features 253 of the user logging in to the service using the electronic device 40 based on the browsing history media ID list 254, following account list 255, follower account list 256, preference information at the time of initial registration, etc. registered in the account database 250 using a model learned by machine learning, and registers the calculated preference features 253 in the account database 250 (step S42).

[0088] FIG. 18 shows the configuration of the account usage history analysis unit.

[0089] When a user logs in to an account and uses a service provided by the information processing system 1, the account usage history analysis unit 150 recalculates the preference feature quantity based on the user's usage history (step S5). Specifically, the account usage history analysis unit 150 reads the account ID 251, preference feature quantity 253, and browsing history media ID list 254 from the account database 250, and recalculates the preference feature quantity 253 based on the browsing history media ID list 254, which is the usage history (step S51). The account usage history analysis unit 150 may further recalculate the preference feature quantity 253 based on the following account list 255 and the follower account list 256. The account usage history analysis unit 150 registers (updates) the recalculated preference feature quantity 253 in the account database 250. In this way, the user's preferences are analyzed based on the keywords selected at the time of initial registration and the past usage history of the service.

[0090] FIG. 19 shows the configuration of the startup recommendation unit.

[0091] The startup recommendation unit 160 selects a plurality of pieces of media information each having a media feature that satisfies a predetermined condition with respect to the preference feature 253 as a plurality of first media objects 410 and a plurality of second media objects 420 to be initially displayed (step S6). Specifically, when a user launches an application program using the electronic device 40 (step S61), the startup recommendation unit 160 reads the account database 250. The startup recommendation unit 160 reads the preference feature 253 associated with the account ID 251 of the logged-in user from the account database 250. The startup recommendation unit 160 extracts a plurality of pieces of analysis information data 240A having media features 245, 246, and 247 that satisfy a predetermined condition with respect to the read preference feature 253 from the analysis information database 240. This makes it possible to provide a method for recommending search needs candidates to the user (displaying an initial screen based on preferences) and a display method (UI) to enable searches for search needs that the user is not aware of.

[0092] The startup recommendation unit 160 extracts from the media information database 210 a plurality of media data 210A having the same media ID 211 as the media ID 242 of the extracted plurality of analysis information data 240A. The data generation unit 180 generates a plurality of first media objects 410 and a plurality of second media objects 420 based on the title 212, text 213, and image identifier 214 of the extracted plurality of media data 210A (step S10). The plurality of first media objects 410 and the plurality of second media objects 420 are display data for displaying the selected plurality of media information, which are supplied to the electronic device 40 via the web server 30. The data generation unit 180 causes the display device 41 of the electronic device 40 to display a top screen 400 including the plurality of first media objects 410 and the plurality of second media objects 420 based on the plurality of media data 210A via the web server 30 (step S62). That is, the web server 30 supplies the electronic device 40 with display data for displaying the plurality of pieces of media information selected by the information processing device 10 .

[0093] FIG. 27 shows a modified example of the configuration of the startup recommendation unit.

[0094] Furthermore, the startup recommendation unit 160 may not only extract the analysis information data 240A from the analysis information database 240, but also generate data of media information that matches the user's preference feature 253 (step S63). In this case, the data generation unit 180 may generate the first media object 410 or the second media object 420 for displaying the generated data of the media information.

[0095] The user browses the top screen 400 (step S7). The user operates (e.g., drags and drops) the first media object 410 so that it is positioned above the first functional object 430, thereby selecting the first functional object 430 and performing a search (step S8). When transitioning from the top screen 400, the first functional object 430 remains in its designated position, but the information in the first media object 410 is changed as follows (step S9).

[0096] Fig. 20 shows the configuration of the search time recommendation unit, Fig. 28 and Fig. 29 are diagrams for explaining an example of the operation of the search time recommendation unit.

[0097] When an operation is performed to move one first media object 410 toward the first functional object 430, the search recommendation unit 170 selects a plurality of pieces of media information each having a concept that has a predetermined conceptual relationship with the concept of the media information indicated by the one first media object 410. Specifically, the user operates the first media object 410 to move toward the first functional object 430 (step S81). In the example of Fig. 28, the media information indicated by the first media object 410 operated by the user is assumed to be "a video of a cat jumping toward the moon."

[0098] The search-time recommendation unit 170 extracts the media ID 211 of the media data 210A indicated by the first media object 410 selected and operated by the user from the media information database 210. The search-time recommendation unit 170 extracts the dominant concept 243, sub-concept 244, and media features 245, 246, and 247 of the media ID 242 that is the same as the extracted media ID 211 from the analysis information database 240. The search-time recommendation unit 170 extracts the concept IDs 222 of the extracted dominant concept 243 and sub-concept 244 from the concept database 220.

[0099] When the dominant concept 243 and subconcept 244 identified by the extracted concept ID 222 are defined as concepts from 233, the search-time recommendation unit 170 extracts concepts to 234 whose strength of relationship 235 from this concept from 233 satisfies a predetermined condition (e.g., a threshold or greater) from the concept relationship database 230. The search-time recommendation unit 170 extracts media IDs 242 associated with the concept ID of the extracted concept to 234 (i.e., media IDs 242 of media information having the concept to 234 as a dominant concept 243 or subconcept 244) from the analysis information database 240. The search-time recommendation unit 170 extracts analysis information data 240A of the extracted media ID 242 from the analysis information database 240 (step S91). This allows the search recommendation unit 170 to select media (media identified by media ID 242) that has a predetermined conceptual relationship to the media data 210A indicated by the first media object 410 selected by the user.

[0100] As a process for broadening the search scope for selected media information, information (subconcepts) that the media information does not directly possess can be assigned using the concept from 233 and concept to 234. This process can be performed not only once but also recursively any number of times. For example, a second concept (subconcept) can be derived from a first concept (dominant concept), and then a third concept (subconcept) can be derived from the second concept (subconcept). That is, the search-time recommendation unit 170 may add at least one dominant concept 243 and / or subconcept 244 that has a predetermined conceptual relationship with at least some of the dominant concepts 243 and / or subconcepts 244 of the concepts of the media information selected by the user to the concept of the media information. This allows the search-time recommendation unit 170 to select media that have concepts that do not have a direct conceptual relationship with the concept of the media information selected by the user.

[0101] In the examples of Figures 28 and 29, the search-time recommendation unit 170 extracts the dominant concept 243 "cat" (Dominant in Figure 29) of "video of a cat jumping towards the moon" and the sub-concepts 244 "moonlight" and "jump" (Sub in Figure 29). The search-time recommendation unit 170 extracts "hunchback" and "shelter cat adoption event" (Sub1-1 in Figure 29) as sub-concepts 244 (concept to 234) that have a relationship with the dominant concept 243 "cat" (concept from 233). The search-time recommendation unit 170 extracts media information 210A (e.g., a video of exercises to prevent hunchback, an advertisement for a shelter cat adoption event) that has the sub-concepts 244 "hunchback" and "shelter cat adoption event."

[0102] As described above, just because the strength of relationship 235 from the concept "today" (first concept) to the concept "event" (second concept) is registered, the strength of relationship 235 from the concept "event" to the concept "today" in the reverse direction does not necessarily have to be registered. Furthermore, the strength of relationship 235 from the concept "today" to the concept "event" does not necessarily match the strength of relationship 235 from the concept "event" to the concept "today" in the reverse direction. For this reason, for example, even if media information having the concept "event" is extracted using a key from media information having the concept "today," this does not mean that media information having the concept "today" is extracted using a key from media information having the concept "event." Here, in addition to media information having a direct relationship derived from the dominant concept 243, media information having an indirect relationship derived from the subconcept 244 is selected. As a result, media information that is unexpected and not patterned for the user is extracted.

[0103] FIG. 30 shows a schematic comparison between a conventional search and a search according to this embodiment.

[0104] As shown in (A), conventional search systems assume that users are aware of their search needs and can spontaneously describe them in language. Therefore, the user's preferences are first uniquely identified by search terms (including image and multimedia searches), and information directly related to the user's preferences (search terms) is then retrieved. Such multimedia search systems cannot provide users with information other than what the user expects in response to a search query. In other words, the system can only provide information within the scope of the user's expectations.

[0105] In contrast, as shown in (B), in this embodiment, one of the recommended media information is used as a search query, allowing the user to enter a search query unconsciously, and thus acquiring suggestive trends and preferences rather than the user's unique preferences. The search results can include not only media information that is directly related to the search query (one of the recommended media information), but also media information that is indirectly related. This allows the user to perform a search even without being aware of their search needs. Furthermore, by including multimedia that the user did not expect but that is still relevant to the search target in the search results, the user can discover new connections and expand their exploration.

[0106] Returning to the description of the operation, the search-time recommendation unit 170 extracts the preference feature 253 associated with the account ID 251 of the logged-in user from the account database 250. The search-time recommendation unit 170 filters the analysis information data 240A based on the extracted preference feature 253 (step S92).

[0107] The search recommendation unit 170 extracts, from the media information database 210, a plurality of media data 210A having the same media ID 211 as the media ID 242 of the plurality of post-filtering analysis information data 240A. The data generation unit 180 generates a plurality of first media objects 410 and a plurality of second media objects 420 based on the title 212, text 213, and image identifier 214 of the extracted plurality of media data 210A (step S10). The data generation unit 180 causes the display device 41 of the electronic device 40, via the web server 30, to display a top screen 400 including the plurality of first media objects 410 and the plurality of second media objects 420 based on the plurality of media data 210A.

[0108] FIG. 31 shows a modified example of the configuration of the search time recommendation unit.

[0109] Furthermore, the search recommendation unit 170 may not only extract the analysis information data 240A from the analysis information database 240, but also generate media information data that matches the user's preference feature quantity 253 (step S93). In this case, the data generation unit 180 may generate the first media object 410 or the second media object 420 for displaying the generated media information data.

[0110] When a first search is performed, the search recommendation unit 170 extracts dominant concepts 243 and subconcepts 244 from the media information 210A to be searched. These may be pre-calculated. At this time, the search recommendation unit 170 may add concepts that have a relationship with each dominant concept 243 in the concept relationship database 230 as subconcepts 244. The search recommendation unit 170 searches the media information 210A database, the analysis information database, the concept database, and the concept relationship database 230 to obtain one or more pieces of media information 210A and feature quantities related to the media information 210A to be searched. At this time, the search recommendation unit 170 narrows the search range to only media information 210A that has a dominant concept 243 or subconcept 244 in common with the media information 210A to be searched. Finally, the search recommendation unit 170 displays the media information 210A based on a display priority (including not displaying the media information 210A). The display priority and whether or not to display may be determined based on the user's preferences, the importance of the concept using TF-IDF (Term Frequency - Inverse Document Frequency), and the like.

[0111] When the nth search is performed, the search recommendation unit 170 extracts dominant concepts 243 and subconcepts 244 from the media information 210A to be newly searched. These may be pre-calculated. At this time, the search recommendation unit 170 may add concepts that have a relationship with each dominant concept 243 in the concept relationship database 230 as subconcepts 244. The search recommendation unit 170 searches the media information 210A database, the analysis information database, the concept database, and the concept relationship database 230 to obtain one or more pieces of media information 210A and feature quantities related to the media information 210A to be searched. At this time, the search recommendation unit 170 narrows the search range to only media information 210A that has a dominant concept 243 or subconcept 244 in common with the media information 210A to be searched. Here, the search range may be further narrowed using the overlapping portion with all or any of the search ranges from the first to the n-1th search, or the search range may be widened using these search ranges. The search range from the first to the n-1th search may not be used. Finally, the search recommendation unit 170 performs display based on the display priority (including not displaying). The display priority may be determined based on the user's preferences, the importance of the concept using TF-IDF (Term Frequency - Inverse Document Frequency), etc.

[0112] According to this embodiment, media information recommended to a user is selected based not only on word relationships but also on the directional relationships between the dominant concept 243 and the subconcept 244. Here, in addition to media information with a direct relationship derived from the dominant concept 243, media information with an indirect relationship derived from the subconcept 244 is selected. Therefore, rather than presenting commonplace related information, media information that is unexpected for the user is presented. For the user, a topic that the user is familiar with but did not realize was related to a topic of interest may be presented. In this way, this embodiment can stimulate the user's intellectual curiosity and provide the user with the opportunity to discover new connections and expand their exploration. This creates an incentive for the user to use the service more.

[0113] According to this embodiment, as described above, the conceptual relationship calculation unit 130 calculates and updates the conceptual relationships between concepts of multiple pieces of media information present on the network. The account usage history analysis unit 150 calculates and updates the preference feature 253. Therefore, even if the number of pieces of media information present on the network does not change (increase or decrease), the media information recommended to a specific user dynamically changes both at startup and during a search due to changes in the relationships between the pieces of media information and changes in the user's preference feature 253. This allows users to constantly discover new connections and expand their exploration.

[0114] 5. Other

[0115] (1) Account history service

[0116] Logged-in users can view their past usage history. Usage history includes posting history, search history, history of media information for which detailed information has been viewed, comments viewed, comments written, etc. Users can delete all or part of the history. Users can select the history to view. If search history is selected, the search history at the time of selection will be displayed. If the history of media information for which detailed information has been viewed is selected, the detailed information can be confirmed. Each user can check the users who are following them and the users who are following them. From these confirmation screens, users can move to their respective My Pages. Account usage history is stored in the account database 250.

[0117] (2) Influence function (advertising, flyers)

[0118] Logged-in users who wish to post advertisements can use media objects 410, 420 to post their own advertisements. Advertisements are viewed by users. When a user selects an advertisement, an existing web browser is launched to move to an external site or to view more information. The advertisements viewed by users are selected based on keywords selected by the advertiser. The relevance and appropriateness of the selected keywords and the displayed advertisement are evaluated by an analysis system, and the display date and time and display location are used as the advertisement slot, and the display price for this advertisement slot can be set by the person wishing to display the advertisement. The price for the advertisement slot can be set by the person wishing to display the advertisement placing a bid. Advertisements are prioritized for display based on an analysis of their relevance to the keywords and the unit price. Advertisements analyzed to have low keyword relevance can be set to a low display priority.

[0119] (3) Posting function

[0120] Users can post media information consisting of one or more pieces of media they have created. Keywords can be set for posted media information. Posted media information is set using the keywords set when posting and highly relevant keywords extracted using an analysis function. Media information that is determined to be highly relevant and important based on the keyword group is set as a group for the posted media information and is displayed when the media information is searched using the system's functions. Posters can select and delete all or part of the media information that has been determined to be highly relevant and set as a group. Posters can add media information that is determined to be highly relevant to the group of media information they have posted.

[0121] (4) Autoplay function

[0122] Fig. 21 shows an example of a top screen, and Fig. 22 shows an example of a screen after the GUI of the electronic device has changed (autoplay).

[0123] In the top screen 400 of Fig. 21 , a first media object 410 and a second media object 420 represent media information including video and audio. As shown in (A), when a user performs an operation (such as a touch operation) on the first media object 410 without movement, a play button may be displayed within the first media object 410. As shown in (B), when a user performs an operation (such as a touch operation) on the second media object 420 without movement, a play button may be displayed within the second media object 420. Furthermore, when a user performs an operation (such as a touch operation) on the first media object 410 or the second media object 420 with the play button displayed without movement, a transition to a details page (Fig. 22) may occur, and the start screen of (A) may be displayed.

[0124] The user can automatically play listed media information. The automatic playback method can be a combination of one or more of the following: an automatic transition method in which media information displayed on the screen switches every certain time; a method in which each piece of media information, such as video, is played back sequentially; and a method in which audio information is read aloud. On the start screen (A) in FIG. 22 , the user can change the automatic transition time for the video media information and the playback speed of the automatic playback and the audio information. When the user operates the screen during various playback operations (B), the operation screen (C) is displayed. On the operation screen, the user can adjust the playback speed, play, stop playback, rewind for a certain period of time, forward for a certain period of time, move to the previous media information, or move to the next media information. On the other hand, as shown in (D), for media primarily consisting of still images, the still images are displayed large. As described above, media information is composed of at least one of several different modalities (formats), such as still images, video images, audio, and text. The type of modality is not limited to this example and may be any format.

[0125] (5) Modified top screen

[0126] 23, 24, and 25 show modified examples of the top screen.

[0127] As shown in FIG. 23 , the layout of the top screen 400 is not limited to the layout of the above embodiment. FIGS. 24 and 25 show examples of the top screen 400 when the electronic device 40 is displayed on a browser on a personal computer rather than a smartphone. FIG. 24 shows an example of the top screen 400 in which a community function, a recommendation function, and other functions are listed together with a media display function. FIG. 25 shows an example of the top screen 400 that displays only media information. In FIG. 25 , only a display area 471 including the first media object 410 and the first functional object 430 may be displayed. For example, displaying only the display area 471 is useful when the displayable area is small, such as with VR glasses. In any of FIGS. 23 , 24 , and 25 , any layout may be used as long as multiple first media objects 410 are displayed around the first functional object 430.

[0128] Although the embodiments and modified examples of the present technology have been described above, the present technology is not limited to the above-described embodiments, and it goes without saying that various modifications can be made within the scope of the gist of the present technology.

[0129] 1 Information processing system 10 Information processing device 20 Storage device 30 Web server 40 Electronic device 400 Top screen 401 First display area 402 Second display area 41 Display device 410 First media object 42 Control circuit 420 Second media object 430 First functional object 440 Account object 450 Third media object 451 Second functional object 110 Collection unit 120 Media information analysis unit 130 Concept relationship calculation unit 140 Account creation unit 150 Account usage history analysis unit 160 Startup recommendation unit 170 Search recommendation unit 210 Media information database 220 Concept database 230 Concept relationship database 240 Analysis information database 250 Account database

Claims

1. A display device, and a control circuit configured to display, on the display device, a first functional object and a plurality of first media objects each indicating different media information around the first functional object, and when an operation is performed on one of the first media objects towards the first functional object, switch the display so that, instead of the plurality of first media objects being displayed, a plurality of new first media objects each indicating different media information related to the media information indicated by the one first media object on which the operation was performed are displayed around the first functional object. An electronic device comprising the same.

2. The electronic device according to claim 1, wherein the plurality of first media objects are four rectangular first media objects, and the four first media objects arranged around the first functional object form a square. An electronic device.

3. The electronic device according to claim 2, wherein the first functional object is arranged at the center of the square. An electronic device.

4. The electronic device according to claim 2 or 3, wherein the control circuit sets, on the display device, a first display area formed by the square and a rectangular second display area having a first side adjacent to one side of the first display area and having a length equal to one side of the square and a second side orthogonal to the first side, displays the first functional object and the four first media objects in the first display area, and displays, in the second display area, a plurality of square second media objects, three or more in a first direction which is the length direction of the first side and one or more in a second direction which is the length direction of the second side, in a matrix such that they are adjacent to the first display area and all the second media objects are adjacent to each other. An electronic device.

5. The electronic device according to claim 4, wherein each of the second media objects indicates media information different from the media information of the first media object, and the control circuit, when an operation of one second media object towards the first functional object is performed, replaces the plurality of second media objects being displayed with a plurality of new second media objects each indicating media information related to the media information indicated by the one second media object that has been operated, and switches the display so as to display the plurality of new second media objects around the first functional object.

6. The electronic device according to claim 4, wherein the control circuit, when the user performs a first operation for displaying new information, replaces N (N is an integer of 1 or more and 4 or less) of the four first media objects displayed in the first display area with N new first media objects each indicating the media information indicated by N second media objects close to the first display area, and displays the N new first media objects in the first display area, and replaces the N second media objects displayed in the second display area with N new second media objects each indicating different media information, and switches the display so as to display the N new second media objects in the second display area.

7. The electronic device according to claim 4, wherein the control circuit, when the user performs a second operation for displaying new information, replaces N (N is an integer of 1 or more and 4 or less) of the three or more second media objects displayed in the second display area with N new second media objects each indicating the media information indicated by N first media objects close to the second display area, and displays the N new second media objects in the second display area, and replaces the N first media objects displayed in the first display area with N new first media objects each indicating different media information, and switches the display so as to display the N new first media objects in the first display area.

8. The electronic device according to claim 5, wherein when the user performs a third operation for displaying a detailed page of media information indicated by one first media object or a second media object, the control circuit displays in detail the media information indicated by the one first media object or the second media object that has been operated, and displays a detailed page larger than the one first media object and the second media object.

9. The electronic device according to claim 1, wherein when the user performs a fourth operation for text searching of information, the control circuit displays a second functional object, displays one or more third media objects each indicating media information related to the text input to the second functional object, and when an operation is performed on one third media object toward the second functional object, displays a plurality of first media objects each indicating different media information related to the media information indicated by the operated third media object.

10. A display control method, wherein a computer causes a display device to display a first functional object and a plurality of first media objects each indicating different media information around the first functional object, and when an operation is performed on one first media object toward the first functional object, switches the display so as to display, around the first functional object, a plurality of new first media objects each indicating different media information related to the media information indicated by the operated first media object instead of the plurality of first media objects being displayed.

11. An application program that operates a control circuit of an electronic device to display on a display device a first functional object and a plurality of first media objects each indicating different media information around the first functional object, and when an operation is performed on one of the first media objects toward the first functional object, the display is switched so that, instead of the plurality of first media objects being displayed, a plurality of new first media objects each indicating different media information related to the media information indicated by the one first media object that has been operated are displayed around the first functional object.

Images