Virtual space generation device and program

Abstract

To provide a virtual space generation device and program that enable presentation of works across categories.SOLUTION: An exhibition space processing server 1 comprises: a work reception unit 11 that receives the selection of multiple works from a work information DB storing work image data of the works and attribute information related to the works; a space axis reception unit 13 that receives the selection of an item of the attribute information to be used as an axis of the exhibition space for exhibiting each work by referring to the work information DB; a work coordinate determination unit 15 that determines, for each work received by the work reception unit 11, coordinate values in the exhibition space with the item of the attribute information received by the space axis reception unit 13 as an axis on the basis of the attribute information of each work; and an exhibition data generation unit 16 that generates work exhibition data in which the work image data of each work corresponding to the coordinate values are arranged on the coordinate values in the exhibition space of the works.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a virtual space generating device and a program. [Background technology]

[0002] In recent years, in the field of digital archives, efforts are underway to develop ways to utilize digitized archive data, rather than simply digitizing and storing artworks such as works of art. To promote the utilization of digitally archived data, a system is required that can devise ways to display not only artworks but also various other works in an easy-to-understand manner for users. In addition, a system is required that allows users to gain knowledge of individual pieces of digital archive data, but also to have a variety of perspectives that allow them to discover relationships between works. By making such efforts, it becomes possible for users who have no knowledge of the digital archive data to view the data with interest.

[0003] Incidentally, the metaverse has become popular in recent years, and virtual museums in which artworks are arranged in a virtual space have appeared. For example, a system has been disclosed that distributes images of artworks such as paintings stored in a museum database to an unspecified number of customers using Web3D (for example, Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2003-296587 A Summary of the Invention [Problem to be solved by the invention]

[0005] In the system described in Patent Document 1, "when you select Exhibit List from the main menu screen of the virtual museum, thumbnail and panoramic images of all the works on display in the gallery are displayed. When you select the desired painting or sculpture from these, a walk-through screen will guide you to the courtyard where the sculpture is on display." However, when using the system described in Patent Document 1, although knowledge of individual work information could be obtained, it was difficult to grasp the position of the works within the overall space, or the connections and relationships between the works.

[0006] Also, looking at the virtual museum services that have appeared on the market so far, there are, for example, virtual museums that are designed to enable rich artwork appreciation, virtual museums that archive real facilities and allow visitors to experience the same layout, etc. The spatial layout of these exhibits is generally such that the space is divided by thresholds, grouped by classification units such as artists or categories, and visitors are allowed to view the exhibits in a set order. However, when viewing artworks in a space separated by a threshold, one's interest is focused only on the artworks (or categories or artists) that interest oneself, making it difficult to grasp the connections and relationships between artworks across groups. Therefore, it seems difficult to get the viewer interested in the artworks beyond their own interests. In addition, virtual museums that archive real facilities lack the experience that is unique to virtual spaces, and as a result, there is an issue of sluggish visitor numbers.

[0007] Therefore, an object of the present invention is to provide a virtual space generation device and program that enable the display of works across classifications. [Means for solving the problem]

[0008] The present invention solves the above problems by the following solving means. A first invention is a virtual space generation device comprising: a work selection means for accepting a selection of a plurality of works from a work information storage unit which stores work image data of the works and attribute information related to the works; a spatial axis selection means for referring to the work information storage unit and accepting a selection of an item of the attribute information to be used as an axis of an exhibition space in which each work is to be displayed; a work coordinate determination means for determining coordinate values ​​in the exhibition space for each work accepted by the work selection means, the coordinate values ​​being the item of the attribute information accepted by the spatial axis selection means, based on the attribute information of each work; and an exhibition data generation means for generating work exhibition data in which the work image data of each work corresponding to the coordinate values ​​is placed at the coordinate values ​​in the exhibition space of the work. A second invention is a virtual space generation device according to the first invention, further comprising an element information receiving means for receiving a coordinate range of an area in space and a representative word related to each element of the attribute information when the attribute information for the item received by the spatial axis selection means is not numerical, and the work coordinate determination means determines the coordinate value of each work within the coordinate range of the area based on the similarity between the representative word received by the element information receiving means and a string of a specified attribute information of each work. A third invention is a virtual space generating device according to the first invention, wherein, when the attribute information for the item accepted by the spatial axis selection means is a numerical value, the work coordinate determination means determines, as the coordinate value, a value obtained by converting the numerical value of the attribute information of each work using a predetermined formula. A fourth invention is a virtual space generation device in which, in any of the first to third inventions, when the spatial axis selection means accepts a selection of two of the items, the work coordinate determination means determines the coordinate values ​​of each work by using the two accepted items as planar two-dimensional axes in the exhibition space. A fifth invention is a virtual space generation device in which, in any of the first to third inventions, when the spatial axis selection means accepts a selection of three of the items, the work coordinate determination means determines the coordinate values ​​of each work using the accepted three pieces of attribute information as three-dimensional axes including height in the exhibition space. A sixth invention is a virtual space generation device according to any one of the first to fifth inventions, further comprising an association acquisition means for acquiring associations between two or more works based on the attribute information of the plurality of works accepted by the work selection means, and the exhibition data generation means generates the work exhibition data when the association is acquired by the association acquisition means, further including connecting members connecting the works having the association and a character string indicating the association. A seventh invention is a virtual space generation device according to any one of the first to sixth inventions, comprising a spatial image memory unit which stores a plurality of spatial image data for constituting the exhibition space, and a spatial image selection means which accepts from the spatial image memory unit a selection of the spatial image data to be placed on each surface that constitutes the exhibition space, and the exhibition data generation means generates work exhibition data in which the work image data of each work corresponding to the coordinate values ​​in the exhibition space based on the spatial image data accepted by the spatial image selection means is placed at the coordinate values. An eighth invention is a virtual space generation device, which is any of the virtual space generation devices from the first to seventh inventions, and which is equipped with an exhibition data output means that enables viewing on a display device of the exhibition space based on the work exhibition data generated by the exhibition data generation means. A ninth invention is a virtual space generation device in any one of the first to eighth inventions, comprising a work information registration means for acquiring the work image data and the attribute information related to the work from an external device connected in a communicative manner, and registering them in the work information storage unit. A tenth aspect of the present invention is a program for causing a computer to function as any one of the virtual space generating devices according to the first to ninth aspects of the present invention. Effect of the Invention

[0009] According to the present invention, it is possible to provide a virtual space generating device and program that enable works to be displayed in a way that transcends classifications. [Brief description of the drawings]

[0010] [Figure 1] 1 is an overall schematic diagram of an image processing system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a functional block diagram of an exhibition space processing server according to the present embodiment. [Diagram 3] FIG. 2 is a diagram showing an example of a work information DB according to the embodiment. [Figure 4] 11 is a diagram for explaining a method of registering work information on a setting terminal according to the embodiment. FIG. [Diagram 5] 10 is a flowchart showing the exhibition space generation process of the exhibition space processing server according to the present embodiment. [Figure 6] FIG. 11 is a diagram showing an example of a screen displayed on a setting terminal according to the embodiment. [Figure 7] FIG. 11 is a diagram showing an example of a screen displayed on a setting terminal according to the embodiment. [Figure 8] FIG. 11 is a diagram showing an example of a screen displayed on a setting terminal according to the embodiment. [Figure 9] 13 is a flowchart showing the artwork coordinate determination process of the exhibition space processing server according to the present embodiment. [Figure 10] FIG. 11 is a diagram showing an example of a screen displayed on a setting terminal according to the embodiment. [Figure 11] 11 is a diagram for explaining the work coordinate determination process of the exhibition space processing server according to the present embodiment. FIG. [Figure 12] FIG. 11 is a diagram showing an example of work exhibition data that can be viewed on a user terminal according to this embodiment. [Figure 13] 13 shows an example of a screen of an exhibition space displayed on a user terminal according to the present embodiment. [Figure 14]13 shows an example of a screen of an exhibition space displayed on a user terminal according to a modified embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. Note that this is merely an example, and the technical scope of the present invention is not limited to this example. (Embodiment) <Image processing system 100> FIG. 1 is an overall schematic diagram of an image processing system 100 according to this embodiment. FIG. 2 is a functional block diagram of the exhibition space processing server 1 according to this embodiment. FIG. 3 is a diagram showing an example of the work information DB 3 according to this embodiment.

[0012] The image processing system 100 shown in Figure 1 is a system including an exhibition space processing server 1 (virtual space generation device), a work information DB (database) 3 (work information storage unit), a setting terminal 5, a user terminal 6 (display device), and an external server 7 (external device). The exhibition space processing server 1 generates an exhibition space for multiple artworks input and specified by the setting terminal 5. The exhibition space is a space whose axis is the attribute information item specified by the setting terminal 5, and the work image data of each work is arranged at a position corresponding to the coordinate value of each work determined based on the attribute information. The exhibition space is also generated using spatial image data that constitutes the exhibition space selected by the setting terminal 5. Furthermore, the exhibition space generated using the spatial image data and in which the work image data is arranged is generated as work exhibition data.

[0013] The exhibition space processing server 1 then creates an exhibition space using editing software such as an authoring tool based on the work exhibition data indicating the exhibition space, and makes the created exhibition space of the works viewable on the user terminal 6. In this way, the image processing system 100 makes it possible to provide the user (experiencer) with a viewing screen for the exhibition space of works across classifications. In the following, we will explain the exhibition space of artworks using paintings, crafts, sculptures, etc. held in museums and art galleries as examples.

[0014] The exhibition space processing server 1, the setting terminal 5, the user terminal 6, and the external server 7 shown in Fig. 1 are communicatively connected via a communication network N. The communication network N is, for example, an Internet line or the like, and may be wired or wireless. In addition, the exhibition space processing server 1 is communicatively connected to the artwork information DB 3. In the example of Fig. 1, the exhibition space processing server 1 and the artwork information DB 3 are directly connected, but they may be connected via a communication network N.

[0015] <Exhibition space processing server 1> The exhibition space processing server 1 generates work exhibition data in response to operations from the setting terminal 5. The exhibition space processing server 1 then enables viewing of the exhibition space on the user terminal 6 by using the generated work exhibition data in editing software for creating the exhibition space. The exhibition space processing server 1 is, for example, a Web server, or may be a personal computer (PC) or the like.

[0016] As shown in FIG. 2, the exhibition space processing server 1 includes a control unit 10, a storage unit 20, and a communication interface unit 29. The control unit 10 is a central processing unit (CPU) that controls the entire exhibition space processing server 1. The control unit 10 appropriately reads and executes the operating system (OS) and application programs stored in the storage unit 20, thereby cooperating with the above-mentioned hardware and executing various functions.

[0017] The control unit 10 includes a work of art receiving unit 11 (work of art selection means), a spatial image receiving unit 12 (spatial image selection means), a spatial axis receiving unit 13 (spatial axis selection means), an element information receiving unit 14 (element information receiving means), a work of art coordinate determination unit 15 (work of art coordinate determination means), an exhibition data generation unit 16 (exhibition data generation means), an exhibition data output unit 17 (exhibition data output means), and a work of art information registration unit 18 (work of art information registration means).

[0018] The work receiving unit 11 receives a selection of multiple works from among the works stored in the work information DB3 from the setting terminal 5. Specifically, for example, the names of multiple works to be exhibited are selected by the setting terminal 5 from the names of the multiple works displayed on the setting terminal 5, whereby the work receiving unit 11 receives information about the multiple works. The work receiving unit 11 then temporarily stores the received information about the works in the storage unit 20.

[0019] The spatial image receiving unit 12 receives a selection of spatial image data stored in a spatial image storage unit 22 (described later) from the setting terminal 5. Specifically, for example, a plurality of spatial image data to be arranged on each surface constituting the exhibition space in which the works are exhibited is displayed on the setting terminal 5, and the spatial image data for the surface of the exhibition space on which the user wishes to arrange the spatial image data is selected, whereby the spatial image receiving unit 12 receives the spatial image data. Here, the spatial image data is, for example, a texture image. Then, the spatial image receiving unit 12 temporarily stores the received spatial image data in the storage unit 20.

[0020] The spatial axis receiving unit 13 receives the selection of the attribute information items to be used as the axes of the exhibition space from the setting terminal 5. Specifically, for example, options regarding the number of axes of the exhibition space and items selectable as axes are displayed on the setting terminal 5, and one is selected from the options regarding the number of axes, and a number of items corresponding to the number of axes are selected, whereby the spatial axis receiving unit 13 receives the selection of the attribute information items to be used as the axes of the exhibition space. Here, if the received option is one that is configured with two axes, the spatial axis receiving unit 13 receives the selection of two items, and if the received option is one that is configured with three axes, the spatial axis receiving unit 13 receives the selection of three items.

[0021] When the attribute information for an item accepted by the spatial axis accepting unit 13 is not a numerical value, the element information accepting unit 14 accepts the coordinate range of an area in space and a representative word related to each element for each element of the attribute information. Here, the coordinate range of the area in space is specified so that the areas of each element do not overlap within the range from 0 to 100, for example, and the combined areas of each element are in the range from 0 to 100. The representative word related to each element is a representative keyword expressing each element, and may be multiple words or a sentence.

[0022] The work coordinate determination unit 15 determines the coordinate values ​​of each work in the exhibition space. Here, the work coordinate determination unit 15 performs different processing depending on whether the attribute information of the item to be the axis is a numerical value or not. Here, an example of the attribute information of an item that is a numerical value is the birth year of the work, which will be described later. When the attribute information of the axis item is a numerical value, the work coordinate determination unit 15 converts the numerical value of the attribute information of each work using a predetermined formula and determines the converted value as the coordinate value. The predetermined formula is used to match the numerical range of the attribute information of each work to the numerical range of the axis of the exhibition space.

[0023] On the other hand, when the attribute information of the axis item is not a numerical value, the work coordinate determination unit 15 determines the coordinate value of each work in the coordinate range of the area of ​​each element based on the similarity between the representative word accepted by the element information acceptance unit 14 and the character string of the predetermined attribute information of each work. Here, the character string of the predetermined attribute information of each work is, for example, a character string in the explanatory text field of each work. Through this process, the coordinate value of a work having a character string similar to the representative word in its attribute information is determined, for example, to be a coordinate near the beginning of the coordinate range of the area of ​​the element, while the coordinate value of a work having a character string not similar to the representative word in its attribute information is determined, for example, to be a coordinate away from the beginning of the coordinate range of the area of ​​the element.

[0024] The exhibition data generation unit 16 generates an exhibition space based on the spatial image data received by the spatial image receiving unit 12. Then, the exhibition data generation unit 16 generates work exhibition data in which the work image data of the work corresponding to the coordinate values ​​is arranged at the coordinate values ​​in the generated exhibition space. The exhibition data output unit 17 loads the work exhibition data generated by the exhibition data generation unit 16 into editing software for creating an exhibition space, thereby making the created exhibition space viewable from the user terminal 6. Here, the editing software for creating an exhibition space refers to, for example, software for creating a space such as authoring software, or a virtual space construction platform on a cloud service. The work information registration unit 18 acquires work image data and attribute information held in the external server 7 from the external server 7 via the communication network N, and registers them in the work information DB 3. The work information registration unit 18 also accepts work image data and attribute information from the setting terminal 5, and registers them in the work information DB 3.

[0025] The storage unit 20 is a storage area such as a hard disk, a semiconductor memory device, etc. for storing programs, data, etc. required for the control unit 10 to execute various processes. The storage unit 20 includes a program storage unit 21 and a space image storage unit 22 . The program storage unit 21 is a storage area for storing various programs. The program storage unit 21 stores a program 21a for carrying out various functions executed by the control unit 10 of the exhibition space processing server 1.

[0026] The spatial image storage unit 22 is a storage area for storing spatial image data that constitutes the exhibition space. For example, the spatial image storage unit 22 stores the data name of the spatial image data in association with the spatial image data. The data name is preferably a name that includes the characteristics of the spatial image data, for example, a name that includes a color or a pattern. The spatial image data stored in the spatial image storage unit 22 can be an important element for the user to actively confirm the positioning of each work. Therefore, the space creator who designs the space using the setting terminal 5 stores the spatial image data that takes into account the exhibition configuration in the spatial image storage unit 22 in advance. In addition, in order to realize a rich expression by the spatial image data, normal map data for expressing unevenness may also be stored in the spatial image storage unit 22 and used when configuring the exhibition space. The communication interface unit 29 is an interface for performing communication with, for example, the setting terminal 5, the user terminal 6, the external server 7, etc. via the communication network N.

[0027] <Work information DB3> The work information DB 3 shown in FIG. 1 is a database that stores work image data and attribute information related to the works. FIG. 3 shows an example of the work information DB3, taking the content of one work as an example. The work information DB3 stores the content of the work and the data name for each item, such as the work ID (IDentification), category, work name, technique, explanatory text, work data name, work's birth year, birth location information (latitude, longitude), location of collection, related information link URL, and related information video content. The work ID is identification information for identifying the work, and may be arbitrarily determined by the exhibition space processing server 1. The category indicates the genre of the work, for example, Japanese painting, Western painting, print, sculpture, crafts, etc.

[0028] The work name is the name of the work. The work name may be a name by which the work is generally known, or may be a name given by the data registrant, for example. The technique is the technique of the work, for example, ink painting in the Japanese painting category. The commentary is a text that explains the work. The work data name is the file name of the work image data. The work image data is data to be arranged in the exhibition space, for example, image data of a photograph of the work. The work image data may be other images, such as an illustration image of the work, so long as the work is expressed in an easily understandable manner. The work image data may also be two-dimensional image data or three-dimensional modeling data.

[0029] The birth year of the work indicates the year in which the work was created. Depending on the work, the birth year of the work may indicate an approximate time period. The birth location information (latitude, longitude) indicates the location information of the place where the work was created. The birth location information (latitude, longitude) may be the location information of the place where the work was discovered or excavated. The storage location indicates the location where the work is actually stored, such as the name of an art gallery or museum. The related information link URL is, for example, the URL of a web page that has information about the work. The related information video content indicates content related to the work. The related content may be a video content explaining the details of the work, or may be the file name of an audio file. It should be noted that the above-mentioned items of attribute information in the work information DB 3 are merely an example, and other items may be present, or there may be no items at all.

[0030] <Setting terminal 5> 1 is a terminal used by a data registrant who registers data related to works in the work information DB 3 or a space creator who creates an exhibition space, and is, for example, a stationary terminal such as a PC. The setting terminal 5 may also be a portable terminal that also has computer functions, such as a tablet. Although not shown, the setting terminal 5 includes at least a control unit, a storage unit, an input unit, a display unit, and a communication interface unit.

[0031] <User terminal 6> The user terminal 6 is a terminal used by a user to view the virtual museum, which is an exhibition space displayed based on the artwork exhibition data, and is, for example, a portable terminal that also has computer functions, such as a tablet. The user terminal 6 may also be a portable terminal such as a smartphone or a mobile phone, or a stationary terminal such as a PC. Although not shown, the user terminal 6 includes at least a control unit, a storage unit, a touch panel display (or an input / output unit), and a communication interface unit.

[0032] <External Server 7> The external server 7 is a server that stores various data related to the work. The external server 7 may be, for example, a server of Japan Search. Japan Search provides a Web API (https: / / jpsearch.go.jp / static / developer / webapi / ). Therefore, by using this Web API, the exhibition space processing server 1 can obtain artwork image data related to artworks such as cultural properties and attribute information of the artworks from the external server 7.

[0033] Here, a computer refers to an information processing device equipped with a control unit, a memory device, etc., and the exhibition space processing server 1, the setting terminal 5 and the user terminal 6 are each information processing devices equipped with a control unit, a memory device, etc., and are included in the concept of a computer.

[0034] Next, as a preparatory step, a process for registering work image data and attribute information related to the work in the work information DB 3 will be described. FIG. 4 is a diagram for explaining a method for registering work information in the setting terminal 5 according to this embodiment. In response to a screen request for registration from the setting terminal 5, the control unit 10 of the exhibition space processing server 1 causes the setting terminal 5 to display a registration screen 40 shown in FIG. In the setting terminal 5, for example, the data registrant inputs the details of each item displayed on the registration screen 40 for each artwork. Then, when the data registrant selects the "Register" button at the bottom of the registration screen 40, the input details are sent from the setting terminal 5 to the exhibition space processing server 1. The artwork information registration unit 18 of the exhibition space processing server 1 stores the received input details in the artwork information DB3.

[0035] It should be noted that the data registration in the work information DB3 is not limited to this example. For example, a work folder is created in the memory of the setting terminal 5 to store the work image data, and attribute information related to the work is created as text data. Then, by designating each work folder and text data on a batch registration screen (not shown) prepared in advance in the exhibition space processing server 1, the work information registration unit 18 of the exhibition space processing server 1 may add data to the work information DB3. In this case, the work image data and the attribute information related to the work may be obtained from the external server 7 by the data registrant. Furthermore, the entry of artwork information using the registration screen 40 can be carried out not only before the start of the service provided by the exhibition space processing server 1, but also while the service is being provided.

[0036] <Processing Description> Next, the processing carried out between the exhibition space processing server 1 and the setting terminal 5 will be explained with reference to a flowchart. FIG. 5 is a flowchart showing the exhibition space generation process of the exhibition space processing server 1 according to this embodiment. 6 to 8 are diagrams showing examples of screens displayed on the setting terminal 5 according to this embodiment.

[0037] The space creator accesses the exhibition space processing server 1 using the setting terminal 5 and makes selections for setting the exhibition space from a menu screen (not shown). In response to this, the control unit 10 of the exhibition space processing server 1 transmits to the setting terminal 5 an exhibition work selection screen 51, an example of which is shown in FIG. An exhibit work selection screen 51 shown in FIG. 6 is a screen that displays a list of works registered in the work information DB 3 and allows the space creator to select multiple works to be placed in the exhibition space. The exhibit work selection screen 51 has a list area 51a, a selected work area 51b, and an OK button 51c.

[0038] The list area 51a is an area that displays a list of information about the works that is easy for the space creator to distinguish, such as the work's name, the work data name, etc. When the space creator selects works to exhibit from the list area 51a, the selected works are displayed in the selected work area 51b, and a check is added next to the corresponding work in the list area 51a. Then, when the space creator selects the confirm button 51c after registering the work to be exhibited in the selected work area 51b, in step S11 of Fig. 5 (hereinafter, "step S" will be simply referred to as "S"), the work reception unit 11 of the exhibition space processing server 1 receives information related to the work displayed in the selected work area 51b. After that, the work reception unit 11 temporarily stores the received information related to the work in the storage unit 20.

[0039] Next, the control unit 10 of the exhibition space processing server 1 transmits a space image selection screen 52, an example of which is shown in FIG. The spatial image selection screen 52 shown in FIG. 7 is a screen that displays multiple spatial image data to be placed on each surface that constitutes the exhibition space, and allows the space creator to select spatial image data to be assigned to each surface of the exhibition space. The spatial image selection screen 52 has a list area 52a, a preview area 52b, and a decision button 52c.

[0040] The list area 52a is an area where image information that is easily recognizable by the space creator, such as the data name of the space image data, is displayed in a list. The preview area 52b is an area where the selected spatial image data is displayed. The preview area 52b is shown as a cube, and allows the user to check the exhibition space that will be generated by the selected spatial image data. The space creator performs a so-called drag-and-drop operation, which is an operation of selecting one piece of space image data from the list area 52a and moving it to a surface in the preview area 52b where the image is to be placed. Then, the image represented by the space image data is displayed on the surface of the preview area 52b where the image data was moved. Then, when the space creator selects the decision button 52c after arranging the space image data in the preview area 52b, in S12, the space image receiving unit 12 of the exhibition space processing server 1 receives the selected space image data and the surface to be arranged. After that, the space image receiving unit 12 temporarily stores the received data in the storage unit 20.

[0041] Next, the control unit 10 of the exhibition space processing server 1 transmits a spatial axis setting screen 53, an example of which is shown in FIG. A spatial axis setting screen 53 shown in FIG. 8 is a screen for setting the axis of the exhibition space. The spatial axis setting screen 53 has an axis number selection area 53a, an item list area 53b, a selection item area 53c, and an enter button 53d. The axis number selection area 53a is an area that displays options regarding the number of axes of the exhibition space. The item list area 53b is an area in which items that can be set as axes are displayed in a list. The space creator selects one of the options in the axis number selection area 53a, and then selects the items to be used as axes from the item list area 53b. The axes are then set and displayed in the selection item area 53c in the order in which the items to be used as axes were selected. At that time, if the attribute information for the selected item is a numerical value, an area in which a numerical value range can be entered is displayed in the selection item area 53c. Therefore, the space creator specifies the numerical value range in the displayed area.

[0042] Here, among the items in the artwork information DB3 shown in Fig. 3, the items that can be set as axes are, for example, the category, technique, birth year of the work, birth location information (latitude), birth location information (longitude), and storage location. Among these items, the attribute information for the item is a numerical value for the birth year of the work, birth location information (latitude), and birth location information (longitude). Then, when the space creator selects the decision button 53d after selecting an item in the selection item area 53c, in S13, the spatial axis receiving unit 13 of the exhibition space processing server 1 receives the selection of the item of attribute information to be used as the axis of the exhibition space. After that, the spatial axis receiving unit 13 temporarily stores information regarding the item and the corresponding axis in the storage unit 20.

[0043] In S14, the control unit 10 performs a work coordinate determination process, which will be described later. In S15, the exhibition data generating unit 16 generates work exhibition data. The work exhibition data includes space image data, work image data, and coordinate values ​​corresponding to the work image data. In S16, the exhibition data generation unit 16 stores the generated work exhibition data in the storage unit 20.

[0044] Next, the artwork coordinate determination process carried out by the exhibition space processing server 1 will be described. FIG. 9 is a flowchart showing the artwork coordinate determination process of the exhibition space processing server 1 according to this embodiment. FIG. 10 is a diagram showing an example of a screen displayed on the setting terminal 5 according to this embodiment. FIG. 11 is a diagram for explaining the work coordinate determination process of the exhibition space processing server 1 according to this embodiment.

[0045] In S31 of FIG. 9, the control unit 10 designates one of the items to be used as an axis of the exhibition space received in the process of S13 of FIG. In S32, the control unit 10 judges whether the attribute information for the specified item is a numerical value. If the attribute information is a numerical value (S32: YES), the control unit 10 shifts the process to S33. On the other hand, if the attribute information is not a numerical value (S32: NO), the control unit 10 shifts the process to S35. In S33, the work coordinate determination unit 15 obtains values ​​obtained by converting the attribute information of each work using a predetermined mathematical formula. In S34, the work coordinate determination unit 15 determines each of the acquired converted values ​​as the coordinate values ​​of each work.

[0046] Here, a process of obtaining a value from attribute information using a predetermined mathematical formula and converting the obtained value into a coordinate value will be described with a concrete example. When the attribute information is a numerical value, the numerical range has already been specified in the area in which the numerical range can be entered on the spatial axis setting screen 53 in Fig. 8. Then, if the maximum value of the specified numerical range is set to max and the minimum value is set to min, and the maximum value of the coordinate range of the axis targeted in the exhibition space is set to MAX and the minimum value is set to MIN, the coordinate PA of work A in the exhibition space is calculated using the following (Formula 1).

number

[0047] Using this (Formula 1), for example, if the numerical range of the attribute information in the item for the birth year of the work is 1700-1900 (years) and the coordinate range of the axis targeted in the exhibition space is 0-100, the value of the coordinate PX in the exhibition space of work X, which was born in 1750, can be calculated as follows: PX = (1750 - 1700) x 100 / 200 = 25

[0048] The work coordinate determination unit 15 applies this (Equation 1) to the attribute information of each work to determine the coordinate values ​​of each work. Note that the above (Formula 1) is an example of a predetermined formula. Other formulas may be used to determine the coordinate values ​​of the exhibition space of each work on the axis of interest. Thereafter, the control unit 10 advances the process to S38.

[0049] In S35, the control unit 10 outputs a screen for determining coordinate values ​​to the setting terminal 5, thereby causing the setting terminal 5 to display a coordinate value setting screen 55 exemplified in FIG. A coordinate value setting screen 55 shown in FIG. 10 is a screen used to determine the coordinate values ​​of each work when the attribute information is a categorical expression other than a numerical value. The coordinate value setting screen 55 has an element list area 55a, a quantity input field 55b, an element setting area 55c, a coordinate range setting area 55d, and a decision button 55e.

[0050] The element list area 55a is an area in which elements of attribute information corresponding to an item are displayed in a list. The quantity input field 55b is an area for inputting the quantity corresponding to the element. The element setting area 55c is an area for inputting a coordinate range and a representative word corresponding to an element. The coordinate range setting area 55d is a GUI (Graphical User Interface) of the coordinate range corresponding to the element, and is an area where the coordinate range can be visually grasped and operated.

[0051] Here, a method for determining the coordinates of a work in the exhibition space when "category" is designated as an item using the coordinate value setting screen 55 shown as an example in FIG. 10 will be described. 6, the categories of artworks accepted include five elements: “Japanese painting,” “Western painting,” “Print,” “Sculpture,” and “Crafts.” In element list area 55a of coordinate value setting screen 55, the five elements: “Japanese painting, Western painting, Print, Sculpture, Crafts” are displayed as a list. Next, the space creator specifies the number of coordinate ranges in quantity input field 55b. In this example, since there are five elements in the category, "5" is input in quantity input field 55b. Then, five areas (area 1, area 2, area 3, area 4, area 5) and input fields for the coordinate range and representative word of each area are displayed in element setting region 55c.

[0052] The space creator decides the allocation of category elements to each area. This is a correspondence between which category elements works of art will be placed in each area. The space creator also adjusts the coordinate range of each area. The coordinate range may be adjusted using element setting area 55c or coordinate range setting area 55d. Although not shown, as another adjustment method, a GUI may be provided that displays a preview of the exhibition space and displays the area range on this preview, allowing the area range to be visually adjusted while checking the preview of the exhibition space. The space creator also inputs a representative keyword (multiple keywords are acceptable) that expresses each area in the representative word input field. Note that instead of a keyword, a sentence that describes the area may also be input.

[0053] Then, when the space creator selects the confirm button 55e after making settings in the element setting area 55c, the element information receiving unit 14 of the exhibition space processing server 1 receives the coordinate range and representative word for each element in S36 of Fig. 9. More specifically, the element information receiving unit 14 receives the number of coordinate ranges that have been set, the correspondence between each area and an element, and the coordinate range and representative word for each area in the exhibition space. The element information receiving unit 14 then temporarily stores this information in the memory unit 20.

[0054] In S37, the work coordinate determination unit 15 determines the coordinate values ​​of each work based on the similarity with the representative word. The coordinate values ​​of each work are determined using the coordinate range of the exhibition space defined for each area, a representative word, and information specific to each work that explains the work. For example, attribute information of the explanatory text can be used as information specific to the work. The procedure for determining the coordinate values ​​of each work is shown below.

[0055] (Step 1) Convert various character data into numeric vectors The work coordinate determination unit 15 performs a numerical vectorization process on the representative word set for the target area and the unique information of all works belonging to the target area. Here, an example of a technique for converting sentences and words into numerical vectors is TextEmbedding (https: / / platform.openai.com / docs / guides / embeddings / what-are-embeddings) provided by OpenAI. Through this process, the representative word and the explanatory text of each work are expressed as vectors of the same dimension.

[0056] (Step 2) Calculate the similarity value between the representative word and the explanatory text Using the numerical vectors acquired in the above (step 1), the work coordinate determination unit 15 calculates the similarity value between the representative word and each work by setting the representative word vector as vector a and the accepted work vector as vector b. The calculation of the similarity value uses, for example, the cosine similarity calculation formula shown in (Formula 2).

number

[0057] The method of calculating the similarity is not limited to this, and for example, an index such as Euclidean distance or Mahalanobis distance may be used. Furthermore, when a numerical vector is output using the technique of (Step 1), it is usually output as a high-dimensional (over 1000 dimensions) numerical vector. In general, when an index such as similarity is calculated in a high-dimensional state, there are cases where the result is not appropriate, for example, the output result value from cosine similarity converges to 0. For this reason, the value to be calculated may be calculated after performing Principal Component Analyses on the numerical vector to reduce the number of dimensions. Based on the similarity value calculated by this method, works can be sorted in order of their proximity to the representative word. The relationship between the representative word's numerical vector and each work's numerical vector is shown in Fig. 11(A). Fig. 11(A) is a relationship diagram 60 showing the relationship between the representative word and each work by numerical vector.

[0058] (Step 3) Determining coordinate values ​​based on similarity values The artwork coordinate determination unit 15 determines the placement coordinates of each artwork within the coordinate range based on the similarity value obtained in the above (step 2). Here, the coordinate values ​​of the exhibition space can be calculated by performing a scale conversion using the above (formula 1). In this case, the maximum value of the similarity value is set to max, and the minimum value is set to min. The coordinate values ​​of each work obtained using the above (step 3) are shown in Fig. 11(B). Fig. 11(B) is an image diagram 61 showing the coordinate values ​​of each work (work A to work E) in the coordinate range of area x (x is, for example, any of 1 to 5 in Fig. 10).

[0059] By executing the above processing procedure, the coordinate values ​​of each work belonging to the area can be uniquely determined, and at the same time, fine arrangement can be realized by arranging the works belonging to the same coordinate range in order of proximity to the representative word assigned to the coordinate range. With this method, for example, if the element of the coordinate range is "Japanese painting" and the representative word is "concrete," the works can be arranged in the coordinate range of Japanese painting in order of proximity to concrete. Note that input of the representative word may be omitted. In that case, for example, the coordinate value of the center of the defined coordinate range is set to "(maximum value of area x - minimum value of area x) / 2". Thereafter, the artwork coordinate determination unit 15 temporarily stores the determined coordinate values ​​together with the artwork in the storage unit 20.

[0060] In S38 of Fig. 9, the control unit 10 judges whether or not all items on the accepted spatial axis have been processed. If all items on the accepted spatial axis have been processed (S38: YES), the control unit 10 shifts the process to S15 of Fig. 5. On the other hand, if all items on the accepted spatial axis have not been processed (S38: NO), the control unit 10 shifts the process to S31, designates one item that has not yet been designated, and repeats the processes from S32 onward.

[0061] Next, a process for displaying a virtual museum, which is an exhibition space, on the user terminal 6 using the work exhibition data stored in the storage unit 20 in the exhibition space generation process of FIG. 5 will be described. The space creator creates the exhibition space using editing software for creating an exhibition space based on the work exhibition data stored in the storage unit 20. Then, the exhibition data output unit 17 of the exhibition space processing server 1 makes the created exhibition space viewable on the user terminal 6.

[0062] FIG. 12 shows an example of artwork exhibition data used in editing software based on processing by the exhibition space processing server 1. FIG. 12 is a diagram showing an example of work exhibition data that can be viewed on the user terminal 6 according to this embodiment. 12(A) shows a description 70 of a part of the data related to the artworks included in the artwork exhibition data. The description 70 expresses the artwork information and the coordinate values ​​of one artwork included in the artwork exhibition data in the json (JavaScript Object Notation) format.

[0063] In description 70, id is the work ID, title is the work name, category is the category to which the work belongs, technique is the technique, image is path information including the work data name of the exhibited work, birth is the birth year of the work, place is the place of collection, location is birth location information (latitude, longitude), relationURL is the related information link URL, and relationmovie is the related information video content. Also, position is the coordinate value where the work is located.

[0064] 12B shows a description 71 of the spatial image data included in the work exhibition data. The description 71 is the texture information of the space, including the texture image, included in the work exhibition data, in the json (JavaScript Object Notation) format. In the description 71, id describes the spatial surface ID, title describes the title for identifying the spatial surface, and texture describes path information including the image name of the texture image to be assigned. In addition, it is desirable that the path information in the descriptions 70 and 71 be described as a relative path based on the JSON data, in order to facilitate automatic extraction of data later by authoring software or the like. Also, the json property names in the above example are just examples and are not limited to these.

[0065] The artwork image data and space image data are bundled together with the descriptions 70 and 71, and sent to editing software for creating an exhibition space, such as authoring software (not shown) for creating a space. Note that in cases where the system is linked to authoring software or the like, the information stored in the storage unit 20 may be bundled together and sent directly to the authoring software or the like. The authoring software etc. constructs a space based on the received exhibition work data. The authoring software etc. reads the placement coordinates of the work image data and the attribute information of the work from the received description 70, and uses an automatic placement program to display an exhibition space in which the works are placed in a virtual space.

[0066] FIG. 13 shows an example of a screen of an exhibition space 80 displayed on a user terminal 6 according to this embodiment. The exhibition space 80 is a space created along two axes, with the width direction (X-axis direction) indicating the category and the depth direction (Y-axis direction) indicating the year in which the works were created. The categories are a space in which category elements such as "Japanese painting, Western painting, woodblock print, sculpture, crafts" are arranged. A texture image indicating the category is assigned to face 81. The years when the works were created range from 1700 to 1990. Surface 82 is assigned a texture image having events that occurred in Japan during the years when the works were created, and surface 83 is assigned a texture image having events that occurred abroad. Each work is displayed by arranging the work image data at a position corresponding to the coordinate values ​​of the work within the exhibition space 80. For example, work 84 is an image of a Western-style painting from the early 1700s.

[0067] In addition, if there is attribute information identifying the work, such as an explanatory text for the work or related information video content, the exhibition space processing server 1 can output the attribute information, for example, by performing an operation to select an image of the work. Also, although not specifically explained, for example, the fixtures 85 that decorate the space (such as pedestals on which the works are placed) can be determined based on the coordinate values, since the coordinates for the placement of the works have already been determined.

[0068] This allows the user (experiencer) to view each work in detail (micro perspective). The user (experiencer) can also view the exhibition space 80 from a bird's-eye view (macro perspective). Viewing the exhibition space 80 from a bird's-eye view allows the positioning and relationships of the entire exhibited works to be grasped at a glance, which increases the user's desire to view other works starting from the work that interests them, and as a result, it is possible to foster interest in the entire exhibited works.

[0069] As described above, the exhibition space processing server 1 of this embodiment has the following advantages. (1) A selection of multiple works is accepted from a work information DB3 that stores work image data and attribute information related to the works. By referring to the work information DB3, a selection of attribute information items to be used as axes of the exhibition space in which the works will be displayed is accepted. Coordinate values ​​in the exhibition space of each accepted work, with the accepted attribute information items as axes, are determined based on the attribute information of each work. Work exhibition data is generated in which the work image data of the work corresponding to the coordinate values ​​is placed at the coordinate values ​​in the exhibition space of the work. Therefore, an exhibition space for the works can be generated by arranging the artwork image data of the multiple works received on the received spatial axis, and by displaying the generated exhibition space, the works can be presented to the user in an easy-to-understand manner, and depending on the types of the multiple works received, it can be possible to display the works across classifications. (2) If the attribute information for the accepted item is not numerical, the coordinate range of an area in space and a representative word associated with each element of the attribute information are accepted for each element, and the coordinate value of each work within the coordinate range of the area is determined based on the similarity between the accepted representative word and a character string of the specified attribute information of each work. Therefore, when the attribute information of an item cannot be expressed numerically, the coordinate value can be determined based on the similarity with the representative word in the attribute information element. As a result, the presence or absence of similarity with the representative word can be visually confirmed as the position of the work.

[0070] (3) If the attribute information for the accepted item is a numerical value, the numerical value of the attribute information for each work is converted using a predetermined formula, and the converted value is determined as the coordinate value. Therefore, when the attribute information is a numerical value, the numerical value can be used to determine the coordinate value, and as a result, the numerical value can be reflected in the coordinate value, allowing the position of the artwork to be visually confirmed.

[0071] (4) When two selections are accepted, the two accepted items are used as two-dimensional axes in the exhibition space to determine the coordinate values ​​of each work. Therefore, the coordinate values ​​of each work can be determined using the width and depth of the exhibition space, and the position of the work can be understood based on its positional relationship in the width and depth directions.

[0072] (5) A selection of spatial image data to be placed on each surface that constitutes the exhibition space is accepted from the spatial image memory unit 22, which stores multiple spatial image data for constituting the exhibition space, and artwork exhibition data is generated in which artwork image data of the work corresponding to the coordinate values ​​is placed at the coordinate values ​​in the exhibition space based on the accepted spatial image data. Therefore, the exhibition space can be generated by the spatial image data arranged on each surface that constitutes the exhibition space. As a result, the world view based on the spatial image data can be expressed.

[0073] (6) The generated artwork exhibition data is used in editing software for creating an exhibition space, making it possible to view it on the user terminal 6. Therefore, the exhibition space can be displayed on the user terminal 6, and the user can view the exhibition space generated based on the work exhibition data.

[0074] (7) The work image data and attribute information stored in the external server 7 are acquired from the external server 7 and registered in the work information DB3. Therefore, an exhibition space can be created for various artworks stored on the external server 7.

[0075] Although the embodiments of the present invention have been described above, the present invention is not limited to the above-mentioned embodiments. Furthermore, the effects described in the embodiments are merely a list of the most preferable effects resulting from the present invention, and the effects of the present invention are not limited to those described in the embodiments. The above-mentioned embodiments and the modified forms described below can be used in appropriate combination, but detailed description will be omitted.

[0076] (Variations) (1) In the present embodiment, the exhibition space is configured by selecting two axes, but is not limited to this. For example, the exhibition space may be configured by selecting three axes. More specifically, when the spatial axis selection means accepts the selection of three items, the work coordinate determination means determines the coordinate values ​​of each work using the accepted three pieces of attribute information as three-dimensional axes, including height, in the exhibition space. This allows works to be exhibited in an exhibition space that uses not only the width and depth directions, but also the height direction (Z-axis direction, see Figure 13).

[0077] (2) In the present embodiment, the relationships between works are described as being closer to each other in terms of coordinate values. In addition, the relationships may be viewed from a different perspective and displayed in a way that makes the relationships clearer. More specifically, the exhibition space processing server 1 is equipped with an association acquisition means for acquiring the association between two or more works based on the attribute information of the plurality of works received, and when the association acquisition means acquires an association, the exhibition data generation means generates work exhibition data which further includes connecting members connecting the associated works and character strings indicating the association.

[0078] FIG. 14 shows an example of a screen of an exhibition space 90 displayed on a user terminal 6 according to a modified embodiment. The exhibition space 90 shown in FIG. 14 shows two or more artwork images connected by connecting members 91 and text 92 , which explains why they are connected. In this way, not only can the similarity of the attribute information of the axes be recognized, but also works that are related based on the attribute information of the works can be intuitively understood through the linking members 91 and the text 92 indicating the relationship.

[0079] (3) In the present embodiment, an example has been described in which an exhibition space is displayed on the user terminal 6 based on the generated work exhibition data, but this is not limiting. For example, an image processing device having the functions of an exhibition space processing server and a user terminal may be made to display the exhibition space based on the work exhibition data.

[0080] (4) In the present embodiment, the storage unit stores the work exhibition data, and the space creator creates the exhibition space based on the work exhibition data using editing software for creating the exhibition space, but the present invention is not limited to this. The exhibition space processing server may transmit the work exhibition data to another environment for creating a space other than the exhibition space processing server, such as authoring software or a virtual space construction platform of a cloud service, and the space creator may create the exhibition space based on the transmitted work exhibition data using editing software such as authoring software. [Explanation of symbols]

[0081] 1. Exhibition space processing server 3 Work information DB 5. Setting terminal 6 User terminals 7 External Servers 10 Control section 11. Works Reception 12 Spatial image reception section 13 Spatial axis reception section 14 Element information reception section 15 Work Coordinate Determination Section 16 Exhibition Data Generation Department 17. Exhibition Data Output Section 18 Work Information Registration Section 20 Memory section 21a Program 22 Spatial image storage unit 100 Image Processing System

Claims

1. a work selection means for receiving a selection of a plurality of works from a work information storage unit that stores work image data and attribute information related to the works; a spatial axis selection means for receiving a selection of an item of the attribute information to be used as an axis of an exhibition space in which each work is exhibited, by referring to the work information storage unit; a work coordinate determination means for determining, for each work received by said work selection means, a coordinate value in said exhibition space, with the item of said attribute information received by said spatial axis selection means as an axis, based on said attribute information of each work; an exhibition data generating means for generating work exhibition data in which the work image data of each work corresponding to the coordinate values ​​is arranged at the coordinate values ​​in the exhibition space of the work; A virtual space generating device comprising:

2. 2. The virtual space generating device according to claim 1, an element information receiving means for receiving a coordinate range of an area in space and a representative word related to each element of the attribute information when the attribute information for the item received by the spatial axis selection means is not a numerical value; The work coordinate determination means of the virtual space generating device determines the coordinate values ​​of each work within the coordinate range of the area based on the similarity between the representative word accepted by the element information accepting means and a string of specified attribute information of each work.

3. 2. The virtual space generating device according to claim 1, A virtual space generating device in which, when the attribute information for the item accepted by the spatial axis selection means is a numerical value, the work coordinate determination means determines the coordinate value as a value obtained by converting the numerical value of the attribute information of each work using a predetermined formula.

4. The virtual space generating device according to any one of claims 1 to 3, A virtual space generating device in which, when the spatial axis selection means accepts the selection of two of the items, the work coordinate determination means determines the coordinate values ​​of each work using the two accepted items as planar, two-dimensional axes in the exhibition space.

5. The virtual space generating device according to any one of claims 1 to 3, A virtual space generating device in which, when the spatial axis selection means accepts the selection of three of the items, the work coordinate determination means determines the coordinate values ​​of each work using the accepted three pieces of attribute information as three-dimensional axes including height in the exhibition space.

6. The virtual space generating device according to any one of claims 1 to 3, a relationship acquisition means for acquiring a relationship between two or more works based on the attribute information of the plurality of works received by the work selection means, The exhibition data generation means, when the relationship acquisition means acquires the relationship, generates the work exhibition data further including connecting members connecting each work having the relationship and a character string indicating the relationship, in a virtual space generation device.

7. The virtual space generating device according to any one of claims 1 to 3, a space image storage unit for storing a plurality of space image data for constructing the exhibition space; a spatial image selection means for receiving, from the spatial image storage unit, a selection of the spatial image data to be arranged on each surface constituting the exhibition space; Equipped with The exhibition data generation means is a virtual space generation means for generating work exhibition data in which the work image data of each work corresponding to the coordinate values ​​in the exhibition space based on the spatial image data accepted by the spatial image selection means is placed at the coordinate values.

8. The virtual space generating device according to claim 7, A virtual space generating device comprising an exhibition data output means for enabling viewing of the exhibition space on a display device based on the work exhibition data generated by the exhibition data generating means.

9. The virtual space generating device according to any one of claims 1 to 3, A virtual space generating device comprising a work information registration means for acquiring the work image data and the attribute information related to the work from an external device connected in a communicative manner, and registering the work image data and the attribute information related to the work in the work information storage unit.

10. Computer, a work selection means for receiving a selection of a plurality of works from a work information storage unit that stores work image data and attribute information related to the works; a spatial axis selection means for receiving a selection of an item of the attribute information to be used as an axis of an exhibition space in which each work is exhibited, by referring to the work information storage unit; a work coordinate determination means for determining, for each work received by said work selection means, a coordinate value in said exhibition space, with the item of said attribute information received by said spatial axis selection means as an axis, based on said attribute information of each work; an exhibition data generating means for generating work exhibition data in which the work image data of each work corresponding to the coordinate values ​​is arranged at the coordinate values ​​in the exhibition space of the work; A program to make it function as such.

Images