DATA SEARCH SYSTEM FOR MOTION DATA AND DATA COMBINATION SYSTEM FOR MOTION DATA

Abstract

To provide a data retrieval system for motion data, configured to simplify combination of motion data with material data which are different from the motion data.SOLUTION: A data retrieval system is configured to retrieve material data which can be combined with motion data generated based on motion of a moving body, the motion data being associated with motion specification information indicating the contents of the motion data. The data retrieval system includes: data holding means 5 which holds multiple pieces of material data; motion specification information acquisition means 30 which acquires motion specification information associated with motion data; and material retrieval means 32 which retrieves, from the data holding means 5, material data which can be combined with the motion data associated with the motion specification information, based on the motion specification information acquired by the motion specification information acquisition means 30.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a data search system for motion data obtained by converting the movements of a moving object into electronic information, and a data combination system for motion data. [Background technology]

[0002] Conventionally, a system for handling motion data has been known, for example, a three-dimensional content combination system, as disclosed in Patent Document 1, which delivers content (internet live broadcast programs) using a virtual three-dimensional virtual space to a viewing terminal for viewing.

[0003] The content information includes virtual data specification information and virtual data motion information, and the three-dimensional content combination system is configured to play back drawing data rendered based on the virtual data specification information and the virtual data motion information when a viewer accesses the content information that he or she wishes to view. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-127211 A Summary of the Invention [Problem to be solved by the invention]

[0005] Incidentally, the above-mentioned conventional system is configured to allow viewers to add virtual data specification information and motion information to content information, but since the viewer must prepare the information they want to combine themselves, the system is not easy for anyone to use.

[0006] In view of the above circumstances, an object of the present invention is to provide a data search system for motion data and a data combination system for motion data that can simplify the combination of motion data with material data other than motion data. [Means for solving the problem]

[0007] The data retrieval system for motion data of the present invention comprises: A data search system for searching for material data that can be combined with motion data generated based on the movement of a moving object and associated with motion specification information that indicates the content of the motion data, comprising: A data storage means for storing a plurality of said material data; a motion specification information acquisition means for acquiring the motion specification information associated with the motion data; The device further comprises a material search means for searching the data holding means for the motion data associated with the motion specific information and the material data that can be combined with the motion specific information based on the motion specific information acquired by the motion specific information acquisition means.

[0008] According to the data search system for motion data configured as described above, the material search means can search for material data that can be combined with motion data from among multiple material data stored in the data storage means, thereby simplifying the combination of motion data and material data by assisting in the selection of material data to be combined with motion data.

[0009] In the data retrieval system for motion data of the present invention, The material search means may be configured to search for the material data based on the motion identification information and path information of the material data in the data holding means.

[0010] In this way, the data holding means holds the material data in association with the content of the motion indicated by the motion specification information, making it easier for the material search means to search for material data suitable for combination with the motion data.

[0011] The motion data combination system of the present invention comprises: A data combination system for combining material data with motion data generated based on the movement of a moving object and associated with motion specification information indicating the content of the motion data, comprising: A data storage means for storing a plurality of said material data; a motion specification information acquisition means for acquiring the motion specification information associated with the motion data; a material search means for searching the data holding means for the motion data associated with the motion specifying information and the material data that can be combined with the motion specifying information based on the motion specifying information acquired by the motion specifying information acquisition means; The apparatus may further comprise a combination means for combining the motion data associated with the motion identification information used in the search for the material data by the material search means with the material data searched for by the material search means.

[0012] According to the motion data combination system configured as above, the material search means searches for material data that can be combined with the motion data from among the multiple material data held in the data holding means, and further, the combination means combines the motion data with the material data searched for by the material search means. Therefore, by assisting in the selection of material data to be combined with the motion data and the task of combining data together, it is possible to simplify the combination of motion data and material data.

[0013] The motion data combination system of the present invention comprises: The image forming apparatus may further comprise a display means for displaying a preview of combination data generated by the combining means by combining the motion data and the material data.

[0014] In this way, the combination of the motion data and the material data can be simplified by making it easier to check the results of the combination of the motion data and the material data.

[0015] In the data combination system for motion data of the present invention, The material search means may be capable of searching for one or more of the material data, and may have a data selection means capable of selecting, when a plurality of the material data are searched for, at least one of the plurality of material data to be combined with the motion data by the combination means.

[0016] In this way, even when multiple pieces of material data are searched for by the material search means, it is possible to assist in the selection of material data to be combined with the motion data, thereby simplifying the combination of motion data and material data. Effect of the Invention

[0017] As described above, the data search system for motion data and the data combination system for motion data of the present invention can provide the excellent effect of simplifying the combination of motion data with material data other than motion data. [Brief description of the drawings]

[0018] [Figure 1] FIG. 1 is a configuration block diagram of a motion combination system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is an explanatory diagram of motion feature information used in the motion combination system according to the embodiment. [Diagram 3]FIG. 3 is an explanatory diagram of a music table used when searching for music data, which is material data, in the motion combination system according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] Hereinafter, a combination system for motion data (hereinafter referred to as a combination system) according to one embodiment of the present invention will be described with reference to the accompanying drawings.

[0020] The combination system of this embodiment is configured so that motion data and material data suitable for the motion data (music data, avatar data) can be combined and viewed on the system.

[0021] Hereinafter, material data will be referred to as material data, music data will be referred to as music data, and avatar data will be referred to as avatar data.

[0022] The combination system of this embodiment will be described by taking as an example the combination of dance motion data created based on dance movements with material data.

[0023] As shown in FIG. 1, the combination system 1 of this embodiment has a motion data display means 2 that displays a browsing operation screen on the screen of the user terminal T1 and displays motion data on this browsing operation screen, a data search means 3 that searches for and selects material data suitable for the selected motion data when motion data is selected on the browsing operation screen, a generation and display means 4 that generates content data by combining the motion data selected on the browsing operation screen with the material data selected by the data search means 3, and a data storage means 5 for storing information.

[0024] The combination system 1 can be constructed by a processing device (processing server) T2 that executes processing, and a storage device (storage server) T3 for storing information.

[0025] In this case, the combination system 1 is configured so that the processing device T2 is equipped with a motion data display means 2, a data search means 3, and a generating and display means 4, and the storage device T3 is configured to be used as a data storage means 5.

[0026] The motion data display means 2 is configured to display the motion data on the viewing operation screen. The motion data display means 2 is configured to display a title indicating the motion data, a still image, a video (a video generated by rendering the motion data), and the like on the viewing operation screen.

[0027] Motion data is data that contains movement instructions used to instruct a 3D model to move, and avatar data is data that constitutes a 3D model.

[0028] The motion data display means 2 is configured to display a plurality of motion data on the viewing operation screen. The motion data displayed on the viewing operation screen by the motion data display means 2 is in a state where the user can select the motion data via the user terminal T1.

[0029] A plurality of pieces of motion data are stored (held) in the data holding means 5, and the motion data display means 2 is configured to read out the motion data from the data holding means 5 and display it on the browsing operation screen.

[0030] The browsing operation screen that the motion data display means 2 displays on the screen of the user terminal T1 is configured so that the motion data can be searched for.

[0031] As shown in FIG. 2, the motion data M stored in the data storage means 5 is associated with motion specification information D that indicates the content of the motion (movement).

[0032] In the combination system 1 of this embodiment, as the motion specification information D, motion classification information D1 for classifying the motion data M according to the type of motion, and motion model information D2 indicating information related to a model of the motion are used.

[0033] In addition, in the combination system 1 of this embodiment, main classification information D10 indicating the type of motion of the motion data and sub-classification information D11 indicating the type of motion of the motion data within the classification indicated by the main classification information D10 are used as the motion classification information D1.

[0034] The sub-classification information D11 is information for further subdividing and classifying the motion data within the classification indicated by the main classification information D10.

[0035] Furthermore, in the combination system 1 of this embodiment, model name information D20 indicating the model name of the moving object that performed the action is used as the action model information D2.

[0036] The motion data M stored in the data holding means 5 is associated with at least the motion classification information D1 out of the motion classification information D1 and the motion model information D2, and further, as the motion classification information D1, one main classification information D10 and one or more sub-classification information D11 are associated with it.

[0037] The main classification information D10 used as the action classification information D1, the sub-classification information D11, and the model name information D20 used as the action model information D2 are information that functions as a tag, and are used, for example, when a search is performed on the browsing operation screen for motion data M.

[0038] The dance motion data M shown in Figure 2 is associated with main classification information D10 in which information indicating dance is set as the type of movement, sub-classification information D11 in which information indicating the dance genre is set, and sub-classification information D11 in which information indicating the dance tempo (BPM) is set, and further associated with model name information D20 in which the dancer's name is set as motion model information D2.

[0039] As shown in Figure 1, the data search means 3 includes motion specific information acquisition means 30 which acquires (reads from the data storage means 5) motion specific information D associated with the motion data when the motion data is selected on the viewing operation screen, search condition derivation means 31 which derives search conditions for searching for material data that can be combined with the motion data selected by the user based on the motion specific information D acquired by the motion specific information acquisition means 30, and material search means 32 which searches the data storage means 5 for material data that can be combined with the motion data selected by the user based on the search conditions derived by the search condition derivation means 31.

[0040] The motion identification information acquiring means 30 is configured to acquire, among the above-described main classification information, sub-classification information, and model name information, those associated with the motion data.

[0041] The search condition derivation means 31 is configured to execute a music search setting process that derives music search conditions for searching for music data that can be combined with motion data selected on the browsing operation screen based on the main classification information and sub-classification information acquired by the motion specific information acquisition means 30, and an avatar search setting process that derives avatar search conditions for searching for avatar data that can be combined with motion data selected on the browsing operation screen based on the model name information acquired by the motion specific information acquisition means 30.

[0042] The search condition derivation means 31 is configured to acquire, as music search conditions, search conditions for searching for music data of the same type as the type of motion data indicated by the main classification information and the sub-classification information in the music search setting process.

[0043] The search condition derivation means 31 of this embodiment is configured to refer to the main category information and sub-category information acquired by the motion specific information acquisition means 30 during the music search setting process, and to music table information TD in which music search conditions SC are set, categorized for each combination of main category information D10 and sub-category information D11, as shown in Figure 3, and to acquire music search conditions SC from this music table information TD.

[0044] In addition, to obtain music search criteria SC from music table information TD, an element of the music table information TD determined by the main classification information D10 and the sub-classification information D11 is selected, and the music search criteria SC set in that element is obtained.

[0045] The music search criteria SC include path information (folder path) indicating the storage destination of music data, a link, and words to be set as search keywords.

[0046] As shown in Figure 1, the search condition derivation means 31 of this embodiment is configured to refer to the model name information acquired by the motion specific information acquisition means 30 in the avatar search setting process, and acquire the model name set in the model name information as a search condition for the avatar.

[0047] The material search means 32 is configured to execute a music data search process for searching for music data based on the music search criteria derived by the search criteria derivation means 31, and an avatar data search process for searching for avatar data based on the avatar search criteria derived by the search criteria derivation means 31.

[0048] The material search means 32 is configured to search for music data in a music data search process using a search method corresponding to the format of the music search criteria, and to select music data that meets the conditions indicated by the music search criteria.

[0049] The material search means 32 is configured to, in the avatar data search process, perform a keyword search of the avatar data using the model name as a search term, and select corresponding avatar data.

[0050] The generating and displaying means 4 includes a generating means 40 which is a combination means for generating content data by combining (synthesizing) motion data selected on the viewing operation screen with music data and avatar data selected by the material searching means 32, and a display means 41 which displays (previews) the content data generated by the generating means 40 on the viewing operation screen in a viewable state.

[0051] Of the above data combination system 1, the data search means 3 can be configured as a single data search system that searches for material data that can be combined with motion data generated based on the movement of a moving object and associated with motion specific information indicating the content of the motion data.

[0052] The configuration of the combination system 1 according to this embodiment is as described above. Next, how to use the combination system 1 will be described.

[0053] The combination system 1 displays a viewing operation screen on the screen of the user terminal T1 by the motion data display means 2, and further displays motion data on the viewing operation screen.

[0054] On the browsing operation screen, it is possible to perform an operation of selecting motion data to be used in creating content, and to perform an operation of searching for motion data using a motion search means.

[0055] Then, when motion data is selected on the browsing operation screen, the data search means 3 starts searching for and selecting material data suitable for the selected motion data.

[0056] More specifically, the motion specific information acquisition means 30 acquires motion specific information associated with the motion data selected on the browsing operation screen, and the search condition derivation means 31 derives search conditions for searching for material data that can be combined with the motion data selected by the user, based on the motion specific information acquired by the motion specific information acquisition means 30.

[0057] More specifically, the search condition derivation means 31 executes a music search setting process to derive music search conditions for searching for music data that can be combined with the motion data selected on the browsing operation screen, based on the main classification information and sub-classification information acquired by the motion specific information acquisition means 30.

[0058] In the music search setting process of this embodiment, music table information is used as described above, so the search condition derivation means 31 selects elements of the music table information determined by the main classification information and sub-classification information, and obtains the music search conditions set in such elements.

[0059] Next, if the motion specific information acquisition means 30 has acquired model name information, the search condition derivation means 31 executes an avatar search setting process to refer to the model name information acquired by the motion specific information acquisition means 30 and acquire the model name set in the model name information as a search condition for the avatar.

[0060] When the process of deriving search conditions by the search condition derivation means 31 is completed, the material search means 32 searches for material data that can be combined with the motion data.

[0061] More specifically, the material search means 32 executes a music data search process to search for music data based on the music search conditions derived by the search condition derivation means 31, and obtains music data that meets the conditions indicated by the music search conditions.

[0062] In addition, when the model name information D20 is derived by the search condition derivation means 31, The material search means 32 executes an avatar data search process to search for avatar data based on the avatar search conditions derived by the search condition derivation means 31, and acquires avatar data that meets the conditions indicated by the avatar search conditions.

[0063] When the process of deriving search conditions by the search condition derivation means 31 is completed, the generating and displaying means 4 generates content data and displays it on the browsing operation screen.

[0064] More specifically, the generation means 40 generates content data that combines (synthesizes) the motion data selected on the viewing operation screen with the music data and avatar data selected by the material search means 32, and the display means 41 displays the content data generated by the generation means 40 on the viewing operation screen in a viewable state.

[0065] This allows the user to view content data that has been generated based on motion data that the user has selected.

[0066] As described above, according to the data combination system 1 of this embodiment, the user only needs to select the motion data on which the content data is based on the browsing operation screen, and the material search means 32 searches for material data that can be combined with the motion data, thereby facilitating the task of selecting material data that can be combined with the motion data.

[0067] Furthermore, the data combination system 1 can generate content data that combines motion data and material data and display the content data on the browsing operation screen, thereby supporting the task of combining data together.

[0068] Therefore, the data combination system 1 can provide the excellent effect of simplifying the combination of motion data with material data other than the motion data.

[0069] Furthermore, in the combination system 1 of this embodiment, for dance motion data classified as dance based on main classification information, music data is searched for using music search conditions that are set in accordance with sub-classification information in which the dance genre is set and sub-classification information in which the dance tempo is set, so that music data with a musical composition that is compatible with dance movements can be selected, thereby assisting in the task of combining dance motion data and music data.

[0070] Furthermore, when combining motion data and avatar data, if there is a difference between the body type of the person who models the motion data and the body type of the avatar data, the movements indicated by the motion data may not be expressed correctly. However, in the combination system 1 of this embodiment, avatar data is searched for based on model name information, so that avatar data corresponding to the person who models the motion data (i.e., avatar data that can correctly express the movements indicated by the motion data) can be selected, thereby facilitating the task of combining motion data and avatar data.

[0071] It should be noted that the data search system for motion data and the data combination system for motion data of the present invention are not limited to the above-described embodiments, and it goes without saying that various modifications can be made within the scope that does not deviate from the gist of the present invention.

[0072] In the description of the combination system 1 of the above embodiment, only the model name information D20 indicating the name of the model who performed the action is used as the action model information D2, but this is not limited to the configuration. For example, the model body information indicating the body characteristics (gender, body type, etc.) of the model who performed the action may also be used as the action model information D2.

[0073] In this way, even if there is no avatar data of a model performing the action indicated by the motion data, the material search means can search for avatar data with similar physical features, so that avatar data suitable for the motion data can be selected.

[0074] In the above embodiment, the combination system 1 has been described by taking as an example that the motion data indicates dance movements, but is not limited to this configuration. For example, the combination system 1 may be configured to search and select material data that can be combined with motion data indicating sports movements, and combine each piece of data.

[0075] In this case, the motion characteristic information may be configured to use main classification information in which information indicating a sport is set, sub-classification information in which information indicating golf is set, sub-classification information in which golf swing movements (take-back, downswing, follow-through, etc.), and model name information in which information indicating the golf player's name is set.

[0076] Although not specifically mentioned in the description of the combination system 1 of the above embodiment, the material search means 32 may be configured to be capable of searching for one or more pieces of material data, and when multiple pieces of material data are searched for, to have a data selection means capable of selecting at least one piece of material data from the multiple pieces of material data to be combined with the motion data by the combination means.

[0077] Although not specifically mentioned in the description of the combination system 1 of the above embodiment, the combination system 1 may be configured to include a playback speed change means for changing the playback speed of the video (content) displayed by the display means 41.

[0078] Although not specifically mentioned in the description of the combined system 1 of the above embodiment, the combined system 1 may be configured to include a playback means for low-speed communication for displaying video (content) on the user terminal T1 without interruption when the communication speed between the user terminal T1 and the combined system 1 is low. [Explanation of symbols]

[0079] 1...combination system, 2...motion data display means, 3...data search means, 4...generation and display means, 5...data storage means, 30...motion specific information acquisition means, 31...search condition derivation means, 32...material search means, 40...generation means, 41...display means, D...motion specific information, D1...action classification information, D10...main classification information, D11...sub-classification information, D2...action model information, D20...model name information, M...motion data, SC...music search conditions, T1...user terminal, TD...music table information

Claims

1. A data search system for searching for material data that can be combined with motion data generated based on the movement of a moving object and associated with motion specification information that indicates the content of the motion data, comprising: A data storage means for storing a plurality of said material data; a motion specification information acquisition means for acquiring the motion specification information associated with the motion data; and a material search means for searching the data holding means for the motion data associated with the motion specifying information and the material data that can be combined with the motion specifying information based on the motion specifying information acquired by the motion specifying information acquisition means. Data retrieval system.

2. the material search means is configured to search for the material data based on the motion identification information and path information of the material data in the data storage means; 2. The data retrieval system according to claim 1.

3. A data combination system for combining material data with motion data generated based on the movement of a moving object and associated with motion specification information indicating the content of the motion data, comprising: A data storage means for storing a plurality of said material data; a motion specification information acquisition means for acquiring the motion specification information associated with the motion data; a material search means for searching the data holding means for the motion data associated with the motion specifying information and the material data that can be combined with the motion specifying information based on the motion specifying information acquired by the motion specifying information acquisition means; a combining means for combining the motion data associated with the motion specifying information used in the search for the material data by the material search means with the material data searched for by the material search means, Data combination system.

4. a display means for displaying a preview of combination data generated by combining the motion data and the material data by the combining means, The data combination system according to claim 3.

5. the material search means is capable of searching for one or more of the material data, and has a data selection means for selecting, when a plurality of the material data are searched for, at least one of the plurality of material data to be combined with the motion data by the combination means, from the plurality of material data; The data combination system according to claim 3 or 4.

Images