Information processing device, information processing method, and program

Abstract

An information processing device according to an embodiment of the present invention comprises a first acquiring unit and a recommendation information output unit. The first acquiring unit acquires configuration information relating to a configuration of drum instruments, and body information relating to the body of a performer playing the drum instruments. The recommendation information output unit outputs recommendation information which corresponds to the performer and relates to a setting when playing the drum instruments, on the basis of the configuration information and the body information acquired by the first acquiring unit. As a result, it is possible to assist the setting of the drum instruments.

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and a program that can be used for setting up a drum instrument. [Background technology]

[0002] Patent Document 1 discloses a device that enables positioning and repositioning of microphones, stands, transducers, musical instruments, speaker units with built-in amplifiers, furniture, and the like. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2015-507178 Summary of the Invention [Problem to be solved by the invention]

[0004] As described in Patent Document 1, proper setup is important when playing a musical instrument.

[0005] In view of the above circumstances, one object of the present invention is to provide an information processing device, an information processing method, and a program that can assist in setting up a drum instrument. [Means for solving the problem]

[0006] In order to achieve the above object, an information processing device according to an embodiment of the present invention includes a first acquisition unit and a recommended information output unit. The first acquisition unit acquires configuration information relating to the configuration of a drum instrument and physical information relating to the body of a player who plays the drum instrument. The recommended information output unit outputs recommended information corresponding to the player regarding settings when playing the drum instrument, based on the configuration information and the physical information acquired by the first acquisition unit.

[0007] An information processing method according to one embodiment of the present invention is an information processing method executed by a computer system, and includes acquiring configuration information relating to the configuration of a drum instrument and physical information relating to the body of a player playing the drum instrument. Based on the acquired configuration information and physical information, recommended information corresponding to the player regarding settings when playing the drum instrument is output.

[0008] A program according to one embodiment of the present invention causes a computer system to acquire configuration information relating to the configuration of a drum instrument and physical information relating to the body of a player playing the drum instrument, and output recommended information corresponding to the player regarding settings for playing the drum instrument based on the acquired configuration information and physical information. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a schematic diagram illustrating an example of the configuration of a drum setting support system according to an embodiment. [Figure 2] 10 is a flowchart showing an example of a basic operation of a smartphone. [Figure 3] FIG. 1 is a schematic diagram showing an example of the configuration of a drum set. [Figure 4] FIG. 1 is a schematic diagram for explaining the physical state of a player playing a drum set. [Figure 5] FIG. 1 is a schematic diagram for explaining the physical state of a player playing a drum set. [Figure 6] FIG. 1 is a schematic diagram for explaining the physical state of a player playing a drum set. [Figure 7] FIG. 10 is a schematic diagram illustrating an example of generating recommendation information using a learning model. [Figure 8]FIG. 1 is a schematic diagram for explaining learning of a learning model using teacher data. [Figure 9] 10 is a schematic diagram showing an example of generating recommendation information using a learning model that uses extracted information extracted from a performance state image as input. FIG. [Figure 10] FIG. 1 is a schematic diagram for explaining learning of a learning model using teacher data. [Figure 11] FIG. 10 is a schematic diagram showing an example of generating recommendation information using a learning model that uses both a performance state image and extracted information as input. [Figure 12] FIG. 1 is a schematic diagram for explaining learning of a learning model using teacher data. [Figure 13] FIG. 10 is a schematic diagram showing output of recommendation information by processing using a rule base. [Figure 14] FIG. 10 is a schematic diagram showing output of recommendation information by processing using a rule base. [Figure 15] FIG. 10 is a schematic diagram showing output of recommendation information by processing using a rule base. [Figure 16] FIG. 1 is a schematic diagram for explaining semi-customization based on manufacturer standard values. [Figure 17] FIG. 10 is a schematic diagram for explaining semi-customization based on manufacturer standard values. [Figure 18] FIG. 10 is a schematic diagram for explaining semi-customization based on manufacturer standard values. [Figure 19] FIG. 10 is a schematic diagram showing a specific example of output of recommendation information (display of recommendation comments). [Figure 20] FIG. 10 is a schematic diagram showing a specific example of output of recommendation information (display of recommendation comments). [Figure 21] FIG. 10 is a schematic diagram showing a specific example of output of recommendation information (photographed image of Tam). [Figure 22] FIG. 10 is a schematic diagram showing a specific example of output of recommended information (AR display of recommended information). [Figure 23] FIG. 10 is a schematic diagram showing a specific example of output of recommendation information (photographed image of the performer's body). [Figure 24]FIG. 10 is a schematic diagram showing a specific example of output of recommended information (AR display of recommended information). [Figure 25] FIG. 10 is a schematic diagram showing a specific example of output of recommendation information (photographed image of a room). [Figure 26] FIG. 10 is a schematic diagram showing a specific example of output of recommended information (AR display of recommended information). [Figure 27] FIG. 10 is a schematic diagram showing a specific example of output of recommended information (AR display of recommended information). [Figure 28] FIG. 10 is a schematic diagram showing a specific example of output of recommended information (AR display of recommended information). [Figure 29] FIG. 1 is a schematic diagram showing an example of a straight-type cymbal stand. [Figure 30] FIG. 1 is a schematic diagram showing an example of a boom-type cymbal stand. [Figure 31] FIG. 10 is a block diagram illustrating another example of the functional configuration of the smartphone. [Figure 32] FIG. 1 is a schematic diagram illustrating an example of the configuration of an electronic drum. [Figure 33] FIG. 1 is a block diagram illustrating an example of the hardware configuration of a computer that can be used as an information processing device. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0011] [Drum Setting Support System] FIG. 1 is a schematic diagram showing an example of the configuration of a drum setting support system according to one embodiment of the present invention. The drum setting support system 1 can support a performer (drummer) 2 in setting up a drum instrument 3 when playing the instrument. The performer 2 can also be said to be a user of the drum setting support system 1.

[0012] In this disclosure, the drum instrument 3 includes various types of instruments having any configuration including a drum (taiko drum). 1, a drum set 4 is illustrated as the drum instrument 3, but this is not intended to be limiting. For example, the drum instrument 3 also includes a Japanese drum, percussion instruments, or electronic devices such as electronic drums, and the present technology can be applied to such instruments.

[0013] In many cases, instruments that are not classified as drums when viewed individually, such as the various cymbals included in the drum set 4 shown in Figure 1, are placed and played together with the drums. In addition, chairs and other equipment necessary for playing are often used. For example, when playing Japanese drums, gongs and other instruments may be played together. When playing percussion, wind chimes, cowbells, shakers, etc. may also be played together. Electronic drum sets may also include electronic cymbals. In this disclosure, other types of instruments that are played along with such drums and the equipment required for playing them are also considered to be included in the drum instrument 3. In other words, the present technology can also be used to assist with the setting of various cymbals, chairs, etc., as exemplified in FIG. There are also performers who play by hitting objects that are not manufactured as musical instruments, such as pots and tables. In such performances, the objects that are hit as musical instruments by the performer 2 are also included in the drum instrument 3.

[0014] 1, in this embodiment, the drum setting support system 1 is configured using a smartphone 5. The smartphone 5 is used as a computer having an imaging function. Any configuration can be adopted as a computer with imaging capabilities, and for example, a tablet terminal, an HMD (Head Mounted Display) such as AR (Augmented Reality) glasses or VR (Virtual Reality) glasses, a PC, etc. can also be used. In this embodiment, the smartphone 5 functions as an embodiment of an information processing device according to the present technology.

[0015] The smartphone 5 has hardware necessary for configuring a computer, such as processors such as a CPU, a GPU, a DSP, etc., memories such as a ROM, a RAM, etc., storage devices such as an HDD, etc. For example, the CPU loads a program according to the present technology, which is pre-recorded in a ROM or the like, into a RAM and executes the program, thereby executing the information processing method according to the present technology.

[0016] A camera (not shown) is mounted on the smartphone 5. As the camera, for example, a digital camera equipped with an image sensor such as a CMOS (Complementary Metal-Oxide Semiconductor) sensor or a CCD (Charge Coupled Device) sensor is used. In addition, an imaging device having any other configuration may be mounted.

[0017] In this embodiment, the camera of the smartphone 5 captures an image of the performer 2 playing the drum instrument 3. The state in which the performer 2 is playing the drum instrument 3 includes a state in which the performer 2 is moving his / her body to play the drum instrument 3, a state in which the performer 2 is able to play the drum instrument 3 (a state in which the performer 2 is in standby for playing the drum instrument 3), a state in which the performer 2 is in a posture suitable for playing the drum instrument 3, etc. For example, as shown in Figure 1, the drum instrument 3 is a drum set 4. In this case, the state in which the performer 2 plays the drum instrument 3 includes the state in which the performer 2 actually plays rhythms such as 8 beats and 16 beats. This is not limited to the above, and for example, a state in which the performer 2 is sitting on the chair of the drum set 4 and is ready to play the drum set 4 at any time (sitting on the chair, holding the sticks, and being ready to play) is also included in the state in which the performer 2 is playing the drum instrument 3. Additionally, the state in which the performer 2 is sitting on the chair of the drum set 4 and assuming the posture required for playing the drum set 4 is also included in the state in which the performer 2 is playing the drum instrument 3. For example, the state in which the performer 2 is not holding a drumstick but is sitting on the chair and assuming the posture required for actually playing the drum instrument 3 is also included in the state in which the performer 2 is playing the drum instrument 3. Hereinafter, an image captured of the performer 2 playing the drum instrument 3 may be referred to as a performance state image. The performance state image is included in the captured image that includes at least one of the structure of the drum instrument 3 or the body of the performer 2 according to the present technology. In this disclosure, images include both still images and moving images (video).

[0018] The smartphone 5 is also equipped with a touch panel 6. The touch panel 6 functions as a display unit and an input unit. Various image information such as icons, text, GUI (Graphical User Interface), captured images, etc. are displayed on the touch panel 6. In this embodiment, AR display is also possible, in which an AR object (virtual image) is superimposed on a real object. The performer 2 can input various touch operations to icons and the like displayed on the touch panel 6. This allows the performer 2 to input various instructions. The smartphone 5 can also be equipped with various devices such as a microphone, a speaker, a GPS, an IMU (Inertial Measurement Unit) sensor, and the like.

[0019] 1, in this embodiment, a CPU or the like of a smartphone 5 executes a predetermined program to configure a first acquisition unit 7 and a recommended information output unit 8 as functional blocks. Of course, dedicated hardware such as an IC (integrated circuit) may be used to realize the functional blocks. The program is installed on the smartphone 5 via, for example, various recording media. Alternatively, the program may be installed via the Internet or the like. The type of recording medium on which the program is recorded is not limited, and any computer-readable recording medium may be used. For example, any computer-readable non-transitory storage medium may be used.

[0020] FIG. 2 is a flowchart showing an example of a basic operation of the smartphone 5. The first acquisition unit 7 acquires configuration information relating to the configuration of the drum instrument 3 and physical information relating to the body of the player 2 playing the drum instrument 3 (step 101). The configuration information includes any information about the configuration of the drum instrument 3. The physical information includes any information about the body of the player 2.

[0021] 1, a performance state image 9 is captured by the smartphone 5 and displayed on the touch panel 6. The performance state image 9 is a captured image that includes both performance information and physical information. In this embodiment, the first acquisition unit 7 acquires the performance state image 9 captured by the smartphone 5 as performance information and physical information. The extracted information from the performance state image 9 may be acquired as the configuration information or the physical information, without being limited to the performance state image 9. For example, any information about the configuration of the drum instrument 3 extracted from the performance state image 9 may be acquired as the configuration information. Also, any information about the body of the player 2 extracted from the performance state image 9 may be acquired as the physical information. Furthermore, the configuration information and physical information may include information other than the performance state image 9 and the extracted information extracted from the performance state image 9. The acquisition of the configuration information and physical information will be described in detail later.

[0022] The recommended information output unit 8 outputs recommended information corresponding to the player 2 regarding the settings when playing the drum instrument 3 based on the configuration information and physical information acquired by the first acquisition unit 7 (step 102). In the example shown in FIG. 1, a recommendation comment 10 is displayed as recommendation information on the touch panel 6 (also shown in FIG. 19). The "recommended comment regarding instrument placement" in the recommended comment 10 is included in the recommended configuration information regarding the configuration of the drum instrument 3 that corresponds to the body of the player 2 recommended when playing the drum instrument 3. The “recommended comment about playing form” in the recommended comment 10 is included in the recommended physical information about the body of the player 2 recommended when playing the drum instrument 3 . The output of the recommendation information is not limited to the recommendation comment 10, and various forms can be adopted, such as displaying a virtual image or outputting a sound. The output of the recommendation information will be described in detail later.

[0023] 1, the first acquisition unit 7 corresponds to an embodiment of the first acquisition unit according to the present technology, and the recommended information output unit 8 corresponds to an embodiment of the recommended information output unit according to the present technology.

[0024] [Drum set configuration example] FIG. 3 is a schematic diagram showing an example of the configuration of the drum set 4. The drum set 4 shown in FIG. 3 is also called an acoustic drum set. Hereinafter, the present technology will be described using a drum set 4 as an example of a drum instrument 3. The present technology described below can also be applied to drum instruments 3 of various types other than the drum set 4.

[0025] The drum set 4 shown in FIG. 3 includes a bass drum 12, a snare drum 13, a high tom 14, a low tom 15, a floor tom 16, a high-hat cymbal 17, a crash cymbal 18, and a ride cymbal 19. The drum set 4 also includes a kick pedal (foot pedal) 20, a hi-hat pedal 21, a snare stand 22, a hi-hat stand 23, a cymbal stand 24, a sound pickup device 25, and a control device 26. The hi-hat pedal 21 and the hi-hat stand 23 are integrally configured. The drum set 4 also includes a chair 27 (see FIG. 4, etc.) on which the performer 2 sits. The drum set 4 also includes various components (reference numerals omitted) such as legs that support the floor tom 16, and a tom holder that supports the high tom 14 and low tom 15 and is attached to the bass drum 12.

[0026] The sound collection device 25 collects sounds produced by the drum set 4 and outputs sound signals corresponding to the collected sounds. The control device 26 is connected wirelessly or by wire to the sound collection device 25. The control device 26 adds sound effects to the sound signal output from the sound collection device 25 and outputs the sound signal. The performer 2 listens to the sound signal output from the control device 26 through a sound output device such as headphones, thereby enabling the performer 2 to listen to sounds corresponding to the performance.

[0027] Note that the configuration of the drum set 4 to which the present technology can be applied is not limited, and a drum set 4 having any configuration may be used. For example, the configuration of drum set 4 shown in Figure 3 is typically adopted as a right-handed setting for a right-handed player 2. On the other hand, for a left-handed player 2, a setting that is a symmetrical swap of the right-handed setting shown in Figure 3 may be adopted as a left-handed setting. The following description will be given taking as an example a case where player 2 is right-handed and a right-handed setting is used, but the contents of this description can also be applied to a left-handed setting by switching the left and right sides of the description.

[0028] [Person 2's physical condition (posture while performing)] 4 to 6 are schematic diagrams for explaining the physical state of the player 2 playing the drum set 4. The physical posture etc. when playing the drum set 4 will be explained with reference to FIGS. 4 to 6. The drum set 4 shown in Figures 4 to 6 has a slightly different configuration from the drum set 4 shown in Figure 3. Specifically, the drum set 4 shown in Figures 4 to 6 does not have the sound collection device 25 and control device 26 shown in Figure 3 installed. 4 to 6, two crash cymbals 18a and 18b are arranged. The left crash cymbal 18a is arranged in approximately the same position as the crash cymbal 18 shown in FIG. 3. The right crash cymbal 18b is arranged in approximately the same position as the ride cymbal 19 shown in FIG. 3. In the drum set 4 shown in FIGS. 4 to 6, a ride cymbal 19 is disposed between the low tom 15 and the floor tom 16.

[0029] In the example shown in FIGS. 4 to 6, the performer 2 plays the drum set 4 while sitting on a chair 27 . The performer's right foot 31 is placed on the kick pedal 20, and the bass drum 12 can be played by stepping on the kick pedal 20. The left foot 30 of the player 2 is placed on the hi-hat pedal 21, and by stepping on the hi-hat pedal 21, the open / closed state of the hi-hat cymbal 17 can be controlled.

[0030] The player 2 holds sticks 34a and 34b in his left hand 32 and right hand 33, respectively. 4 and 5, the snare drum 13 is played with the left hand 32 using a stick 34a. The right hand 33 is positioned above the left hand 32 so as to intersect with the left hand 32, and the hi-hat cymbal 17 is played with the right hand 33 using a stick 34b. By moving the right foot 31, left hand 32, and right hand 33 to play the bass drum 12, snare drum 13, and hi-hat cymbal 17 at various sounding timings, it is possible to play various rhythms such as 8 beats and 16 beats. Additionally, by appropriately operating the hi-hat pedal 21 with the left foot 30 to control the open / close state of the hi-hat cymbal 17, it is possible to adjust the tone and length of the sound emitted from the hi-hat cymbal 17. Of course, it is also possible to produce a sound by stepping on the hi-hat pedal 21 with the left foot 30 to open or close the hi-hat cymbal 17.

[0031] 6, performer 2 moves left hand 32 and right hand 33 to hit high tom 14, low tom 15, floor tom 16, crash cymbals 18a and 18b, and ride cymbal 19 with sticks 34a and 34b, respectively. This allows each part to be played, and makes it possible to produce a sound corresponding to each part. The performer 2 can play various rhythms and patterns by playing the drums, cymbals, etc. included in the drum set 4.

[0032] In the above description, the entire body from the base of the foot to the tip (tip of the fingers) is represented as a left foot 30 and a right foot 31. Also, the entire body from the shoulder to the tip of the hand (tip of the fingers) is represented as a left hand 32 and a right hand 33. Hereinafter, when describing each part of the body of the player 2 in detail, expressions such as the thighs (femur), ankles, and knees of the left foot 30 and the right foot 31, and expressions such as the wrists, forearms, elbows, and upper arms of the left hand 32 and the right hand 33 will be used as appropriate. Of course, expressions that are easy to understand will also be used as appropriate to describe each part of the body other than the left and right hands and feet.

[0033] There are various methods and styles for playing the drum set 4. For example, the drum set 4 can be played while standing, rather than sitting on the chair 27. There is also an open-hand style in which the left hand 32 and the right hand 33 do not cross over each other, and the hi-hat cymbal 17 is played with the left hand 32 and the snare drum 13 with the right hand 33. There are also various ways to hold the sticks 34a and 34b, such as a matched grip or a regular grip (traditional grip). Of course, the grip method also affects how you use your body when hitting the snare drum 13, various toms, and various cymbals. Furthermore, the sticks 34a and 34b are not limited to ordinary sticks, but also come in various types such as rods, brushes, broomsticks, mallets, etc. Depending on the type of stick used when playing, the way the body is used when hitting the snare drum 13, various toms, and various cymbals also changes. For example, when using brushes, the way you use your arms changes compared to when using regular sticks, so in many cases you will want to increase the height of the snare stand 22 and set the striking surface of the snare drum 13 higher. The drum setting support system 1 according to this embodiment can support a wide range of settings without limiting the type of drum set 4, playing method, type of sticks, etc.

[0034] [Drum setup assistance] The drum setting support system 1 can output recommended information regarding the settings for a player 2 to play the drum set 4 based on information such as the configuration of the drum set 4 and the physical condition of the player 2 who will be playing the drum set 4. The recommended information that is output is recommended information that corresponds to the body of the player 2. In other words, it is possible to output recommended information that is optimal for the body of each player 2. 1 and 2, first, the first acquisition unit 7 acquires configuration information and physical information in order to output recommended information corresponding to the player 2. When the drum instrument 3 is a drum set 4, the first acquisition unit 7 acquires configuration information relating to the configuration of the drum set 4 and physical information relating to the body of the player 2 who plays the drum set 4.

[0035] [Example of configuration information] The configuration information acquired by the first acquisition unit 7 includes information that can indicate the configuration of the drum set 4 to be played. For example, the configuration information may be information indicating the current settings (physical settings) of the drum set 4 that is about to be played. On the other hand, if it is possible to identify the configuration of the drum set 4 that is the target of the performance, the information on the current settings may not be necessary. For example, the configuration information may indicate that the drum set 4 to be played is a drum set 4 with a specific model number from a specific manufacturer, and that the current setup is as follows. However, the configuration information may simply indicate that the drum set 4 is a drum set with a specific model number from a specific manufacturer. Examples of information that can be used as configuration information are listed below. The information shown below is merely an example and does not limit the application of this technology to configuration information.

[0036] (Photos including the composition of Drum Set 4) For example, it is possible to acquire and use as configuration information a performance state image 9 as shown in FIG. 1 or a photographed image of only the drum set 4. The photographic image is not limited to one that includes the entire drum set 4, and there may be cases where a photographic image that includes only a portion of the drum set 4 can also be used.

[0037] (Extracted information extracted from the photographed image including the configuration of the drum set 4) Extracted information relating to the configuration of the drum set 4, extracted from a photographed image including the configuration of the drum set 4, can be acquired and used as configuration information. Such extracted information includes, for example, the following information: Drum Set 4 product information (type, name, manufacturer, product number, etc.) Number and placement of each part For example, it includes information such as one tom and one floor, two toms and two floors, etc. It also includes information indicating the basic composition, such as the number and placement of cymbals. The position of each part is calculated based on, for example, a predetermined coordinate system. The method for setting the coordinate system is not limited, and any setting method may be adopted.

[0038] The size of each part (diameter of each drum, size of each cymbal, etc.) Configuration of each stand (model number, type, etc.) Configuration of each holder (model number, type, etc.)

[0039] For example, the performer 2 inputs a captured image (e.g., a performance state image 9, etc.) including the configuration of the drum set 4. The first acquisition unit 7 extracts the extracted image as described above from the captured image and acquires it as configuration information. The method for extracting the extracted information from the captured image is not limited, and any technique (algorithm) may be used. For example, any image recognition technology may be used, such as image size conversion, character recognition, shape recognition, matching processing using a model image of an object, edge detection, projective transformation, etc. Alternatively, extracted information may be obtained by matching with a database or the like that stores information about the drum set 4. Furthermore, an externally constructed library with existing image processing or machine learning functions may be used. Any machine learning algorithm may be used to extract the extracted information, for example, performing semantic segmentation on the image information to determine the object type for each pixel in the image.

[0040] For example, it is possible to determine the manufacturer and size of each part of the drum set 4 based on a logo mark or text information contained in the captured image. Furthermore, if an object of known size can be identified within the captured image, it is possible to calculate the size of other objects within the captured image by using the size of that object as a scale standard and performing image size conversion, etc. For example, the lengths of the sticks 34a and 34b are often uniform within a certain range, so it is possible to calculate the size of each part of the drum set 4 using the lengths of the sticks 34a and 34b in the captured image as a scale reference. Alternatively, the size of the control device 26 shown in Figure 1 can be used as the scale reference. Alternatively, if the size of the snare drum 13 can be determined by character recognition or the like, the size of the snare drum 13 can be used as the scale reference. Furthermore, feature points may be extracted for each component of the drum set 4 through a feature point extraction process. Then, based on the extracted feature points, configuration information regarding the configuration of the drum set 4 may be obtained. For example, information such as the position, movement (momentum), speed, and acceleration of the extracted feature points may be used.

[0041] (Input information about the configuration of drum set 4 input by performer 2) For example, input information from the performer 2 regarding the configuration of the drum set 4 may be used as configuration information. For example, the product information of the drum set 4 listed above as extracted information, the number and placement position of each part, the size of each part, the configuration of each stand, the configuration of each holder, etc. may be directly input by the performer 2. The method and GUI for inputting the input information by the performer 2 are not limited and may be designed arbitrarily. For example, a GUI may be displayed along with text information such as "Please enter the basic configuration of the drum set," allowing the performer 2 to select a basic configuration such as one tom and one floor cymbal, two crash cymbals, and one ride cymbal, and the basic configuration may be selected. Furthermore, product information about the drum set 4 may be selectable using a pull-down menu. Of course, the number and size of each part (each drum, each cymbal, etc.) may be input directly using text data. Alternatively, interactive information input using voice input, etc. may be possible.

[0042] [Example of physical information] The physical information acquired by the first acquisition unit 7 includes information capable of indicating the physical characteristics of the player 2. Typically, physique information indicating the physique of the player 2 is used as the physical information. However, the physical information is not limited to this. Examples of information that can be used as physical information are listed below. The information listed below is merely an example, and does not limit the application of this technology to physical information.

[0043] (Photo includes the body of Performer 2) For example, a performance state image 9 as shown in FIG. 1 or a photographed image of only the body of the performer 2 can be acquired and used as body information. The photographed image is not limited to one that includes the entire body of the performer 2, and there may be cases where a photographed image that only includes a portion of the body of the performer 2 can be used.

[0044] (Information extracted from a photographed image including the body of performer 2) Extracted information about the body of the player 2, extracted from a photographed image including the body of the player 2, can be acquired and used as body information. Such extracted information includes, for example, the following information: Skeletal information of performer 2 The skeletal information may include, for example, the position and size of each part of the body. In addition, the following may be extracted as skeletal information: height, length of upper body, length of lower body, length of limbs (left foot 30, right foot 31, left hand 32, and right hand 33), size of palm, length of forearm (part from wrist to elbow), length of upper arm (part from elbow to shoulder), length of neck, length of thigh (part from groin to knee), length of shin (part from knee to ankle), size of foot, etc. The position of each part is calculated based on, for example, a predetermined coordinate system. The method for setting the coordinate system is not limited, and any setting method may be adopted.

[0045] Posture of performer 2 (position and tilt of each part, etc.) Center of gravity and displacement of center of gravity of player 2 Movement of performer 2 (displacement of each part of the body) In many cases, this information can be obtained as skeletal information of the player 2.

[0046] Size, position, and movement of sticks 34a and 34b Distance from shoulder to tip of stick (distance from shoulder of left hand 32 to tip of stick 34a / distance from shoulder of right hand 33 to tip of stick 34b) The sticks 34a and 34b are held by the player 2. Therefore, information about the sticks 34a and 34b can be used as physical information about the body. On the other hand, information about the sticks 34a and 34b may also be used as configuration information about the configuration of the drum set 4.

[0047] For example, the performer 2 inputs a captured image (such as a performance state image 9) that includes the body of the performer 2. The first acquisition unit 7 extracts the extracted image as described above from the captured image and acquires it as body information. The method for extracting the extracted information from the captured image is not limited, and any technique (algorithm) may be used. For example, any image recognition technology may be used, such as image size conversion, character recognition, shape recognition, matching processing using a model image of a human body, edge detection, or projective transformation. Skeleton estimation (bone estimation) may also be used. Alternatively, extracted information may be obtained by matching with a database or the like that stores information about the human body. Furthermore, an externally constructed library with existing image processing or machine learning functions may also be used. Any machine learning algorithm may be used to extract the extracted information, for example, semantic segmentation may be performed on the image information to determine the type of body part for each pixel in the image.

[0048] Furthermore, if an object of known size can be identified within the captured image, it is possible to calculate the size of each part of the body of performer 2 in the captured image by using the size of the object as a scale standard and performing image size conversion, etc. For example, it is possible to calculate the size of each part of the player 2's body using the length of the sticks 34a and 34b in the captured image as a scale reference. The size of another object may be used as the scale reference. For example, if the size of the snare drum 13 can be determined by character recognition or the like, the size of the snare drum 13 may be used as the scale reference. Furthermore, feature points may be extracted for each part of the body of the player 2 by the feature point extraction process. Then, based on the extracted feature points, physical information about the body of the player 2 may be obtained. For example, information such as the position, movement (momentum), speed, and acceleration of the extracted feature points can be used.

[0049] (Input information about the body of performer 2 input from performer 2) For example, input information from the player 2 regarding the body of the player 2 may be used as the body information. For example, the skeletal information of the player 2 (information that the player 2 can input, such as height) and the length of the sticks 34a and 34b, etc., included in the extracted information listed above, may be input directly by the player 2. The method and GUI for the performer 2 to input the input information are not limited and may be designed arbitrarily. For example, height may be selectable using a pull-down menu along with text information such as "Please enter your height." Of course, the size of each body part, such as height, may be input directly using text data. Alternatively, interactive information input using voice input or the like may be possible.

[0050] For example, the first acquisition unit 7 acquires a photographed image including both the drum set 4 and the body of the player 2, such as a performance state image 9, as information including both configuration information and body information. Alternatively, a set of the configuration information and physical information as exemplified above may be acquired by the first acquisition unit 7. For example, any combination of one or more pieces of configuration information as exemplified above and one or more pieces of physical information as exemplified above may be acquired and used. Of course, there may be cases where multiple pieces of configuration information and multiple pieces of physical information are acquired.

[0051] For example, the performer 2 inputs a photographed image including only the configuration of the drum set 4 and a photographed image including only the body of the performer 2. These photographed images are acquired as the configuration information and the body information by the first acquisition unit 7. Alternatively, one or more pieces of extracted information extracted from these photographed images are acquired as the configuration information and the body information. Alternatively, there may be a configuration in which the performer 2 does not input the captured images. For example, via a predetermined GUI, the performer 2 inputs input information regarding the configuration of the drum set 4 and input information regarding the body of the performer 2. This input information may be acquired and used as configuration information and body information.

[0052] [Recommended information] The recommended information output by the recommended information output unit 8 includes recommended body shape information and recommended physical information. The recommended configuration information is recommended information regarding the configuration of the drum instrument 3 that is recommended to correspond to the body of the player 2 when playing the drum instrument 3. In this embodiment, recommended information regarding the configuration of the drum set 4 that is recommended to correspond to the body of the player 2 when playing the drum set 4 is output as recommended configuration information. The recommended physical information is recommended information about the body of the player 2 that is recommended when playing the drum instrument 3. In this embodiment, recommended information about the body of the player 2 that is recommended when playing the drum set 4 is output as the recommended physical information.

[0053] [Recommended configuration information] The recommended configuration information is information corresponding to the body of the player 2, and includes the position, height, and posture of each part included in the drum instrument 3, and the relative positional relationship of each part, etc. At least one of these pieces of information may be output. The position of each part is a position on the installation surface (ground) on which the drum instrument 3 is installed. The height of each part is the height (distance) from the installation surface. The orientation of each part is the angle with respect to the surface on which it is placed, or can also be called the tilt with respect to the surface on which it is placed. Typically, the angle with respect to the horizontal plane (tilt with respect to the horizontal plane) is used as the orientation of each part. The relative positional relationship of each part includes the distance between two or more parts, the angle at which they intersect, and the like.

[0054] In this embodiment, information regarding the position, height, posture (including tilt) and relative positional relationship of each part of the drum set 4 is output as recommended configuration information. For example, information on which parts of the drum set 4 should be moved, how, and by how much can be output as recommended configuration information. Alternatively, if a standard configuration (hereinafter referred to as the standard configuration) such as manufacturer standard values ​​is specified for the position, height, posture (including tilt), and relative positional relationships of each part of the drum set 4, it is also possible to output recommended configuration information using the difference from that standard configuration. Examples of recommended configuration information are listed below. The information shown below is merely an example, and does not limit the application of the present technology to the recommended configuration information.

[0055] (Information about the position and height of chair 27) Information that allows the position and height of the chair 27 to be adjusted can be output as recommended configuration information. Regarding the position of the chair 27, for example, information that allows the relative positional relationship with the bass drum 12 to be adjusted to a recommended state (hereinafter referred to as the recommended state) is recommended. This will be described in detail later as information regarding the position of the bass drum 12. Regarding the height of chair 27, for example, it is possible to set the recommended state as a state in which, when sitting on chair 27, the entire soles of the feet are placed on the surface and the thighs are horizontal, or a state in which the knees are slightly lower than horizontal. Information that allows the height of chair 27 to be adjusted so that such a recommended state is realized is output as recommended configuration information. Note that it is possible to determine the angle of the thighs by regarding the surface direction of the installation surface or the surface direction of the seat of chair 27 as the horizontal direction. For example, it is possible to output information such as "Please raise the chair," "Please lower the chair," "Please raise the chair height higher than the manufacturer's standard value," or "Please lower the chair height lower than the manufacturer's standard value" as recommended configuration information. Of course, the recommended configuration information may be output using specific values ​​(e.g., cm). For example, it is possible to specify a predetermined range of values ​​to be adjusted, such as "Please make sure the chair height is within the range of XX cm to XX cm," or to specify a specific value.

[0056] The above-mentioned recommended state for chair height 27 is an example, and is not limited to this recommended state. Each performer 2 may have different opinions regarding the recommended state for the configuration of drum set 4, such as the height of chair 27. Also, there may be performers 2 who personally prefer a state that is not generally recommended. Taking this into consideration, it may be possible to appropriately set a recommended state for the configuration of the drum set 4 by customization, etc. For example, it may be possible to set the recommended state for the height of the chair 27 such that the angle of the thighs is slightly higher than the horizontal at the knee side. In this way, it is possible to output recommendation information that will realize the recommended state that has been arbitrarily set. Of course, it is also possible to set the generally recommended state as the default in the initial settings. The fact that this recommended state is not limited also applies to recommended states regarding other components of the drum set 4 described below. The same also applies to recommended states regarding the body of the player 2 who plays the drum set 4.

[0057] (Information about the position and inclination of the bass drum 12) Information that enables adjustment of the position and tilt of the bass drum 12 can be output as recommended configuration information. Regarding the position of the bass drum 12, for example, information that allows the relative positional relationship with the chair 27 to be adjusted to a recommended state is recommended. For example, a user sits on chair 27 and places right foot 31 on kick pedal 20. At this time, the recommended state can be set as a state in which bass drum 12 is positioned such that the angle of the shin of right foot 31 positions the ankle slightly forward (toward bass drum 12) than the knee. In addition, it is possible to set the recommended state as follows: when viewed from above, the bass drum 12 is positioned so that the direction in which the thigh of the right foot 31 extends (the direction from the base of the foot to the knee) is perpendicular to the striking surface of the bass drum 12. Information that allows the position of the bass drum 12 to be adjusted so that such a recommended state is realized is output as recommended configuration information. For example, it is possible to output information such as "Move the bass drum closer to the chair," "Move the bass drum further away from the chair," "Move the bass drum and chair further apart than the manufacturer's standard value," or "Move the bass drum and chair closer together than the manufacturer's standard value" as recommended configuration information. Of course, it is also possible to output recommended configuration information using specific values ​​(cm, etc.) (specifying a predetermined value range / specifying a predetermined value, etc.).

[0058] To achieve a recommended state regarding the relative positional relationship between the bass drum 12 and the chair 27, recommended configuration information regarding the position of the chair 27 may be output. For example, recommended configuration information such as "move the chair closer to the bass drum" or "move the chair away from the bass drum" may be output. In this way, the relative positional relationship between the two parts can be achieved by outputting recommended configuration information that allows the position of each part to be adjusted. Of course, information that allows direct adjustment of the relative positional relationship between the two parts, such as "Please increase the distance between the chair and the bass drum" or "Please decrease the distance between the chair and the bass drum," can also be output as recommended configuration information (this point will be discussed later).

[0059] Regarding the tilt of the bass drum 12, for example, it is possible to set a state in which the front side (the side opposite the striking surface) of the bass drum 12 is slightly raised as the recommended state. This recommended state has the effect of making the bass drum 12 produce a good sound rather than making it easier to play. Information that allows adjustment of the height (floating amount) of the front side of the bass drum 12 so that such a recommended state is realized is output as recommended configuration information. For example, it is possible to output information such as "Raise the front of the bass drum slightly above the ground" or "Raise the front of the bass drum higher than the manufacturer's standard value" as recommended configuration information. Of course, it is also possible to output recommended configuration information using specific values ​​(e.g., cm) (specifying a specified value range / specifying a specified value, etc.). For example, the amount of lift may be calculated based on the depth of the bass drum 12 (the distance between the striking surface and the front surface) (e.g., if the depth is 16 inches, lift 10 mm). Also, the recommended tilt may be indicated using an angle.

[0060] (Information about the position, height, and inclination of the snare drum 13) Information that enables adjustment of the position, height, and tilt of the snare drum 13 can be output as recommended configuration information. Regarding the position of the snare drum 13, for example, the performer 2 sits on a chair 27 and places his / her right foot 31 on the kick pedal 20. In this case, it is possible to set the state in which the snare drum 13 is positioned directly in front of the torso of the performer 2 as the recommended state. For example, it is possible to set the state in which the center of the snare drum 13 is positioned on the central axis extending from the center of the body to the front as viewed from above as the recommended state. The performer 2 also positions the tips of the sticks 34a and 34b at the center of the snare drum 13. In this case, the recommended state can be set as the state in which the snare drum 13 is positioned so that the upper arms are extended vertically to the sides of the torso. For example, the state in which the snare drum 13 is positioned so that the elbows are away from the torso is set as the unrecommended state. Information that allows the position of the snare drum 13 to be adjusted so that such a recommended state is realized is output as recommended configuration information. For example, it is possible to output information such as "Move the snare drum closer to the chair," "Move the snare drum farther from the chair," "Move the snare drum and chair farther apart than the manufacturer's standard value," or "Move the snare drum and chair closer together than the manufacturer's standard value" as recommended configuration information. Of course, it is also possible to output recommended configuration information using specific values ​​(cm, etc.) (specifying a predetermined value range / specifying a predetermined value, etc.).

[0061] Regarding the height of the snare drum 13, for example, the performer 2 positions the tips of the sticks 34a and 34b at the center of the snare drum 13. In this case, it is possible to set the height of the striking surface of the snare drum 13 within the range from knee height to elbow height of the performer 2 as the recommended state. The range of the recommended state can also be called the recommended range. More specifically, it is possible to set the height of the striking surface of the snare drum 13 at a height slightly below the navel of the player 2 as the recommended state. Information that allows the height of the snare drum 13 to be adjusted so that such a recommended state is realized is output as recommended configuration information. For example, it is possible to output information such as "Lower the height of the snare drum," "Increase the height of the snare drum," "Lower the height of the snare drum from the manufacturer's standard value," or "Increase the height of the snare drum from the manufacturer's standard value" as recommended configuration information. Of course, it is also possible to output recommended configuration information using specific values ​​(cm, etc.) (specifying a predetermined value range / specifying a predetermined value, etc.).

[0062] Regarding the inclination of the snare drum 13, it is possible to set a state in which the striking surface of the snare drum 13 is slightly inclined toward the center of the body of the performer 2 when viewed from above, i.e., toward the front from the performer 2, as a recommended state. For example, a state in which the striking surface of the snare drum 13 is inclined toward the back (away from the body) from the performer 2 is an unrecommended state. It should be noted that many performers 2 are particular about setting the striking surface to be horizontal because it looks good (cool) when they are playing. Taking this into consideration, it is also possible to include a horizontal state in the recommended state. A specific angle range for the recommended state may also be set. Information that allows the tilt of the snare drum 13 to be adjusted so that such a recommended state is realized is output as recommended configuration information. For example, it is possible to output information such as "Tilt the snare drum towards you" as recommended configuration information. Of course, it is also possible to output recommended configuration information using a specific value (e.g., cm) (specifying a predetermined value range / specifying a predetermined value, etc.).

[0063] (Information about the position and height of hi-hat cymbal 17) It is possible to output, as recommended configuration information, information that enables adjustment of the position and height of the hi-hat cymbal 17. The position of the hi-hat cymbal 17 can also be said to be the position of the hi-hat stand 23. Regarding the position of the hi-hat cymbal 17, for example, a person sits on a chair 27 and places his / her left foot 30 on the hi-hat pedal 21. In this case, the angle of the shin of the left foot 30 can be set as the recommended state, such that the hi-hat cymbal 17 is positioned so that the ankle is slightly forward of the knee (toward the hi-hat cymbal 17). In addition, it is possible to set the recommended state as one in which the center of the hi-hat cymbal 17 is positioned on an axis extending along the direction of the thigh of the left foot 30 (from the base of the foot toward the knee) when viewed from above. Information that allows the position of the hi-hat cymbal 17 to be adjusted so that such a recommended state is realized is output as recommended configuration information. For example, it is possible to output information such as "Move the hi-hat cymbal (hi-hat stand) closer to the chair," "Move the hi-hat cymbal (hi-hat stand) farther from the chair," "Move the hi-hat cymbal (hi-hat stand) farther from the chair than the manufacturer's standard value," or "Move the hi-hat cymbal (hi-hat stand) closer to the chair than the manufacturer's standard value" as recommended configuration information. Of course, it is also possible to output recommended configuration information using specific values ​​(cm, etc.) (specifying a predetermined value range / specifying a predetermined value, etc.).

[0064] Regarding the height of the hi-hat cymbal 17, it is possible to set a state where the difference in height between it and the striking surface of the snare drum 13 is within a predetermined range as a recommended state. For example, it is possible to set a state where the hi-hat cymbal 17 is positioned about 20 cm to 25 cm above the striking surface of the snare drum as a recommended state. Information that allows the height of the hi-hat cymbal 17 to be adjusted so that such a recommended state is realized is output as recommended configuration information. For example, it is possible to output information such as "Please lower the height of the hi-hat cymbal," "Please raise the height of the hi-hat cymbal," "Please lower the height of the hi-hat cymbal below the manufacturer's standard value," or "Please raise the height of the hi-hat cymbal above the manufacturer's standard value" as recommended configuration information. Of course, it is also possible to output recommended configuration information using specific values ​​(cm, etc.) (specifying a predetermined value range / specifying a predetermined value, etc.). There tends to be large individual differences in the difference between the height of the hi-hat cymbal 17 and the height of the snare drum 13. By appropriately adjusting the specific numerical value of the range of difference that is considered to be the recommended state (recommended range), it is possible to address such individual differences.

[0065] (Information about the position, height and inclination of floor tom 16) Information that allows adjustment of the position, height, and tilt of floor tom 16 can be output as recommended configuration information. Regarding the position of the floor tom 16, for example, it is possible to set the recommended state so that the center of the striking surface of the snare drum 13 and the center of the striking surface of the floor tom 16 are roughly symmetrical with respect to the axis perpendicular to the center of the striking surface of the bass drum 12. Information that allows the position of floor tom 16 to be adjusted so that such a recommended state is realized is output as recommended configuration information. For example, it is possible to output information such as "Move the floor tom closer to the bass drum," "Place the floor tom in a position that is roughly symmetrical to the snare drum, with the bass drum at the center," or "Move the floor tom to the right of the manufacturer's standard position." Of course, it is also possible to output recommended configuration information using specific values ​​(e.g., cm) (specifying a specific value range / specifying a specific value, etc.). The conditions under which it is easy to hit the floor tom 16 tend to vary greatly from person to person. By appropriately setting the recommended conditions, it is possible to accommodate such individual differences.

[0066] Regarding the height of the floor tom 16, for example, it is possible to set a state in which the height (striking surface height) of the floor tom 16 is approximately the same as the height (striking surface height) of the snare drum 13 as a recommended state. In other words, it is possible to set a state in which the heights of the floor tom 16 and the snare drum 13 are the same as each other as recommended information. Information on how to adjust the height of floor tom 16 so that such a recommended state is realized is output as recommended configuration information. For example, it is possible to output information such as "Lower the height of the floor tom," "Increase the height of the floor tom," "Lower the height of the floor tom from the manufacturer's standard value," or "Increase the height of the floor tom from the manufacturer's standard value" as recommended configuration information. Of course, it is also possible to output recommended configuration information using specific values ​​(e.g., cm) (specifying a specified value range / specifying a specified value, etc.).

[0067] Regarding the tilt of the floor tom 16, it is possible to set a state in which the striking surface of the floor tom 16 is slightly tilted toward the center of the body of the performer 2 when viewed from above, i.e., toward the performer 2. For example, a state in which the striking surface of the floor tom 16 is tilted toward the rear (away from the performer's body) is not a recommended state. Information that allows the tilt of floor tom 16 to be adjusted so that such a recommended state is realized is output as recommended configuration information. For example, it is possible to output information such as "Tilt the floor tom towards you" as recommended configuration information. Of course, it is also possible to output recommended configuration information using specific values ​​(e.g., centimeters) (specifying a specific value range / specifying a specific value, etc.).

[0068] (Information about the position, height and inclination of the toms) Information that allows adjustment of the position, height, and inclination of the toms (high tom 14 and low tom 15) can be output as recommended configuration information. Regarding the position and height of the toms, performer 2 positions the tips of sticks 34a and 34b at the center of the toms. At this time, it is possible to set the recommended state to be a state in which the toms are positioned so that the left hand 32 and right hand 33 are not fully extended, i.e., the elbows are slightly bent and there is some leeway. Alternatively, it is possible to set the recommended state to be a state in which the toms are positioned so that they are easy for performer 2 to hit. Information that allows the position and height of the snare drum 13 to be adjusted so that such a recommended state is realized is output as recommended configuration information. For example, it is possible to output information such as "Raise the height of the high toms," "Move the low toms closer to the front," or "Lower the height of the high toms from the manufacturer's standard value" as recommended configuration information. Of course, it is also possible to output recommended configuration information using specific values ​​(cm, etc.) (specifying a specified value range / specifying a specified value, etc.).

[0069] Regarding the inclination of the toms (high tom 14 and low tom 15), it is possible to set a state in which the striking surfaces of the toms are slightly inclined toward the center of the body of the player 2 when viewed from above, i.e., toward the player 2. For example, a state in which the striking surfaces are inclined toward the back (away from the player 2's body) is not recommended. Information that allows the tilt of the toms to be adjusted so that such a recommended state is realized is output as recommended configuration information. For example, it is possible to output information such as "Tilt the toms toward you" as recommended configuration information. Of course, it is also possible to output recommended configuration information using specific values ​​(e.g., centimeters) (specifying a predetermined value range / specifying a predetermined value, etc.).

[0070] (Information about the position, height and tilt of the cymbal) Information that enables adjustment of the position, height, and tilt of the cymbals (crash cymbal 18 and ride cymbal 19) can be output as recommended configuration information. Regarding the position and height of the cymbals, for example, a state in which the height of the crash cymbal 18 is within the range from shoulder height to eye level of the performer 2 can be set as a recommended state. Also, for example, a state in which the height of the ride cymbal 19 is approximately equal to the height of the hi-hat cymbal 17 can be set as a recommended state. Additionally, it is possible to set a recommended state in which various cymbals are positioned and at a height that is easy for the player 2 to hit. The position and height at which it is easy to hit the cymbals tend to vary greatly among individuals. For example, by appropriately adjusting the specific values ​​of the recommended range, it is possible to accommodate such individual differences. Information that allows the position and height of the cymbals to be adjusted so that the recommended state is realized is output as recommended configuration information. For example, it is possible to output information such as "Raise the height of the crash cymbal," "Move the ride cymbal closer to the front," or "Lower the height of the crash cymbal from the manufacturer's standard value" as recommended configuration information. Of course, it is also possible to output recommended configuration information using specific values ​​(cm, etc.) (specifying a predetermined value range / specifying a predetermined value, etc.).

[0071] Regarding the tilt of the cymbal, it is possible to set a state in which the cymbal is tilted slightly toward the center of the body of the performer 2 when viewed from above, that is, toward the front from the perspective of the performer 2, as a recommended state. For example, a state in which the cymbal is tilted toward the back (away from the body) from the perspective of the performer 2 is an unrecommended state. Information that allows the tilt of the cymbal to be adjusted so that such a recommended state is realized is output as recommended configuration information. For example, it is possible to output information such as "Tilt the crash cymbal towards you" as recommended configuration information. Of course, it is also possible to output recommended configuration information using specific values ​​(e.g., centimeters) (specifying a predetermined value range / specifying a predetermined value, etc.).

[0072] (Information about the difference in height between snare drum 13 and hi-hat cymbal 17) Information that allows adjustment of the relative positional relationship between two or more parts included in the drum set 4 can be output as recommended configuration information. For example, in the above example, the recommended state is set when the difference in height between the hi-hat cymbal 17 and the striking surface of the snare drum 13 is within a predetermined range (for example, 20 cm to 25 cm). This recommended state may be set as a recommended state regarding the difference in height between the snare drum 13 and the hi-hat cymbal 17. Then, recommended configuration information may be output that allows the difference in height between these parts to be adjusted so that the difference in height between the snare drum 13 and the hi-hat cymbal 17 becomes the recommended state. For example, it is possible to output information such as "Please widen the gap between the hi-hat cymbal and the snare drum" or "Please narrow the gap between the hi-hat cymbal and the snare drum from the manufacturer's standard value" as recommended configuration information. Of course, it is also possible to output recommended configuration information using specific values ​​(cm, etc.) (specifying a predetermined value range / specifying a predetermined value, etc.). The output of recommended configuration information is not limited to the difference in height between the snare drum 13 and the hi-hat cymbal 17, but may also be capable of adjusting, for example, the positional relationship between the high tom 14 and the low tom 15, the positional relationship between the ride cymbal 19 and the hi-hat cymbal 17, the positional relationship between the snare drum 13 and the floor tom 16, etc.

[0073] [Recommended physical information] The recommended body information is information recommended for playing the drum instrument 3 to be played, and includes the position, height, and posture of each part of the player's 2 body, and the relative positional relationship of each part, etc. At least one of these pieces of information may be output. The position of each part is a position on the installation surface (ground) on which the drum instrument 3 is installed. The height of each part is the height (distance) from the installation surface. The orientation of each part is an angle with respect to the installation surface, which can also be called an inclination with respect to the installation surface. Typically, the orientation of each part is an angle with respect to the horizontal plane (inclination with respect to the horizontal plane). The relative positional relationship of each part includes the distance between two or more parts, the angle at which they intersect, and the like.

[0074] For example, information on which body parts of the player 2 should be in what posture can be output as recommended body information. Examples of recommended physical information are listed below. The information shown below is merely an example, and does not limit the recommended physical information to which the present technology can be applied.

[0075] (Information about the angle of the thighs when sitting on chair 27) For example, regarding the angle of the thighs when sitting on chair 27, it is possible to set the recommended state to be a state in which the entire soles of the feet are in contact with the surface and the thighs are horizontal, or a state in which the knees are slightly lower than horizontal. Information that guides the user to adjust the thigh angle to the recommended state is output as recommended body information. Note that the thigh angle can be determined by considering the surface direction of the installation surface or the surface direction of the seat of chair 27 as the horizontal direction. For example, information such as "Set your thighs so that they are horizontal" or "Set your knees slightly lower than the bases of your feet" can be output as recommended physical information.

[0076] The thigh angle when sitting on chair 27 correlates with the height of chair 27. That is, the recommended state for the thigh angle often corresponds to the recommended state for the height of chair 27. Furthermore, the recommended state for the thigh angle and the recommended state for the height of chair 27 often become the same state. Therefore, the recommended physical information regarding the angle of the thighs when sitting on chair 27 and the recommended configuration information regarding the height of chair 27 may correspond to each other. For example, information such as "Raise the chair height so that your thighs are horizontal" is information included in both the recommended physical information and the recommended configuration information. In this way, there may be recommended information that is included in both the recommended configuration information and the recommended physical information.

[0077] (Information about the relative position of the bass drum 12 and the foot playing the bass drum 12) For example, with regard to the positional relationship between the bass drum 12 and the right foot 31 playing the bass drum 12, it is possible to set the recommended state as follows: when viewed from above, the direction in which the thigh of the right foot 31 extends (the direction from the base of the foot to the knee) is perpendicular to the striking surface of the bass drum 12. Information that guides the player to achieve a recommended positional relationship between the bass drum 12 and the foot playing the bass drum 12 is output as recommended physical information. For example, information such as "Please set your right thigh so that it is perpendicular to the bass drum" can be output as recommended physical information. It should be noted that the recommended body information regarding the positional relationship between the bass drum 12 and the foot playing the bass drum 12 may correspond to recommended configuration information regarding the position of the bass drum 12. For example, the recommended information included in both the recommended body information and the recommended configuration information may be information such as "Adjust the orientation of the bass drum so that the thigh of your right foot is perpendicular to the bass drum."

[0078] (Information about the angle of the shin of the foot playing bass drum 12) For example, with regard to the angle of the shin of the right foot 31 playing the bass drum 12, when the player is sitting on the chair 27 and has the right foot 31 placed on the kick pedal 20, the angle of the shin of the right foot 31 can be set as a recommended state such that the ankle is positioned slightly forward (towards the bass drum 12) of the knee. Information that guides the angle of the shin of the foot playing the bass drum 12 to a recommended state is output as recommended physical information. For example, information such as "Set the angle of the shin of the right leg 31 so that the ankle is slightly forward" can be output as recommended physical information. It should be noted that the recommended physical information regarding the angle of the shin of the foot playing the bass drum 12 may correspond to recommended configuration information regarding the position of the bass drum 12. For example, the recommended information included in both the recommended physical information and the recommended configuration information may be information such as "Move the bass drum away from the chair so that the ankle of your right foot is slightly forward of your knee."

[0079] (Information about the relative position of snare drum 13 and the body) For example, regarding the positional relationship between the snare drum 13 and the torso, when the performer 2 sits on a chair 27 and places his / her right foot 31 on the kick pedal 20, it is possible to set the recommended state so that the snare drum 13 is positioned directly in front of the performer's torso. Information that guides the positional relationship between the snare drum 13 and the trunk to be in a recommended state is output as recommended body information. For example, information such as "Please set your torso facing forward toward the snare drum" can be output as recommended physical information. It should be noted that the recommended body information regarding the positional relationship between the snare drum 13 and the torso may correspond to recommended configuration information regarding the position of the snare drum 13. For example, the recommended information included in both the recommended body information and the recommended configuration information may be information such as "Adjust the orientation of the snare drum so that your torso faces forward relative to the snare drum."

[0080] (Information about the relative position of the upper arms and torso when playing the snare drum) For example, the performer 2 positions the tips of the sticks 34a and 34b at the center of the snare drum 13. In this case, a state in which the upper arms are extended vertically beside the torso can be set as a recommended state. For example, a state in which the elbows are away from the torso is set as an unrecommended state. Information that guides the player to achieve a recommended positional relationship between the upper arms and the trunk when playing the snare drum is output as recommended physical information. For example, information such as "When you take a playing posture for the snare drum, make sure your elbows do not move away from your torso" can be output as recommended physical information. It should be noted that the recommended body information regarding the positional relationship between the upper arms and the torso when playing the snare drum may correspond to recommended configuration information regarding the position of the snare drum 13. For example, the recommended information included in both the recommended body information and the recommended configuration information may be something like "Place the snare drum in a position where your elbows do not move away from your torso when you assume a playing posture in relation to the snare drum."

[0081] (Information about the relationship between snare drum 13 and elbow and knee height) For example, the player 2 positions the tips of the sticks 34a and 34b at the center of the snare drum 13. In this case, it is possible to set a state where the height of the striking surface of the snare drum 13 falls within the range from knee height to elbow height of the player 2 as the recommended state. More specifically, it is possible to set the recommended state so that the height of the cross section of the snare drum 13 is slightly below the navel of the player 2. Information that guides the relationship between the height of the snare drum 13 and the elbows and knees to a recommended state is output as recommended physical information. For example, information such as "When you take a playing posture in front of the snare drum, set the snare drum so that it is positioned between knee height and elbow height" can be output as recommended physical information. It should be noted that the recommended physical information regarding the relationship between the height of the snare drum 13 and the elbows and knees may correspond to recommended configuration information regarding the height of the snare drum 13. For example, the recommended information included in both the recommended physical information and the recommended configuration information may be information such as "raise the height of the snare drum so that it is within the range from knee height to elbow height when you take a playing posture in relation to the snare drum."

[0082] (Information about the relative position of the hi-hat cymbal 17 and the foot playing the hi-hat cymbal 17) For example, suppose you are sitting on a chair 27 and place your left foot 30 on the hi-hat pedal 21. When viewed from above, it is possible to set the recommended state as follows: the direction in which the thigh of your left foot 30 extends (the direction from the base of your foot to the knee) is directed toward the center of the hi-hat cymbal 17. Information that guides the positional relationship between the hi-hat cymbal 17 and the foot playing the hi-hat cymbal 17 to be in a recommended state is output as recommended physical information. For example, information such as "Set your left thigh so that it extends toward the center of the hi-hat cymbal" can be output as recommended physical information. Note that the recommended body information regarding the relative positions of the hi-hat cymbal 17 and the foot playing the hi-hat cymbal 17 may correspond to recommended configuration information regarding the position of the hi-hat cymbal 17 (hi-hat stand 23). For example, information such as "Adjust the orientation of the hi-hat cymbal so that the thigh of your left foot extends toward the center of the hi-hat cymbal" may be output as recommended information included in both the recommended body information and the recommended configuration information.

[0083] (Information about the angle of the shin of the foot playing hi-hat cymbal 17) For example, a user sits on a chair 27 and places his or her left foot 30 on the hi-hat pedal 21. At this time, the angle of the shin of the left foot 30 can be set as a recommended state such that the ankle is positioned slightly forward of the knee (toward the hi-hat cymbal 17). Information that guides the angle of the shin of the foot playing the hi-hat cymbal 17 to a recommended state is output as recommended physical information. For example, information such as "Set the angle of your left shin so that the ankle is slightly forward of the knee" can be output as recommended physical information. It should be noted that the recommended physical information regarding the angle of the shin of the foot playing the hi-hat cymbal 17 may correspond to recommended configuration information regarding the position of the hi-hat cymbal 17 (hi-hat stand 23). For example, the recommended information included in both the recommended physical information and the recommended configuration information may be something like, "Move the hi-hat cymbal closer so that the angle of the shin of your left foot is such that the ankle is slightly forward of the knee."

[0084] (Information about the positional relationship between floor tom 16 and the body) For example, a person sits on a chair 27 with his or her torso positioned in front of the snare drum 13, and places his or her right foot 31 on the kick pedal 20. When viewed from above, the recommended position can be set as follows: the thigh of the right foot 31 is positioned midway between the snare drum 13 and the floor tom 16. In particular, it is possible to set the recommended state such that the center of the striking surface of the snare drum 13 and the center of the striking surface of the floor tom 16 are roughly symmetrical with respect to the axis of the direction in which the thigh of the right foot 31 extends. Information that guides the player so that the positional relationship between the floor tom 16 and the torso is in a recommended state is output as recommended body information. For example, information such as "When sitting in a chair, position your right thigh so that it is positioned midway between the snare drum and the floor tom" can be output as recommended physical information. It should be noted that the recommended body information regarding the positional relationship between the floor tom 16 and the torso may correspond to recommended configuration information regarding the position of the floor tom 16. For example, the recommended information included in both the recommended body information and the recommended configuration information may be information such as, "When sitting with your torso facing forward toward the snare drum, position the floor tom so that the snare drum and floor tom are symmetrical with respect to your right thigh."

[0085] (Information about the positional relationship between the toms and the arms) For example, performer 2 positions the tips of sticks 34a and 34b at the center of the toms (high tom 14 and low tom 15). At this time, it is possible to set a state in which the left hand 32 and right hand 33 are not fully extended, i.e., a state in which the elbows are slightly bent and there is some leeway, as a recommended state. In addition, it is also possible to set a body position that makes it easy for performer 2 to hit the toms as a recommended state. Information that guides the player so that the positional relationship between the tom and the arm is in a recommended state is output as recommended body information. For example, information such as "When playing the high tom and low tom, please set your elbows so that they are not fully extended" can be output as recommended physical information. The recommended physical information regarding the positional relationship between the toms and the arms may correspond to recommended configuration information regarding the position and height of the toms. For example, the recommended information included in both the recommended physical information and the recommended configuration information may be something like, "Raise the height of the high toms and low toms so that your elbows do not fully extend when playing the high toms and low toms."

[0086] (Information about the position of the cymbal relative to the arm) For example, it is possible to set the physical condition that makes it easy for the performer 2 to hit the cymbals (crash cymbal 18 and ride cymbal 19) as the recommended condition. Note that the condition that makes it easy to hit the cymbals tends to vary greatly from person to person. By appropriately setting the recommended condition, it is possible to accommodate such individual differences. Information that guides the player to achieve a recommended positional relationship between the cymbal and the arm is output as recommended physical information. For example, information such as "When hitting the ride cymbal, make sure your elbow is not fully extended" can be output as recommended physical information. Note that the recommended physical information regarding the positional relationship between the cymbals and the arms may correspond to recommended configuration information regarding the position and height of the cymbals. For example, the recommended information included in both the recommended physical information and the recommended configuration information may be something like, "When hitting the ride cymbal, please move the ride cymbal closer so that your elbow does not fully extend."

[0087] [Recommendation output (processing using machine learning)] There are no limitations on the method by which the recommended information output unit 8 generates and outputs the recommended information, and any technique (algorithm, etc.) may be used. For example, any machine learning algorithm may be used, such as a DNN (Deep Neural Network), an RNN (Recurrent Neural Network), or a CNN (Convolutional Neural Network). For example, by using AI (artificial intelligence) that performs deep learning, it becomes possible to generate and output recommendation information with high accuracy. The following describes a case where recommended information is output by processing using machine learning.

[0088] FIG. 7 is a schematic diagram showing an example of generating recommendation information using a learning model. In the example shown in FIG. 7, recommended information is generated by performing machine learning using as input 9 performance state images obtained by capturing a state in which a performer 2 is playing a drum instrument 3. That is, by inputting the performance state image 9 into a trained learning model 36 that has undergone machine learning to estimate recommended information, a process is executed to acquire recommended information from the learning model 36. This process makes it possible to output recommended information with high accuracy. The learning model 36 can also be called a machine learning model 36 or a trained model 36.

[0089] FIG. 8 is a schematic diagram for explaining the learning of the learning model 36 using the training data. 8, for learning of the learning model 36, training data in which training data is associated with training labels is input to the learning unit 37. The training data is data for training the learning model 36, which estimates a correct answer for an input. 8, in this embodiment, a performance state image 9 is input to a learning unit 37 as learning data. In addition, recommended information is input to the learning unit 37 as a teacher label 38. The teacher label 38 is a correct answer (correct answer data) corresponding to the performance state image 9 for learning.

[0090] In this embodiment, data in which recommended information (teaching labels 38) is associated with learning performance state images 39 (learning data) is used as training data. Therefore, the learning model 36 is a prediction model that has been machine-learned using the performance state images 39 and the recommended information as training data. The method for creating the training data (the performance state images 39 for learning and the data set of recommendation information) is not limited. For example, the training data may be created manually. Alternatively, training data created in advance may be acquired and input to the learning unit 37. For example, the various types of recommended configuration information and recommended physical information described above are associated as recommended information (labels 38) used as training data, and the learning model 36 is trained. This makes it possible to output the various types of recommended configuration information and recommended physical information described above by processing using machine learning. In other words, it becomes possible to acquire various types of recommended information from the learning model 36.

[0091] When creating training data, it is important to use performance state images 9 that are correlated with the recommended information (recommended composition information and recommended physical information) to be output as learning performance state images 39 (learning data). For example, the above describes various recommended configuration information that can lead to recommended states for the position, height, posture, and relative positional relationship of each part included in the drum instrument 3. Of these pieces of recommended configuration information, a performance state image 9 that is found to have a correlation with the recommended configuration information to be output is used as a performance state image 39 (learning data). Specifically, a performance state image 9 that includes parts whose positions, heights, etc. are to be adjusted by the recommended configuration information is used as a performance state image 39 (learning data). Furthermore, if another object (for example, a body part of the performer 2) is needed to serve as a reference when defining the recommended state, a performance state image 9 that also includes the other object that serves as a reference is used as a performance state image 39 (learning data). For example, a performance status image 9 that can determine whether the position of each part of the drum instrument 3 is in a recommended state is used as a performance status image 39 (learning data). Then, recommended configuration information that can lead the position of each part to the recommended state is associated with the performance status image 39 (learning data) as a label 38. This makes it possible to create training data. For example, when constructing a learning model 36 capable of outputting recommended configuration information regarding the height of a chair 27, a performance state image 9 in which the chair 27 and the thighs of a performer 2 seated on the chair 27 are photographed can be used as a performance state image 39 (learning data). Then, by associating the performance state image 39 (learning data) with recommended configuration information that allows the chair height 27 to be adjusted so that the chair height 27 photographed in the performance state image 39 (learning data) becomes the recommended state, training data can be created.

[0092] Also, various recommended body information that can lead the position, height, posture, and relative positional relationship of each part of the player 2's body to a recommended state has been described above. Of these pieces of recommended physical information, a performance state image 9 that is found to correlate with the recommended physical information to be output is used as a performance state image 39 (learning data). Specifically, a performance state image 9 that includes a body part whose posture, etc., is to be adjusted based on the recommended physical information is used as a performance state image 39 (learning data). Furthermore, if another object (e.g., a part of the drum instrument 3) is needed to serve as a reference when defining the recommended state, a performance state image 9 that also includes the other object that serves as a reference is used as a performance state image 39 (learning data). For example, a performance state image 9 that can determine whether the posture of each body part of the performer 2 is in a recommended state is used as a performance state image 39 (learning data). Then, recommended physical information that can lead the posture of each body part to the recommended state is associated with the performance state image 39 (learning data) as a label 38. This makes it possible to create training data. For example, when constructing a learning model 36 capable of outputting recommended physical information regarding the thigh angle when sitting on chair 27, a performance state image 9 in which the thighs of performer 2 seated on chair 27 are photographed so that the thigh angle can be determined can be used as performance state image 39 (learning data). Then, by associating recommended physical information that guides the thigh angle photographed in performance state image 39 (learning data) with performance state image 39 (learning data), it is possible to create training data.

[0093] As shown in Fig. 8, the learning unit 37 uses the training data and performs learning based on a machine learning algorithm. Through the learning, parameters (coefficients) for calculating the correct answer (training label) are updated and generated as trained parameters. A program incorporating the generated trained parameters is generated as a learning model 36.

[0094] The backpropagation method is one example of a learning method used for learning models. Backpropagation is a commonly used learning method for training neural networks. A neural network is a model that originally imitates the neural circuits of the human brain, and has a layered structure consisting of three types of layers: an input layer, an intermediate layer (hidden layer), and an output layer. Neural networks with many hidden layers are called deep neural networks, and the deep learning techniques used to train them are known as models that can learn complex patterns hidden in large amounts of data. Backpropagation is one such learning method, and is often used, for example, in training CNNs, which are used to recognize images and videos. Furthermore, as a hardware structure for realizing such machine learning, a neurochip / neuromorphic chip incorporating the concept of neural networks can be used.

[0095] The algorithm for training the learning model 36 is not limited, and any machine learning algorithm may be used. For example, machine learning algorithms include supervised learning, unsupervised learning, semi-supervised learning, reinforcement learning, inverse reinforcement learning, active learning, and transfer learning. Furthermore, machine learning models such as HMM (Hidden Markov Model) and SVM (Support Vector Machine) may also be used.

[0096] The learning model 36 generated by the learning unit 37 is incorporated into the recommended information output unit 8 shown in Fig. 1. Then, the recommended information output unit 8 estimates recommended information. The learning unit 37 shown in FIG. 8 may be mounted on an information processing device according to the present technology, such as the smartphone 5 shown in FIG. 1, and the learning of the learning model 36 may be performed by the information processing device according to the present technology. On the other hand, the learning unit 37 may be configured outside the information processing device according to the present technology. That is, learning may be performed in advance by the learning unit 37 outside the information processing device according to the present technology, and only the learned learning model 36 may be incorporated into the recommended information output unit 8. Furthermore, the specific configuration of the learning model 36 and the learning unit 37 for learning the learning model 36 is not limited.

[0097] The application of a machine learning algorithm may be performed for any process within the present disclosure, i.e., any process described within the present disclosure may be subjected to a process using machine learning.

[0098] [Recommendation output using extracted information] FIG. 9 is a schematic diagram showing an example of generating recommended information using a learning model that uses extracted information extracted from the performance state image 9 as an input. 9, it is possible to estimate recommended information by performing machine learning using extracted information extracted from the performance state image 9 as input. For example, the various extracted information described above can be used. In this case, the extracted information extracted from the performance state image 9 is input to the trained learning model 40, which has undergone machine learning to estimate the recommended information, and a process is executed to obtain the recommended information from the learning model 40. This makes it possible to generate and output the recommended information with high accuracy.

[0099] FIG. 10 is a schematic diagram for explaining learning of the learning model 40 using teacher data. In this embodiment, the extracted information 41 extracted from the performance state image 9 is used as learning data. Data in which the learning data is associated with recommended information (teaching label 42) is used as teaching data. Therefore, the learning model 40 is a prediction model that is machine-learned using the extracted information 41 extracted from the performance state image 9 and the recommended information as training data. 10, the learning unit 43 uses the training data and executes learning based on a machine learning algorithm, thereby generating a learning model 40. The algorithm for training the learning model 40 is not limited, and any machine learning algorithm may be used.

[0100] The various types of recommended configuration information and recommended physical information described above are associated as recommended information (labels 42) used as training data, and the learning model 40 is trained. This makes it possible to output the various types of recommended configuration information and recommended physical information described above by processing using machine learning. In other words, it becomes possible to acquire various types of recommended information from the learning model 40.

[0101] When creating training data, it is important to use extracted information that is correlated with the recommended information (recommended configuration information and recommended physical information) to be output as extracted information 41 for learning (learning data). For example, extracted information that is found to have a correlation with the recommended configuration information to be output is used as the extracted information for learning 41. Specifically, extracted information related to parts whose positions, heights, etc. are to be adjusted by the recommended configuration information, or extracted information related to other objects that serve as a reference when defining the recommended state, can be used as the extracted information for learning 41 (learning data). In addition, various extracted information that can be used to determine whether the position, etc. of each part of the drum instrument 3 is in the recommended state can be used as the extracted information for learning 41 (learning data). For example, a performance state image 9 that is recognized to have a correlation with the recommended configuration information to be output is selected as the performance state image 9 from which the information is extracted. From the performance state image 9, extracted information that is recognized to have a correlation with the recommended configuration information to be output can be used as extracted information 41 for learning (learning data). Then, the extracted information is associated with recommended configuration information that can lead the positions of each part in the performance state image 9 from which the information was extracted to a recommended state as a label 42. This makes it possible to create training data.

[0102] Furthermore, extracted information that is found to have a correlation with the recommended physical information to be output is used as extracted information for learning 41. Specifically, extracted information related to the body parts whose posture, etc. will be adjusted based on the recommended physical information, or extracted information related to other objects that serve as a reference when defining the recommended state can be used as extracted information for learning 41 (learning data). In addition, various extracted information that can be used to determine whether the posture, etc. of each body part of player 2 is in the recommended state can be used as extracted information for learning 41 (learning data). For example, a performance state image 9 that is correlated with the recommended physical information to be output is selected as the source performance state image 9. Extracted information that is correlated with the recommended physical information to be output from the performance state image 9 can be used as extracted information 41 for learning (learning data). Then, the extracted information is associated with recommended body information that can lead the posture of each body part in the performance state image 9 from which the extracted information was extracted to a recommended state as a label 42. This makes it possible to create training data.

[0103] FIG. 11 is a schematic diagram showing an example of generating recommendation information using a learning model that uses both the performance state image 9 and the extracted information as input. As shown in FIG. 11, it is possible to estimate recommended information by performing machine learning using both the performance state image 9 and the information extracted from the performance state image 9 as input. In this case, the performance state image 9 and the extracted information extracted from the performance state image 9 are input to a trained learning model 44 that has undergone machine learning to estimate recommended information, and a process of acquiring recommended information from the learning model 44 is executed. This makes it possible to generate recommended information with high accuracy.

[0104] FIG. 12 is a schematic diagram for explaining the learning of the learning model 44 using the training data. In this embodiment, a set of a learning performance state image 45 and extracted information 46 extracted from the learning performance state image 45 is used as learning data. Data in which this learning data is associated with recommended information (teaching label 47) is used as teaching data. Therefore, the learning model 44 is a prediction model that has been machine-learned using the performance state image 45, a set of extracted information 46 extracted from the performance state image 45, and the recommended information as training data. 12, the learning unit 48 uses the training data and executes learning based on a machine learning algorithm, thereby generating a learning model 44. The algorithm for training the learning model 44 is not limited, and any machine learning algorithm may be used. The various types of recommended configuration information and recommended physical information described above are associated as recommended information (labels 47) used as training data, and the learning model 44 is trained. This makes it possible to output the various types of recommended configuration information and recommended physical information described above by processing using machine learning. In other words, it becomes possible to acquire various types of recommended information from the learning model 44.

[0105] When creating training data, it is important to use a pair of performance state image 9 and extracted information that is correlated with the recommended information (recommended composition information and recommended physical information) to be output as the learning performance state image 45 and learning extracted information 46 (learning data). For example, a performance state image 9 that is recognized to have a correlation with the recommended composition information to be output is used as a learning performance state image 45. Further, extracted information that is recognized to have a correlation with the recommended composition information to be output, extracted from the learning performance state image 45, is used as extracted information 46 for learning. Then, recommended configuration information that can lead the position of each part in the learning performance state image 45 to a recommended state is associated with the set of the learning performance state image 45 and the learning extraction information 46 as a label 47. This makes it possible to create training data.

[0106] Furthermore, performance state image 9 that is found to have a correlation with the recommended physical information to be output is used as learning performance state image 45. Furthermore, extracted information that is found to have a correlation with the recommended physical information to be output and that is extracted from learning performance state image 45 is used as learning extracted information 46. Then, recommended physical information that can lead the posture of each body part in the learning performance state image 45 to a recommended state is associated with the pair of the learning performance state image 45 and the learning extraction information 46 as a label 47. This makes it possible to create training data.

[0107] In the examples shown in FIGS. 7 to 12, the performance state image 9 and the extracted information are input, and machine learning is executed to output the recommended information. Of course, this is not limiting, and machine learning may be performed using the various configuration information and various physical information exemplified above as inputs to output recommended information. In this case, training information corresponding to the information to be input to the learning model is associated with the recommended information to be output, and the training data is prepared. Then, the learning model can be trained using the training data. In other words, by inputting at least one of configuration information or physical information into a trained learning model that has undergone machine learning to estimate recommended information, it is possible to obtain recommended information from the learning model.

[0108] For example, it is possible to use any combination of configuration information and physical information as an input, as exemplified above, and output recommended information through machine learning. In this case, a learning model is constructed using the set of configuration information and physical information and the recommended information to be output as training data. Alternatively, machine learning can be performed using either the configuration information or the physical information as input to output recommended information. In this case, a learning model is constructed using either the configuration information or the physical information and the recommended information to be output as training data. That is, a learning model (prediction model) may be used that is machine-learned using at least one of the configuration information and the physical information, and the recommendation information as training data.

[0109] For example, a learning model may be constructed for each type of configuration information, and recommended information may be output by inputting physical information into the learning model. For example, a learning model may be constructed for each type or basic configuration of drum set 4. A learning model is then selected based on the configuration information (such as the type or basic configuration of drum set 4) input by player 2. Recommended information is output by inputting the physical information input by player 2 into the selected learning model. Such a configuration is also possible. Alternatively, a learning model may be constructed for each type of physical information, and recommended information may be output by inputting configuration information into the learning model. For example, a learning model may be constructed for each height classification of the player 2. For example, a learning model corresponding to a height of 100 cm to 120 cm, a learning model corresponding to a height of 120 cm to 140 cm, a learning model corresponding to a height of 140 cm to 160 cm, a learning model corresponding to a height of 160 cm to 180 cm, and a learning model corresponding to a height of 180 cm to 200 cm may be constructed. Then, a learning model is selected based on the height input by the player 2. The configuration information input by the player 2 is input into the selected learning model, and the recommended information is output. Such a configuration is also possible.

[0110] [Recommendation output (rule-based processing)] 13 to 15 are schematic diagrams showing output of recommendation information by processing using a rule base. As shown in FIGS. 13 to 15, the recommended information output unit 8 can also generate and output recommended information by processing using a rule base.

[0111] In the example shown in FIG. 13, the performance status image 9 is input and processing using a rule-based algorithm is executed, thereby generating and outputting recommendation information. In the example shown in FIG. 14, extracted information extracted from the performance state image 9 is used as input, and processing using a rule-based algorithm is executed to generate and output recommended information. In the example shown in Figure 15, recommended information is generated and output by using a rule-based algorithm to process both the performance state image 9 and the extracted information extracted from the performance state image 9 as input.

[0112] The input is not limited to the performance state image 9 or extracted information, but can also be any of the various configuration information and physical information exemplified above, and recommended information can be generated and output using rule-based processing. It is possible to use a set of configuration information and physical information as input, or to use either configuration information or physical information as input, and output recommended information through rule-based processing. There are no particular limitations on the specific algorithms and the like that are executed as rule-based processing. Any rule-based algorithm, such as matching technology, image recognition technology, or analysis technology, may be used.

[0113] [Semi-customized based on manufacturer standard values] 16 to 18 are schematic diagrams for explaining semi-customization based on manufacturer standard values. The manufacturer of the drum instrument 3 may create information indicating standard settings of the drum instrument 3, such as manufacturer standard values. This drum setting support system 1 allows for personal arrangement (semi-customization) for each performer 2, based on a standard configuration indicated by manufacturer standard values, etc. It is also possible to output recommended information that can guide the performer to easily reflect the semi-customized settings on the actual drum.

[0114] 16 to 18, semi-customization will be described using the height of the chair 27 as an example. Of course, semi-customization can be realized not only for the height of the chair 27, but also for various configurations related to the drum instrument 3 (drum set 4). 16, the recommended information output unit 8 performs semi-customization based on the manufacturer's standard value for the height of the chair 27 and the physical information of the player 2. Then, the height of the chair 27 is calculated as a result of the semi-customization. By presenting the height of the chair 27, semi-customized from the manufacturer's standard value, to the player 2, it becomes possible to reflect the semi-customized setting in the actual instrument. The manufacturer's standard values ​​can be obtained, for example, by accessing a database managed by the manufacturer.

[0115] 17, the recommended information output unit 8 may calculate difference information 50 between the manufacturer's standard value and the height of the semi-customized chair 27. By outputting the calculated difference information 50, it becomes possible to guide the setting from the standard configuration. As a result, it becomes possible to easily reflect the semi-customized setting in the actual chair. 18, the recommended information output unit 8 may calculate difference information 51 between the current setting (height of chair 27) and the height of semi-customized chair 27. By outputting the calculated difference information 51, it becomes possible to guide the user from the current setting to the semi-customized setting. As a result, it becomes possible to easily reflect the semi-customized setting in the actual device.

[0116] In the examples shown in FIGS. 16 to 18, the manufacturer standard values ​​are included in standard configuration information that indicates the standard configuration of a drum instrument. Furthermore, the manufacturer standard values ​​and information on the current settings are included in the configuration information acquired by the first acquisition unit 7. That is, the manufacturer standard values ​​are included in both the standard configuration information and the configuration information. The physical information of the player 2 shown in FIG. 16 is included in the physical information acquired by the first acquisition unit 7. The semi-customized setting information and the difference information 50 and 51 that guides the settings are included in the recommendation information output by the recommendation information output unit 8. That is, the recommended information output unit 8 can output, as recommended information, difference information from standard configuration information that indicates the standard configuration of the drum instrument 3.

[0117] [Example of recommended information output] 19 to 28 are schematic diagrams showing specific examples of output of recommendation information. 19 to 28, a form in which the recommended information is displayed on the touch panel 6 of the smartphone 5 will be described as a specific example of output of the recommended information.

[0118] For example, the performer 2 downloads an application (application program) for using the drum setting support system 1 to the smartphone 5. For example, the performer 2 inputs information such as an ID and a password to create an account for using the drum setting support system 1. Of course, it is not necessary to create an account.

[0119] The player 2 starts an application for using the drum setting support system 1 and inputs configuration information and physical information. For example, the performer 2 takes a performance status image 9 using a camera mounted on the smartphone 5. For example, the performer places the smartphone 5 in front of the drum set 4 and starts a video recording mode. Then, the performer plays the drum set 4 to take a performance status image 9. Of course, the performer 2 may have someone else take a video of the performer 2 playing the drums. Alternatively, the above-mentioned configuration information and physical information may be input via various GUIs displayed on the touch panel 6. Of course, voice input or the like may also be used.

[0120] The first acquisition unit 7 shown in FIG. 1 etc. acquires the configuration information and the physical information. The recommended information output unit 8 executes processes using machine learning as exemplified in Figures 7 to 12, or processes using a rule base as exemplified in Figures 13 to 15, and generates and outputs recommended information.

[0121] In the example shown in FIG. 19, a recommendation comment 10 is displayed on the touch panel 6. Specifically, "recommended comments about instrument placement" is displayed as recommended composition information, and "recommended comments about playing form" is displayed as recommended physical information. The comment may include, for example, the various recommended configuration information and various recommended physical information exemplified above. It is also possible to display information on the recommended state of the settings that the player 2 should aim for, and information on why such a state is recommended. The recommendation comment 10 may also be read aloud.

[0122] In the example shown in FIG. 20, the recommended configuration information displayed for "low tom and high tom adjustment" is a recommendation comment that says, "Raise the position and tilt it toward the front." Additionally, as recommended physical information, a recommended comment is displayed regarding the "thigh angle (chair height)" such as "set it so that your waist is slightly higher than your knees." 20, an AR display button 53 is displayed next to the recommendation comment regarding "low tom and high tom adjustment." An AR display button 54 is displayed next to the recommendation comment regarding "thigh angle (chair height)."

[0123] When the AR display button 53 shown in FIG. 20 is selected, for example, images (screens) shown in FIG. 21 and FIG. 22 are displayed in a switchable manner. 21 is a photographed image 55 of the high tom 14 and the low tom 15. The photographed image 55 is input as configuration information, and is an image showing the current setting state.

[0124] 22, a virtual image 56 of a drum set 4 is displayed as the recommended configuration information. The virtual image 56 is also called an AR image, and is superimposed on a real object. In this embodiment, a photographed image 55 of the high tom 14 and the low tom 15 shown in FIG. 21 is used as a real object, and a virtual image 57 of the high tom 14 and a virtual image 58 of the low tom 15 are displayed superimposed on each other. The virtual images 57 and 58 are images showing the recommended settings of the high tom 14 and the low tom 15 corresponding to the body of the performer 2. The virtual images 57 and 58 also correspond to the recommendation comment shown in FIG. 20 , which states, "Raise the position and tilt it toward you." The player 2 can intuitively understand the optimal setting (recommended setting) for his or her body by viewing the virtual images 57 and 58 superimposed on the actual high tom 14 and low tom 15. As a result, the player 2 can easily set the high tom 14 and low tom 15 to suit his or her body. In this way, the drum setting support system 1 can display the virtual image 56 of the drum instrument 3 as recommended configuration information so that it can be superimposed on the real object. This makes it possible to provide sufficient support for setting up the drum instrument 3 with high accuracy.

[0125] When the AR display button 54 shown in FIG. 20 is selected, for example, images (screens) shown in FIG. 23 and FIG. 24 are displayed in a switchable manner. 23 is a photographed image 60 including the thigh of the left leg 30 of the player 2. The photographed image 60 is input as body information, and is an image showing the current setting state.

[0126] 24, a virtual image 61 of the body of the player 2 is displayed as the recommended body information. The virtual image 61 is superimposed on the real object. In this embodiment, a photographed image 60 including thighs shown in Fig. 23 is used as a real object, and a virtual image 61 including thighs is superimposed and displayed. The virtual image 61 is an image showing the angle of the thighs that will result in the recommended posture of the performer 2. The virtual image 61 is also an image corresponding to the recommendation comment shown in Fig. 20, which says, "Please set your hips so that they are slightly higher than your knees." By viewing the virtual image 61 superimposed on the actual thighs, the player 2 can intuitively understand the optimal posture (recommended state) when playing the drum set 4. As a result, it becomes possible to easily set the optimal posture. Specifically, it becomes possible to easily set the chair 27 higher to optimize the angle of the thighs. In this way, the drum setting support system 1 can display the virtual body image 61 of the player 2 as recommended body information so that it can be superimposed on a real object. This makes it possible to provide sufficient support for setting up the drum instrument 3 with high accuracy.

[0127] In the example shown in FIG. 25, the smartphone 5 captures an image of the inside of a room in the real world, and the captured image 63 of the room is displayed on the touch panel 6. In the example shown in Fig. 26, a photographed image 63 of the room shown in Fig. 25 is used as a real object, and a virtual image 64 of the entire drum set 4 is superimposed and displayed. The virtual image 64 of the drum set 4 is an image generated as recommended configuration information, and represents the optimal setting state (recommended state) corresponding to the body of the player 2. For example, by inputting a touch operation on the touch panel 6, it is possible to enlarge / reduce the virtual image 64 of the drum set 4 in the recommended state and display it. By visually viewing the virtual image of the drum set 4 displayed in the room, the performer 2 can intuitively understand the optimal setting (recommended setting) for his or her own body. As a result, the performer 2 can easily set up each part of the drum set 4 to suit his or her own body. This makes it possible to fully support the setting up of the drum instrument 3 with high accuracy.

[0128] In the example shown in FIG. 27, both a virtual image 64 of the entire drum set 4 and a virtual image 65 of the entire body of the player 2 playing the drum set 4 are displayed on the touch panel 6. The virtual body image 65 of the player 2 is an image generated as recommended body information, and is an image showing the state in which the body of the player 2 is in the recommended state. That is, in the example shown in Figure 27, a drum set 4 in a recommended state corresponding to the body of the performer 2 and the performer 2 playing the drum set 4 in a posture that results in the recommended state are displayed in AR within an actual room. Of course, by inputting a touch operation on the touch panel 6, it is also possible to enlarge or reduce the virtual image 64 of the drum set 4 and the virtual image 65 of the body. By viewing the virtual image 64 of the drum set 4 and the virtual image 65 of the body of the player 2 displayed in the room, the player 2 can intuitively understand the optimal setting state (recommended state) for the configuration of the drum set 4 and the body of the player 2. As a result, it becomes possible to easily perform settings that will enable ideal performance, thereby providing sufficient support for setting up the drum instrument 3 with high accuracy.

[0129] 28, a performance status image 9 is displayed on the touch panel 6. Virtual images showing the state of each part of the drum set 4 and the state of each body part of the player 2 are superimposed on this performance status image 9 as a real object. Specifically, a virtual image 66a showing the posture of the torso of the player 2 and a virtual image 66b showing the posture (angle) of the thigh of the left leg 30 are displayed. Also displayed are a virtual image 67a showing the difference in height between the hi-hat cymbal 17 and the snare drum 13, a virtual image 67b showing the attitude (position, height, and inclination) of the high tom 14, and a virtual image 67c showing the attitude (position, height, and inclination) of the crash cymbal 18a. In this way, virtual images 66a and 66b showing the state of each part of the drum set 4 and virtual images 67a to 67c showing the state of each body part of the player 2 may be displayed as recommended information. The virtual images 66a and 66b showing the state of each part of the drum set 4 are information included in the recommended configuration information. The virtual images 67a to 67c showing the state of each body part of the player 2 are information included in the recommended body information. By visually checking each virtual image shown in FIG. 28, the player 2 can easily grasp the current setting state, and can easily realize the optimum setting.

[0130] Of course, instead of or in addition to the virtual images shown in FIG. 28, virtual images showing the state of each part in the drum set 4 that is in the recommended state may be displayed. For example, instead of or in addition to the virtual image 66a showing the current posture of the torso of the player 2, a virtual image showing the posture of the torso of the player 2 in a recommended state may be displayed. Furthermore, instead of or in addition to the virtual image 67 showing the difference in height between the current hi-hat cymbal 17 and snare drum 13, a virtual image showing the difference in height between the hi-hat cymbal 17 and snare drum 13 in a recommended state may be displayed. These virtual images are also included in the recommendation information (recommended configuration information and recommended physical information). By visually checking the virtual images of the recommended states, the player 2 can easily achieve the optimum settings.

[0131] The form in which a virtual image is superimposed on a photographed image can also be considered as an AR representation in which a virtual image is superimposed on a real object displayed in the photographed image. Furthermore, virtual images may be displayed as recommended information without being superimposed on real objects. For example, virtual images of each part of the drum set 4 in a recommended state or virtual images of each body part of the player 2 in a recommended state may be displayed without being superimposed on real objects. Even in this case, the player 2 can easily achieve the optimal settings by viewing the virtual images.

[0132] When setting up the drum instrument 3, it may be necessary to assemble the individual parts of the drum instrument 3 by placing them in order. For example, when setting up the drum set 4 illustrated in FIG. 4 etc., the following arrangements (arrangement steps) may be performed in this order. Arrangement of 27 chairs Bass drum 12 placement (kick pedal 20 installation) Snare drum 13 placement Hi-hat cymbal 17 (hi-hat stand 23 (hi-hat pedal 21)) placement Positioning of High Tam 14 and Low Tam 15 Floor tom 16 placement Placement of crash cymbals 18a and 18b Ride cymbal 19 placement

[0133] The drum setting support system 1 can output recommended information according to the actions of the performer 2 in arranging the parts of the drum instrument 3 (drum set 4) in order. Of course, when applying this technology, the order in which the parts are arranged is not limited, and the parts may be arranged in any order.

[0134] For example, as shown in FIG. 25, a smartphone 5 is fixed and a moving image of the inside of a room in the real world is captured. The performer 2 sequentially arranges each part of the drum set 4. For example, as described above, the chair 27, bass drum 12 (kick pedal 20), hi-hat cymbal 17 (hi-hat stand 23 (hi-hat pedal 21)), high tom 14, low tom 15, floor tom 16, crash cymbals 18a and 18b, and ride cymbal 19 are arranged in this order in the room. A captured image (moving image) showing the arrangement of each part of the drum set 4 is acquired by the first acquisition unit 7 as the configuration information and the body information. Then, recommended information is output according to the action of arranging each part in order by the player 2. For example, it is possible to output the various recommended composition information and recommended physical information described above. In addition, information may be output to guide the placement of each part in order, such as "First, place chair 27 and sit down," "Next, place the bass drum and place your foot on the kick pedal," and "Place the snare drum and hold the sticks and get ready."

[0135] First, when the chair 27 is arranged, it is possible to output recommended configuration information regarding the position and height of the chair 27, recommended body information regarding the angle of the thighs when sitting on the chair 27, and the like.

[0136] Next, when the bass drum 12 is positioned, it is possible to output, for example, recommended configuration information regarding the position and inclination of the bass drum 12. It is also possible to output recommended physical information regarding the positional relationship between the bass drum 12 and the foot playing the bass drum 12, and recommended physical information regarding the angle of the shin of the foot playing the bass drum 12.

[0137] Next, when the snare drum 13 is positioned, it is possible to output, for example, recommended configuration information regarding the position, height, and inclination of the snare drum 13. It is also possible to output recommended physical information regarding the positional relationship between the snare drum 13 and the torso, the positional relationship between the upper arms and the torso when playing the snare drum, and the height relationship between the snare drum 13 and the elbows and knees.

[0138] Next, when the hi-hat cymbal 17 (hi-hat stand 23 (hi-hat pedal 21)) is positioned, it is possible to output, for example, recommended configuration information regarding the position and height of the hi-hat cymbal 17, recommended configuration information regarding the difference in height between the snare drum 13 and the hi-hat cymbal 17, etc. It is also possible to output recommended physical information regarding the positional relationship between the hi-hat cymbal 17 and the foot playing the hi-hat cymbal 17, recommended physical information regarding the angle of the shin of the foot playing the hi-hat cymbal 17, etc.

[0139] Next, when the toms (high tom 14 and low tom 15) are positioned, it is possible to output, for example, recommended configuration information regarding the position, height, and inclination of the toms, and recommended physical information regarding the positional relationship between the toms and the arms.

[0140] Next, when the floor tom 16 is positioned, it is possible to output, for example, recommended configuration information regarding the position, height, and inclination of the floor tom 16, and recommended physical information regarding the positional relationship between the floor tom 16 and the torso.

[0141] Next, when the cymbals (crash cymbals 18a and 18b, ride cymbal 19) are positioned, it is possible to output, for example, recommended configuration information regarding the position, height, and tilt of the cymbals, and recommended physical information regarding the positional relationship between the cymbals and the arms.

[0142] For example, in response to the action of placing each part, a virtual image of each part in a recommended state is displayed on the touch panel 6. By visually checking the virtual image of each part displayed on the touch panel 6, the performer 2 can easily set each part in the optimal state (recommended state) for his or her body. As a result, it is possible to provide sufficient support for setting up the drum instrument 3 with high accuracy. Of course, the output of recommendation information is not limited to the display of a virtual image, and other forms of output, such as the display of recommendation comments, may also be executed.

[0143] As an embodiment of the information processing device according to the present invention, it is assumed that AR glasses (HMD) that can be worn on the head of the player 2 are used. In this case, it is possible to display recommended information (recommended composition information and recommended physical information) on the display unit of the AR glasses. For example, assume that a player 2 is playing a drum instrument 3 that is currently set up. When the drum instrument 3 and the body of the player 2 are in the field of view of the player 2, it is also possible to superimpose a virtual image of the drum instrument 3 and a virtual image of the body of the player 2 as recommended information, with the drum instrument 3 and the body of the player 2 as real objects. The player 2 can easily achieve the optimal settings while viewing the virtual image displayed on the display unit of the AR glasses.

[0144] As an embodiment of the information processing device according to the present invention, it is assumed that VR glasses (HMD) that can be worn on the head of the performer 2 are used. In this case, it is possible to display recommended information (recommended configuration information and recommended physical information) on the display unit of the VR glasses. For example, suppose that a player 2 is playing a drum instrument 3 that is currently set up. On the display unit of the VR glasses, 3D model images of the drum instrument 3 and the body of the player 2 are displayed as virtual images (VR images) corresponding to the actual positions of the drum instrument 3 and the body of the player 2. Also displayed is recommended information for setting the drum instrument 3 and the body of the player 2 to a recommended state. Alternatively, the display of the VR glasses displays a captured image of the actual drum instrument 3 and the body of the player 2. Then, recommended information is displayed for setting the drum instrument 3 and the body of the player 2 to a recommended state. This type of form is also called a video see-through AR representation. The performer 2 can easily achieve the ideal settings in various virtual spaces while visually checking the recommended information displayed on the display unit of the VR glasses.

[0145] As described above, the drum setting support system 1 and smartphone 5 according to this embodiment output recommended setting information corresponding to the player 2 based on configuration information about the drum instrument 3 (drum set 4) and physical information about the player 2's body. This makes it possible to support the setting of the drum instrument 3.

[0146] A drum instrument 3 such as a drum set 4 has a high degree of freedom in settings, and the settings are often left up to the performer 2 (user). The high degree of freedom in settings is one of the attractions of drum instruments, as they can be adapted to various performance styles. On the other hand, there is no clear correct answer (goal) when it comes to settings, so for example, beginners without knowledge may not know how to set up, and it may take a long time before they can play (or they may not be able to reach a state where they can play). Even for intermediate and advanced riders, there are many different opinions regarding settings, and it can often be difficult to choose the best settings for you. Even if a performer 2 (such as a professional performer) has a set ideal for themselves, it may be difficult to reproduce their preferred settings in a short period of time.

[0147] With this drum setting support system 1, it is possible to guide the performer 2 to the optimal setting for the drum instrument 3 (drum set 4), which has a high degree of freedom in setting, and to improve reproducibility. As a result, it is possible to shorten the time it takes for the performer 2 to set up before starting to play. In other words, it is also possible to minimize the preparation time before starting to play. Furthermore, this drum setting support system 1 allows for individual arrangements (semi-customization) for each performer 2 based on a standard configuration indicated by manufacturer standard values, etc. It is then possible to provide guidance that makes it easy to reflect the semi-customized settings on the actual drums.

[0148] By applying this drum setting support system 1, it is possible to support the performer 2 who has no knowledge about "drum settings that suit him or her." For example, since each performer 2 has a different physique and musical preferences, the ideal state for the settings often differs as well. For example, a semi-customized setting is provided to the performer 2 based on a standard configuration indicated by manufacturer standard values, etc. For performer 2, it is possible to use the semi-customized settings as a standard and further explore his or her ideal settings, which greatly reduces the preparation time required to perform in the ideal state, and deepens the attachment to drum instrument 3. Furthermore, beginners and others who lack knowledge may end up playing with incorrect settings. In other words, they may start playing without knowing whether the settings are wrong or whether a part is broken. This drum setting support system 1 can also alert a performer 2 who is playing with incorrect settings to an abnormal condition, thereby providing a more comfortable playing environment for the performer 2.

[0149] In this way, the drum setting support system 1 can provide appropriate support to the performer 2, from a state where the performer himself does not know what is wrong to an optimal setting. Furthermore, the performer 2 can enjoy playing the drum instrument 3 with peace of mind by receiving a seal of approval that "this is good enough." For example, in a situation where a student is being instructed on how to play the drum instrument 3, the drum setting support system 1 can present one correct answer regarding the setting. Presenting such a correct answer is considered to be effective when instructing how to play the drum instrument 3.

[0150] Furthermore, as shown in Figure 1, this drum setting support system 1 can be configured using a single smartphone 5, making it possible to provide efficient setting support appropriate for a wide range of performers 2, from professional drummers to amateur drummers (including beginners), depending on their level.

[0151] <Other embodiments> The present invention is not limited to the above-described embodiment, and various other embodiments can be realized.

[0152] [Recommendation information output using the movable range of each part] The first acquisition unit 7 may acquire information about the movable range of each part included in the drum instrument 3 as configuration information. The information regarding the movable range includes any information that can derive an adjustable range regarding the position, height, posture, relative positional relationship, etc. of each part included in the drum instrument 3. For example, the information regarding the movable range includes the following information:

[0153] Information indicating the range of movement For example, information on the range (area) in which the seat of chair 27, the striking surfaces of each drum, each cymbal, etc. can be placed / moved in a three-dimensional space in which a predetermined coordinate system is set may be acquired. For example, the range in which the height can be adjusted, the range in which the angle can be adjusted, the range in which the position when viewed from above can be adjusted, etc. may be acquired using position information such as coordinates.

[0154] Types of stands and holders The movable range of each part supported (held) by a stand or holder often differs depending on the configuration of each stand or holder. For example, the cymbal stand 24a shown in Fig. 29 is a so-called straight-type cymbal stand. As shown in Fig. 29, in the cymbal stand 24a, the crash cymbal 18 is attached to the upper end of a pipe sleeve 49a extending in the vertical direction via a chiller 49b. The player 2 can adjust the height of the crash cymbal 18 by adjusting the length of the pipe sleeve 49a, which is located at approximately the same position as the center of the crash cymbal 18. The player 2 can also adjust the posture (tilt) of the crash cymbal 18 by adjusting the chiller 49b. In the straight-type cymbal stand 24a, the height and attitude (tilt) of the crash cymbal 18 are adjusted while the center position of the crash cymbal 18 is maintained near the upper tip of the pipe sleeve 49a.

[0155] The cymbal stand 24b shown in Figure 30 is a so-called boom-type cymbal stand. As shown in Figure 30, in the cymbal stand 24b, a boom arm 52c is attached to the upper end of a pipe sleeve 52a extending in the vertical direction via a tiller 52b. The crash cymbal 18 is then attached to the end of the boom arm 52c via a tiller 52d. The player 2 can adjust the height of the crash cymbal 18 by adjusting the length of the pipe sleeve 52a that extends in the vertical direction. The player 2 can also adjust the posture (tilt) of the crash cymbal 18 by adjusting the chiller 52d. Furthermore, the performer 2 can adjust the connection position of the boom arm 52c relative to the pipe sleeve 52a and the angle of the boom arm 52c by adjusting the chiller 52b. That is, with the boom-type cymbal stand 24b, the height and attitude (tilt) of the crash cymbal 18 can be adjusted with the center position of the crash cymbal 18 significantly shifted from the upper tip of the pipe sleeve 49a.

[0156] In this way, the movable range of each part is often determined by the configuration of each stand, the configuration of each holder, the configuration of the legs that support the drum, etc. Therefore, information such as the configuration of each stand (model number, type, etc.), the configuration of each holder (model number, type, etc.), and the configuration of the legs that support the drum (model number, type, etc.) can be used as information regarding the movable range.

[0157] For example, from a captured image including the configuration of the drum instrument 3, such as a performance state image 9 or an image capturing only the drum set 4, it is possible to extract information about the movable range, such as the configuration of each stand (model number, type, etc.), the configuration of each holder (model number, type, etc.), and the configuration of the legs that support the drums (model number, type, etc.). In this case, the information about the movable range is included in the extracted information. Furthermore, the performer 2 may input information such as the configuration of each stand (model number, type, etc.), the configuration of each holder (model number, type, etc.), and the configuration of the legs that support the drum (model number, type, etc.), and acquire this information as information about the movable range. In this case, the information about the movable range is included in the input information.

[0158] The recommended information output unit 8 is capable of outputting recommended information based on the information relating to the movable range acquired by the first acquisition unit 7. For example, based on information about the movable range, the adjustable range is calculated for the position, height, posture, relative positional relationship, etc. of each part of the drum instrument 3. Then, within the adjustable range of each part, it is possible to output recommended information about the optimal configuration of each part for the body of the player 2. This makes it possible to present highly accurate recommended information that is more precisely tailored to the physique of the performer 2. For example, it is possible to avoid a problem such as presenting recommended information for a configuration that can only be realized with the boom-type cymbal stand 24b, even though the performer 2 is currently using the straight-type cymbal stand 24a. Information regarding the movable range may be presented to the player 2 as recommended information.

[0159] It is assumed that the recommended information output unit 8 executes a process using machine learning as exemplified in Fig. 7 to Fig. 12. In this case, the recommended information may be output using a learning model that has been machine-learned using information related to the movable range as training data. This makes it possible to use machine learning to provide highly accurate recommended settings that are actually achievable and tailored to the physique of performer 2.

[0160] FIG. 31 is a block diagram showing another example of the functional configuration of the smartphone 5. The smartphone 5 shown in FIG. 31 further includes a second acquisition unit 69 and a third acquisition unit 70 as functional blocks. The second acquisition unit 69 and the third acquisition unit 70 are configured, for example, by a CPU or the like executing a predetermined program, similar to the first acquisition unit 7 and the recommended information output unit 8. Of course, dedicated hardware such as an IC (integrated circuit) may be used to realize the second acquisition unit 69 and the third acquisition unit 70.

[0161] The second acquisition unit 69 acquires information relating to the player's desired settings realized by the player 2. The information about the desired settings is information about the results of customization to achieve the personally desired settings by the player 2. Hereinafter, the information about the desired settings will be referred to as personal customization information. For example, recommended information is output by the drum setting support system 1. For example, semi-customized setting information is provided to the performer 2 based on a standard configuration indicated by manufacturer standard values ​​or the like. The player 2 further adjusts the position, height, posture, etc. of each part of the drum instrument 3 from the semi-customized setting provided by the drum setting support system 1 to achieve the setting he or she desires. The second acquisition unit 69 acquires personal customization information, which is information resulting from further personal customization by the player 2. For example, the player 2 inputs that the desired setting has been achieved. The second acquisition unit 69 acquires information on the personally customized setting as personal customization information in accordance with the input from the player 2. Information on how the player 2 moved each part to achieve the desired setting may also be acquired as personal customization information. Alternatively, when the performer 2 starts playing without any input from the performer 2, information on the settings at that time may be acquired as personal customization information. Of course, information on how each part was moved before the performance started may also be acquired as personal customization information.

[0162] The recommended information output unit 8 is capable of outputting recommended information based on the personal customizing information acquired by the second acquisition unit 69. For example, recommended configuration information and recommended body information are output based on the desired settings that have been achieved through personal customization by the player 2. This allows the player 2 to easily reproduce the settings that he or she has personally customized the next time he or she plays the drum instrument 3. For example, a performer 2 (such as a professional performer) who has a set ideal for his or her own performance can quickly reproduce his or her preferred settings.

[0163] It is assumed that the recommended information output unit 8 executes a process using machine learning as exemplified in Fig. 7 to Fig. 12. In this case, the recommended information may be output using a learning model that has been machine-learned using personally customized information (information on desired settings) as training data. This makes it possible to use machine learning to reproduce with high accuracy the desired settings that the player 2 has personally customized.

[0164] The third acquiring unit 70 acquires response information to a questionnaire about playing the drum instrument 3 input by the player 2. For example, a questionnaire regarding favorite musicians, favorite music genres, favorite settings, drum playing experience, playing level (beginner / intermediate / advanced / professional, etc.), playing environment, etc. is displayed on the touch panel 6. The performer 2 can input answer information to the questionnaire by performing touch operations on the touch panel 6, etc. There are no particular limitations on the form in which the questionnaire is presented to the performer 2, and any GUI may be configured. Also, a form other than a GUI display may be adopted, such as voice input in response to a voice announcement.

[0165] The recommended information output unit 8 is capable of outputting recommended information based on the response information acquired by the third acquisition unit 70. For example, the configuration information and physical information acquired by the first acquisition unit 7 may be updated (corrected) based on the answer information. For example, the configuration information acquired from the captured image of the drum instrument 3 is updated based on the answer information about the preferred setting. This makes it possible to provide assistance with drum setting using highly accurate configuration information. Furthermore, the recommended state that is used as a reference when generating the recommended information may be updated (corrected) based on the answer information. For example, the recommended state may be updated to be closer to the settings of a favorite musician. This makes it possible to achieve settings that are in line with the preferences of the performer 2. It is also possible to adjust the recommended state based on the performance level of the performer 2. It is also possible to update the recommended state based on the preferred genre. For example, for a performer 2 who likes songs with a very fast BPM (Beats Per Minute), a setting that is advantageous for fast performance is set as the recommended state. For example, a setting that makes the chair 27 relatively high so that detailed performance of the bass drum 12 (kick pedal 20) is possible is set as the recommended state. On the other hand, for a performer 2 who prefers songs with a slow BPM (Beats Per Minute), a setting that emphasizes power is set as the recommended state. For example, a setting that makes the chair 27 relatively low so that the bass drum 12 (kick pedal 20) can be played loudly is set as the recommended state. Of course, the present invention is not limited to such settings, and the recommended heights of the snare drum 13 and hi-hat cymbals 17 may be set as appropriate to make it easier to play songs of a preferred genre.

[0166] It is assumed that the recommended information output unit 8 executes a process using machine learning as exemplified in Figures 7 to 12. In this case, a learning model that has been machine-learned using the answer information as training data may be used to output the recommended information. Alternatively, the learning model to be used may be appropriately selected based on the answer information. This makes it possible to use machine learning to achieve highly accurate settings that match the preferences of performer 2.

[0167] In this embodiment, the third acquiring unit 70 functions as a response information acquiring unit. The response information to the questionnaire can also be considered as the preference information of the performer 2.

[0168] In the drum setting support system 1, the recommended information output for each performer 2 and the recommended conditions set for each performer 2 may be stored in association with identification information (ID) that can identify the performer 2. The information may then be read and output as appropriate in response to an instruction from the performer 2 or another user. For example, information on settings semi-customized by the drum setting support system 1 for a certain performer 2, or information on settings that the performer 2 has personally customized, is stored as recommended information. In a studio or concert venue where a performer 2 is to play a drum instrument, a staff member or drum tech accesses the drum setting support system 1 and reads out the setting information associated with the performer 2. Then, the drum instrument 3 is set up according to the read-out setting information. This significantly reduces the time it takes for the performer 2 to start performing in a studio or concert venue. The performer 2 can immediately start playing the drum instrument 3 with the optimal settings for themselves in the studio or concert venue. As a result, it is possible to significantly reduce the time required for rehearsals and preparations before a performance, which is advantageous for achieving a good performance at the actual performance. Furthermore, practice studios and the like can appeal to their customers as added value, which can lead to increased sales.

[0169] Furthermore, a history of information on optimal settings for the performer 2 may be stored and read out and output in response to an instruction from the performer 2 or another user. Checking the history of optimal setting information can be useful for improving your performance on the drum instrument 3. It can also be used as a reference when determining the direction you should aim for.

[0170] FIG. 32 is a schematic diagram showing an example of the configuration of an electronic drum. 32 includes a stand (rack) 73, a kick unit (bass drum unit) 74, a snare unit 75, and a hi-hat unit 76. Although not shown, the electronic drum 72 also includes a chair on which the performer 2 sits when playing. Pads 77a for the high tom, low tom, and floor tom, and pads 77b for the crash cymbal and ride cymbal are detachably attached to the stand 73, and a controller 78 is also attached. The kick unit 74 has a bass drum pad 79 and a kick pedal 80 . The snare unit 75 has a snare stand 81 and a pad 82 for the snare drum. The hi-hat unit 76 includes a pad 83 for a hi-hat cymbal, a hi-hat stand 84, and a hi-hat pedal 85.

[0171] Each pad is provided with a strike sensor (not shown). The strike sensor detects a strike via vibrations corresponding to the performance (strike) of each pad by the player 2, and outputs the detected strike to the controller 78 as a strike signal. The controller 78 generates and outputs performance sounds (hit sounds) based on the hit signals output from the hit sensors of each pad. For example, when pads 77a located at the high tom, low tom, and floor tom positions are played, the controller 78 generates and outputs performance sounds for the high tom, low tom, and floor tom. In response to performance on pads 77b arranged at the positions of the crash cymbal and ride cymbal, performance sounds of the crash cymbal and ride cymbal are generated and output. In response to performances on a bass drum pad 79, a snare drum pad 82, and a hi-hat cymbal pad 83, performance sounds of the bass drum, snare drum, and hi-hat cymbal are generated and output. By operating the controller 78, the performer 2 can finely control the tone, response, length, etc. of the sound produced by each pad.

[0172] The present technology can also be applied to the setting of an electronic drum 72 as shown in Fig. 32. That is, using the present drum setting support system 1, it is possible to output recommended configuration information regarding the position, height, posture, etc. of pads 77a and 77b relative to the stand 73. It is also possible to output recommended configuration information regarding the position and height of the chair, the position of the kick unit 74, the position of the snare stand 81, the height of the snare drum pad 82, the position of the hi-hat stand 84, the height of the hi-hat stand cymbal pad 83, etc. It is also possible to output recommended physical information about the player's 2 body that is recommended when playing the electronic drum 72. As a result, the above-mentioned effects can be similarly achieved, and the setting of the electronic drum 72 can be fully supported. For example, it is possible to assist the setting by providing a recommended setting that suits the body of the player 2 after the pads 77a and 77b have been temporarily assembled on the stand 73.

[0173] The learning of the learning model by the learning unit as exemplified in Figures 8, 10, and 12 can be realized by an arbitrary computer such as a PC. That is, the generation device according to the present technology for generating a trained learning model that has undergone machine learning for estimating recommendation information can be realized by an arbitrary computer. For example, it is possible to cause a processor of a computer to execute a generation method relating to the present technology for generating a trained learning model that has undergone machine learning to estimate recommendation information, based on a generation program relating to the present technology for generating a trained learning model that has undergone machine learning to estimate recommendation information.

[0174] For example, the generation device according to the present technology may have the following configuration example. (1) A generation device that uses as input at least one of configuration information regarding the configuration of a drum instrument or physical information regarding the body of a player playing the drum instrument, and generates a trained learning model for estimating recommended information corresponding to the player regarding settings when playing the drum instrument. (2) The generating device according to (1), generating the learning model by performing machine learning using at least one of the configuration information and the physical information and the recommendation information as training data; generator. (3) The generating device according to (1), The learning model is generated by performing machine learning using an image of the performer playing the drum instrument and the recommendation information as training data. generator. (4) The generating device according to (1), The learning model is generated by performing machine learning using the extracted information extracted from the image of the performer playing the drum instrument and the recommended information as training data. generator. A method for executing the processes described above in (1) to (4) can be cited as an example of a generating method according to the present technology, and a program for executing the processes described above in (1) to (4) can be cited as an example of a generating program according to the present technology. Of course, the generating device, generating method, and generating program according to the present technology are not limited to the above (1) to (4).

[0175] The learning units exemplified in Fig. 8, Fig. 10, and Fig. 12 may be mounted on an information processing device according to the present technology, such as the smartphone shown in Fig. 1. In this case, the information processing device according to the present technology also functions as a generation device according to the present technology. In this case, a learning stage in which a learning model is trained and an execution stage in which recommendation information is output using the learning model are executed by one device (system).

[0176] On the other hand, a generation device according to the present technology may be configured by a computer separate from the information processing device according to the present technology, and the generation method according to the present technology may be executed based on a generation program according to the present technology. In this case, the trained model generated by the generation device is incorporated into a recommendation information output unit of the information processing device according to the present technology. In this case, the learning stage in which the learning model is trained and the execution stage in which recommendation information is output using the learning model are executed by a plurality of different devices (systems).

[0177] It should be noted that "teaching data" can also be expressed as "training data." Furthermore, the expression "learning a model" can also be replaced with the expression "training a model." For example, the expression "a computer uses training data to train a learning model" can be replaced with the expression "a computer uses training data to train a learning model."

[0178] Another embodiment of the drum setting support system according to the present technology may be a configuration in which either configuration information or physical information is acquired, and recommended information (recommended configuration information or recommended physical information) is output based on the acquired configuration information or physical information. For example, only the configuration information may be acquired, and the recommended information (recommended configuration information or recommended physical information) may be output based on the configuration information. Alternatively, only the physical information may be acquired, and the recommended information (recommended configuration information or recommended physical information) may be output based on the physical information. For example, information about the physical characteristics of a performer may be set as default (such as average height and weight), and recommended information may be output in response to the input of only the configuration information. Alternatively, recommended information may be output in response to the input of only the configuration information, assuming a performer with an average physical shape. Additionally, information regarding the type of drums may be set as default (type, name, manufacturer, product number, etc.), and recommended information may be output in response to input of only physical information. For example, as a service for playing a certain drum set, recommended information regarding the settings for playing that drum set may be output in response to input of only the player's physical information. Additionally, for the various pieces of configuration information listed above, related recommendation information may be output in response to input of only the configuration information.Furthermore, for the various pieces of physical information listed above, related recommendation information may be output in response to input of only the physical information.

[0179] Guide information may be output to guide the shooting when taking the performance state image 9, the captured image of the drum instrument 3, and the captured image of the performer 2. For example, information that allows the performer 2 to understand how to shoot, such as "take the photo from the front of the drum set," "take the photo from behind the performer so that the entire snare drum is included," or "take the photo so that the entire body is included," may be output as guide information.

[0180] 1, a smartphone 5 is used as an embodiment of the information processing device according to the present technology. That is, a computer having an imaging function is used as an embodiment of the information processing device according to the present technology. Without being limited to this, it is also possible to realize the drum setting support system 1 using an imaging device and a computer such as a PC that are connected to each other wirelessly or via a wire so that they can communicate with each other. When an imaging device and a computer that can communicate with each other are used, the computer functions as one embodiment of the information processing device related to the present technology. The connection between the imaging device and the computer is not limited, and it is possible to use, for example, wireless LAN communication such as WiFi or short-range wireless communication such as Bluetooth (registered trademark).

[0181] Furthermore, in step 101 shown in FIG. 2, if information other than the captured image and the extracted information extracted from the captured image is acquired as configuration information or physical information, it is also possible to realize an embodiment of the drum setting support system according to the present technology using a computer that does not have an imaging function. That is, an embodiment of the drum setting support system according to the present technology may not be provided with an imaging function.

[0182] FIG. 33 is a block diagram showing an example of the hardware configuration of a computer 87 that can be used as an information processing device according to the present technology. The computer 87 includes a CPU 88, a ROM 89, a RAM 90, an input / output interface 91, and a bus 92 that interconnects these components. The input / output interface 91 is connected to a display unit 93, an input unit 94, a storage unit 95, a communication unit 96, a drive unit 97, and the like. The display unit 93 is a display device that uses, for example, a liquid crystal display, an electroluminescent display, etc. The input unit 94 is, for example, a keyboard, a pointing device, a touch panel, or other operating device. When the input unit 94 includes a touch panel, the touch panel can be integrated with the display unit 93. The storage unit 95 is a non-volatile storage device such as a HDD, flash memory, or other solid-state memory. The drive unit 97 is a device capable of driving a removable storage medium 98 such as an optical storage medium or magnetic recording tape. The communication unit 96 is a modem, router, or other communication device that can be connected to a LAN, WAN, or the like and that communicates with other devices. The communication unit 96 may communicate either wired or wirelessly. The communication unit 96 is often used separately from the computer 87. Information processing by the computer 87 having the above hardware configuration is realized by software stored in the storage unit 95, ROM 89, etc., working in cooperation with the hardware resources of the computer 87. Specifically, the information processing method according to the present invention is realized by loading a program constituting the software stored in the ROM 89, etc., into the RAM 90 and executing the program. The program is installed in the computer 87 via, for example, a recording medium 98. Alternatively, the program may be installed in the computer 87 via a global network or the like. Any other computer-readable non-transitory storage medium may be used.

[0183] The information processing method (drum setting support method) and program of the present invention may be executed by multiple computers connected to each other so as to be able to communicate via a network or the like, thereby constructing an information processing device of the present invention. That is, the information processing method and program according to the present invention can be executed not only in a computer system configured by a single computer, but also in a computer system in which a plurality of computers operate in conjunction with each other. In this disclosure, a system refers to a collection of multiple components (devices, modules (components), etc.), regardless of whether all the components are in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device housed in a single housing with multiple modules, are both systems. The execution of the information processing method and program according to the present invention by a computer system includes both cases where the acquisition of configuration information and physical information, output of recommended information, acquisition of captured images, extraction of extracted information, acquisition of information on desired settings, acquisition of answer information, etc. are performed by a single computer, and cases where each process is performed by a different computer. Furthermore, the execution of each process by a specific computer includes having another computer execute part or all of the process and obtaining the results. That is, the information processing method and program according to the present invention can also be applied to a cloud computing configuration in which a single function is shared and processed jointly by a plurality of devices via a network.

[0184] The drum setting support system, information processing device, smartphone, and GUI for outputting recommended information described with reference to the drawings, as well as the process flows for generating and outputting recommended information, are merely exemplary embodiments and may be modified as desired without departing from the spirit of the present invention. In other words, any other configurations, algorithms, etc. may be employed to implement the present invention.

[0185] In this disclosure, to facilitate understanding of the explanation, words such as "approximately," "almost," and "roughly" may be used as appropriate. However, there is no clear difference between using and not using words such as "approximately," "almost," and "roughly." That is, in the present disclosure, concepts that define shape, size, positional relationship, state, etc., such as "center," "central," "uniform," "equal," "same," "orthogonal," "parallel," "symmetrical," "extended," "axial direction," "cylindrical," "cylindrical," "ring-shaped," and "annular," are concepts that include "substantially center," "substantially central," "substantially uniform," "substantially equal," "substantially the same," "substantially orthogonal," "substantially parallel," "substantially symmetrical," "substantially extended," "substantially axial direction," "substantially cylindrical," "substantially cylindrical," "substantially ring-shaped," "substantially annular," and the like. For example, this also includes states that fall within a specified range (for example, a range of ±10%) based on criteria such as "perfectly centered," "perfectly central," "perfectly uniform," "perfectly equal," "perfectly the same," "perfectly perpendicular," "perfectly parallel," "perfectly symmetrical," "perfectly extended," "perfectly axial," "perfectly cylindrical," "perfectly cylindrical," "perfectly ring-shaped," and "perfectly annular." Therefore, even if the words "roughly," "almost," "approximately," etc. are not added, the concept expressed by adding "roughly," "almost," "approximately," etc. may be included. Conversely, a state expressed by adding "roughly," "almost," "approximately," etc. does not necessarily exclude a complete state.

[0186] In this disclosure, expressions using "more than," such as "greater than A" and "smaller than A," are expressions that comprehensively include both concepts that include equivalent to A and concepts that do not include equivalent to A. For example, "greater than A" is not limited to cases that do not include equivalent to A, but also includes "A or greater." Furthermore, "smaller than A" is not limited to "less than A," but also includes "A or less." When implementing the present technology, specific settings and the like may be appropriately adopted from the concepts included in "greater than A" and "smaller than A" so as to achieve the effects described above.

[0187] It is also possible to combine at least two of the features of the present invention described above. That is, the various features described in each embodiment may be combined in any way without distinguishing between the embodiments. Furthermore, the various effects described above are merely examples and are not limiting, and other effects may also be achieved. [Explanation of symbols]

[0188] 1. Drum setting support system 2…Performer 3...Drum instruments 4...Drum set 5. Smartphone 9...Playback status image 10...Recommended comments 12...Bass drum 13...Snare drum 14...High Tam 15...Low Tom 16...Floor tom 17...Hi-hat cymbal 18...Crash cymbal 19...Ride cymbal 20...Kick pedal 21...Hi-hat pedal 27...Chair 30...Left foot 31...Right foot 32...Left hand 33...Right hand 34b, 34b...Stick 36, 40, 44…Learning Model 50, 51...Difference information 55, 60, 63...Photos 56~58, 61, 64~67...Virtual images 72...Electronic drums 87...Computer

Claims

1. A first acquisition unit that acquires configuration information regarding the configuration of a drum instrument that exists in the real world and is composed of multiple parts each having unique characteristics, and that allows a performer to play the drum instrument by arranging the multiple parts in predetermined positions, and physical information regarding the body of the performer playing the drum instrument; a recommended information output unit that outputs recommended information corresponding to the player regarding settings when playing the drum instrument, based on the configuration information and the physical information acquired by the first acquisition unit; and Equipped with the configuration information includes information identifying parts that configure the drum instrument; The recommended information output unit outputs the recommended information so that a relative positional relationship between the identified parts and the performer corresponds to the inherent characteristics of the identified parts. Information processing device.

2. a first acquisition unit that acquires configuration information relating to a configuration of a drum instrument and physical information relating to the body of a player who plays the drum instrument; a recommended information output unit that outputs recommended information corresponding to the player regarding settings when playing the drum instrument, based on the configuration information and the physical information acquired by the first acquisition unit; and Equipped with The recommended information output unit inputs at least one of the configuration information and the physical information into a trained learning model that has undergone machine learning to estimate the recommended information, thereby acquiring the recommended information from the trained learning model. Information processing device.

3. a first acquisition unit that acquires configuration information relating to a configuration of a drum instrument and physical information relating to the body of a player who plays the drum instrument; a recommended information output unit that outputs recommended information corresponding to the player regarding settings when playing the drum instrument, based on the configuration information and the physical information acquired by the first acquisition unit; and Equipped with the first acquisition unit acquires, as the configuration information, information regarding a movable range of each part included in the drum instrument; The recommended information output unit outputs the recommended information based on information about the movable range acquired by the first acquisition unit. Information processing device.

4. 4. The information processing device according to claim 3, The recommended information output unit outputs the recommended information using a learning model that has been machine-learned using information about the movable range as training data. Information processing device.

5. a first acquisition unit that acquires configuration information relating to a configuration of a drum instrument and physical information relating to the body of a player who plays the drum instrument; a recommended information output unit that outputs recommended information corresponding to the player regarding settings when playing the drum instrument, based on the configuration information and the physical information acquired by the first acquisition unit; and Equipped with the recommendation information includes at least one of recommended configuration information regarding a configuration of the drum instrument that corresponds to a recommended physical configuration of the player when playing the drum instrument, and recommended physical information regarding a recommended physical configuration of the player when playing the drum instrument; the drum instrument is a drum set, The recommended body information includes information on at least one of the angle of the thigh when sitting on a chair, the positional relationship between the bass drum and the foot playing the bass drum, the angle of the shin of the foot playing the bass drum, the positional relationship between the snare drum and the torso, the positional relationship between the upper arm and the torso when playing the snare drum, the height relationship between the snare drum and the elbow and knee, the positional relationship between the hi-hat cymbal and the foot playing the hi-hat cymbal, the angle of the shin of the foot playing the hi-hat cymbal, the positional relationship between the floor tom and the torso, the positional relationship between the tom and the arm, or the positional relationship between the cymbal and the arm. Information processing device.

6. a first acquisition unit that acquires configuration information relating to a configuration of a drum instrument and physical information relating to the body of a player who plays the drum instrument; a recommended information output unit that outputs recommended information corresponding to the player regarding settings when playing the drum instrument, based on the configuration information and the physical information acquired by the first acquisition unit; and Equipped with The recommended information output unit outputs, as the recommended information, difference information from standard configuration information indicating a standard configuration of the drum instrument. Information processing device.

7. a first acquisition unit that acquires configuration information relating to a configuration of a drum instrument and physical information relating to the body of a player who plays the drum instrument; a recommended information output unit that outputs recommended information corresponding to the player regarding settings when playing the drum instrument, based on the configuration information and the physical information acquired by the first acquisition unit; and Equipped with The recommended information output unit outputs the recommended information in response to an operation of arranging each part of the drum instrument in order. Information processing device.

8. a first acquisition unit that acquires configuration information relating to a configuration of a drum instrument and physical information relating to the body of a player who plays the drum instrument; a recommended information output unit that outputs recommended information corresponding to the player regarding settings when playing the drum instrument, based on the configuration information and the physical information acquired by the first acquisition unit; and Equipped with the recommendation information includes at least one of recommended configuration information regarding a configuration of the drum instrument that corresponds to a recommended physical configuration of the player when playing the drum instrument, and recommended physical information regarding a recommended physical configuration of the player when playing the drum instrument; The recommended information output unit displays a virtual image of the drum instrument as the recommended configuration information so as to be superimposable on a real object. Information processing device.

9. a first acquisition unit that acquires configuration information relating to a configuration of a drum instrument and physical information relating to the body of a player who plays the drum instrument; a recommended information output unit that outputs recommended information corresponding to the player regarding settings when playing the drum instrument, based on the configuration information and the physical information acquired by the first acquisition unit; and Equipped with the recommendation information includes at least one of recommended configuration information regarding a configuration of the drum instrument that corresponds to a recommended physical configuration of the player when playing the drum instrument, and recommended physical information regarding a recommended physical configuration of the player when playing the drum instrument; The recommended information output unit displays a virtual image of the player's body as the recommended body information so as to be superimposable on a real object. Information processing device.

10. a first acquisition unit that acquires configuration information relating to a configuration of a drum instrument and physical information relating to the body of a player who plays the drum instrument; a recommended information output unit that outputs recommended information for the player regarding settings when playing the drum instrument, based on the configuration information and the physical information acquired by the first acquisition unit; and a second acquisition unit that acquires information about the performer's desired settings realized by the performer; Equipped with The recommended information output unit outputs the recommended information based on the information about the desired setting acquired by the second acquisition unit. Information processing device.

11. The information processing device according to claim 10, The recommended information output unit outputs the recommended information using a learning model that has been machine-learned using information about the desired settings as training data. Information processing device.

12. a first acquisition unit that acquires configuration information relating to a configuration of a drum instrument and physical information relating to the body of a player who plays the drum instrument; a recommended information output unit that outputs recommended information for the player regarding settings when playing the drum instrument, based on the configuration information and the physical information acquired by the first acquisition unit; and an answer information acquisition unit that acquires answer information to a questionnaire regarding the performance of the drum instrument input by the player; Equipped with The recommended information output unit outputs the recommended information based on the answer information acquired by the answer information acquisition unit. Information processing device.

13. 13. The information processing device according to claim 1, The recommendation information includes at least one of recommended configuration information regarding a configuration of the drum instrument that corresponds to the player's body when playing the drum instrument, or recommended physical information regarding the player's body when playing the drum instrument. Information processing device.

14. 14. The information processing device according to claim 1, The first acquisition unit acquires at least one of a photographed image including at least one of a structure of the drum instrument or a body of the player, extracted information about the structure of the drum instrument extracted from the photographed image, extracted information about the body of the player extracted from the photographed image, input information about the structure of the drum instrument input by the player, or input information about the body of the player input by the player. Information processing device.

15. 14. The information processing device according to claim 13, the recommended configuration information includes at least one of the position of each part included in the drum instrument, the height of each part, the posture of each part, or the relative positional relationship of each part; The recommended body information includes at least one of the position of each part of the player's body, the height of each part, the posture of each part, or the relative positional relationship of each part. Information processing device.

16. 16. The information processing device according to claim 13, the drum instrument is a drum set, The recommended configuration information includes information on at least one of the position and height of a chair, the position and inclination of a bass drum, the position, height and inclination of a snare drum, the position and height of a hi-hat cymbal, the position, height and inclination of a floor tom, the position, height and inclination of a tom, the position, height and inclination of a cymbal, or the difference in height between the snare drum and the hi-hat cymbal. Information processing device.

17. An information processing method executed by a computer system, comprising: Acquire configuration information relating to the configuration of a drum instrument that exists in the real world and is composed of a plurality of parts each having unique characteristics, and that can be played by a player by arranging the plurality of parts in predetermined positions, and acquire physical information relating to the body of the player who plays the drum instrument; Based on the acquired configuration information and physical information, recommended information corresponding to the player regarding settings when playing the drum instrument is output. This includes: the configuration information includes information identifying parts that configure the drum instrument; The process of outputting the recommended information outputs the recommended information so that a relative positional relationship between the identified parts and the performer corresponds to the inherent characteristics of the identified parts. Information processing methods.

18. A program for causing a computer system to execute an information processing method, comprising: The information processing method includes: Acquire configuration information relating to the configuration of a drum instrument that exists in the real world and is composed of a plurality of parts each having unique characteristics, and that can be played by a player by arranging the plurality of parts in predetermined positions, and acquire physical information relating to the body of the player who plays the drum instrument; Based on the acquired configuration information and physical information, recommended information corresponding to the player regarding settings when playing the drum instrument is output. This includes: the configuration information includes information identifying parts that configure the drum instrument; The process of outputting the recommended information outputs the recommended information so that a relative positional relationship between the identified parts and the performer corresponds to the inherent characteristics of the identified parts. program.

Images