Music creation device and music creation method

Abstract

The present invention addresses a problem regarding the music creation device comprising a video camera of Japanese Patent No. P-6833313 in which it is proposed to create music from a light source present in the external environment of the video camera with which the music creation device is equipped, but it is not possible to produce music in environments in which no light source is present. As a means for solving this problem, the detection of position information regarding a light source in the external environment is stopped, a pseudo-space is combined with the video being captured by a video camera body, an image being recorded and played back, or the like, the position of the intersection of laser light from at least two locations in the pseudo-space is calculated by applying triangulation, a coordinate formula, or the like and the position is designated as a light source, a plurality of pseudo light sources which make it possible to grasp position information are thereby created by free ideation, improvements are added to the music creation device which is driven as a result of the position measurement unit (sensor) detecting the position information regarding the created light sources, and it thus becomes possible to create music even in locations in which there are no light sources in the external environment.

Description

[Technical Field]

[0001] PC Electronic musical instrument Sonic wave Sensor Toy AI Triangulation [Background technology]

[0002] Patent application 2015-186116 is a music creation device, and patent application H06-298573 is a piano keyboard device that utilizes a light-receiving sensor (photodetector). Patent application P-5396420 is a patent application for a piano keyboard. Improvements in optical disc media recording and reading methods have benefited fields such as CDs and DVDs. Amid the rapid advances in technological innovations such as the spread of 5G, autonomous driving, and AI, FOT technology is a novel technology in the field of 3D sensing. It appears that means and methods for predicting changes in the external environment due to vehicle movement are improving significantly, with safety as a criterion.

[0003] And from documents published in the publicity of his patented music creation device (P-6833313), it was revealed that creating music in a place where there was no light source in the external environment was a certain challenge. This time, it was an idea to create a pseudo light source and use that pseudo light source to create music, and to explain how the positional information of that pseudo light source was obtained, the intersection of laser beams emitted from two specified locations was considered as triangulation, and the irradiation angles of each of the two locations were managed to sequentially obtain the positional information of the intersection, and in this triangulation method, a line connecting the irradiation positions of each of the two locations was made the base, and a triangle could be drawn with the intersection point of each irradiation as the vertex, and when the tilt angle was changed based on the base of the triangle, the intersection point also changed at the same time, and further, the theory behind this triangle By moving the element and controlling the change in the position of the intersection, and at the same time using an extension member or the like to tilt and rotate the base, which serves as the base for creating a triangle from the line located at the base, the intersection will draw a circle (or a polygon such as a star, or an ellipse, etc.) (See Figure 13).By configuring a program that has in advance the geometric relationships that will be drawn by moving this theoretical intersection, it is possible to draw various shapes one after another, and the positional information of these various shapes can be grasped.An internet search did not reveal any ideas for creating such a pseudo light source and using it in a music creation device. [Prior art documents] [Patent documents]

[0004] Patent application 2015-186116 [Non-patent literature]

[0005] none Summary of the Invention [Problem to be solved by the invention]

[0006] The invention of a music creation device for a video camera in Japan P-6833313 was designed on the premise that there was a light source in the external environment, but there was a problem in that it was impossible to create music in an environment without a light source (excluding video footage that can be recorded and played back and that was recorded at the same time as the positional information of the light source). [Means for solving the problem]

[0007] This is an improvement to a music creation device in which the signal to the light source position measurement unit (sensor) of the music creation device is switched with a signal of position information of a light source in the external environment, and a pseudo-space is compositely constructed in the image being captured by the internal environment video camera body, and the position of the intersection of each laser beam emitted from at least two locations in this pseudo-space is determined using triangulation methods, coordinate equations, etc., and this determined position is designated as a pseudo-light source, and the position information of this pseudo-light source is compared with the position information of the position measurement unit (sensor) to determine the position information again, and the music creation device is driven by the position information of the detected pseudo-light source instead of the position information of the light source in the external environment. [Effects of the Invention]

[0008] Even in places where there is no light source in the external environment, music can be created based on the pseudo light source created by the light source creation device equipped in the music creation device and the position information of the pseudo light source.The position measurement unit can also handle light sources or pseudo light sources in the external environment, and currently it is described as being switched between them, but ideally the position measurement unit would have functions that conform to specifications that allow it to combine light sources existing in the external environment with pseudo light sources. [Brief explanation of the drawings]

[0009] [Figure 1] A model of a toy musical instrument with patented functions [Figure 2] An explanatory diagram with symbols assigned to each part of Figure 1 [Figure 3] Product image and simple overview diagram [Figure 4] Figure 1 is an explanatory diagram of the principle of how light or light rays from the entrance are irradiated onto the light receiving sensor (light receiving element) keyboard by controlling a freely movable reflector (Example 1). [Figure 5] An explanatory diagram of an improved version of the light reflector shown in Figure 4 equipped with a laser beam, and a new synthesizer equipped with a controller that divides an electronic wind instrument into two parts (Example 1). [Figure 6] Two-dimensional illustration of a light source formed by irradiation of a freely movable laser beam. [Fig. 7] Fig. 7 shows a projection diagram of a CCD or CMOS image sensor type video camera body incorporating a freely movable light reflector and a keyboard with a built-in light receiving sensor that is joined to an electronic musical instrument, and an example of connection with related equipment accompanying the computerization of the system (Example 1). FIG. 8 is a perspective view of the appearance of a three-stage turntable part of the toy shown in FIGS. 1 and 2. [Figure 9] An external view of the three-stage turntable seen from directly above the toy shown in Figures 1 and 2. [Figure 10] A diagram illustrating the application of triangulation, combining Figure 6 with the external view of Figure 8. [Figure 11] A conceptual image of a music-creating device created based on a patent that creates music from street lights in the external environment when installed inside a car. [Figure 12] An image of a pseudo light source in a virtual space where circles of various diameters are drawn successively from four light source creation devices and overlapped, and the intersections of the circles are defined as the light sources that create music. [Fig. 13] An explanatory diagram of a functional part body that creates a light source from the triangulation method of Fig. 6, Fig. 8, Fig. 9, and Fig. 10, equipped with a base that allows tilting and rotation based on the reference. [Figure 14] Figure 14 is a composite diagram of a freely movable reflector-type light-receiving musical instrument and other systems. The arrows indicate the basic system for creating sounds (Example 1). DETAILED DESCRIPTION OF THE INVENTION [Example]

[0010] As details of the music creation device for which we have obtained patents, we have included in this PCT application all four of the drawings (Figures 4, 5, 7, and 14) and the general examples set forth in Japan Patent Office P-6833313, which are the registered rights. All eight registered claims are set forth below, with Examples 2 and 5 being particularly relevant to this rights registration. (Claim 1) A music creation device to be installed in a vehicle, comprising: an in-vehicle video camera capable of capturing images of the external environment; a sensor that successively measures positional information (angle, depth, etc.) of a moving light source captured by the video camera; reflection means that successively changes the direction of the light source based on the positional information measured by the sensor; a light-receiving element (sensor) divided into note scales that receives the light whose direction has been changed by the reflection means; and a synthesizer or sound source module that is driven by the characteristics of the light-receiving element (sensor). (Claim 2) A music creation device to be installed in a video camera, comprising: a sensor that successively measures position information (angle, depth, etc.) of a light source that moves during shooting based on the shooting position of the video camera; a reflecting means that successively changes the direction of the light source based on the position information measured by the sensor; a light receiving element (sensor) that receives the light whose direction has been changed by the reflecting means and is divided into note names; and a synthesizer or sound source module that is driven by the characteristics of the light receiving element (sensor). (Claim 3) A music creation device equipped in a video camera, comprising: a sensor that successively measures position information (angle, depth, etc.) of a light source that moves during shooting based on the shooting position of the video camera when the shooting position of the video camera is moved during shooting; a reflecting means that successively changes the direction of the light source based on the position information measured by the sensor; and light receiving elements (sensors) divided into musical scales that receive the light that has been changed in direction by the reflecting means, and the music creation device is characterized in that a synthesizer or a sound source module and a sound source device are driven by the distribution of sound signals according to the characteristics of the light receiving elements (sensors) divided into musical scales. (Claim 4) The music creation device according to any one of claims 1 to 3, further comprising: a sensor for measuring positional information of a plurality of light sources captured by the video camera; a reflecting means for changing the direction of each light source based on the positional information; a light receiving element for receiving the reflected light from each light source, which is divided into light receiving elements for each musical scale; and a synthesizer or sound source module driven by the characteristics of each different light receiving element (sensor). A music creation device characterized by (Claim 5) The video camera of the music creation device to be provided in a vehicle as described in claim 1 or the video camera of the music creation device to be provided in any one of the video cameras as described in claims 2 to 4, characterized in that the video camera of the music creation device comprises a reflection means for successively changing the direction of the light source based on position information (angle, depth, etc.) measured by a sensor that can successively measure position information of a moving light source captured by the video camera, and a simulation that distributes sound signals by receiving light from light-receiving elements (sensors) divided into musical scales that are irradiated with light whose direction has been changed by the reflection means, and that synthesizes and starts the simulation on the image of the moving light source captured by the video camera, and determines, through a calculation program prepared in advance, the position where light from the light source is irradiated by the reflection means whose direction has been changed, and drives a synthesizer or a sound source module and a sound source device by distributing sound signals from the positions where light is received by the light-receiving elements (sensors) divided into musical scales that have been determined. (Claim 6) 6. The music creation device according to claim 5, which is provided in a video camera, wherein, in a recording function of the video camera, when recording an image of a moving light source by the video camera, the light source position information is recorded in a superimposed manner, and based on the recorded position information of the moving light source, the simulation according to claim 5 is synthesized and activated on the recorded image of the moving light source, thereby making it possible to repeatedly create music from the same image. (Claim 7) A music creation device provided with a video camera according to claim 5 or claim 6, characterized in that the music creation device is provided with a hardware with a video camera or a hardware connectable to a video camera, which is capable of converting a function to drive a synthesizer or a sound source module and a sound source device into software and installing it by distributing the determined sound signal, and distributes the sound signal to an audio device that can be connected either inside or outside the hardware. (Claim 8) A music creation device to be provided in the vehicle-mounted video camera of claim 1 or the video camera of any one of claims 2 to 7, further comprising a controller that enables remote control of the reflection means, and an electric wind instrument, wherein the electric wind instrument is divided, and ends of the divided electric wind instrument are connected to ends of a control lever of the controller, and the reflection means can be remotely controlled by the control lever of the controller while the divided electric wind instrument is being played. [Example]

[0011] Example 2, shown in Figures 1 and 2, is a model of a musical toy created by applying the principles of the music creation device described in patent P-6833313. We will now discuss its details. The functions and specifications described in Figure 1 will be explained using the diagrams in Figures 2, 6, and 9. As mentioned above, Figure 1 is a schematic diagram of a musical toy created by utilizing the patented functions. Figure 2 is a diagram in which reference numerals are assigned to the various components of the schematic diagram of the toy shown in Figure 1. We will begin our explanation using this diagram. Reference numerals H, F, and G represent the rings of a three-tiered turntable, each consisting of the outer diameter of the smallest ring at the top and the inner diameter of the next ring, forming a three-tiered ring configuration with no gaps between them. Each ring rotates, and the top turntable is equipped with a musical band, a tent, a mirror ball, and other items. The top of the tent is equipped with a video camera entrance and a laser light source (reference numeral L). The waterfowl symbol A and the musical band symbol B (see Figure 2) can also be equipped with reflectors and laser beams, which are installed on each turntable and can be used to rotate or perform other functions using sound or light.

[0012] The symbol O provided on the upper surface of each turntable on the first to third tiers has a freely movable light reflector, symbol Q, and a freely movable laser light source, symbol Q, housed inside the surface of symbol O, and the remotely controllable freely movable laser light source, symbol P, controls the laser light emitting device and the remotely controllable freely movable light reflector, symbol Q, which are provided on the back of the rotationally controllable tent, symbol I, and controls the freely movable light reflector, symbol J, which is provided on the back of the rotationally controllable tent, symbol I, to create sound by changing the irradiation position on the synthesizer equipped with an optical sensor, symbol X3.

[0013] The section marked L can be fitted with a camera equipped with a music creation device marked D (see Figure 6) on top, and multiple marks T (see Figure 6) are capable of projecting laser light. (The video cameras marked D in Figure 6 and Z in Figure 9 have almost the same functions, and by applying triangulation to a triangle with the intersection of the two laser lights from each turntable as its vertex, it is possible to store, overwrite, compose, synthesize, play, etc., light source information from the inclination angle of each laser light, and these video cameras have the functionality to create music from the multiple stored light sources.)

[0014] Furthermore, the part marked S (see Figure 6) is a detachable joint, and its installation position can be changed to any position where a port that allows for connection is provided. For example, by providing a connection port in front of the synthesizer on the outside bottom of a three-stage turntable, the installation position can be changed, and even in this case, the operations of the marks D, T, and S (see Figure 6) provided on the mark L (see Figure 6) can be remotely controlled.

[0015] Each of the turntables H, F, and G (see Figure 2) has multiple turntables O (see Figure 10), each of which is an independent turntable and is a rotating type that can rotate individually to the left or right.

[0016] The rotation speed and direction of each turntable can be controlled remotely either by an automated program or manually. Reference I (see Figure 2) is a remotely controlled rotating tent, and a remotely controlled, freely movable light reflector reference J (see Figure 2) is attached to the back of the tent. This reflects and controls the laser light emitted from reference P (see Figure 6) housed in reference O of each turntable, and directs it towards the synthesizer, creating changes in sound.

[0017] Symbol K (see Figure 2) is a mirror ball that can be divided into various shapes, and the left and right rotation direction and speed can be controlled independently for each individual unit. The sphere has a structure that allows it to be transformed into various shapes, and each transformed surface is treated as a mirror surface that acts as a reflector, reflecting the received light and creating light art.

[0018] The drawing shows a three-stage turntable, but the number of stages can be increased to four or five, and as will be explained later, this can be said to be proportional to the improvement in functionality. On the drawing, each turntable is equipped with multiple hemispheres like marbles.

[0019] In Fig. 2, the hemisphere is designated by the symbol O and is described as the irradiation port of the freely movable light reflecting device and the freely movable laser light emitting device. In more detail, in Fig. 6, the symbol P (remotely controllable freely movable laser light emitting device) and the symbol Q (remotely controllable freely movable light reflecting device) are incorporated directly below the symbol O.

[0020] The irradiation and reflection control device that creates the sound, and another idea, a controller that controls the laser light and light reflector, are used to create an improved electronic wind instrument (X1, X2) that is divided into two parts, making it possible to remotely control various functions of this toy.It also has the function of enjoying the sounds of various wind instruments, and it is possible to play the symbols P and Q using the light reflection and dual-character control device, and at the same time, it is possible to play an ensemble of electronic wind instruments (see Figure 5).It is also a toy instrument with the function of a music creation device for children.

[0021] We have explained the specifications and functions from 0012 to 0020, but this musical toy has a built-in medium that can play only the main melody of a well-known song, other sound devices, and various function control programs, and the configuration of this musical toy was designed from the perspective of adding the maximum number of functions that will allow children to enjoy the art of light and sound, and activating as many functions as possible to attract children's interest, without considering manufacturing costs, etc.

[0022] It also has a mechanism that produces sound from the irradiation and reflection of light in time with your favorite tune, and combines a wind instrument with a synthesizer, which may sound nonsensical to adults, but is designed to be a musical toy that young children can enjoy with their eyes and ears. Various functions can be operated automatically or manually using the controller equipped with the wind instrument synthesizer at the bottom of Figure 5. Furthermore, by applying the functions of the irradiation device code P managed by the position measurement unit provided in Figures 8, 9, and 13, which highlight the three-stage turntable in Figure 2, it is possible to create a light source for creating music, and by digitizing this function, we will next explain how to use it in combination with images from a PC or video camera. [Example]

[0023] The creation of a light source, as explained in 0022, addresses the problem of the present invention: the inability to use a music-creating device in an environment without a light source for creating music. This article explains the method devised based on this idea: "If that's the case, then why not just create a light source?" Using laser light, light rays, and triangulation, the invention creates a pseudo-light source as a solution to music creation, and uses this pseudo-light source to operate the music-creating device. The details of this invention are explained below. This device creates music from a pseudo-light source. This music-creating device, which uses this light source to create music, can essentially be described as a device in which sound changes are generated entirely from positional information, which is essentially a numerical representation of the light source. The light source is defined as the point where light rays from two specific locations intersect, and the positional information of the pseudo-light source is detected from the respective illumination angles created by these light rays. By variably controlling the illumination angle, the music-creating device can create sound by changing the intersection, i.e., the position of the light source. Another method is to use this light point creation method to set multiple light points in a virtual spatial image and create music based on the multiple pseudo-light sources in that space. It is also possible to create new light spaces in real time, and we will explain this function next.

[0024] The remotely operable, freely movable laser beam emitting device (symbol P) in Figure 6 is a movable part with a freely movable function like a spherical joint that can be remotely controlled automatically or manually, allowing it to emit a beam continuously or intermittently in any direction. The direction of the beam emitted by symbol P, which emits a beam three-dimensionally, is continuously managed by a position measurement (sensor). A program equipped with the position measurement (sensor) allows symbol P to remotely emit in a specified direction, and control is also possible by a program centered on a coordinate system database equipped with the position measurement (sensor). In combination with the description in 0023, the position measurement (sensor) measures the position of the pseudo light source from the irradiation angle of the laser beam emitted from one laser light source and the irradiation angle of the laser beam emitted from the other laser light. Furthermore, each turntable on which the automatically and manually remotely operable, freely movable laser beam emitting device (symbol P) is placed rotates independently, and the rotation can also be remotely controlled automatically or manually.

[0025] The remotely operable, freely movable light reflector device (symbol Q) in Figure 6 also has a freely movable function with a joint that can be controlled automatically or manually by remote control, making it possible to reflect light in any direction, and symbol Q, which reflects light three-dimensionally, has its reflection direction managed sequentially by a position measurement (sensor), making it possible to control it by a program centered on a coordinate system database built into the position measurement (sensor). Symbols P and Q directly below symbol O do not come as a set of two, but can also be used alone (symbol P).

[0026] The music creation device (symbol L) mounted on the top of the tent, which is mounted on the top of the axis of the rotating tent in Figure 2, has an incident light for a video camera (symbol D) compatible with the music creation device on the top (see Figures 6 and 10), and is equipped with multiple laser lights (symbol T in Figure 6) on the side, which allows the installation position to be changed as explained in 0013 and 0014, and is capable of automatic or manual control by remote operation, and can emit multiple light rays continuously or intermittently in any direction. The emission direction of symbol T attached to symbol L, which emits light rays three-dimensionally, is managed sequentially by a sensor, and by a program centered on the coordinate system data built into the position measurement (sensor), symbol T attached to symbol L can also be remotely controlled to emit in a specified direction.

[0027] The control box (symbol N) (see Figure 6) of the multiple (P+Q)+(D+T+S) coordinate system is a device that controls the positional information of the light source used to create music for the video camera (symbol Z) (see Figure 9). It includes a control device that uses a program to manage the operation of symbol O (see Figure 6) which has multiple symbols P and Q directly below it, and symbol T which is attached to symbol L, whose position can change. It has the function of applying triangulation from the position where the two laser beams of the multiple symbols P and symbol T attached to symbol L intersect among the devices attached to symbols P, symbol Q, and symbol L, to create a light source that is converted into music. It is a box that controls the configuration of the light source and the configuration of the space, and it also manages the positional information of the light source that creates music and sends operation commands to symbols P and T via a program based on the inclination angle of each position measurement (sensor) attached to each device.

[0028] Having explained the functions for using triangulation and the intersection of laser light as a light source in 0023 to 0027 above, we will now explain the triangulation and the creation of a circular light source by adding rotation to triangulation (see Fig. 13) and the expansion of that virtual space using Fig. 10. In the position measurement process, the laser light source makes it possible to save and reproduce the shape drawn by the rotation of the intersection obtained by changing the relative position of the rotation part with respect to the position variation part as a light source, and this will be explained next using a simple configuration.

[0029] In Figure 10, when a triangle is drawn with the laser beam projection port (symbol O) on the left side of the drawing and the right side symbol O as the base, and a line from the left symbol O to point W and a line from the right symbol O to point W, triangulation applies the theory that in a triangle with the target position as the vertex, the length of the base and the length to the vertex can be calculated from the two angles. Using a straight line connecting the left symbol O and the right symbol O in Figure 10 as the reference point, the intersection of the light beams from the left and right symbols O is determined as the light source position, and the information on the angles inside the left and right sides of the triangle that have been calculated is saved, and this position is used as the light source for creating music, and each angle information is managed by position measurement (sensor).

[0030] Since this code O is installed on each turntable, if the intersection code W is stored as a light source as shown in Figure 10, and the time it takes for the three-stage turntable body (Figure 9) to make one forward rotation, theoretically the position information will be stored in the shape of a circle. By using each turntable, which is equipped with multiple codes O, to rotate it while the intersection is indicated (see Figure 10), the circular position information is obtained, and by connecting and rotating the three-stage turntable body to a rotatable base (see Figure 13) that has the function of tilting it, in other words, by connecting it to the rotating body via a position changer (see Figure 13) that changes the relative position of the laser light source, it is possible to create light sources of various shapes and store these light sources based on the intersection position information obtained by changing the relative position of the laser light source.

[0031] Also, from the triangulation method, if the angle of the symbol O relative to the reference line is the same or the lengths of the two sides are the same, the theory goes that even if the symbol is rotated, the position information as a point will not change.

[0032] This theory states that the greater the difference in the lengths of the two sides, the larger the numerical value of the diameter. It can also be said that two-dimensional information, such as the lengths of the two sides and their respective angles, can be used to construct three-dimensional information by adding rotation to that two-dimensional information.

[0033] Although this overlaps with the explanation in 0030, the position changer of the three-stage turntable body (Fig. 10) that allows the three-stage turntable body to tilt in any direction based on the bottom surface of the body is not limited to a specific mechanism and can be an extendable rod, an extension, a free-moving member, etc. The position changer also allows rotation while the three-stage turntable is activated. By controlling the movement of the position changer that allows this rotation (automatic or manual), the position of the intersection formed by controlling the irradiation provided on the three-stage turntable can be changed, making it possible to configure various shapes other than circles, and all of the functions explained in 0033 can be controlled automatically or manually by remote control. The position change unit and the rotation unit are managed sequentially, allowing for the saving and playback of information such as position and tilt angle. This type of management also makes it possible to set up multiple units of this device (Fig. 10) and, depending on the program prepared in advance, to create images that mimic the constellations floating in the night sky.

[0034] Furthermore, as a method or operation for drawing light sources that evoke the image of constellations using saved light source positions, the basic procedure is to apply triangulation to the angle of a laser beam attached to a three-stage turntable to save each light source in a flat (2-dimensional) state, and then group and save them. However, as there are various constellations, and the configuration of their multiple stars on a flat surface is roughly fixed, applying triangulation to define a certain distance from a position somewhere on the base of the triangle makes it easy to play back and use by programming position information in advance, and I believe that by applying this circular position data, it would be possible to simply recreate outer space as seen from the ground (similar to a planetarium). I also believe that processing speed could be increased by incorporating irradiation position information attached to the turntable, calculated backward from the position of the stars, into the program.

[0035] Continuing from the explanation using the constellations as an example, if we imagine projecting this 3D space section onto a PC screen and creating music in a situation where we are traveling in a spaceship, it is inevitable that we will need a program that can handle the speed of movement and changes in position, as well as overall high-speed processing capabilities.

[0036] I'm going to explain it in a bit of a reverse order, but the light sources 0029 to 0033 were all created by applying triangulation, and the angle of code P at which laser light is irradiated from two points on the bottom was calculated using a calculation program and saved as the position information of the light source. In this state, some ingenuity is required in terms of the visuals, but theoretically, the accurate position information of multiple light sources for the video camera with music creation function code Z to play sound is provided by the program, and codes N, Z, and T are activated, making it possible to create music.

[0037] In a music creation device whose program operates based on light source position information, even in environments where the light source cannot be seen (environments where there is no light source, or conversely, environments where it is so bright that the light source cannot be distinguished), it is possible to simply set up temporary position information and create a light source. To briefly explain this light source creation method once again, the intersecting position of two laser beams attached to each turntable is saved as position information in a pre-installed program centered on triangulation, and this saved light source position information is used to drive the music creation device (code Z) and create music. By computerizing this method and incorporating it into a music creation device (patent pending) previously equipped with a video camera, it is possible to create a light source using this method in places where there is no light source (in the dark, in the mountains where there are no streetlights, inside a PC screen, etc.), and then create music from the created light source. (Creating a virtual space dotted with light sources using the application of triangulation)

[0038] The method for creating a light source has been explained from the perspective of the physical configuration of a musical instrument toy such as Fig. 1 in the explanation of 0029 to 0033, but it is also possible to configure a light source from various positional relationships by a position measurement process in which a position measurement unit (sensor) measures position information of a pseudo light source formed as the intersection of two light beams emitted from at least two or more laser light sources, and by the combined movement of the rotation unit and the rotation of the main body, etc., of the laser light source via the extension unit in a predetermined direction. Also, by remotely operating the code P provided on each of the multiple turntables, it has a freely movable function like a spherical joint that supports automatic and manual control, making it possible to continuously or intermittently emit light beams in any direction, and the irradiation direction of code P that emits light beams three-dimensionally is sequentially managed by a sensor, and code P can be remotely operated to emit light in a specified direction by a program programmed in the sensor, and it is also equipped with a function that enables control by a program centered on a coordinate system database programmed in the sensor. [Example]

[0039] Example 4 is an application of Example 3, and is a method for creating a light source for creating music by combining position information of the intersection point obtained by changing the relative position of the laser light source with the rotation unit using a position change unit, and further combining triangulation with a coordinate system program. In Figures 6 and 10, the symbol P (left) represents an image of a laser beam emitted almost perpendicularly, while the symbol P (right) represents an image of a laser beam emitted at an oblique angle. The point where the laser beams emitted by the left and right symbols P intersect is symbol W, which becomes the light source that produces sound in the music creation device. Even if the angle of the laser beam of symbol W changes, by saving the position of W (save function = save → location → determine), the light source is recognized as being present there. As explained in Example 3, it is essential to add a save function to the program that groups and saves the position information of multiple light sources so that it can be played back immediately when needed.

[0040] The position when symbol P is tilted horizontally from symbol W to the right of symbol P is symbol M. In the specifications of toys, etc., it is not possible to expect much change in the positions of symbols W and M, but in PC simulations, etc., it is possible to increase the number of rotating turntables as much as you want, and change the operation of each of multiple turntables with many symbols P, such as rotating forward and backward left and right.

[0041] The symbol T attached to the symbol L attached to the top of the explanatory musical toy shown in Figure 6 is attached to the toy in the drawing in such a way that when laser light is emitted horizontally from symbol T as shown in Figure 6, the position where symbols V and U intersect with the laser light emission lines on the left and right of symbol P can be recognized as the light source and saved, and the position information of the intersection on the line from symbol P can be recognized from the changing position of symbol L and the tilt angle of symbol L, so the position information of the light source saved can be calculated using a coordinate system program that can be compared with the information on the horizontal line of laser light from symbol T, and music is created from that numerical value.

[0042] We have explained how the position of a virtual light source is set using the irradiation of two laser beams, one on the left and one on the right, marked P in Figure 6, and the other on the right, marked L. However, as described in 0041, by increasing the number of stages of a turntable equipped with multiple laser beams beyond the three stages shown in the musical toy shown in Figure 1, the number of light intersecting positions, i.e., the number of light sources, can be infinitely increased. It is also possible to digitize the structure and function program and synthesize and activate it on the video camera image. Ideally, the triangulation method of Example 3 would be applied and combined with the functions of an electronic version of the structure that adds rotation to that triangulation method. (Configuration of a virtual space dotted with light sources by making combined use of triangulation and coordinate system programs) [Example]

[0043] Figures 4, 5, 7, and 14 are patented designs that explain the principles of a music creation device to be attached to a video camera, characterized by the function of changing the direction of a light source with a reflector based on the light source's position information, and creating sound from changes in the illumination caused by reflection onto light receiving elements divided into note names, and it is recommended that AI be used for this function control.Even if light from the light source is changed in direction by controlling the reflector and detected by a single note name sensor divided into note names, this music creation device can choose to convert it into a chord, guitar chord, etc., and when changing the direction of the light by reflection, it is also possible to change the specifications so that the light from the light source is diffused irregularly on the surface of the light reflector.

[0044] In this invention, theoretically it was impossible to create sound in an environment without light, but the explanations in Examples 2 and 3 have made it possible to create an artificial light source space in an environment without a light source. We will now explain how to add this invention to the patented music creation device equipped with an in-vehicle camera in Figure 11 from the perspective of an upgrade.

[0045] This music creation device works by reading the position information of the light source using a position measurement unit (sensor) located near the incident light beam, and by comparing this position information with the reflection angle of the reflector, the position at which the sound is output from the light receiving element, which is divided into note names and scales, is determined.The sound signal from that position is then sent to the audio device, and the sound is played.

[0046] In other words, there was a problem with the device being unable to operate in an environment without a light source, but this problem can be solved by combining the light source creation function. Let me explain how the improvement was made.

[0047] It would be complicated to explain in detail all the details of the means of combining this with the music device and its functions, so I will just explain the main points briefly.The function is to combine the two rays of light selected from the application of triangulation of the laser light source (symbol P) equipped on the turntable shown in Figure 9 to create a circular light source by rotation, the function related to saving the position information of this light source, and the function related to creating the light source using a coordinate system program and saving the position information, and then digitize the combined light source creation function and program and incorporate it into the software that starts the music creation device.The light source creation simulation function is combined with the simulation image of the music creation device and started up, and the position measurement unit (sensor) is switched and used according to the source of the light source that is essential for creating music (whether it is a light source in the external environment or an artificially created light source).

[0048] Next, I would like to propose a slight simplification of the processing function of the aforementioned music creation device, which is the comparison of the digital position information of the light source and the digital information of the reflection angle of the reflector, which can be said to be an overly precise part of the device. Figure 7 shows how sound is created by controlling the light taken in from the entrance and the freely movable light reflector, but it is also possible to change the sound by taking in the light directly without passing through the reflector, and conversely by changing the position of the light receiving element, which is divided into electronic musical scales.

[0049] For example, the light receiving elements divided into note name scales of the music creation device, which previously had fixed dimensions, have been converted into an electronic simulation, so by changing the size of the light receiving elements converted into that simulation, it is possible to change the width or narrowness of the space between adjacent note names from time to time, and by changing the input position of the light in accordance with the change in the position of the note name scale, and also by rotating the light receiving elements or making changes to each surface with a polygon, the configuration can be easily changed in a simulation, and this makes it possible to create a music creation device that plays sound using the incident position of light that is randomly captured.

[0050] Although reflectors may be necessary depending on the configuration of the camera's entrance's shooting function, for the time being, it will no longer be necessary to use reflectors that perform complex operations such as programs based on sensor information, as has been the case until now.

[0051] Furthermore, in the proposal to add changes to the light receiving element configured in the simulation explained in 0049, the operation of the light reflector is simplified, but if cost issues are not a concern, it is a proposal that can be enjoyed even if added to a music creation device that has a freely movable light reflector before the improvement, and it can be thought of as a specification that can be used with or without the reflector.

[0052] The explanation will go back and forth from here, but the music creation device described in patent application 2015-186116 is based on the principle of creating music by controlling a light source with a reflector and changing the position of the sound on light-receiving elements divided into musical scales, and therefore cannot be used in environments where there is no light source.

[0053] The solution to this problem was to create a virtual space dotted with artificial light sources, combining triangulation and coordinate programming (see above).

[0054] In the explanation of the configuration of this virtual space dotted with artificial light sources, first of all, there is a description, repeating the explanation from 0029 to 0033, that it is possible to express constellations floating in the night sky, but to put it simply, the toy symbol Z in Figure 9 houses a video camera equipped with a patented music creation device that creates sound from the positional information of light sources. By controlling the light beams of symbol P housed directly below the two symbols O on the camera's video monitor and determining the intersection points on the video monitor, the positional information of the constellations, which are a group, is saved by saving each point in a group that matches the shape of the constellation.

[0055] This eliminates the need for sensor information to detect the position of the light source of the music creation device; instead, the light source is recognized from position information that stores multiple intersections of the artificial space formed by the code P, and the music creation device is driven based on this information.

[0056] It is also possible to combine this with a method of creating a light source by applying a coordinate system program using movement control and function control of the symbol L (laser light irradiation symbol T + video camera symbol D) in Fig. 6. And, the application of the configurations 0055 and 0056 to computerize the functions of Fig. 9, and the contents of compositing and activating the image of the music creation device as a simulation are also explained in the fourth embodiment. [Example]

[0057] The explanations from the latter half of Example 2 to Example 5 share the invention of creating a basic light source. As an example of how to enjoy this invention using a PC in every home, the series of steps can be written as a manual example sentence: 1. Download the application software for the pseudo-space music creation device, which combines a music creation device and a light source creation device. 2. Then install it and launch it. 3. A virtual space music creation device will open on the PC screen. 4. To briefly explain the screen, the top screen displays a selection of various pseudo-spaces, a simulation of light reflectors and light receiving elements divided into musical scales to create music from these pseudo-spaces, and electronic instruments and optional functions for this purpose, which can then be selected. 5. Select Outer Space and choose Piano and Drum Set as electronic instruments. 6. Next, select a space that already has an existing light source configured in this space. 7. You can also choose to create your own light source in the virtual space. 8. This time, the space that the light source selected in 6 has already been configured in is a simulated spaceship equipped with a light reflector for creating music and a device that simulates light receiving elements divided into musical scales. By manipulating the speed and direction of the spaceship, music is created, and it is also possible to create music by manipulating the position of the light source. 9. Even with this existing space selection, you can set up and add your own light sources. 10. This time, draw and insert the Big Dipper. 11. Also, the countless stars that make up this existing virtual universe are music creation equipment for spaceships. This is a system in which all location information starting from the output device is known. 12. Of course, we also know the positions of the seven stars of the Big Dipper, which were added later. 13. Once you have completed the other service settings, click the Start button. 14. This service menu also allows you to select background music for beginners, and you can enjoy creating arrangements by adding a repeating melody to the main background music. 15. This time I chose the song OOO. 16. Then, increase the speed using the dedicated controller (see Figure 3) from the spaceship standby screen. 17. It is also possible to distribute controllers that can be synchronized with smartphones. 18. This time, you will enjoy the sounds produced by the music creation device by controlling the light reflectors and speed, along with background music for beginners. 19. By incorporating a support function that responds to the AI's musical performance and lighting environment, the melody continues without straying from the auxiliary melody with a repetitive rotation rate, no matter how you operate it. 20.You can also add a light source that changes position to produce a pleasant sound when passing by the Big Dipper. 21. It is also possible to play completely automatically, allowing you to listen to background music and arranged music for long periods of time, and depending on the settings, you can expect it to surpass the original. 22. When you feel a pleasant melody, you can play it back a certain time. 23. You can save the pleasant melody while it is playing, and if you select save, the song will be converted into sheet music and saved along with the melody. 24. The music extracted from the music creation device can be played immediately on a real instrument. It is also possible to control the combination of many (This is the kind of device you can enjoy.)

[0058] The term "laser (light beam)" used in this specification refers to any type of light beam. This refers to light and radio waves that can be used for triangulation, and is not limited to visible light. [Industrial Applicability]

[0059] It is a music-creation device that can be enjoyed physically as a toy by children, but also has functions that have been digitized so that adults can enjoy it at home using a PC, etc. We believe that the PC version can easily be commercialized as an app. [Explanation of symbols]

[0060] A waterfowl model equipped with a freely movable light reflector B Music band model C Position of the sensor and laser light source on the upper right inside of the controller E Position of the sensor and laser light source on the upper left inside of the controller H Arrow pointing to top turntable F Arrow indicating the second turntable G Arrow indicating the third turntable I Rotation controllable tent J Arrow indicating the position of the freely movable light reflector on the back of the tent marked I K. A mirror ball that can be divided into various shapes L Image of the music-making device installed at the top of the tent D Image of the camera lens of the music creation device equipped with the symbol L Image of the laser beam lamp equipped with the symbol L N Control box image of multiple (P+Q)+(D+T+S) coordinate systems O Image of the freely movable light reflector and the irradiation port of the freely movable laser light irradiation device P Image of an irradiation device with a remotely controlled, freely movable laser light source Q Image of a remotely controlled, freely movable light reflector R Image of code P and code Q being divided into separate parts S Image of the connection part that allows free movement of symbol L by remote control W: Diagram showing the point where the radiation from two symbols P on the left and right intersects M: A diagram showing the contact point that moves when the right-hand projection of symbol P is tilted in symbol W. U An image of the horizontal line of the symbol T intersecting with the oblique line of the symbol P on the right V: An image of the horizontal line of the symbol T intersecting with the vertical line of the symbol P on the left X1 Flexible Light Reflector System Controller (Left-Handed Wind Instruments) X2 Flexible Light Reflector System Controller (Right-Handed Wind Instrument) X3 Synthesizer with Light Sensor X4 Sound Quality Control Panel Arrows indicating the joints of the X5 controller Y1 Laser light lamp attached to reflector body Y2 Laser light lamp attached to a fixed base of a reflector Three video camera entrances on the top surface of the turntable with Z code H2 F2 Outer diameter of second turntable G2 Outer diameter of the third turntable H2 Outer diameter of first turntable

Claims

1. A music creation device having a position measurement unit that measures position information of a light source, a reflecting unit that changes the direction of the light source based on the position information of the light source measured by the position measurement unit, a light receiving unit that receives the light from the light source whose direction has been changed by the reflecting unit and is divided into note scales, a sound output unit that is driven by the characteristics of the light receiving unit, and at least two or more laser light sources that irradiate laser light, wherein the light source is a pseudo light source formed as an intersection of the laser light irradiated from the laser light sources.

2. 2. The music creation device according to claim 1, wherein the position measurement unit measures the position of the pseudo light source from an irradiation angle of the laser light emitted from one of the laser light sources and an irradiation angle of the laser light emitted from the other laser light source.

3. 3. The music creation device according to claim 2, wherein the laser light source has a movable part capable of changing the irradiation angle of the laser light, and the position measurement part measures the position of the pseudo light source based on the position information of the intersection obtained by changing the irradiation angle of the laser light emitted from the laser light source.

4. 4. The music creation device according to claim 2, wherein the laser light source is connected to a rotating unit that rotates around a predetermined axis, and the position measurement unit measures the position of the pseudo light source based on the position information of the intersection obtained by rotating the rotating unit.

5. The music creation device described in claim 4, wherein the laser light source is connected to the rotating unit via a position variation unit that changes its relative position with respect to the rotating unit, and the position measurement unit measures the position of the pseudo light source based on the position information of the intersection obtained by changing the relative position of the laser light source by the position variation unit.

6. The music creation device of claim 5, wherein the position variation unit is a plurality of extension units that extend in a predetermined direction, and the position measurement unit measures the position of the pseudo light source based on the position information of the intersection obtained by tilting the laser light source relative to the rotating unit by changing the extension lengths of each of the plurality of extension units.

7. A music creation method comprising: a position measurement step in which a position measurement unit measures position information of a pseudo light source formed as an intersection of laser light irradiated from at least two or more laser light sources; a reflection step in which a reflection unit changes the direction of the pseudo light source based on the position information of the pseudo light source measured in the position measurement step; a light reception step in which the light of the pseudo light source whose direction has been changed in the reflection step is received and divided into note names by a light reception unit; and a sound output step in which a sound output unit is driven by the characteristics of the light reception unit.

8. 8. The music creation method according to claim 7, wherein the position measurement step measures the position of the pseudo light source from an irradiation angle of the laser light emitted from one of the laser light sources and an irradiation angle of the laser light emitted from the other laser light source.

9. 9. The music creation method according to claim 8, wherein the position measurement step measures the position of the pseudo light source based on the position information of the intersection obtained by varying the irradiation angle of the laser light emitted from the laser light source using a movable part.

10. 10. The music creating method according to claim 8, wherein the position measuring step measures the position of the pseudo light source based on the position information of the intersection obtained by rotating a rotating section around a predetermined axis.

11. The music creation method according to claim 10, wherein the position measurement step measures the position of the pseudo light source based on the position information of the intersection obtained by changing the relative position of the laser light source with respect to the rotation unit using a position variation unit.

12. The music creation method of claim 10, wherein in the position measurement process, the laser light source is connected to the rotating unit via a plurality of extension portions that extend in a predetermined direction, and the extension lengths of the plurality of extension portions are changed, thereby measuring the position of the pseudo light source based on the position information of the intersection obtained by tilting the laser light source relative to the rotating unit.

13. A music creation device having a position measurement unit that measures position information of a light source, a reflecting unit that changes the direction of the light source based on the position information of the light source measured by the position measurement unit, a light receiving unit that receives the light from the light source whose direction has been changed by the reflecting unit and is divided into note scales, a sound output unit that is driven by the characteristics of the light receiving unit, and a light source of at least two or more light rays that irradiates light rays, wherein the light source is a pseudo light source formed as an intersection of the light rays irradiated from the light source of the light rays.

14. A music creation method comprising: a position measurement step in which a position measurement unit measures position information of a pseudo light source formed as an intersection of light rays emitted from at least two or more light sources; a reflection step in which a reflection unit changes the direction of the pseudo light source based on the position information of the pseudo light source measured in the position measurement step; a light reception step in which the light of the pseudo light source whose direction has been changed in the reflection step is received and divided into note names by a light reception unit; and a sound output step in which a sound output unit is driven by the characteristics of the light reception unit.

Images