Performance pattern generation device, performance pattern generation method and performance pattern generation program

The performance pattern generation device addresses the challenge of repetitive drone displays by associating sound characteristics with flight, light emission, and fireworks patterns, facilitating dynamic and efficient event productions.

JP2024166197APending Publication Date: 2024-11-28DRONE SHOW JAPAN INC
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024128152
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-08-02
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

Existing drone systems lack the ability to generate diverse performance patterns for events, leading to repetitive displays and increased production burdens, as they cannot associate sound characteristics with flight, light emission, and fireworks patterns.

Method used

A performance pattern generation device that stores and associates sound characteristics with flight, light emission, and fireworks patterns, enabling the generation of unique displays by correlating sound information with flight patterns, light emission patterns, and fireworks launch patterns.

Benefits of technology

Enables the creation of dynamic and diverse performance patterns for events by automatically generating synchronized flight, light, and fireworks displays based on sound characteristics, reducing production effort and ensuring unique presentations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024166197000001_ABST
    Figure 2024166197000001_ABST
Patent Text Reader

Abstract

To provide a performance pattern generation device, a performance pattern generation method and a performance pattern generation program capable of generating a performance pattern using a flying object.SOLUTION: A performance pattern generation device includes: a storage part for storing pattern information of a content of movement of a flying object, a content of light emitted by a light emitting part disposed on the flying object, and a content of display of fireworks; an association part for associating a feature content of sound used for the performance with at least one content to be registered in the pattern information to generate association result information; a receiving part for receiving sound information of the sound used for the performance; and an acquisition part referring to the association result information generated by the association part to acquire the content of the movement of the flying object, the content of light emitted by the light emission part disposed on the flying object and the content of the display of the fireworks according to the feature content of the sound based on the sound information received by the receiving part.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a rendering pattern generating device, a rendering pattern generating method, and a rendering pattern generating program. [Background technology]

[0002] There have been attempts to use drones in events such as festivals. The drone described in Patent Document 1 is equipped with a light-emitting diode (LED) and is remotely controlled from a ground station to fly and emit light in the shape of a Great Buddha. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-098421 Summary of the Invention [Problem to be solved by the invention]

[0004] However, events may be held periodically, and it is thought that the audience can be more entertained by performing different performances at each event, but creating drone performances for each event would increase the burden on the production side. With the drone described in Patent Document 1, it is not possible to create performance patterns, and there is a risk that the performance patterns will be the same, and creating performance patterns would increase the burden on the production side.

[0005] The present disclosure provides a performance pattern generation device, a performance pattern generation method, and a performance pattern generation program capable of generating a performance pattern using an aircraft. [Means for solving the problem]

[0006] One embodiment of the performance pattern generation device includes a memory unit that stores pattern information regarding the content of the movement of the flying object, the content of the light emitted by the light-emitting unit arranged on the flying object, and the content of the fireworks being launched; a matching unit that generates correspondence result information by matching the characteristic content of the sound used in the performance with at least one content registered in the pattern information; a reception unit that receives sound information of the sound used in the performance; and an acquisition unit that refers to the correspondence result information generated by the matching unit and acquires the content of the movement of the flying object, the content of the light emitted by the light-emitting unit arranged on the flying object, and the content of the fireworks being launched in accordance with the characteristic content of the sound based on the sound information accepted by the acceptance unit. Effect of the Invention

[0007] According to one embodiment, a pattern for a performance using an aircraft can be generated. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram for explaining a performance pattern generating device according to an embodiment. [Diagram 2] 1 is a block diagram for explaining a performance pattern generating device according to an embodiment. [Diagram 3] 11A to 11D are diagrams for explaining an example of generating response result information, showing the flow of processing when generating response result information. [Figure 4] 1 is a diagram for explaining an example of identifying a pattern corresponding to sound information (sound), in which (A) to (D) show the flow of processing for identifying the pattern. [Diagram 5] 1A and 1B are diagrams for explaining an example of generating a performance pattern, in which (A) is a first example of generating a performance pattern, and (B) is a diagram for explaining a second example of generating a performance pattern. [Figure 6] 1 is a flowchart for explaining a first information processing method (a method for generating a presentation pattern) according to an embodiment. [Figure 7]13 is a flowchart illustrating a second information processing method (billing method) according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] An embodiment will be described below.

[0010] [Overview of the rendering pattern generating device 100] First, an overview of a performance pattern generation device 100 according to an embodiment will be described. FIG. 1 is a diagram illustrating a representation pattern generating device 100 according to an embodiment.

[0011] The effect pattern generation device 100 may be configured as a effect content acquisition (generation) device capable of acquiring and generating effect content when performing an effect using an air vehicle (not shown) at an event, etc. The effect pattern generation device 100 may also be configured as a fee billing device that bills event organizers, advertisers, etc. for the cost of the effect when performing an effect using an air vehicle based on the acquired effect content. The effect pattern generation device 100 is not limited to the device of the above example, and may be configured as various devices, etc. The effect pattern generation device 100 may be, for example, a computer (information processing device) such as a server, a desktop, a laptop, a tablet, or a smartphone.

[0012] The aircraft may be an aircraft, such as a drone or helicopter, that flies by radio control or that flies autonomously based on a preset content (flight pattern), etc. The flying object may, for example, include a light-emitting unit (not shown) that emits light. The light-emitting unit may be a light or the like. As an example, at least one light-emitting unit may be provided on the flying object, and may emit light (turn on and off) based on a preset content (light-emitting pattern). A plurality of light emitting units may be provided on the aircraft. In this case, at least one of the plurality of light emitting units may be selected based on a preset content (light emission pattern) so as to emit light in a preset direction (so that a light capable of emitting light in a preset emission direction emits light).

[0013] The effect pattern generation device 100 stores pattern information. The pattern information may be information in which, for example, the details of the movement of the flying object (flight pattern), the details of the light emitted by the light emitting unit arranged on the flying object (light emission pattern), and the details of the fireworks launch (fireworks launch pattern) are recorded.

[0014] There may be a plurality of flight patterns. For example, the flight pattern may be a pattern related to various movements (flights) of the flying object that enable the flying object to fly. There may be a plurality of light emission patterns. For example, the light emission patterns may be various patterns for turning on and off the light emitting unit (light). The launch pattern of fireworks (launch pattern) may be a pattern of fireworks launched as part of a performance when a flying object is flown in a performance such as an event.

[0015] In the pattern information, the flight pattern, the light emission pattern, and the launch pattern may be previously associated with each other on a one-to-one-to-one basis, or may not be previously associated with each other.

[0016] The effect pattern generation device 100 associates the characteristic content of the sound used in the effect with at least one of the contents registered in the pattern information. That is, the effect pattern generation device 100 associates the characteristic content of the sound used in the effect with at least one of the flight pattern, the light emission pattern, and the launch pattern. The characteristic content of the sound used in the effect may be, for example, at least one of the frequency, rhythm, tempo, and beat of the sound. The effect pattern generation device 100 generates information (correspondence result information) that is the result of associating the characteristic content of the sound with at least one of the flight pattern, the light emission pattern, and the launch pattern. By associating the characteristic content of the sound with one piece of content registered in the pattern information, the performance pattern generation device 100 becomes able to associate a sound based on the received sound information with at least one of a flight pattern, a light emission pattern, and a launch pattern, as described below.

[0017] The effect pattern generation device 100 receives information (sound information) related to sounds to be used in the effect of an event. The sound information may be, for example, information about music to be played during the effect of the event.

[0018] The effect pattern generation device 100 refers to the correspondence result information, acquires the details of the movement of the flying object (flight pattern), the details of the light emitted by the light-emitting unit disposed on the flying object (light emission pattern), and the details of the fireworks launch (launch pattern) according to the features of the sound (sound used in the performance) based on the received sound information, and generates an effect pattern. The features of the sound based on the sound information may be, for example, at least one of the frequency, rhythm, tempo, and beat of the sound.

[0019] [Details of the rendering pattern generating device 100] Next, the effect pattern generating device 100 according to an embodiment will be described in detail. FIG. 2 is a block diagram for explaining the effect pattern generating device 100 according to an embodiment.

[0020] The effect pattern generation device 100 includes, for example, a communication unit 121, a storage unit 122, a display unit 123, and a control unit 110. The communication unit 121, the storage unit 122, and the display unit 123 may be an embodiment of an output unit. The control unit 110 includes, for example, an association unit 111, a reception unit 112, an acquisition unit 113, an identification unit 114, a setting unit 115, a generation unit 116, an assignment unit 117, an estimation unit 118, and a request unit 119. The control unit 110 may be configured by, for example, an arithmetic processing device of the effect pattern generation device 100. The control unit 110 (e.g., a calculation processing unit, etc.) may realize the functions of each unit (e.g., the matching unit 111, the reception unit 112, the acquisition unit 113, the identification unit 114, the setting unit 115, the generation unit 116, the assignment unit 117, the estimation unit 118, and the claim unit 119, etc.) by, for example, appropriately reading and executing various programs, etc. stored in the memory unit 122, etc.

[0021] The communication unit 121 is, for example, a communication interface capable of transmitting and receiving various information to and from a device external to the effect pattern generation device 100 (external device).

[0022] The storage unit 122 may store, for example, various information and programs. Examples of the storage unit 122 may be a memory, a solid state drive, a hard disk drive, etc. Note that the storage unit 122 may be, for example, a storage area and a server on a cloud.

[0023] The memory unit 122 stores pattern information regarding the details of the movement of the flying object (flight pattern), the details of the light emitted by the light-emitting unit arranged on the flying object (light emission pattern), and the details of the fireworks launch (fireworks launch pattern).

[0024] There may be a plurality of flight patterns. The flight pattern may be information that defines (a part of) the movement path of the aircraft and defines the speed and direction in which the aircraft will fly. As an example, the flight pattern may be a pattern related to the movement (flight) of various aircraft that enables the aircraft to fly, such as a pattern of moving horizontally, a pattern of moving vertically, a pattern of moving in a clockwise (or counterclockwise) circular motion, a pattern of moving in a zigzag motion, etc. The flight pattern may be a pattern when one aircraft moves, a pattern when multiple aircraft all move in the same way, or a pattern when each group moves when there are multiple groups consisting of one or multiple aircraft.

[0025] There may be a plurality of light emission patterns. The light emission pattern may be information that defines which color is to be emitted at what timing when there are a plurality of light emission colors. Furthermore, the light emission pattern may be information that defines which light emission unit is to be emitted at what timing when there are a plurality of light emission units. As an example, the light emission pattern may be various patterns of turning on and off the light emission unit (light), including a pattern in which the light emission unit (light) repeatedly turns on and off in a relatively long cycle (or a relatively short cycle), a pattern in which the light emission unit (light) continues to be on (or off) for a set period, and the like.

[0026] The launch pattern of fireworks (launch pattern) may be a pattern of fireworks that are launched as part of a performance when flying an aircraft in a performance such as an event. Note that the fireworks are not limited to launch fireworks, and may include trick fireworks installed on the ground and underwater (surface) fireworks. The launch content of fireworks (launch pattern) may be rephrased as the ignition pattern when igniting the fireworks. The above-mentioned lighting patterns and launch patterns may take into consideration the relationship between the lighting color of the drone and the color of the fireworks.

[0027] In the pattern information, the flight pattern, the light emission pattern, and the launch pattern may be previously associated with each other on a one-to-one-to-one basis, or may not be previously associated with each other.

[0028] The display unit 123 is, for example, a display capable of displaying various characters, symbols, images, and the like.

[0029] 3A to 3D are diagrams for explaining an example of how to generate response result information, where (A) to (D) show the flow of processing when generating response result information.

[0030] The association unit 111 generates association result information by associating the feature content of the sound used for the performance with at least one content registered in the pattern information.

[0031] The association unit 111 associates the feature content of the sound with at least one of the content registered in the pattern information. That is, the association unit 111 associates the feature content of the sound with at least one of the flight pattern, the light emission pattern, and the launch pattern. The feature content of the sound may be, for example, at least one of the frequency, rhythm, tempo, and beat of the sound.

[0032] As a specific example, the association unit 111 may associate sounds that are said to have a strong beat and a good rhythm with flight patterns, light emission patterns, and launch patterns that have a sense of rhythm. As a more specific example, the association unit 111 may associate sounds that are said to have a strong beat and a good rhythm with various patterns that have a strong sense of rhythm and speed, including a pattern in which the flying object flies in a zigzag pattern with a shorter cycle, a light emission pattern in which the light emission unit repeatedly blinks with a shorter cycle, and a launch pattern in which larger fireworks are launched in succession.

[0033] In addition, when specific characteristics of the sound (for example, a song with a strong beat and a song with a good rhythm) are input using an input device (for example, a keyboard and mouse, etc.) (not shown) of the performance pattern generation device 100 (see Figure 3(A)), and when the feeling for each of the flight pattern, light emission pattern, and launch pattern (for example, a strong sense of rhythm and a strong sense of speed, etc.) is set using the input device (see Figure 3(C)), the correspondence unit 111 may generate correspondence result information by correlating the flight pattern, light emission pattern, and launch pattern set to a feeling that the songs with a strong beat and a good sense of rhythm have a good sense of rhythm and a strong sense of speed (see Figure 3(D)).

[0034] That is, various sensations (sensory information) including the strength of rhythm and the strength of speed during the performance may be set for each of the flight patterns, light emission patterns, and launch patterns (see FIG. 3(C)). In this case, the association unit 111 may refer to the association information (see FIG. 3(B)) to identify which sensation the specific characteristic content of the sound (see FIG. 3(A)) corresponds to, identify the flight pattern, light emission pattern, and launch pattern for which the identified sensation (sensory information) is set (see FIG. 3(C)), and associate the characteristic content of the sound with each identified pattern (see FIG. 3(D)).

[0035] The correspondence information may be information that associates specific characteristic contents of a sound with a sensation appropriate to the characteristic contents (see FIG. 3(B)). As an example, in the correspondence information, characteristic contents such as a low-frequency sound, a fast-tempo song, a song with a good beat, and a song with a good rhythm may be associated with a sensation such as a stronger sense of rhythm and a stronger sense of speed (faster). Similarly, as an example, in the correspondence information, characteristic contents such as a high-frequency sound, a slow-tempo song, a song with a weak beat, and a song with a bad rhythm may be associated with a sensation such as a weaker sense of rhythm and a weaker sense of speed (slower).

[0036] As a result, the matching unit 111 generates information (matching result information) that results in matching the characteristic content of the sound (the specific characteristic content of the sound) with at least one of the flight pattern, the light emission pattern, and the launch pattern (see Figure 3 (D)).

[0037] 4A to 4D are diagrams for explaining an example of identifying a pattern corresponding to sound information (sound), in which (A) to (D) show the flow of processing for identifying the pattern.

[0038] The receiving unit 112 receives sound information of sounds to be used in the performance (see FIG. 4(A)). The sound information here may be information of sounds to be reproduced during the event. The receiving unit 112 may receive sound information from an external device (not shown), for example, via the communication unit 121. The external device may be a user terminal used by a user of the effect pattern generation device 100, a server, or the like. Alternatively, for example, when an external memory (not shown) in which sound information is stored is connected to the effect pattern generation device 100 via an interface (not shown), the receiving unit 112 may receive the sound information from the external memory.

[0039] The acquisition unit 113 refers to the correspondence result information generated by the matching unit 111 and acquires the movement content of the flying object (flight pattern), the light emission content (light emission pattern) of the light-emitting unit arranged on the flying object, and the fireworks launch content (launch pattern) according to the sound characteristics content (at least one of the sound frequency, rhythm, tempo, and beat) based on the sound information accepted by the acceptance unit 112.

[0040] As an example, the acquisition unit 113 may analyze the sound information (sound) received by the reception unit 112 to acquire at least one characteristic content of the frequency, rhythm, tempo, and beat of the sound (see FIG. 4(B)). As a specific example, the acquisition unit 113 may acquire (estimate) characteristic content (specific characteristic content) of the sound, such as that the sound based on the sound information received by the reception unit 112 is a song with a good beat and a good rhythm. In this case, the acquisition unit 113 may automatically acquire the sound information (sound) using a known analysis method such as frequency analysis and music analysis (rhythm, tempo, and beat analysis). As another example, the acquisition unit 113 may acquire at least one of the frequency, rhythm, tempo, and beat according to time of the sound information (sound) (at least one of the frequency, rhythm, tempo, and beat for each time).

[0041] The correspondence result information (see FIG. 4(C) and FIG. 3(D)) may be information associating flight patterns, light emission patterns, and launch patterns with characteristic contents of the sound (specific characteristic contents). As an example, the characteristic contents of the sound (specific characteristic contents) may be low frequency sounds, fast tempo songs, songs with a strong beat, songs with good rhythm, high frequency sounds, slow tempo songs, songs without a strong beat, songs with poor rhythm, etc. The characteristic contents of the sound (specific characteristic contents) may include melody (for example, bright and dark according to major and minor keys, peaceful, stimulating, etc.).

[0042] The acquisition unit 113 identifies (see FIG. 4(D)) the flight pattern, light emission pattern, and launch pattern associated with the characteristic content of the sound (specific characteristic content (analysis result (see FIG. 4(B))) received by the reception unit 112, based on the correspondence result information (see FIG. 4(C) and FIG. 3(D)). In this case, if there are multiple identified flight patterns, light emission patterns, and launch patterns, the acquisition unit 113 may identify any one of the flight patterns, light emission patterns, and launch patterns.

[0043] The identification unit 114 identifies the positional relationship between the event venue and the aircraft flying over the event venue. As an example, the identification unit 114 may identify the longitude and latitude of the event venue and the position coordinates where the aircraft is scheduled to fly. The identification unit 114 may identify the position where the aircraft will fly relative to the event venue (positional relationship) based on the longitude and latitude of the event venue and the flight position coordinates of the aircraft. As an example, the identification unit 114 may identify that the aircraft will fly at the front rear of the event venue (positional relationship).

[0044] The setting unit 115 sets the direction of light emitted from the light-emitting unit based on the positional relationship identified by the identification unit 114 and the pattern information stored in the memory unit 122 so that the content of the light emitted by the light-emitting unit can be viewed from the event venue. When an aircraft flies, it may be possible to set the attitude (direction) of the aircraft. As an example, it is possible to set a three-dimensional attitude using the X-axis, Y-axis, and Z-axis for the aircraft, and assuming that the +X direction is the front of the aircraft, it is possible to set the three dimensions of the X-axis, Y-axis, and Z-axis even at the event venue, and if the direction from the flying position of the aircraft (stage) to the audience seating side is the +X direction, the aircraft may be able to fly so that the +X direction is aligned with the +X direction of the event venue as an initial setting. For simplicity's sake, if we assume that the flying object flies with its +X axis pointing toward the +X axis of the event venue, spectators in the stands will be able to see light emitted in the ranges of +X, -Y to +Y, and -Z to +Z. Therefore, in this case, the setting unit 115 may identify, based on the positional relationship, among the light-emitting units (multiple light-emitting units) arranged on the flying object, those light-emitting units that are capable of emitting light in the ranges of the +X direction, the -Y direction to +Y direction, and the -Z direction to +Z direction, and set the identified light-emitting units to emit light according to pattern information (e.g., a light emission pattern).

[0045] Depending on the positional relationship identified by the identification unit 114, the flying object may fly near the center of the event venue. In this case, the setting unit 115 may identify light-emitting units (all of the multiple light-emitting units) that can emit light in the ranges from +X direction to -X direction, -Y direction to +Y direction, and -Z direction to +Z direction, and set the identified light-emitting units to emit light according to pattern information (e.g., a light emission pattern).

[0046] Fig. 5 is a diagram for explaining an example of generating a performance pattern, in which Fig. 5(A) is a diagram for explaining a first example of generating a performance pattern, and Fig. 5(B) is a diagram for explaining a second example of generating a performance pattern.

[0047] As an example, as shown in FIG. 5(A), the generation unit 116 may combine sound information (sound) (M1) received by the reception unit 112 with the flight pattern (A1), light emission pattern (B1), and launch pattern (C1) acquired by the acquisition unit 113 in response to the sound (M1) to generate a pattern of a performance to be performed at the event (flight pattern, light emission pattern, and launch pattern).

[0048] When the characteristic content of the sound (specific characteristic content) changes over time, the generation unit 116 may connect any one of the flight patterns, light emission patterns, and launch patterns identified by the acquisition unit 113 in accordance with the characteristic content of the sound over time to generate flight patterns, light emission patterns, and launch patterns (performance patterns) that are continuous over time. As an example of this case, as shown in FIG. 5(B), when the characteristic content (specific characteristic content) of the sound changes over time (M1, M3, M2...), the same specific characteristic content (M1, M2) may appear multiple times in a non-continuous manner. In addition, multiple flight patterns (A1, A2), multiple light emission patterns (B1, B2), and multiple launch patterns (C1, C2) may be specified corresponding to the same characteristic content (specific characteristic content) of the sound that appears multiple times (M1, M2). In this case, the generation unit 116 may select multiple different patterns from the multiple specified flight patterns, light emission patterns, and launch patterns, and connect the selected patterns in any order in time to generate a performance pattern.

[0049] In other words, for flight patterns (A1, A2) identified corresponding to the same sound characteristic content (M1, M2), the generation unit 116 may select one of the flight patterns (A1, A2) for the sound (sound characteristic content) (M1) when generating a performance pattern, and identify the selected flight pattern (flight pattern (A1) in the example shown in Figure 5 (B)). Similarly, the generation unit 116 may select one of the remaining flight patterns (A1, A2) for the sound (characteristic content of the sound) (M2) when generating a performance pattern, and identify the selected flight pattern (flight pattern (A2) in the example shown in Figure 5 (B)).

[0050] Similarly to the flight patterns described above, the generation unit 116 may also select one of the light emission patterns (B1, B2) for the sound (characteristic content of the sound) (M1) when generating a performance pattern, and identify the selected light emission pattern (light emission pattern (B1) in the example shown in Figure 5 (B)). Similarly, the generation unit 116 may select one of the remaining light emission patterns (B1, B2) for the sound (characteristic content of the sound) (M2) when generating a performance pattern, and identify the selected light emission pattern (flight pattern (B2) in the example shown in Figure 5 (B)).

[0051] Similarly to the flight patterns described above, the generation unit 116 may select one of the launch patterns (C1, C2) as the sound (characteristic content of the sound) (M1) when generating a performance pattern, and identify the selected launch pattern (light emission pattern (C1) in the example shown in Figure 5 (B)). Similarly, the generation unit 116 may select one of the remaining launch patterns (C1, C2) for the sound (characteristic content of the sound) (M2) when generating a performance pattern, and identify the selected launch pattern (flight pattern (C2) in the example shown in Figure 5 (B)).

[0052] 5(B), since the feature contents according to the time lapse during which the sound is reproduced are M1, M3, M2..., the generation unit 116 combines each pattern specified according to the time lapse of the sound (sound feature) in order (A1·B1·C1, A3·B3·C3, and A2·B2·C2 in this order) and generates a performance pattern by associating it with the sound information (sound) (M1, M3, M2) accepted by the acceptance unit 112. That is, the generation unit 116 uses, for example, the feature contents (concrete feature contents) of the sound based on the sound information accepted by the acceptance unit 112 to associate the sound with a flight pattern, a light emission pattern, and a launch pattern, thereby generating a performance pattern.

[0053] The generation unit 116 may record the light-emitting unit specified by the setting unit 115 in association with a performance pattern (for example, a light-emitting pattern, etc.).

[0054] The generation unit 116 may control the output unit to output the generated effect pattern. The output unit may be the communication unit 121, the storage unit 122, the display unit 123, or the like. The generation unit 116 may, for example, control the communication unit 121 to transmit the generated performance pattern to an external device (not shown). The external device may be a playback device that reproduces sound information, an aircraft, an ignition device that launches fireworks, or the like. When an instruction to start a performance based on a performance pattern is input, the generation unit 116 may transmit a control signal to each external device to start the performance (to start sound playback, flight of the aircraft, lighting / extinguishing of the light-emitting unit, and launching fireworks based on the performance pattern). The generation unit may transmit only related patterns from among the performance patterns to each external device. Furthermore, the generation unit 116 may control the storage unit 122 to store the effect pattern. Furthermore, the generation unit 116 may control the display unit 123 to display the effect pattern.

[0055] As a result, when the generated performance pattern is executed, the sound registered in the performance pattern is played in the event venue, the flying object flies autonomously or by radio control in accordance with the performance pattern and the played sound, and the light emitting unit disposed on the flying object lights up. Furthermore, a control signal is sent to an ignition device (not shown) for the fireworks in accordance with the performance pattern, and the fireworks are launched.

[0056] When performing a performance using the above-mentioned performance pattern, the granting unit 117 calculates a total score by adding a score based on the number of spectators watching at the event venue and a preset first value score, and a score based on the number of spectators watching the performance online and a preset second value score (second value<first value). That is, the granting unit 117 grants a first value score to each spectator at the event venue, and grants a second value score lower than the first value to each spectator viewing a video of the event venue. The granting unit 117 calculates a total score based on the score according to the number of spectators at the event venue and the score according to the number of spectators watching the performance online (video). For example, the granting unit 117 can obtain the number of spectators at the event venue and the number of spectators watching online (video) by various known methods.

[0057] The estimation unit 118 estimates an amount of money according to the total value (total score) of the points awarded by the awarding unit 117. Since an amount of money according to one point (or a predetermined unit of score) is preset, for example, the estimation unit 118 can calculate an amount of money according to the total value (total score) by multiplying the total value (total score).

[0058] The billing unit 119 bills the amount estimated by the estimation unit 118 to the advertiser of the event held at the event venue. The advertiser of the event may include the organizer of the event. When there are multiple advertisers of the event, the billing unit 119 may divide the amount estimated by the estimation unit 118 by the number of advertisers and bill each of the multiple advertisers for the calculated amount. Alternatively, when a burden ratio is set in advance for multiple advertisers, the billing unit 119 may bill each advertiser for the amount of the amount estimated by the estimation unit 118 for each burden ratio. When the contact information (e.g., email address, etc.) of the advertiser is set in advance, the billing unit 119 may generate an invoice stating the amount to be billed to each advertiser and send the invoice to the contact information. For example, the billing unit 119 can use various known generation methods when automatically generating an invoice.

[0059] [Information processing method] Next, an information processing method according to an embodiment will be described.

[0060] (First information processing method) First, as an information processing method, a method for generating a performance pattern will be described. FIG. 6 is a flowchart illustrating a first information processing method (a method for generating a presentation pattern) according to an embodiment.

[0061] In step ST101, the association unit 111 generates association result information by associating a feature content of a sound used for a performance with at least one content registered in the pattern information.

[0062] In step ST102, the receiving unit 112 receives sound information on sounds to be used for the performance.

[0063] In step ST103, the acquisition unit 113 refers to the response result information generated in step ST101, and acquires the movement content (flight pattern) of the flying object, the light emission content (light emission pattern) of the light-emitting unit arranged on the flying object, and the fireworks launch content (launch pattern) according to the sound characteristics content (e.g., at least one of the sound frequency, rhythm, tempo, and beat) based on the sound information received in step ST102.

[0064] In step ST104, the identification unit 114 identifies the positional relationship between the event venue and the flying object flying over the event venue.

[0065] In step ST105, the setting unit 115 sets the direction, color, timing, etc. of the light emitted from the light-emitting unit (light-emitting unit) based on the positional relationship identified in step ST104 and the pattern information (e.g., the light-emitting pattern) stored in the memory unit 122 so that the content of the light emitted by the light-emitting unit can be viewed from the event venue.

[0066] In step ST106, the generation unit 116 may generate a performance pattern (a flight pattern, a light emission pattern, a launch pattern, and other performance patterns) to be performed at the event by combining the sound information (sound) received in step ST102 with the flight pattern, light emission pattern, and launch pattern obtained in step ST103 corresponding to that sound. In this case, the generation unit 116 may record the light-emitting unit set in step ST105 in association with a performance pattern (for example, a light-emitting pattern, etc.). That is, the generation unit 116 may register the setting of the light-emitting unit set in step ST105 in the performance pattern so that the light-emitting unit emits light (light-emitting and light-off) according to the light-emitting pattern acquired in step ST103.

[0067] (Second information processing method) Next, as an information processing method, a method for charging for the costs of a production (event) will be described. FIG. 7 is a flowchart for explaining the second information processing method (billing method) according to an embodiment.

[0068] In step ST201, the awarding unit 117 awards a first value of score to each spectator watching the performance at the event venue, and awards a second value of score lower than the first value to each spectator (e.g., number of accesses) viewing (viewing online) a video of the event venue (performance).

[0069] In step ST202, the estimation unit 118 estimates an amount of money according to the total value of the points awarded in step ST201 (total points).

[0070] In step ST203, the billing section 119 bills the amount estimated in step ST202 to the advertiser of the event (performance) held at the event venue.

[0071] [Functions and circuits] Next, the functions and circuits of the above-mentioned effect pattern generation device 100 will be described. Each unit of the effect pattern generation device 100 may be realized as a function of a computer arithmetic processing device or the like. That is, the association unit 111, the reception unit 112, the acquisition unit 113, the identification unit 114, the setting unit 115, the generation unit 116, the granting unit 117, the estimation unit 118, and the request unit 119 (control unit 110) of the effect pattern generation device 100 may be realized as an association function, a reception function, an acquisition function, an identification function, a setting function, a generation function, an granting function, an estimation function, and a request function (control function) by the computer arithmetic processing device or the like. The effect pattern generation program can cause a computer to realize each of the above-mentioned functions. The effect pattern generation program may be recorded in a non-transitory computer-readable recording medium, such as a memory, a solid-state drive, a hard disk drive, or an optical disk. The recording medium may be referred to as a non-transitory computer-readable medium, for example. As described above, each unit of the effect pattern generation device 100 may be realized by an arithmetic processing device of a computer or the like. The arithmetic processing device or the like is constituted by, for example, an integrated circuit or the like. For this reason, each unit of the effect pattern generation device 100 may be realized as a circuit constituting the arithmetic processing device or the like. That is, the correspondence unit 111, the reception unit 112, the acquisition unit 113, the specification unit 114, the setting unit 115, the generation unit 116, the assignment unit 117, the estimation unit 118, and the request unit 119 (control unit 110) of the effect pattern generation device 100 may be realized as a correspondence circuit, a reception circuit, an acquisition circuit, a specification circuit, a setting circuit, a generation circuit, an assignment circuit, an estimation circuit, and a request circuit (control circuit) constituting the arithmetic processing device of a computer or the like. The communication unit 121, the storage unit 122, and the display unit 123 (output unit) of the effect pattern generation device 100 may be realized as a communication function, a storage function, and a display function (output function) including the functions of an arithmetic processing device or the like. The communication unit 121, the storage unit 122, and the display unit 123 (output unit) of the effect pattern generation device 100 may be realized as a communication circuit, a storage circuit, and a display circuit (output circuit) by being configured, for example, by an integrated circuit or the like. The communication unit 121, the storage unit 122, and the display unit 123 (output unit) of the effect pattern generation device 100 may be realized as a communication device, a storage device, and a display device (output device) by being configured, for example, by being configured by a plurality of devices.

[0072] The effect pattern generating device 100 can combine one or any two or more of the above-mentioned multiple units. In this disclosure, the term "information" is used, but the term "information" can be replaced with "data" and the term "data" can be replaced with "information."

[0073] [Aspects and Effects of the Present Embodiment] Next, one aspect of this embodiment and the effects of each aspect will be described. Note that each aspect described below is an example at the time of filing, and this embodiment is not limited to the aspects described below. In other words, this embodiment is not limited to each aspect described below, and may be realized by appropriately combining each of the above-mentioned parts. In addition, a lower aspect may be able to cite any of the higher aspects. In addition, the effects described below are merely examples, and the effects of each aspect are not limited to those described below. In addition, each aspect may, for example, achieve at least one of the effects described below.

[0074] (Aspect 1) One embodiment of the performance pattern generation device includes a memory unit that stores pattern information regarding the content of the movement of the flying object, the content of the light emitted by the light-emitting unit arranged on the flying object, and the content of the fireworks being launched; a matching unit that generates correspondence result information by matching the characteristic content of the sound used in the performance with at least one content registered in the pattern information; a reception unit that receives sound information of the sound used in the performance; and an acquisition unit that refers to the correspondence result information generated by the matching unit and acquires the content of the movement of the flying object, the content of the light emitted by the light-emitting unit arranged on the flying object, and the content of the fireworks being launched in accordance with the characteristic content of the sound based on the sound information accepted by the acceptance unit. In other words, the performance pattern generation device can identify and acquire the content of the movement of the flying object (flight pattern), the content of the light emitted (light emission pattern), and the content of the fireworks launched (launch pattern) according to the characteristics of the sound used in the performance, and automatically generate a performance pattern that combines each of the acquired patterns with the sound used in the performance. In the performance pattern, when the start execution process is performed, the playback of sound, the flight of the flying object according to the flight pattern (performance pattern), the lighting and extinguishing of the light-emitting part according to the light-emitting pattern (performance pattern), and the launch of fireworks according to the launch pattern (performance pattern) can all start simultaneously. That is, the flying object can fly according to the performance pattern and the lighting and extinguishing of the light-emitting part. Also, the fireworks launching device can launch fireworks according to the performance pattern.

[0075] (Aspect 2) One embodiment of the performance pattern generation device may include an identification unit that identifies the positional relationship between an event venue and an aircraft flying over the event venue, and a setting unit that sets the direction of light emitted from the light-emitting unit based on the positional relationship identified by the identification unit and the pattern information stored in a memory unit, so that the content of the light emitted by the light-emitting unit can be viewed from the event venue. This allows the effect pattern generating device to generate an effect pattern suitable for spectators watching from the event venue.

[0076] (Aspect 3) One embodiment of the performance pattern generation device may include an assignment unit that assigns a first score value to each spectator at an event venue and assigns a second score value lower than the first value to each spectator viewing a video of the event venue, an estimation unit that estimates an amount of money corresponding to the total value of the scores assigned by the assignment unit, and a billing unit that bills advertisers of events held at the event venue for the amount estimated by the estimation unit. This allows the effect pattern generating device to charge for the cost of executing the generated effect pattern.

[0077] (Aspect 4) In one embodiment of the performance pattern generation method, a computer having a memory unit that stores pattern information regarding the content of the movement of the flying object, the content of the light emitted by the light-emitting unit arranged on the flying object, and the content of the fireworks being launched executes a matching step of generating correspondence result information by matching the characteristic content of the sound used in the performance with at least one content registered in the pattern information, a reception step of receiving sound information of the sound to be used in the performance, and an acquisition step of referring to the correspondence result information generated by the matching step, and acquiring the content of the movement of the flying object, the content of the light emitted by the light-emitting unit arranged on the flying object, and the content of the fireworks being launched according to the characteristic content of the sound based on the sound information received by the reception step. As a result, the effect pattern generating method can achieve the same effects as the effect pattern generating device of the above-mentioned aspect.

[0078] (Aspect 5) One embodiment of the performance pattern generation program has a computer having a memory unit that stores pattern information regarding the content of the movement of the flying object, the content of the light emitted by the light-emitting unit arranged on the flying object, and the content of the fireworks being launched, and has the following realizations: a matching function that generates correspondence result information by matching the characteristic content of the sound used in the performance with at least one content registered in the pattern information, a reception function that receives sound information of the sound used in the performance, and an acquisition function that refers to the correspondence result information generated by the matching function and acquires the content of the movement of the flying object, the content of the light emitted by the light-emitting unit arranged on the flying object, and the content of the fireworks being launched in accordance with the characteristic content of the sound based on the sound information accepted by the acceptance function. As a result, the effect pattern generation program can achieve the same effect as the effect pattern generation device of the above-mentioned aspect. [Explanation of symbols]

[0079] 100 Production pattern generating device 110 Control section 111 Mapping section 112 Reception 113 Acquisition Department 114 Specific section 115 Setting section 116 Generation part 117 Granting Department 118 Estimation Department 119 Billing Department 121 Communications Department 122 Storage section 123 Display section

Claims

1. a storage unit that stores pattern information regarding the details of the movement of the flying object, the details of the light emitted by the light emitting unit disposed on the flying object, and the details of the fireworks being launched; a correspondence unit that generates correspondence result information by corresponding a feature content of a sound used for a performance to at least one content registered in the pattern information; A reception unit that receives sound information of sounds to be used in the performance; an acquisition unit that acquires details of the movement of the flying object, details of the light emitted by a light-emitting unit disposed on the flying object, and details of the fireworks being launched in accordance with the sound feature details based on the sound information received by the reception unit, by referring to the correspondence result information generated by the association unit; A performance pattern generating device comprising:

2. An identification unit that identifies a positional relationship between an event venue and an aircraft flying over the event venue; a setting unit that sets a direction of light emitted from the light-emitting unit based on the positional relationship specified by the specifying unit and the pattern information stored in the storage unit so that the content of the light emitted by the light-emitting unit can be viewed from the event venue; and The effect pattern generating device according to claim 1 .

3. an awarding unit that awards a first score value to each spectator present at the event venue and awards a second score value lower than the first score value to each spectator viewing a video of the event venue; an estimation unit that estimates an amount of money according to the total value of the points awarded by the awarding unit; a billing unit that bills an advertiser of an event to be held at the event venue for the amount estimated by the estimation unit; The effect pattern generating device according to claim 1 or 2, comprising:

4. a computer including a storage unit that stores pattern information regarding the details of the movement of the flying object, the details of the light emitted by a light-emitting unit disposed on the flying object, and the details of the fireworks launch, a correspondence step of generating correspondence result information by corresponding a feature content of a sound used for a performance to at least one content registered in the pattern information; A receiving step of receiving sound information of sounds to be used in the performance; an acquisition step of acquiring details of the movement of the flying object, details of the light emitted by a light-emitting unit disposed on the flying object, and details of the fireworks launching according to the sound feature details based on the sound information received in the reception step by referring to the correspondence result information generated in the association step; A production pattern generating method for executing the above.

5. A computer having a storage unit that stores pattern information regarding the details of the movement of the flying object, the details of the light emitted by a light emitting unit disposed on the flying object, and the details of the fireworks being launched, a correspondence function for generating correspondence result information by corresponding a feature content of a sound used for a performance to at least one content registered in the pattern information; A reception function for receiving sound information for use in the performance; an acquisition function that acquires the details of the movement of the flying object, the details of the light emitted by the light-emitting function arranged on the flying object, and the details of the fireworks launching according to the sound feature details based on the sound information accepted by the acceptance function, by referring to the correspondence result information generated by the association function; A performance pattern generation program that realizes this.

Citation Information

Patent Citations

  • Composition of light drawn by attaching LED lamp to many drones equipped with ai

    JP2021098421A