Performance pattern generation device, performance pattern generation method, and performance pattern generation program

The performance pattern generation device addresses the challenge of repetitive drone displays by associating sound characteristics with flight, light emission, and fireworks patterns, enabling dynamic and engaging event performances.

WO2024237256A1PCT designated stage expired Publication Date: 2024-11-21DRONE SHOW JAPAN INC
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/017839
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-16
Filing Date
2024-05-14
Publication Date
2024-11-21

AI Technical Summary

Technical Problem

Existing drone performance systems for events lack the ability to generate diverse performance patterns, leading to repetitive displays and increased production burdens, as they cannot effectively associate sound characteristics with flight, light emission, and fireworks patterns.

Method used

A performance pattern generation device and method that includes a storage unit for pattern information and a mapping function to associate sound characteristics with flight, light emission, and fireworks patterns, allowing for the generation of dynamic performance patterns based on received sound information.

Benefits of technology

Enables the creation of unique and synchronized performance patterns for events, reducing production burdens by automatically generating flight, light emission, and fireworks displays that match the characteristics of the sound, enhancing audience engagement.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024017839_21112024_PF_FP_ABST
    Figure JP2024017839_21112024_PF_FP_ABST
Patent Text Reader

Abstract

Provided are a performance pattern generation device, a performance pattern generation method, and a performance pattern generation program that make it possible to generate a pattern for a performance that uses a flying body. A performance pattern generation device according to the present invention comprises a storage unit that stores pattern information about the details of the movement of a flying body, the details of light emission by a light emission unit provided to the flying body, and the details of the launch of fireworks, an association unit that associates characteristic details for sound used in performances with at least one of the details registered in the pattern information to generate association results information, a reception unit that receives sound information about sound to be used in a performance, and an acquisition unit that references the association results information generated by the association unit to acquire details for the movement of the flying body, details for light emission by the light emission unit provided to the flying body, and details for the launch of fireworks that correspond to sound characteristic details based on the sound information received by the reception unit.
Need to check novelty before this filing date? Find Prior Art

Description

Rendering pattern generating device, rendering pattern generating method, and rendering pattern generating program

[0001] The present disclosure relates to a rendering pattern generation device, a rendering pattern generation method, and a rendering pattern generation program.

[0002] Conventionally, attempts have been made to use drones in events such as festivals. The drone described in Patent Literature 1 is equipped with a light-emitting diode (LED) and is remotely controlled from a ground station to fly and emit light in the shape of a Great Buddha.

[0003] Japanese Patent Application Laid-Open No. 2021-098421

[0004] However, events may be held periodically, and while it is thought that different performances for each event could enhance the enjoyment of the audience, creating drone performances for each event would place a greater burden on the production side. With the drone described in Patent Document 1, it is not possible to create performance patterns, and there is a risk that the performance patterns will be the same, and creating performance patterns could increase the burden on the production side.

[0005] The present disclosure provides a performance pattern generation device, a performance pattern generation method, and a performance pattern generation program capable of generating performance patterns using flying objects.

[0006] One embodiment of the effect pattern generation device includes a memory unit that stores pattern information regarding the details of the movement of the flying object, the details of the light emitted by the light-emitting unit arranged on the flying object, and the details of the fireworks being launched; a matching unit that generates correspondence result information by matching the characteristic details of the sound used in the effect with at least one of the details registered in the pattern information; a reception unit that receives sound information of the sound used in the effect; and an acquisition unit that refers to the correspondence result information generated by the matching unit and acquires the details of the movement of the flying object, the details of the light emitted by the light-emitting unit arranged on the flying object, and the details of the fireworks being launched in accordance with the characteristic details of the sound based on the sound information received by the reception unit.

[0007] According to one aspect, it is possible to generate a pattern of effects using flying objects.

[0008] FIG. 1 is a diagram for explaining an effect pattern generation device according to an embodiment. FIG. 2 is a block diagram for explaining an effect pattern generation device according to an embodiment. FIG. 3 is a diagram for explaining an example of generating response result information. (A) to (D) show the flow of processing when generating response result information. FIG. 4 is a diagram for explaining an example of identifying a pattern corresponding to sound information (sound). (A) to (D) show the flow of processing when identifying the pattern. FIG. 5 is a diagram for explaining an example of generating an effect pattern. (A) is a diagram for explaining a first example of generating an effect pattern, and (B) is a diagram for explaining a second example of generating an effect pattern. FIG. 6 is a flowchart for explaining a first information processing method (effect pattern generation method) according to an embodiment. FIG. 7 is a flowchart for explaining a second information processing method (billing method) according to an embodiment.

[0009] An embodiment will be described below.

[0010] [Outline of effect pattern generation device 100] First, an outline of the effect pattern generation device 100 according to an embodiment will be described. Fig. 1 is a diagram for explaining the effect pattern generation device 100 according to an embodiment.

[0011] The effect pattern generation device 100 may be configured as an effect content acquisition (generation) device or the like that can acquire and generate effect content when performing an effect using an air vehicle (not shown) at an event or the like. The effect pattern generation device 100 may also be configured as a fee billing device or the like that bills event organizers, advertisers, etc. for the cost of the effect when performing an effect using an air vehicle based on the acquired effect content. The effect pattern generation device 100 is not limited to the device described above as an example, and may also be configured as various other devices. The effect pattern generation device 100 may be, for example, a computer (information processing device) such as a server, desktop, laptop, tablet, or smartphone.

[0012] The flying object may be a drone, a helicopter, or the like, which flies by radio control, or an aircraft that flies autonomously based on a preset content (flight pattern), etc. The flying object may be equipped with, for example, a light-emitting unit (not shown) that emits light. The light-emitting unit may be a light, etc. As an example, at least one light-emitting unit may be provided on the flying object, and may emit light (turn on and off) based on a preset content (light-emitting pattern). Note that a plurality of light-emitting units may be provided on the flying object. In this case, at least one of the plurality of light-emitting units may be selected, for example, based on the preset content (light-emitting pattern), so as to emit light in a set direction (so that a light that can emit light in a set emission direction emits light).

[0013] The effect pattern generation device 100 stores pattern information. The pattern information may be information that records, for example, the details of the movement of the flying object (flight pattern), the details of the light emitted by the light-emitting unit disposed on the flying object (light-emitting pattern), and the details of the fireworks launch (fireworks launch pattern).

[0014] There may be a plurality of flight patterns. As an example, the flight pattern may be a pattern relating to various movements (flights) of the flying object that enable the flying object to fly. There may be a plurality of light emission patterns. As an example, the light emission pattern may be various patterns relating to the turning on and off of light-emitting units (lights). The launch pattern (launch pattern) of fireworks may be a pattern relating to fireworks that are launched as part of a performance when the flying object is flown in a performance of an event or the like.

[0015] In the pattern information, the flight pattern, the light emission pattern, and the launch pattern may be previously associated one-to-one with each other, or may not be previously associated with each other.

[0016] The effect pattern generation device 100 associates the characteristic content of the sound used in the effect with at least one content registered in the pattern information. That is, the effect pattern generation device 100 associates the characteristic content of the sound used in the effect with at least one of a flight pattern, a light-emitting pattern, and a launch pattern. The characteristic content of the sound used in the effect may be, for example, at least one of the frequency, rhythm, tempo, and beat of the sound. The effect pattern generation device 100 generates information (correspondence result information) that results from associating the characteristic content of the sound with at least one of the flight pattern, the light-emitting pattern, and the launch pattern. By associating the characteristic content of the sound with one content registered in the pattern information, the effect pattern generation device 100 becomes able to associate a sound based on received sound information with at least one of the flight pattern, the light-emitting pattern, and the launch pattern, as described below.

[0017] The effect pattern generation device 100 receives information (sound information) about sounds to be used in the effect of an event. The sound information may be, for example, information about music to be played when the event is effected.

[0018] The effect pattern generation device 100 references the correspondence result information, acquires the details of the movement of the flying object (flight pattern), the details of the light emitted by the light-emitting unit disposed on the flying object (light-emitting pattern), and the details of the fireworks launch (launch pattern) according to the details of the characteristics of the sound (sound used in the effect) based on the received sound information, and generates an effect pattern. The details of the characteristics of the sound based on the sound information may be at least one of the frequency, rhythm, tempo, and beat of the sound, for example.

[0019] [Details of effect pattern generation device 100] Next, the effect pattern generation device 100 according to one embodiment will be described in detail. Fig. 2 is a block diagram for explaining the effect pattern generation device 100 according to one embodiment.

[0020] The effect pattern generation device 100 includes, for example, a communication unit 121, a storage unit 122, a display unit 123, and a control unit 110. The communication unit 121, the storage unit 122, and the display unit 123 may be an embodiment of an output unit. The control unit 110 includes, for example, an association unit 111, a reception unit 112, an acquisition unit 113, an identification unit 114, a setting unit 115, a generation unit 116, an assignment unit 117, an estimation unit 118, and a request unit 119. The control unit 110 may be configured by, for example, an arithmetic processing unit of the effect pattern generation device 100. The control unit 110 (e.g., a processing unit, etc.) may realize the functions of each unit (e.g., the matching unit 111, the reception unit 112, the acquisition unit 113, the identification unit 114, the setting unit 115, the generation unit 116, the assignment unit 117, the estimation unit 118, and the billing unit 119, etc.) by, for example, appropriately reading and executing various programs, etc. stored in the memory unit 122, etc.

[0021] The communication unit 121 is, for example, a communication interface that can transmit and receive various information to and from devices (external devices) external to the effect pattern generation device 100 .

[0022] The storage unit 122 may store, for example, various information and programs. Examples of the storage unit 122 may be a memory, a solid state drive, a hard disk drive, etc. Note that the storage unit 122 may be, for example, a storage area or a server on a cloud.

[0023] The memory unit 122 stores pattern information regarding the details of the movement of the flying object (flight pattern), the details of the light emitted by the light-emitting unit arranged on the flying object (light-emitting pattern), and the details of the fireworks launch (fireworks launch pattern).

[0024] There may be multiple flight patterns. The flight pattern may be information that defines (a part of) the movement path of the aircraft and defines the speed and direction of flight. As an example, the flight pattern may be a pattern related to various aircraft movements (flights) that enable the aircraft to fly, such as a pattern of horizontal movement, a pattern of vertical movement, a pattern of circular movement clockwise (or counterclockwise), a zigzag movement, etc. The flight pattern may be a pattern when one aircraft moves, a pattern when multiple aircraft all move in the same way, or a pattern when each group moves when there are multiple groups consisting of one or more aircraft.

[0025] There may be a plurality of light-emitting patterns. When there are a plurality of light-emitting colors, the light-emitting pattern may be information that defines which color is to be emitted at what timing. Furthermore, when there are a plurality of light-emitting units, the light-emitting pattern may be information that defines which light-emitting unit is to be emitted at what timing. As an example, the light-emitting pattern may be various patterns for turning on and off the light-emitting unit (light), such as a pattern in which the light-emitting unit (light) repeatedly turns on and off in a relatively long cycle (or a relatively short cycle), or a pattern in which the light-emitting unit (light) continues to be on (or off) for a set period.

[0026] The launch pattern of fireworks (launch pattern) may be a pattern of fireworks launched as part of a performance when flying an aircraft in an event or the like. Note that the fireworks are not limited to launch fireworks, but may also include trick fireworks installed on the ground and underwater (surface) fireworks. The launch content of fireworks (launch pattern) may also be referred to as the ignition pattern when igniting the fireworks. The above-mentioned light emission pattern and launch pattern may take into consideration the relationship between the light emission color of the drone and the color of the fireworks.

[0027] In the pattern information, the flight pattern, the light emission pattern, and the launch pattern may be previously associated one-to-one with each other, or may not be previously associated with each other.

[0028] The display unit 123 is a display capable of displaying, for example, various characters, symbols, images, and the like.

[0029] 3A to 3D are diagrams for explaining an example of generating response result information, in which (A) to (D) show the flow of processing when generating response result information.

[0030] The association unit 111 generates association result information by associating the feature content of the sound used for the performance with at least one content registered in the pattern information.

[0031] The association unit 111 associates the characteristic content of the sound with at least one content registered in the pattern information. That is, the association unit 111 associates the characteristic content of the sound with at least one of a flight pattern, a light emission pattern, and a launch pattern. The characteristic content of the sound may be, for example, at least one of the frequency, rhythm, tempo, and beat of the sound.

[0032] As a specific example, the association unit 111 may associate sounds that are said to have a strong beat and a good rhythm with flight patterns, light emission patterns, and launch patterns that have a sense of rhythm. As a more specific example, the association unit 111 may associate sounds that are said to have a strong beat and a good rhythm with various patterns that have a strong sense of rhythm and a strong sense of speed, such as a pattern in which the flying object flies in a zigzag pattern with shorter cycles, a light emission pattern in which the light emission unit repeatedly blinks with shorter cycles, and a launch pattern in which larger fireworks are launched in succession.

[0033] In addition, when specific characteristics of the sound (for example, a song with a strong beat and a song with a good rhythm, etc.) are input using an input device (for example, a keyboard and mouse, etc.) (not shown) of the performance pattern generation device 100 (see Figure 3(A)), and when the feeling for each of the flight pattern, light emission pattern, and launch pattern (for example, the strength of the sense of rhythm and the strength of the sense of speed, etc.) is set using the input device (see Figure 3(C)), the correspondence unit 111 may generate correspondence result information by associating the flight pattern, light emission pattern, and launch pattern set with the feeling that songs with a strong beat and a good sense of rhythm have a good sense of rhythm and a strong sense of speed (see Figure 3(D)).

[0034] That is, various sensations (sensory information) such as the strength of the rhythm and the strength of the sense of speed during the performance may be set for each of the flight pattern, light emission pattern, and launch pattern (see FIG. 3(C)). In this case, the association unit 111 may refer to the association information (see FIG. 3(B)) to identify which sensation a specific characteristic content of the sound (see FIG. 3(A)) corresponds to, identify the flight pattern, light emission pattern, and launch pattern for which the identified sensation (sensory information) is set (see FIG. 3(C)), and associate the characteristic content of the sound with each identified pattern (see FIG. 3(D)).

[0035] The correspondence information may be information that associates specific characteristics of a sound with sensations appropriate for the characteristics (see FIG. 3B). As an example, the correspondence information may associate characteristics such as low-frequency sounds, songs with fast tempos, songs with strong beats, and songs with good rhythms with sensations such as a stronger sense of rhythm and a stronger sense of speed (faster). Similarly, as an example, the correspondence information may associate characteristics such as high-frequency sounds, songs with slow tempos, songs without strong beats, and songs with poor rhythms with sensations such as a weaker sense of rhythm and a weaker sense of speed (slower).

[0036] As a result, the association unit 111 generates information (association result information) that results in association of the characteristic content of the sound (specific characteristic content of the sound) with at least one of the flight pattern, light emission pattern, and launch pattern (see Figure 3 (D)).

[0037] 4A to 4D are diagrams for explaining an example of identifying a pattern corresponding to sound information (sound). (A) to (D) show the flow of processing when identifying the pattern.

[0038] The receiving unit 112 receives sound information of sounds to be used in the effect (see FIG. 4(A)). The sound information here may be information of sounds to be played at an event. The receiving unit 112 may receive the sound information from an external device (not shown), for example, via the communication unit 121. The external device may be a user terminal used by a user of the effect pattern generation device 100, a server, or the like. Alternatively, for example, when an external memory (not shown) storing the sound information is connected to the effect pattern generation device 100 via an interface (not shown), the receiving unit 112 may receive the sound information from the external memory.

[0039] The acquisition unit 113 refers to the correspondence result information generated by the association unit 111 and acquires the details of the movement of the flying object (flight pattern), the details of the light emitted by the light-emitting unit arranged on the flying object (light emission pattern), and the details of the fireworks launch (launch pattern) according to the characteristics of the sound (at least one of the frequency, rhythm, tempo, and beat of the sound) based on the sound information received by the reception unit 112.

[0040] As an example, the acquisition unit 113 may analyze the sound information (sound) received by the reception unit 112 to acquire at least one characteristic content of the sound's frequency, rhythm, tempo, and beat (see FIG. 4B ). As a specific example, the acquisition unit 113 may acquire (estimate) characteristic content (specific characteristic content) of the sound, such as whether the sound based on the sound information received by the reception unit 112 is a song with a strong beat or a good rhythm. In this case, the acquisition unit 113 may automatically acquire the sound information (sound) using known analysis methods such as frequency analysis and music analysis (rhythm, tempo, and beat analysis). As another example, the acquisition unit 113 may acquire at least one of the frequency, rhythm, tempo, and beat of the sound information (sound) according to time (at least one of the frequency, rhythm, tempo, and beat for each time period).

[0041] The correspondence result information (see Figures 4(C) and 3(D)) may be information that associates flight patterns, light emission patterns, and launch patterns with characteristic content (specific characteristic content) of the sound. As an example, the characteristic content (specific characteristic content) of the sound may be a low-frequency sound, a fast-tempo song, a song with a strong beat, a song with a good rhythm, a high-frequency sound, a slow-tempo song, a song without a strong beat, a song with a bad rhythm, etc. The characteristic content (specific characteristic content) of the sound may include melody (for example, bright and dark according to major and minor keys, peaceful, stimulating, etc.).

[0042] Based on the correspondence result information (see FIGS. 4(C) and 3(D)), the acquisition unit 113 identifies (see FIG. 4(D)) the flight pattern, light emission pattern, and launch pattern associated with the characteristic content (specific characteristic content (analysis result (see FIG. 4(B))) of the sound accepted by the acceptance unit 112. In this case, if there are multiple identified flight patterns, light emission patterns, and launch patterns, the acquisition unit 113 may identify any one of the flight patterns, light emission patterns, and launch patterns.

[0043] The identification unit 114 identifies the positional relationship between the event venue and the aircraft flying over the event venue. As an example, the identification unit 114 may identify the longitude and latitude of the event venue and the coordinates of the location where the aircraft is scheduled to fly. The identification unit 114 may identify the location where the aircraft will fly relative to the event venue (positional relationship) based on the longitude and latitude of the event venue and the flight position coordinates of the aircraft. As an example, the identification unit 114 may identify that the aircraft will fly at the front and rear of the event venue (positional relationship).

[0044] The setting unit 115 sets the direction of the light emitted from the light-emitting unit based on the positional relationship identified by the identification unit 114 and the pattern information stored in the memory unit 122 so that the light emitted by the light-emitting unit can be viewed from the event venue. When the aircraft flies, it may be possible to set the aircraft's attitude (orientation). As an example, it is possible to set a three-dimensional attitude using the X, Y, and Z axes for the aircraft. Assuming that the +X direction is the front of the aircraft, it is possible to set the three-dimensional orientation of the X, Y, and Z axes at the event venue. If the +X direction is from the aircraft's flight position (stage) toward the audience seats, the aircraft may be able to fly so that the +X direction is aligned with the +X direction of the event venue as an initial setting. For simplicity's sake, if the aircraft flies with its +X axis facing the +X axis of the event venue, spectators in the audience seats can view light emitted in the +X direction, the -Y to +Y direction, and the -Z to +Z direction. Therefore, in this case, the setting unit 115 may identify, based on the positional relationship, a light-emitting unit that can emit light in the ranges of the +X direction, the -Y direction to the +Y direction, and the -Z direction to the +Z direction from among the light-emitting units (plurality of light-emitting units) arranged on the flying object, and set the identified light-emitting unit to emit light in accordance with pattern information (e.g., a light-emitting pattern).

[0045] Note that the flying object may fly near the center of the event venue depending on the positional relationship identified by the identification unit 114. In this case, the setting unit 115 may identify light-emitting units (all of the multiple light-emitting units) that can emit light in the ranges from the +X direction to the −X direction, the −Y direction to the +Y direction, and the −Z direction to the +Z direction, and set the identified light-emitting units to emit light in accordance with pattern information (for example, a light-emitting pattern).

[0046] 5A and 5B are diagrams illustrating an example of generating a presentation pattern, in which Fig. 5A is a diagram illustrating a first example of generating a presentation pattern, and Fig. 5B is a diagram illustrating a second example of generating a presentation pattern.

[0047] As an example, as shown in FIG. 5(A), the generation unit 116 may combine sound information (sound) (M1) received by the reception unit 112 with the flight pattern (A1), light emission pattern (B1), and launch pattern (C1) acquired by the acquisition unit 113 in response to the sound (M1) to generate a pattern of performances (flight pattern, light emission pattern, and launch pattern) to be performed at the event.

[0048] When the sound characteristic content (specific characteristic content) changes over time, the generation unit 116 may connect any one flight pattern, light emission pattern, and launch pattern identified by the acquisition unit 113 according to the sound characteristic content over time to generate a temporally continuous flight pattern, light emission pattern, and launch pattern (performance pattern). As an example of this case, as shown in FIG. 5B , when the sound characteristic content (specific characteristic content) changes over time (M1, M3, M2, ...), the same specific characteristic content (M1, M2) may appear multiple times discontinuously over time. Furthermore, multiple flight patterns (A1, A2), multiple light emission patterns (B1, B2), and multiple launch patterns (C1, C2) may be identified corresponding to the same sound characteristic content (specific characteristic content) (M1, M2) that appears multiple times. In this case, the generation unit 116 may select multiple different patterns from the multiple identified flight patterns, light emission patterns, and launch patterns, and connect the selected patterns in any order in time to generate a performance pattern.

[0049] That is, for flight patterns (A1, A2) identified corresponding to the same sound characteristic content (M1, M2), the generation unit 116 may select one of the flight patterns (A1, A2) for the sound (sound characteristic content) (M1) when generating a performance pattern, and identify the selected flight pattern (flight pattern (A1) in the example shown in FIG. 5(B)). Similarly, the generation unit 116 may select one of the remaining flight patterns (A1, A2) for the sound (sound characteristic content) (M2) when generating a performance pattern, and identify the selected flight pattern (flight pattern (A2) in the example shown in FIG. 5(B)).

[0050] Similarly to the flight patterns described above, the generation unit 116 may select one of the light emission patterns (B1, B2) for the sound (characteristic content of the sound) (M1) when generating a performance pattern, and specify the selected light emission pattern (light emission pattern (B1) in the example shown in FIG. 5(B)). Similarly, the generation unit 116 may select one of the remaining light emission patterns (B1, B2) for the sound (characteristic content of the sound) (M2) when generating a performance pattern, and specify the selected light emission pattern (flight pattern (B2) in the example shown in FIG. 5(B)).

[0051] Similarly to the flight patterns described above, the generation unit 116 may select one of the launch patterns (C1, C2) as the sound (characteristic content of the sound) (M1) when generating a performance pattern, and specify the selected launch pattern (light emission pattern (C1) in the example shown in FIG. 5(B)). Similarly, the generation unit 116 may select one of the remaining launch patterns (C1, C2) as the sound (characteristic content of the sound) (M2) when generating a performance pattern, and specify the selected launch pattern (flight pattern (C2) in the example shown in FIG. 5(B)).

[0052] 5(B) , the characteristic contents corresponding to the passage of time during which the sound is reproduced are M1, M3, M2, ..., and therefore the generation unit 116 combines each pattern identified in accordance with the passage of time of the sound (sound characteristics) in order (A1, B1, C1, A3, B3, C3, and A2, B2, C2 in this order), and generates an effect pattern by associating the combined patterns with the sound information (sound) (M1, M3, M2) received by the reception unit 112. That is, the generation unit 116 generates an effect pattern by, for example, utilizing the characteristic contents (specific characteristic contents) of the sound based on the sound information received by the reception unit 112 and associating the sound with a flight pattern, a light-emitting pattern, and a launch pattern.

[0053] The generation unit 116 may record the light-emitting unit identified by the setting unit 115 in association with a performance pattern (for example, a light-emitting pattern, etc.).

[0054] The generation unit 116 may control the output unit to output the generated effect pattern. The output unit may be a communication unit 121, a storage unit 122, a display unit 123, or the like. The generation unit 116 may, for example, control the communication unit 121 to transmit the generated effect pattern to an external device (not shown). The external device may be a playback device that plays sound information, an aircraft, an ignition device that launches fireworks, or the like. Furthermore, when an instruction to start an effect based on the effect pattern is input, the generation unit 116 may transmit a control signal to each external device to start the effect (to start sound playback, flight of the aircraft, lighting / extinguishing of the light-emitting unit, and launching fireworks based on the effect pattern). The generation unit may transmit only relevant patterns from among the effect patterns to each external device. Furthermore, the generation unit 116 may control the storage unit 122 to store the effect pattern. Furthermore, the generation unit 116 may control the display unit 123 to display the effect pattern.

[0055] As a result, when the generated effect pattern is executed, the sound registered in the effect pattern is played at the event venue, the flying object flies autonomously or by radio control in accordance with the effect pattern and the played sound, and the light-emitting unit attached to the flying object lights up. Furthermore, a control signal is sent to an ignition device (not shown) for the fireworks in accordance with the effect pattern, and the fireworks are launched.

[0056] When performing a performance using the above-described performance pattern, the assigning unit 117 calculates a total score by adding a score based on the number of spectators at the event venue and a predetermined first score value to a score based on the number of spectators viewing the performance online and a predetermined second score value (the second value is smaller than the first value). That is, the assigning unit 117 assigns a first score value to each spectator present at the event venue, and assigns a second score value lower than the first score value to each spectator viewing a video of the event venue. The assigning unit 117 calculates a total score based on the score corresponding to the number of spectators present at the event venue and the score corresponding to the number of spectators viewing the performance online (via video). For example, the assigning unit 117 can obtain the number of spectators present at the event venue and the number of spectators viewing the performance online (via video) using various known methods.

[0057] The estimation unit 118 estimates an amount of money according to the total value (total score) of the points awarded by the awarding unit 117. For example, since an amount of money according to one point (or a predetermined unit of score) is set in advance, the estimation unit 118 can calculate an amount of money according to the total value (total score) by multiplying the total value (total score).

[0058] The billing unit 119 bills the amount estimated by the estimation unit 118 to advertisers of the event held at the event venue. The advertisers of the event may include the event organizer. If there are multiple advertisers of the event, the billing unit 119 may divide the amount estimated by the estimation unit 118 by the number of advertisers and bill the calculated amount to each of the multiple advertisers. Alternatively, if burden rates are preset among the multiple advertisers, the billing unit 119 may bill each advertiser for the amount estimated by the estimation unit 118 for each burden rate. If contact information (e.g., email address, etc.) of the advertisers is preset, the billing unit 119 may generate an invoice stating the amount to be billed to each advertiser and send the invoice to the contact information. For example, the billing unit 119 can use various known generation methods when automatically generating an invoice.

[0059] [Information Processing Method] Next, an information processing method according to an embodiment will be described.

[0060] (First Information Processing Method) First, a method for generating a presentation pattern will be described as an information processing method. Fig. 6 is a flowchart for describing the first information processing method (presentation pattern generating method) according to one embodiment.

[0061] In step ST101, the association unit 111 generates association result information by associating the feature content of the sound used for the performance with at least one content registered in the pattern information.

[0062] In step ST102, the receiving unit 112 receives sound information of the sound to be used for the performance.

[0063] In step ST103, the acquisition unit 113 refers to the response result information generated in step ST101 and acquires the movement content of the flying object (flight pattern), the light emission content (light emission pattern) of the light-emitting unit arranged on the flying object, and the fireworks launch content (launch pattern) according to the sound characteristics content (e.g., at least one of the sound frequency, rhythm, tempo, and beat) based on the sound information received in step ST102.

[0064] In step ST104, the identification unit 114 identifies the positional relationship between the event venue and the flying object flying over the event venue.

[0065] In step ST105, the setting unit 115 sets the direction, color, timing, etc. of the light emitted from the light-emitting unit (light-emitting unit) based on the positional relationship identified in step ST104 and the pattern information (e.g., light-emitting pattern) stored in the memory unit 122 so that the content of the light emitted by the light-emitting unit can be viewed from the event venue.

[0066] In step ST106, the generation unit 116 may combine the sound information (sound) received in step ST102 with the flight pattern, light emission pattern, and launch pattern acquired in step ST103 corresponding to the sound to generate a performance pattern (such as a flight pattern, light emission pattern, or launch pattern) to be performed at the event. In this case, the generation unit 116 may record the light-emitting unit set in step ST105 in association with the performance pattern (e.g., light emission pattern, etc.). In other words, the generation unit 116 may register the setting of the light-emitting unit set in step ST105 as a performance pattern so that the light-emitting unit set in step ST105 emits light (lights on and off) according to the light-emitting pattern acquired in step ST103.

[0067] (Second Information Processing Method) Next, a method for charging for costs associated with a performance (event) will be described as an information processing method. Fig. 7 is a flowchart illustrating the second information processing method (charging method) according to one embodiment.

[0068] In step ST201, the awarding unit 117 awards a first value of score to each spectator who watches the performance at the event venue, and also awards a second value of score lower than the first value to each spectator (e.g., number of accesses) who watches (watches online) a video of the event venue (performance).

[0069] In step ST202, the estimation unit 118 estimates an amount of money according to the total value of the points awarded in step ST201 (total points).

[0070] In step ST203, the billing section 119 bills the advertiser of the event (performance) to be held at the event venue for the amount estimated in step ST202.

[0071] [Regarding Functions and Circuits] Next, the functions and circuits of the effect pattern generation device 100 described above will be described. Each unit of the effect pattern generation device 100 may be realized as a function of a computer's arithmetic processing unit or the like. That is, the association unit 111, the reception unit 112, the acquisition unit 113, the identification unit 114, the setting unit 115, the generation unit 116, the assignment unit 117, the estimation unit 118, and the request unit 119 (control unit 110) of the effect pattern generation device 100 may be realized as an association function, a reception function, an acquisition function, an identification function, a setting function, a generation function, an assignment function, an estimation function, and a request function (control function) by a computer's arithmetic processing unit or the like. The effect pattern generation program can cause a computer to realize each of the above-described functions. The effect pattern generation program may be recorded on a non-transitory computer-readable recording medium, such as a memory, a solid-state drive, a hard disk drive, or an optical disc. The recording medium may also be referred to as a non-transitory computer-readable medium, for example. Furthermore, as described above, each unit of the effect pattern generation device 100 may be realized by a computer's arithmetic processing unit or the like. The arithmetic processing device and the like are configured, for example, by an integrated circuit and the like. Therefore, each unit of the effect pattern generation device 100 may be realized as a circuit that constitutes the arithmetic processing device and the like. That is, the correspondence unit 111, the reception unit 112, the acquisition unit 113, the identification unit 114, the setting unit 115, the generation unit 116, the assignment unit 117, the estimation unit 118, and the request unit 119 (control unit 110) of the effect pattern generation device 100 may be realized as a correspondence circuit, a reception circuit, an acquisition circuit, an identification circuit, a setting circuit, a generation circuit, an assignment circuit, an estimation circuit, and a request circuit (control circuit) that constitute the arithmetic processing device and the like of a computer. Furthermore, the communication unit 121, the memory unit 122, and the display unit 123 (output unit) of the effect pattern generation device 100 may be realized as a communication function, a memory function, and a display function (output function) that include the functions of the arithmetic processing device and the like. In addition, the communication unit 121, memory unit 122, and display unit 123 (output unit) of the performance pattern generation device 100 may be realized as a communication circuit, memory circuit, and display circuit (output circuit) by being configured, for example, using an integrated circuit or the like.Furthermore, the communication unit 121, memory unit 122, and display unit 123 (output unit) of the performance pattern generation device 100 may be configured as a communication device, a memory device, and a display device (output device) by being composed of multiple devices, for example.

[0072] The effect pattern generation device 100 can combine one or any two or more of the above-described units. In this disclosure, the term "information" is used, but the term "information" can be replaced with "data," and the term "data" can be replaced with "information."

[0073] [Aspects and Effects of the Present Embodiment] Next, one aspect of the present embodiment and the effects of each aspect will be described. Note that each aspect described below is an example at the time of filing, and the present embodiment is not limited to the aspects described below. In other words, the present embodiment is not limited to each aspect described below, and may be realized by appropriately combining each of the above-mentioned parts. Furthermore, a lower aspect may in some cases cite any of the higher aspects. Furthermore, the effects described below are an example, and the effects of each aspect are not limited to those described below. Furthermore, each aspect may, for example, achieve at least one of the effects described below.

[0074] (Aspect 1) An effect pattern generation device of one aspect includes a storage unit that stores pattern information regarding the movement of an air vehicle, the light emission of a light-emitting unit disposed on the air vehicle, and the launch of fireworks, a correspondence unit that generates correspondence result information by associating characteristic content of a sound used in the effect with at least one content registered in the pattern information, a reception unit that receives sound information of the sound used in the effect, and an acquisition unit that references the correspondence result information generated by the correspondence unit and acquires the movement of the air vehicle, the light emission of a light-emitting unit disposed on the air vehicle, and the launch of fireworks in accordance with the characteristic content of the sound based on the sound information received by the acquisition unit. In other words, the effect pattern generation device identifies and acquires the movement of the air vehicle (flight pattern), the light emission of a light-emitting unit (light-emitting pattern), and the launch of fireworks in accordance with the characteristics of the sound used in the effect, and can automatically generate an effect pattern that combines each of the acquired patterns with the sound used in the effect. In the performance pattern, when the start execution process is performed, sound playback, flight of the flying object according to the flight pattern (performance pattern), lighting and extinguishing of the light-emitting unit according to the light-emitting pattern (performance pattern), and launching of fireworks according to the launch pattern (performance pattern) can all be started simultaneously. That is, the flying object can fly according to the performance pattern and light-emitting unit can be turned on and off. Also, the fireworks launching device can launch fireworks according to the performance pattern.

[0075] (Aspect 2) A performance pattern generation device according to one aspect may include an identification unit that identifies a positional relationship between an event venue and an aircraft flying over the event venue, and a setting unit that sets a direction of light emitted from the light-emitting unit based on the positional relationship identified by the identification unit and pattern information stored in the storage unit so that the light emitted by the light-emitting unit can be viewed from the event venue. This allows the performance pattern generation device to generate a performance pattern suitable for spectators watching from the event venue.

[0076] (Aspect 3) A performance pattern generation device according to one aspect may include an assigning unit that assigns a first score to each spectator present at an event venue and assigns a second score lower than the first score to each spectator viewing a video of the event venue, an estimation unit that estimates an amount of money according to the total of the scores assigned by the assigning unit, and a billing unit that bills an advertiser of an event held at the event venue for the amount estimated by the estimation unit. This allows the performance pattern generation device to bill for the cost of executing the generated performance pattern.

[0077] (Aspect 4) In one aspect of the effect pattern generation method, a computer including a storage unit that stores pattern information regarding the movement of an air vehicle, the light emitted by a light-emitting unit disposed on the air vehicle, and the fireworks display executes the following steps: a correspondence step that generates correspondence result information by associating a characteristic content of a sound used in the effect with at least one content registered in the pattern information; a reception step that receives sound information of the sound used in the effect; and an acquisition step that references the correspondence result information generated in the correspondence step and acquires the movement of the air vehicle, the light emitted by a light-emitting unit disposed on the air vehicle, and the fireworks display corresponding to the characteristic content of the sound based on the sound information received in the reception step. This allows the effect pattern generation method to achieve the same effects as the effect pattern generation device of the above-mentioned aspect.

[0078] (Aspect 5) A display pattern generation program according to one aspect of the present invention causes a computer having a storage unit that stores pattern information regarding the movement of an air vehicle, the light emitted by a light-emitting unit disposed on the air vehicle, and the launch of fireworks to implement the following: a correspondence function that generates correspondence result information by associating characteristic content of a sound used in the display with at least one content registered in the pattern information, a reception function that receives sound information of the sound used in the display, and an acquisition function that references the correspondence result information generated by the correspondence function and acquires the movement of the air vehicle, the light emitted by the light-emitting unit disposed on the air vehicle, and the launch of fireworks in accordance with the characteristic content of the sound based on the sound information received by the reception function. This allows the display pattern generation program to achieve effects similar to those of the display pattern generation device according to the above-described aspect of the present invention.

[0079] REFERENCE SIGNS LIST 100 Effect pattern generation device 110 Control unit 111 Corresponding unit 112 Receiving unit 113 Acquiring unit 114 Identifying unit 115 Setting unit 116 Generating unit 117 Granting unit 118 Estimating unit 119 Requesting unit 121 Communication unit 122 Storage unit 123 Display unit

Claims

1. A performance pattern generation device comprising: a memory unit that stores pattern information regarding the content of the movement of an aircraft, the content of the light emitted by a light-emitting unit arranged on the aircraft, and the content of the fireworks being launched; a matching unit that generates correspondence result information by matching the content of the characteristics of the sound used in the performance with at least one content registered in the pattern information; a reception unit that receives sound information of the sound used in the performance; and an acquisition unit that refers to the correspondence result information generated by the matching unit and acquires the content of the movement of the aircraft, the content of the light emitted by a light-emitting unit arranged on the aircraft, and the content of the fireworks being launched in accordance with the content of the characteristics of the sound based on the sound information accepted by the acceptance unit.

2. A performance pattern generation device as described in claim 1, comprising: an identification unit that identifies the positional relationship between an event venue and an aircraft flying over the event venue; and a setting unit that sets the direction of light emitted from the light-emitting unit based on the positional relationship identified by the identification unit and the pattern information stored in the memory unit so that the content of the light emitted by the light-emitting unit can be viewed from the event venue.

3. A presentation pattern generation device as described in claim 1 or 2, comprising: an assignment unit that assigns a first score value to each spectator present at an event venue and assigns a second score value lower than the first value to each spectator viewing a video of the event venue; an estimation unit that estimates an amount of money according to the total value of the scores assigned by the assignment unit; and a billing unit that bills advertisers of events held at the event venue for the amount estimated by the estimation unit.

4. A method for generating a performance pattern, the method comprising: a correspondence step in which a computer having a memory unit that stores pattern information regarding the content of the movement of the flying object, the content of the light emitted by the light-emitting unit arranged on the flying object, and the content of the fireworks being launched generates correspondence result information by corresponding the content of the characteristics of the sound used in the performance to at least one content registered in the pattern information; a reception step in which sound information of the sound used in the performance is received; and an acquisition step in which, by referring to the correspondence result information generated by the correspondence step, the content of the movement of the flying object, the content of the light emitted by the light-emitting unit arranged on the flying object, and the content of the fireworks being launched correspond to the content of the characteristics of the sound based on the sound information received by the reception step.

5. A performance pattern generation program that realizes the following in a computer having a memory unit that stores pattern information regarding the content of the movement of an aircraft, the content of the light emitted by a light-emitting unit arranged on the aircraft, and the content of the fireworks being launched: a matching function that generates correspondence result information by matching the characteristic content of the sound used in the performance with at least one content registered in the pattern information; a reception function that receives sound information of the sound used in the performance; and an acquisition function that refers to the correspondence result information generated by the matching function and acquires the content of the movement of the aircraft, the content of the light emitted by the light-emitting function arranged on the aircraft, and the content of the fireworks being launched in accordance with the characteristic content of the sound based on the sound information accepted by the acceptance function.

Citation Information

Patent Citations

  • Unmanned aerial vehicle formation music synchronization light control method, control system and unmanned aerial vehicle

    CN111988891A

  • Image / Voice interlocking output device and method

    JP2003331310A

  • Composition of light drawn by attaching LED lamp to many drones equipped with ai

    JP2021098421A

  • Unmanned aerial vehicle light show

    US20190146501A1

  • Media playback system

    WO2022254229A1