Information processing device, photographing system, program, and information processing method

The information processing device simplifies the creation of DJ performance videos by synchronizing multiple camera feeds based on operation signals, addressing the need for specialized equipment and complex techniques.

JP7606305B2Active Publication Date: 2024-12-25ALPHATHETA CORP
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2020159634
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-09-24
Publication Date
2024-12-25
Estimated Expiration
2040-09-24

AI Technical Summary

Technical Problem

Creating high-quality moving images of DJ performances without requiring special equipment or effort is challenging for general users due to the need for multiple devices and complex production techniques.

Method used

An information processing device that receives operation signals from a DJ play application, acquires and selects moving images from multiple cameras based on the operation signals and timestamps, and integrates them to create a synchronized DJ performance video.

Benefits of technology

Enables easy creation of high-quality DJ performance videos without specialized equipment or expertise, ensuring smooth transitions and viewer engagement through intelligent image selection and synchronization.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007606305000001
    Figure 0007606305000001
  • Figure 0007606305000002
    Figure 0007606305000002
  • Figure 0007606305000003
    Figure 0007606305000003
Patent Text Reader

Abstract

To simply create a moving image excellent in a performance aspect, without need of a special apparatus and time.SOLUTION: An information processing device comprises: a signal receiving unit which receives from an operation device an operation signal of a reproduction operation of music data; an image acquisition unit which acquires a moving image from each of a plurality of imaging devices; and a selection unit which selects in time series at least one moving image out of the moving images acquired from the imaging devices in accordance with the type of the operation signal and a time when the operation signal is received.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device, an image capturing system, a program, and an information processing method. [Background technology]

[0002] Regarding DJ (Disc Jockey) performances, various technologies have been considered, such as DJ play applications using mobile terminals such as smartphones and tablet terminals. As a result, not only professional DJs but also general users can enjoy DJ performances. For example, Non-Patent Document 1 discloses a DJ play application that can be used on computers and mobile terminals. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] DJ Player Professional (iMect Ltd.) application introduction homepage (https: / / apps.apple.com / jp / app / dj-player-professional / id339810085) Summary of the Invention [Problem to be solved by the invention]

[0004] By the way, videos are often used to introduce DJ performances. When shooting videos of DJ performances, various equipment is often required to create videos that have a good presentation, and it also requires the skills and effort of directing and editing. Therefore, there are various problems when general users try to create them.

[0005] Therefore, the present invention aims to provide an information processing device, a shooting system, a program, and an information processing method that can easily create moving images that have excellent presentation without requiring special equipment or effort. [Means for solving the problem]

[0006] According to one aspect of the present invention, there is provided an information processing device comprising: a signal receiving unit that receives an operation signal for operating playback of music data from an operation device; an image acquiring unit that acquires moving images from each of a plurality of image capturing devices; and a selection unit that selects at least one moving image in chronological order from a plurality of moving images acquired from the plurality of image capturing devices depending on the type of the operation signal and the time at which the operation signal was received.

[0007] According to another aspect of the present invention, there is provided a program configured to cause a computer to function as the above-mentioned information processing device.

[0008] According to yet another aspect of the present invention, there is provided an information processing method including the steps of receiving an operation signal for operating playback of music data from an operation device, acquiring moving images from each of a plurality of image capturing devices, and selecting at least one moving image in chronological order from a plurality of moving images acquired from the plurality of image capturing devices depending on the type of the operation signal and the time at which the operation signal was received. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram showing a schematic functional configuration of a photographing system according to an embodiment of the present invention; [Diagram 2] FIG. 2 is a schematic diagram illustrating selection of a moving image in one embodiment of the present invention. [Diagram 3] 10 is a flowchart showing an operation when a moving image is selected in one embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same functional configurations are designated by the same reference numerals, and duplicated explanations will be omitted.

[0011] 1 is a block diagram showing a schematic functional configuration of an image capturing system according to an embodiment of the present invention. The image capturing system 1 according to an embodiment of the present invention includes a plurality of image capturing devices 10A, 10B, 10C, and 10D, an audio device 20, a display device 30, an audio output device 40, a distribution device 50, and a recording device 60. Video images generated by the plurality of image capturing devices 10A, 10B, 10C, and 10D are supplied to the audio device 20 via wired or wireless communication. In addition, the output of the audio device 20 is supplied to each of the display device 30, the audio output device 40, the distribution device 50, and the recording device 60. In such an imaging system 1, a DJ performance performed by a user using an audio device 20 is simultaneously captured from different angles by imaging devices 10A, 10B, 10C, and 10D, and a video of the DJ performance is generated by the audio device 20.

[0012] The image capturing devices 10A, 10B, 10C, and 10D are image capturing devices that capture an object scene and generate a moving image. A time stamp, which is information on the capture time, is associated with the generated moving image data. 1 illustrates four image capturing devices 10A, 10B, 10C, and 10D, but any number of image capturing devices may be included in the image capturing system 1. Furthermore, the image capturing devices 10A, 10B, 10C, and 10D may be image capturing devices equipped with only an image capturing function, or may be mobile terminals such as smartphones and tablets equipped with image capturing devices. The image capturing devices 10A, 10B, 10C, and 10D are positioned to capture video images of the user's DJ performance from different angles. Examples of video images of the DJ performance include video images of the hands of the user performing DJ play, and video images of the user's whole body or part.

[0013] The audio device 20 is a device that integrates an operation device and an information processing device, and has the functions of multiple playback devices capable of playing different music data, the function of a mixer that controls the multiple playback devices, and the function of generating video images of DJ play. 1, the audio device 20 includes an operation unit 21, a control unit 22, a music data storage unit 23, and a display unit 24. The functions of the above units are realized by a processor operating according to a program in an audio device having, for example, a computer hardware configuration. The functions of the units are further described below.

[0014] The operation unit 21 accepts user operations related to DJ play, that is, user operations for the purpose of operating the playback of music data, via various operators and a touch panel, and supplies operation signals indicating the user operations to the control unit 22. The playback operations include operations for playback setting and playback control by multiple playback devices, and operations for playback control related to multiple playback devices. More specifically, the playback operations include operations for selecting music, operations related to the playback of music, operations related to playback control such as trick playback and effect processing, and the like. The operation unit 21 includes, for example, a jog dial, a tempo slider, a performance pad (a general-purpose operator to which various functions related to playback control can be assigned), operators related to effect processing such as phase and noise, a channel fader, and the like.

[0015] The control unit 22 is implemented in the audio device 20 by, for example, a communication interface, a processor such as a CPU (Central Processing Unit), and a memory serving as a working area, and controls the operation of the audio device 20. The control unit 22 includes a signal receiving unit 221, which is realized by the processor operating according to a program stored in the memory or received via the communication interface, a playback control unit 222, a display control unit 223, an analysis unit 224, an image acquisition unit 225, a selection unit 226, and an output unit 227.

[0016] The signal receiving unit 221 receives an operation signal from the operation unit 21 . The playback control unit 222 has the functions of a plurality of playback devices, plays music data in each of the playback devices, and outputs an audio signal to the output unit 227. Based on an operation signal received by the signal receiving unit 221, the playback control unit 222 acquires music data from a music data storage unit 23 (described later) and controls the playback of the acquired music data. The display control unit 223 causes the display unit 24 to display a moving image including information on the music data being played by the audio equipment 20 as a moving image indicating the state of the playback operation. The moving image indicating the state of the playback operation includes information on the music data loaded in each of the multiple playback devices, waveform information on the music data, information indicating the BPM, and information indicating the synchronization state of the BPMs of the multiple playback devices. The analysis unit 224 analyzes the music data to generate music analysis information. The music analysis information includes information such as beat position information, bar position information, and development change points of the music data, and can be generated based on existing music analysis technology. The analysis unit 224, for example, detects a specific instrument sound to obtain beat position information and bar position information of the music data. Furthermore, the analysis unit 224 determines the development change points of the music data based on the analysis result of the beat position information, the similarity of the pronunciation pattern, and the like. The development change points correspond to, for example, the beginning of the A melody, B melody, chorus, etc. of the music, and can be referred to as the development configuration of the music. The image acquisition section 225 acquires video images of the DJ playing music data from each of the image capture devices 10A, 10B, 10C, and 10D.

[0017] The selection unit 226 selects at least one video in chronological order from the multiple videos etc. acquired from each of the image capturing devices 10A, 10B, 10C, and 10D according to the type of the operation signal received by the signal receiving unit 221 and the time at which the operation signal was received. Details of the process performed by the selection unit 226 will be described later.

[0018] The output unit 227 is an interface between the audio device 20 and an external device. The output unit 227 sequentially outputs the moving images selected by the selection unit 226 to the display device 30, the distribution device 50, and the recording device 60. The output unit 227 also outputs an audio signal of the music data reproduced by the reproduction control unit 222 to the audio output device 40, the distribution device 50, and the recording device 60.

[0019] The music data storage unit 23 is configured to be able to store music data using a HDD (Hard Disk Drive) or a flash memory, etc. The music data storage unit 23 stores a plurality of music data in a predetermined format, such as MP3 format. In addition to audio information, the music data includes tag information such as the BPM of the music, artwork, title, artist name, album name, key, number of DJ plays, and genre. The music data stored in the music data storage unit 23 is associated with a time stamp, which is information on the playback position. The audio device 20 may be configured to include a communication interface, and acquire music data stored in an external storage device, a computer, or the like via the communication interface (not shown), and store the music data in the music data storage unit 23. In this case, the audio device 20 does not include the music data storage unit 23, and the external storage device functions as the music data storage unit 23.

[0020] The display unit 24 is a display device that displays various types of information on the audio device 20. As the display unit 24, various types of display devices such as a liquid crystal display device and an organic electroluminescence display device can be adopted. Note that the display unit 24 may be used as at least a part of the operation unit 21 described above by providing a touch panel on the surface of the display unit 24.

[0021] The display device 30 sequentially displays the moving images output from the output unit 227 . The audio output device 40 includes a speaker and the like, and outputs the audio signal output from the output unit 227 as audio information. The distribution device 50 is connected to the Internet, and sequentially distributes the moving images output from the output unit 227 over the Internet, and also distributes the audio signal output from the output unit 227 over the Internet in synchronization with the moving images, thereby distributing the moving images with audio over the Internet. The recording device 60 is equipped with a disk-type recording medium, an HDD, a semiconductor memory, and other recording media, and sequentially combines and records the moving images output from the output unit 227, and records the audio signal output from the output unit 227 in synchronization with the moving images, thereby recording moving images with audio. The distribution device 50 may sequentially distribute the audio-accompanied videos generated by the recording device 60 over the Internet, and the recording device 60 may sequentially record the audio-accompanied videos distributed over the Internet by the distribution device 50. In addition, the audio equipment 20 may be provided with a generating unit that generates the audio-accompanied videos.

[0022] The process by the selection unit 226 in the above-described photographing system 1 will be described. As described above, the selection unit 226 selects at least one video in chronological order from the multiple videos according to the type of operation signal received by the signal receiving unit 221 and the time at which the operation signal is received. The multiple videos include videos generated by the photographing devices 10A, 10B, 10C, and 10D, as well as videos indicating the state of a playback operation. The video indicating the state of a playback operation is, for example, a video displayed on the display unit 24 by the above-described display control unit 223.

[0023] First, the moving images generated by the image capturing devices 10A, 10B, 10C, and 10D will be described. The image capturing device 10A is installed at an angle that allows the image capturing of the user who performs the playback operation, that is, the operation unit 21 of the audio device 20 and the user who performs the playback operation using the operation unit 21. A is a video suitable for visually confirming how a user is operating each of the controls during DJ play. The image capturing device 10B is set at an angle that allows the upper body of the user performing the playback operation to be captured. B This is a video suitable for visually checking the so-called monitoring state, in which a user specifies the playback position of a song during DJ play. The image capturing device 10C is installed at an angle that allows the whole body of the user performing the playback operation to be captured from the front, or an overall view of the user and the audio device 20 to be captured from the front. C is a video suitable for visually checking the overall situation when the user is not performing any special playback operations during DJ play. The image capturing device 10D is installed at an angle that allows the whole body of the user performing the playback operation to be captured from the left or right side, or the overall appearance of the user and the audio device 20 to be captured from the left or right side. D is the above-mentioned moving image M C Similarly, when the user is not performing any special playback operations during DJ play, this is an image suitable for visually checking the overall state of the video image M. C is a moving image suitable for visually checking the overall situation from different angles. In addition, the above-mentioned moving image M A , M B , M C , and M. D In addition, a moving image M which is displayed on the display unit 24 by the display control unit 223 and indicates a state of a playback operation E are also candidates for videos selected by the selection unit 226.

[0024] Fig. 2 is a schematic diagram for explaining the selection of a video by the selection unit 226. In the example of Fig. 2, a case is illustrated in which the playback operations are performed sequentially as follows. Note that by monitoring the presence or absence of reception of an operation signal at a predetermined cycle P, the playback operation for each predetermined section can be determined. Time t1: Reproduction operation Op1 of first music data Time t2: Selection operation Op2 of the second music data to be played next Time t3: Monitoring operation Op3 to determine the mix point, which is the timing to switch or mix songs Time t4: Switching from the first music piece data to the second music piece data, or mixing the first music piece data and the second music piece data Op4 Time t5: Selection operation Op5 of the third music data to be played next

[0025] Basically, when the signal receiving unit 221 receives an operation signal, the selection unit 226 selects one of the above-mentioned moving images M according to the type of the received operation signal and the time of reception. A , M B , M C , M D , or M E The selection unit 226 selects one of the following. This selection can be performed, for example, by storing the contents of the playback operation in association with the multiple image capture devices 10A, 10B, 10C, and 10D in a storage unit (not shown). The selection unit 226 determines the contents of the playback operation based on the received operation signal, and selects a video generated by an image capture device associated with the determined contents of the playback operation. An example of the association between the contents of the playback operation and the multiple image capture devices 10A, 10B, 10C, and 10D is shown below. The image capturing device 10A (at the user's hand): A playback operation on the operation unit 21 of the audio device 20 Photographing device 10B (upper body of user): Playback operation to specify playback position Shooting device 10C (user's whole body, front): no playback operation, initial state Imaging device 10D (user's whole body, left or right side): no playback operation, initial state In other words, since the content of the playback operation is linked to the video that the viewer wants to view, the selection unit 226 can easily select a video appropriate to the content of the playback operation by selecting a video generated by a shooting device associated with the content of the playback operation.

[0026] If a video is selected after receiving an operation signal, the video will be selected at or after the start of the actual playback operation. Therefore, as shown in Fig. 2, the selection unit 226 selects a video starting from the time when the operation signal was received, that is, a time a predetermined time L before the playback operation time. As a result, it is possible to select an optimal video starting from a time a predetermined time L before the actual playback operation start time.

[0027] Furthermore, when a user frequently or continuously performs playback operations, operation signals are received frequently, and if a video is selected each time in response to every operation signal, the angle will be changed frequently, causing a problem of discomfort and annoyance to the viewer. Therefore, the selection unit 226 selects a video for the (N+1)th time after a predetermined time T1 has elapsed since the Nth selection of a video. In other words, after the selection unit 226 selects a video, it does not select a video for a certain period of time even if it receives an operation signal. The predetermined time T1 may be determined in advance or may be specified by the user. It may also be determined based on music analysis information. For example, T1 may be set to be short for music with a fast tempo or a strong melody, since more angle changes are more appropriate, whereas T1 may be set to be long for music with a slow tempo or a gentle melody, since fewer angle changes are more appropriate.

[0028] Furthermore, the selection unit 226 can also use the music analysis information generated by the analysis unit 224 to select a moving image. In this case, it is preferable that the generation of music analysis information by the analysis unit 224 is performed in advance for each piece of music data as a preparation operation by the user, and is recorded in association with the music data. For example, in contrast to the above example, if the user does not perform a playback operation for a certain period of time, the operation signal will not be received and no video will be selected. In such a case, the angle will not change, which may reduce the entertainment value or cause viewers to tire of the content. Therefore, the selection unit 226 selects a video image according to the evolution change point of the music analysis information when the signal receiving unit 221 does not receive an operation signal for a predetermined time T2, such as from the mixing operation Op4 to the selection operation Op5 of the music data in Fig. 2. In the example of Fig. 2, the selection unit 226 selects a video image M suitable for visually confirming the overall state at the evolution change point closest to the point at which the time T2 has elapsed since the mixing operation Op4, which is the previous playback operation, that is, at the evolution change point of the music analysis information D2c and D2d. D Select . When the signal receiving unit 221 does not receive an operation signal for a predetermined time T2, the video to be selected may be prioritized in advance or may be randomly determined. The predetermined time T2 may be determined in advance or may be specified by the user. It may also be determined based on music analysis information. For example, T2 may be set to be short for music with a fast tempo or a strong melody, since more angle changes are appropriate, whereas T2 may be set to be long for music with a slow tempo or a gentle melody, since fewer angle changes are appropriate.

[0029] Furthermore, the selection unit 226 may select the end point of the currently selected video and the start point of the next video to be selected according to the development change point, beat position, bar position, etc. By selecting the start and end points of the video in this way, the timing of the angle change can be attached to the development change point, beat position, bar position, etc., so that the sense of discomfort felt by the viewer can be suppressed and camera work that is comfortable for the viewer can be easily achieved. In the example of FIG. 2, the selection unit 226 selects the video M E When selecting the currently selected video image M, the closest development change point, that is, the development change point of the music analysis information D1a and D1b is selected. C The end point of the next video M E By selecting this as the start point of the scene, the timing of the angle change is shifted back to coincide with the development change point. In addition, the selection unit 226 selects the moving image M due to not receiving the operation signal for a predetermined time T2. D When selecting the currently selected video image M, the closest development change point, that is, the development change point of the music analysis information D2c and D2d is selected. A The end point of the next video M D By selecting this as the starting point of the scene, the timing of the angle change is shifted forward to coincide with the development change point. If the time to the nearest development change point is longer than the predetermined time T3, the timing of the angle change will be too far off, which is undesirable. To avoid this problem, if the time to the nearest development change point is longer than the predetermined time T3, it is better to select the next beat position or the next bar position as the end point of the currently selected video and the start point of the next video to be selected.

[0030] Furthermore, the selection unit 226 may select video images at timings other than the above-mentioned timings based on the music analysis information. For example, when there is a section where the tune gets exciting, such as near the chorus, video images may be selected frequently to match that timing, thereby increasing the timing of the angle change and achieving a performance effect such as an image scratch. When achieving such a performance effect, the performance effect can be further improved by matching the timing of the angle change to the beat position of the music analysis information. In either case, by using music analysis information as auxiliary information in selecting a video, processing according to the characteristics of the music can be realized.

[0031] The selection unit 226 may also perform image effect processing at the timing of the angle change. For example, image effect processing such as fade-in and fade-out, zoom-in and zoom-out, etc. may be performed between the end point of the currently selected video and the start point of the next video to be selected. By performing such image effect processing, it is possible to realize an angle change that is comfortable for the viewer and to improve the presentation effect.

[0032] Furthermore, when a user operation that is particularly characteristic of DJ play is performed, such as a scratch operation via the operation unit 21, the selection unit 226 may, as in the above-mentioned case, deliberately select moving images frequently or perform image effect processing.

[0033] FIG. 3 is a flowchart showing the operation of the control unit 22 when a moving image is selected. In the example shown in FIG. 3, first, it is determined whether or not the signal receiving unit 221 has received an operation signal (step S101). If it is determined that an operation signal has been received (step S101 YES), the selection unit 226 selects a video according to the type of operation signal and the time when the operation signal was received (step S102). On the other hand, if it is determined that an operation signal has not been received (step S101 NO), it is determined whether or not a predetermined time T2 has elapsed since the previous reception of an operation signal (step S103). If it is determined that the predetermined time T2 has elapsed (step S103 YES), the selection unit 226 selects a video according to the music analysis information (step S104). On the other hand, if the predetermined time T2 has not elapsed, the process returns to step S101. After a video is selected (step S102 or S104), it is determined whether the time to the previous or next evolution change point is less than T3 (step S105). If it is determined that the time to the previous or next development change point is less than T3 (step S105 YES), the closest development change point is selected as the end point of the currently selected video and the start point of the next video to be selected (step S106).On the other hand, if it is determined that the time to the previous or next development change point is T3 or more (step S105 NO), the next beat position is selected as the end point of the currently selected video and the start point of the next video to be selected (step S107). After the start point and end point are selected (step S106 or S107), the currently selected video is output by the output unit 227 (step S108), and it is determined whether a predetermined time T1 has elapsed since the previous operation signal was received (step S109). The process waits until the predetermined time T1 has elapsed, and if it is determined that the predetermined time T1 has elapsed (step S109 YES), the process returns to step S101 and repeats the process from step S101.

[0034] According to one embodiment of the present invention as described above, moving images of DJ performances with excellent presentation can be easily created without requiring special equipment or effort. Previously, videos of DJ performances were often shot from a single angle using a fixed camera. As a result, the videos only showed the DJ's appearance or his hands, which made them less entertaining and made it difficult for viewers to see the detailed operations that they wanted to see. Solving these issues also required resources such as special equipment and multiple people to film, which was not easy for the average user to do. Another problem was that it required the skills and effort of directing and editing. In contrast, in the above embodiment, an operation signal for playing music data is received from an operation device, video images are acquired from each of the multiple shooting devices, and at least one video image is selected in chronological order from the multiple videos acquired from the multiple shooting devices according to the type of operation signal and the time when the operation signal was received, thereby making it possible to select the optimal video image in chronological order according to the content of the DJ play. In particular, according to this embodiment, no special equipment, directing and editing skills, effort, personnel, etc. are required, so even a single user can easily perform the process.

[0035] In the above embodiment, the video is selected starting from a time a predetermined time before the playback operation, so that the optimal video can be selected just before the playback operation, and the same effect as camera switching that changes the angle prior to the playback operation can be obtained. In the above embodiment, the next video is selected after a predetermined time T1 has elapsed since the previous video was selected, which is expected to reduce discomfort and annoyance felt by viewers due to frequent angle changes.

[0036] In the above embodiment, the content of the playback operation is stored in association with at least one of the multiple camera devices, the content of the playback operation is determined based on the operation signal, and a video generated by the camera device associated with the determined content of the playback operation is selected. This makes it possible to easily select a video with an angle suitable for the content of the playback operation. In the above embodiment, at least beat position information of music data is analyzed to generate music analysis information, and a video is selected according to the music analysis information, so that a video with an appropriate angle can be selected according to the characteristics of the music being played.

[0037] In the above embodiment, the development change point of the music data is further determined, and if an operation signal is not received for a predetermined time T2, a video is selected according to the development change point. This is expected to avoid problems such as a decrease in entertainment value due to an unchanging angle and viewers becoming bored. In the above embodiment, the end point of the currently selected video and the start point of the next video are selected according to the development change point, so that the sense of discomfort felt by the viewer due to the angle change can be reduced, and camera work that is comfortable for the viewer can be easily achieved. In the above embodiment, at least one video is selected in chronological order from among the multiple videos acquired from the multiple image capture devices and the video showing the state of the playback operation. Therefore, when selecting a song, the video showing the state of the playback operation can be selected.

[0038] In the above embodiment, the imaging system 1 includes the display device 30, the audio output device 40, the distribution device 50, and the recording device 60, but some of these may be omitted. At least one of the display device 30, the audio output device 40, the distribution device 50, and the recording device 60 may be provided in the audio device 20 body.

[0039] In addition, in the above embodiment, an example was shown in which a moving image is selected by software using the selection unit 226 of the audio equipment 20, but the audio equipment 20 may be provided with switching equipment that switches the input of moving images by hardware, and the moving images input from multiple imaging devices may be selected by the switching equipment.

[0040] In addition, in the above embodiment, the audio equipment 20 is exemplified as an equipment in which a playback device and a mixer that controls the playback device are integrated together, but the playback device and the mixer may be independent, and the present invention can also be applied to audio equipment that uses a DJ controller without a playback function, or a mobile terminal such as a smartphone or a tablet terminal.

[0041] In the above embodiment, the video of DJ play is exemplified, but the present invention is not limited to this example. For example, the present invention can be suitably used for video displayed on a screen used in a club or concert, promotional video, tutorial or lesson video. Videos capturing the surroundings during DJ play may also be selected. For example, at a wedding party, a camera may be provided to capture the bride and groom, and another camera to capture the guests.

[0042] In the above embodiment, the control unit 22 of the audio device 20 performs the above-mentioned processing by reading and executing a program from a storage unit and a recording medium (not shown). However, this is not limiting, and for example, the control unit 22 may obtain and execute a program from a device on a network. Examples of the recording medium include a disk-type recording medium, a HDD, and a semiconductor memory.

[0043] Although the preferred embodiment of the present invention has been described in detail above with reference to the accompanying drawings, the present invention is not limited to such an example. It is clear that a person having ordinary knowledge in the technical field to which the present invention pertains can come up with various modified or amended examples within the scope of the technical ideas described in the claims, and it is understood that these also naturally belong to the technical scope of the present invention. [Explanation of symbols]

[0044] 1...photography system, 10A, 10B, 10C, 10D...photography device, 20...audio equipment, 21...operation unit, 22...control unit, 23...music data storage unit, 24...display unit, 30...display device, 40...audio output device, 50...distribution device, 60...recording unit, 221...signal receiving unit, 222...playback control unit, 223...display control unit, 224...analysis unit, 225...image acquisition unit, 226...selection unit, 227...output unit.

Claims

1. a signal receiving unit that receives, from an operation device that controls a playback state of music data, an operation signal indicating an operation performed on the operation device; an image acquisition unit that acquires moving images from each of a plurality of image capture devices; an information processing device comprising: a selection unit that selects at least one moving image in chronological order from the multiple moving images acquired from the multiple photographing devices in accordance with the content of the operation indicated by the operation signal and the time when the operation signal was received.

2. The information processing device according to claim 1 , wherein the selection unit selects the video starting from a time that is a predetermined time before a time of the operation.

3. The information processing device according to claim 1 , wherein the selection unit performs an (N+1)th selection of the video after a predetermined time T1 has elapsed since the Nth selection of the video.

4. a storage unit that stores the content of the operation in association with at least one of the plurality of photographing devices; The information processing device according to claim 1 , wherein the selection unit determines the content of the operation based on the operation signal, and selects the video generated by the imaging device associated with the determined content of the operation.

5. The music data processing apparatus further includes an analysis unit that analyzes at least beat position information of the music data to generate music analysis information, or an information acquisition unit that acquires music analysis information generated by an external device, The information processing device according to claim 1 , wherein the selection unit selects the video image in accordance with the music analysis information.

6. The analysis unit further determines a transition point of the music data; The information processing device according to claim 5 , wherein the selection section selects the moving image in accordance with the evolution change point when the signal receiving section does not receive the operation signal for a predetermined time T2.

7. The information processing device according to claim 6 , wherein the selection section selects an end point of a currently selected video and a start point of a next video to be selected in accordance with the evolution change point.

8. the image acquisition unit acquires a moving image generated by the imaging device that captures an image of a user operating the operation device, and a moving image showing information related to the music data that is displayed on the display unit; The information processing device according to claim 1 , wherein the selection unit selects at least one video in chronological order from among the multiple video images acquired from the multiple image capture devices and a video image indicating information related to the music data.

9. A photographing system having an operation device for controlling a playback state of music data, a plurality of photographing devices for generating moving images, and an information processing device, The information processing device includes: a signal receiving unit that receives an operation signal indicating an operation performed on the operation device from the operation device; an image acquisition unit that acquires a plurality of the moving images from each of the plurality of image capture devices; a selection unit that selects at least one video image in chronological order from the multiple video images acquired from the multiple photographing devices in accordance with the content of the operation indicated by the operation signal and the time when the operation signal was received.

10. The imaging system includes: The imaging system according to claim 9 , further comprising a distribution device that sequentially distributes the moving images selected by the selection unit over the Internet.

11. The imaging system includes: The photographing system according to claim 9 , further comprising a recording device that sequentially combines and records the moving images selected by the selection unit.

12. A program configured to cause a computer to function as the information processing device according to any one of claims 1 to 8.

13. receiving, from an operation device that controls a playback state of music data, an operation signal indicating an operation performed on the operation device; acquiring video images from each of a plurality of image capture devices; and selecting at least one moving image in chronological order from the multiple moving images acquired from the multiple photographing devices in accordance with the content of the operation indicated by the operation signal and the time at which the operation signal was received.

Citation Information

Patent Citations

  • Data processor and program for conducting guidance display associated with music playing and lyrics display

    JP2006171215A

  • Photographic system

    JP2006217366A

  • Moving picture generation system and method

    JP2008010966A

  • Live video processing system, live video processing method, and program

    JP2018170678A