Content information processing method and content information processing device

Abstract

To provide a content information processing method that makes it possible to perceive as if a performance is being held at a remote venue.SOLUTION: A content information processing method acquires first performance information pertaining to a live performance of a first performer at a first venue, acquires first content information pertaining to video or sound at a second venue connected to the first venue by a network, generates second content information on the basis of the first performance information and the first content information, and generates video or sound based on the second content information.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] An embodiment of the present invention relates to a content information processing method and a content information processing device. [Background technology]

[0002] Patent Document 1 discloses a signal generating device that performs delay and / or sound pressure correction on the picked-up signals of channels corresponding to each sound collecting point based on the distance between the virtual listening point and each sound collecting point, and adds up the picked-up signals of all channels to generate a synthetic sound signal corresponding to the virtual listening point.

[0003] Patent document 2 discloses a live data distribution method in which sound of a first sound source generated at a first location in a first venue, first sound source information relating to position information of the first sound source, and second sound source information relating to a second sound source generated at a second location in the first venue, are distributed as distribution data, and the distribution data is rendered to provide to a second venue the sound of the first sound source that has been subjected to positioning processing based on the position information of the first sound source and the sound of the second sound source.

[0004] The playback device includes an acquisition unit that acquires content including audio data of each audio object and rendering parameters of the audio data for each of a plurality of expected listening positions, and a rendering unit that renders the audio data based on the rendering parameters for a selected predetermined expected listening position and outputs an audio signal.The playback device includes a first performance detecting a body movement of a performer, placing an avatar object associated with the performer in a virtual space, and making the avatar object perform a second performance in response to the detected body movement of the performer. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent Publication 2018-191127 [Patent Document 2] International Publication No. 2022 / 113394 [Patent Document 3] International Publication No. 2018 / 96954 Summary of the Invention [Problem to be solved by the invention]

[0006] One aspect of the present disclosure aims to provide a content information processing method that allows a performance to be perceived as taking place in a venue in a remote location. [Means for solving the problem]

[0007] A content information processing method according to one embodiment of the present invention acquires first performance information relating to a live performance by a first performer at a first venue, acquires first content information relating to video or sound at a second venue connected to the first venue via a network, generates second content information based on the first performance information and the first content information, and generates video or sound based on the second content information. Effect of the Invention

[0008] According to one embodiment of the present invention, it is possible to perceive a performance as occurring in a remote venue. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram showing a configuration of a content information processing system. [Diagram 2] FIG. 2 is a block diagram showing the configuration of PC1A. [Diagram 3] FIG. 2 is a block diagram showing the configuration of a PC1B. [Figure 4] 13 is a flowchart showing the operation of PC 1A. [Diagram 5] FIG. 11 is a configuration diagram of a content information processing system according to a first modified example. [Figure 6]FIG. 13 is a block diagram showing a configuration of a PC 1B according to Modification 1. [Figure 7] 13 is a flowchart showing the operation of a PC 1A according to the first modified example. [Figure 8] FIG. 11 is a configuration diagram of a content information processing system according to a second modified example. [Figure 9] 13 is a flowchart showing the operation of a PC 1A according to Modification 2. [Figure 10] FIG. 23 is a configuration diagram of a content information processing system according to a seventh modified example. [Figure 11] FIG. 13 is a block diagram showing a configuration of a PC 1B according to a seventh modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] 1 is a configuration diagram of a content information processing system according to this embodiment. The content information processing system includes a PC (personal computer) 1A installed in a first venue 10 and a PC 1B installed in a second venue 20.

[0011] A first performer 3 in a first venue 10 connects a first musical instrument 4 to a PC 1A. The first performer 3 in a first venue 10 also connects a head mounted display (HMD) 51 and headphones 81 to the PC 1A. The first venue 10 is, for example, the home of the first performer 3. The first performer 3 in a first venue 10 performs a performance playing the first musical instrument 4.

[0012] The second venue 20 is a live music venue, a concert hall, or the like. The PC 1B in the second venue 20 is connected to a camera 50, a microphone 8, and a speaker 82. The camera 50 and the microphone 8 are installed on the stage. The camera 50 acquires a video signal related to an image seen from the stage. The microphone 8 acquires an audio signal related to a sound heard on the stage.

[0013] In this embodiment, as an example, the first musical instrument 4 and the microphone 8 are examples of audio equipment. Note that in this embodiment, "playing" is not limited to playing an instrument, but also includes singing using a microphone.

[0014] Fig. 2 is a block diagram showing the configuration of PC1A. Fig. 3 is a block diagram showing the configuration of PC1B. PC1A and PC1B are general-purpose information processing devices. The main configuration of PC1A and PC1B is the same.

[0015] The PC 1A and the PC 1B each include a display interface (I / F) 31, a user I / F 32, a flash memory 33, a processor 34, a RAM 35, a communication I / F 36, and an audio I / F 37.

[0016] The display I / F 31 is connected to a display. The display I / F 31 of PC1A is connected to a head mounted display (HMD) 51, which is an example of a display. Although nothing is connected to the display I / F 31 of PC1B in FIG. 3, a general-purpose display such as an LCD may be connected to it. Note that, although an example in which the HMD 51 is connected to PC1A is shown in this embodiment, a display such as an LCD may be connected to PC1A.

[0017] The user I / F 32 is a keyboard, a mouse, or a touch panel that is laminated on a display. When the user I / F 32 is a touch panel, the user I / F 32 and the display configure a GUI (Graphical User Interface).

[0018] The communication I / F 36 includes a network interface and is connected to a network such as the Internet via a router (not shown). In the example of Fig. 1, PC1A and PC1B are connected via a network. That is, the first venue and the second venue are connected via a network.

[0019] The audio I / F 37 has an audio terminal. The audio I / F 37 is connected to an audio device such as a musical instrument or a microphone via an audio cable and receives an audio signal. In this embodiment, the audio I / F 37 of PC1A is connected to the first musical instrument 4 and receives an audio signal related to a performance sound from the first musical instrument 4. The audio I / F 37 of PC1B is connected to the microphone 8. The audio I / F 37 of PC1B receives an audio signal related to the sound of the second venue 20 picked up by the microphone 8.

[0020] Further, the audio I / F 37 is connected to audio equipment such as a speaker or a headphone. A headphone 81 is connected to the audio I / F 37 of the PC 1A. A speaker 82 is connected to the audio I / F 37 of the PC 1B. The audio I / F 37 outputs an audio signal to the audio equipment such as the headphone 81 or the speaker 82.

[0021] The processor 34 is composed of a CPU, a DSP, or a SoC (System-on-a-Chip), and reads a program stored in a flash memory 33, which is a storage medium, into a RAM 35 to control each configuration of the PC1A and the PC1B. The flash memory 33 stores the program of this embodiment.

[0022] The processor 34 encodes the audio signal received from the audio I / F 37 into an audio packet and transmits it to another device via the communication I / F 36 .

[0023] Furthermore, the communication I / F 36 of the PC 1B receives a video signal from the camera 50. The processor 34 of the PC 1B encodes the video signal received from the camera 50 into a video packet, and transmits the video packet via the communication I / F 36 to another device.

[0024] The processor 34 also decodes audio packets received from other devices via the communication I / F 36, and outputs the decoded audio signals to the audio I / F 37. The processor 34 also decodes video packets received from other devices via the communication I / F 36, and outputs the decoded video signals to the display device via the display device I / F 31.

[0025] 4 is a flow chart showing the operation of the PC 1A. The PC 1A acquires first performance information relating to a live performance of a first performer 3 in a first venue 10 (S11).

[0026] The first performance information relating to the live performance of the first performer 3 includes, for example, a sound signal relating to the performance of the first musical instrument 4. Alternatively, the first performance information may be operation information of the first performer 3 on the first musical instrument 4. For example, in the case of a guitar, the operation information is information indicating which fret is being pressed, the timing at which the fret is pressed, the timing at which the fret is released, information indicating which string is being picked, the timing of picking, the picking speed, or the presence or absence of a mute operation. In addition, in the case of a keyboard instrument such as a synthesizer, the operation information is time parameters such as pitch (note number), tone, attack, decay, sustain, and release. The operation information is obtained based on, for example, a motion sensor. Alternatively, the operation information can be obtained by a sensor mounted on the musical instrument. In the case of a guitar, the sensor mounted on the musical instrument is, for example, a fret sensor attached to each fret.

[0027] Next, PC1A acquires first content information related to video or audio of second venue 20 (S12). In the example of Fig. 1, PC1A acquires, via the network, an audio signal from microphone 8 and a video signal related to second venue 20 captured by camera 50 as first content information.

[0028] The PC1A generates second content information based on the first performance information and the first content information (S13). Specifically, the PC1A generates a mixed sound signal by mixing the sound signal of the microphone 8 included in the first content information and the sound signal of the first instrument 4 included in the first performance information. The PC1A generates encoded data (e.g., MP4 data) including the mixed sound signal and a video signal related to the second venue 20.

[0029] Then, PC1A generates video or sound based on the second content information (S14). Specifically, PC1A decodes the encoded data and extracts an audio signal and a video signal. PC1A then outputs the extracted audio signal to headphones 81, and outputs a video related to second venue 20 to HMD 51. Note that in the process of S13, PC1A does not necessarily generate encoded data. For example, PC1A may output a mixed audio signal before encoding to headphones 81, and output a video signal before encoding to HMD 51 in S14.

[0030] This allows the first performer 3 to perceive as if he or she were performing in the second venue 20, even though he or she is in a remote location. In other words, the user can have a new customer experience in which he or she perceives as if they are performing live in a favorite live music venue or concert hall, for example.

[0031] The image of the second venue 20 included in the first content information may be an image (digital twin) of a virtual space that imitates the real second venue 20. In this case, the first content information may include information related to the shape of the second venue 20, such as 3D CAD data. The PC 1A may render an image of the virtual space that imitates the second venue 20 based on the information related to the shape of the second venue 20 included in the first content information. In this case, too, the user can have a new customer experience in which the user can perceive as if they were experiencing a live performance in, for example, a beloved live music venue or concert hall.

[0032] The camera 50 may have a viewing angle for capturing an image in one direction, or may have a full viewing angle for capturing an image in 360 degrees. The camera 50 may have a mechanism for changing the viewing angle. The HMD 51 may have a sensor for detecting the direction in which the user's head is facing. The PC 1A may change the viewing angle of the real camera 50 or the viewing angle in the virtual space according to the direction in which the user's head is facing. This makes it easier for the user to perceive a live performance in a beloved live music venue or concert hall.

[0033] (Variation 1) FIG. 5 is a configuration diagram of a content information processing system according to Modification 1. Components common to FIG. 1 are given the same reference numerals and descriptions thereof will be omitted. FIG. 6 is a block diagram showing the configuration of a PC 1B according to Modification 1. Components common to FIG. 3 are given the same reference numerals and descriptions thereof will be omitted. FIG. 7 is a flowchart showing the operation of a PC 1A according to Modification 1. Components common to FIG. 4 are given the same reference numerals and descriptions thereof will be omitted.

[0034] In the first modification, a second performer 5 performs on a stage at a second venue 20, playing a second musical instrument 6. A PC 1B at the second venue 20 is connected to the second musical instrument 6, a camera 50, a microphone 8, and a speaker .

[0035] The audio I / F 37 of the PC 1B is connected to the second musical instrument 6 and the speaker 82. The audio I / F 37 of the PC 1B receives, from the second musical instrument 6, a sound signal relating to a performance sound.

[0036] PC1A further acquires second performance information related to a live performance of a second performer in the second venue 20 (S111). The second performance information is a sound signal related to the performance sound of a second musical instrument 6 by a second performer 5 in the second venue 20. A processor 34 of PC1B transmits the sound signal of the second musical instrument 6 to PC1A. Note that the second performance information may include operation information for the second musical instrument 6 instead of the sound signal related to the performance sound of the second performer 5.

[0037] In the process of S13, PC1A generates second content information based on the first performance information, the first content information, and the second performance information. Specifically, PC1A generates a mixed sound signal by mixing the sound signal of microphone 8 included in the first content information, the sound signal of first instrument 4 included in the first performance information, and the sound signal of second instrument 6 included in the second content information. PC1A generates encoded data (e.g., MP4 data) including the mixed sound signal and a video signal related to second venue 20.

[0038] This allows the first performer 3, who is in a remote location, to perceive as if he or she were in the second venue 20 and having a session with the second performer 5 at the second venue 20. The user can have a new customer experience in which he or she perceives as if they are having a session at a favorite live music venue or concert hall, for example.

[0039] As described above, the image of the second venue 20 included in the first content information may be an image of a virtual space that imitates the second venue 20. In this case, the image corresponding to the second performer 5 included in the image of the second venue 20 may be a 3D model placed in the virtual space. In this case, the 3D model of the virtual space and the performer becomes a digital twin that imitates the real second venue 20 and second performer 5.

[0040] (Variation 2) Fig. 8 is a configuration diagram of a content information processing system according to Modification 2. Components common to Fig. 1 are given the same reference numerals, and descriptions thereof will be omitted. Fig. 9 is a flowchart showing the operation of a PC 1A according to Modification 2. Components common to Fig. 4 are given the same reference numerals, and descriptions thereof will be omitted.

[0041] In the second modification, a PC 1C is installed in a third venue 30. The configuration of the PC 1C is the same as that of the PC 1A. In the second modification, the first venue 10, the second venue 20, and the third venue 30 are connected via a network.

[0042] In the second modification, a third performer 7 performs singing using a microphone 80 in a third venue 30. A PC 1C in the third venue 30 has the microphone 80, an HMD 51, and headphones 81 connected thereto.

[0043] PC1C acquires, as the first content information, an audio signal from the microphone 8 and a video signal related to the second venue 20 captured by the camera 50 via the network. The audio I / F 37 of PC1C receives an audio signal related to the singing sound from the microphone 80. PC1C transmits the audio signal related to the singing sound to PC1A.

[0044] The PC 1A further acquires third performance information related to the live performance of the third performer 7 in the third venue 30 (S121). The third performance information is a sound signal related to the singing sound of the third performer 7 in the third venue 30.

[0045] In the process of S13, PC1A generates second content information based on the first performance information, the first content information, and the third performance information. Specifically, PC1A generates a mixed sound signal by mixing the sound signal of microphone 8 included in the first content information, the sound signal of first instrument 4 included in the first performance information, and the sound signal of microphone 80 included in the third content information. PC1A generates encoded data (e.g., MP4 data) including the mixed sound signal and a video signal related to second venue 20.

[0046] This allows the first performer 3, who is in a remote location, to perceive as if he or she were in the second venue 20 and having a session with the third performer 7 at the second venue 20. Users can have a new customer experience in which they can perceive as if they were having a session with another performer in a remote location, for example, at a favorite live music venue or concert hall.

[0047] (Variation 3) The first content information according to the third modification includes information related to the delay in the second venue 20. The process of generating the second content information in the PC 1A includes a process of reproducing the delay in the second venue 20.

[0048] The information on delay includes the delay of sound waves in the space in the second venue 20. The delay of sound waves in the space corresponds to the distance between the position of the speaker 82 and the position of the performer (for example, the microphone 8 or the camera 50), the distance between the position of the speaker 82 and the position of the wall of the second venue 20, or the distance between the position of the wall of the second venue 20 and the position of the performer. The distance between the position of the speaker 82 and the position of the performer (for example, the microphone 8 or the camera 50) can be measured, for example, by outputting a test sound from the speaker 82 and acquiring the test sound with the microphone 8. The distance between the position of the speaker 82 and the position of the wall of the second venue 20 can be measured by outputting a test sound from the speaker 82 and acquiring the test sound with a measurement microphone (not shown). The distance between the position of the wall of the second venue 20 and the position of the performer can be measured by installing a test speaker at the position of the wall of the second venue 20, outputting a test sound from the speaker, and acquiring the test sound with the microphone 8. These distances may also be measured by outputting a test sound from the speaker 82 and acquiring an impulse response from the microphone 8.

[0049] PC1A acquires information related to the delay as the first content information. Then, PC1A performs signal processing related to the delay on the sound signal of the first musical instrument 4 included in the first performance information. For example, if the information related to the delay is an impulse response at the position of the performer measured in the second venue 20, PC1A performs processing to convolute the impulse response into the sound signal of the first musical instrument 4. In this way, PC1A reproduces the delay environment of the second venue 20.

[0050] Therefore, users can more easily perceive it as if they were experiencing a live performance in their favorite live music venue or concert hall.

[0051] The PC1A may receive an adjustment operation related to the delay from the user. The PC1A reproduces the delay adjusted by the adjustment operation. The adjustment operation may be, for example, an operation of designating an arbitrary live music venue or concert hall. The PC1A obtains information related to the delay corresponding to the designated live music venue or concert hall from, for example, a server. This allows the user to reproduce the reverberation of a place different from the reverberation of the second venue 20.

[0052] (Variation 4) The first content information according to the fourth modification further includes information relating to the shape of the second venue 20. PC1A generates information relating to the delay in the second venue 20 based on the information relating to the shape of the second venue 20. PC1A performs a process of reproducing the delay in the second venue 20 based on the generated information relating to the delay.

[0053] The information relating to the shape of the second venue 20 is, for example, 3D CAD data of the second venue 20. PC1A calculates the impulse response of the second venue 20 based on the information relating to the shape of the second venue 20 included in the first content information. At this time, PC1A may specify the position of a performer at any position within the second venue 20 and calculate the impulse response at that position, or may accept the specification of the performer's position from the user and calculate the impulse response at that position.

[0054] The PC1A performs a process of convolving the impulse response with the sound signal of the first musical instrument 4. In this way, the PC1A reproduces the delay environment of the second venue 20.

[0055] In this case too, users can more easily perceive the experience as if they were experiencing a live performance in their favorite live music venue or concert hall.

[0056] (Variation 5) The first content information may include information on past images or sounds. The past images may be past images of the second venue 20 or past images of the first venue 10. If it is past images of the second venue 20, PC1B records the images taken by the camera 50 or the sounds recorded by the microphone 8 in the flash memory 33 of the device or in a server (not shown). PC1A receives information on past images or sounds of the second venue 20 from PC1B or a server (not shown). If it is past images of the first venue 10, PC1A records the images taken by the camera (not shown) or the sounds recorded by the microphone installed in the first venue 10 in the flash memory 33 of the device or in a server (not shown). PC1A receives information on past images or sounds of the first venue 10 from the flash memory 33 of the device or in a server (not shown).

[0057] This allows users to have a new customer experience, for example by perceiving themselves as if they were experiencing a live performance in a beloved live music venue or concert hall that no longer exists.

[0058] (Variation 6) The second content information may be distributed to another venue (fourth venue). PC1A distributes the second content information (encoded data such as MP4) generated in S13 of Fig. 4 to the information processing device of the fourth venue. Alternatively, PC1A may transmit the second content information (encoded data such as MP4) generated in S13 of Fig. 4 to a server (not shown), which distributes it to the information processing device of the fourth venue.

[0059] Furthermore, PC1A or the server may perform billing processing for the listeners via the information processing device of the fourth venue. PC1A or the server distributes the second content information to the listeners who have completed the billing processing. This allows the first performer 3 to sell the content as a performance at any venue of his / her choice.

[0060] Also, PC1A or the server may acquire the position information of the listener through the information processing device of the fourth venue. PC1A or the server may change the billing process according to the acquired position information. The position information is acquired, for example, by a GPS function of the information processing device. Alternatively, the position information may be identification information such as an ID associated with a specific location. The identification information is written on an exhibit or a ticket as, for example, a two-dimensional code at each of the multiple locations. The identification information is read by a camera or the like of the information processing device and transmitted to PC1A or the server. As a result, the amount charged changes depending on the location where the second content information is viewed. Therefore, for example, the amount charged can be changed between when the fourth venue is a home and when the fourth venue is a location where many listeners gather, such as a public viewing. For example, the first performer 3 or the person who executes the event can charge a higher amount when distributing the second content information as a larger event. Alternatively, when the first performer 3 personally distributes the second content information as a small-scale event, a lower amount can be charged to have a larger number of listeners view the information.

[0061] (Variation 7) Fig. 10 is a configuration diagram of a content information processing system according to Modification 7. Components common to Fig. 5 are given the same reference numerals, and descriptions thereof will be omitted. Fig. 11 is a block diagram showing the configuration of a PC 1B according to Modification 7. Components common to Fig. 6 are given the same reference numerals, and descriptions thereof will be omitted.

[0062] A projector 71 is installed in the second venue 20 of the content information processing system according to the seventh modification. The projector 71 is connected to a PC 1B.

[0063] PC1B receives video information relating to the first performer 3 from PC1A. The video information relating to the first performer 3 is a video signal captured by a camera (not shown) of the first performer 3. In this case, PC1B displays a video of the first performer 3 on projector 71 based on the received video information relating to the first performer 3. Alternatively, the video information relating to the first performer 3 may be motion data capturing the movements of the first performer 3. If it is motion data, PC1B further acquires and renders 3D model data corresponding to the first performer 3, displays it on projector 71, and uses the motion data to control the movements of the 3D model data.

[0064] This allows the listeners in the second venue 20 to perceive the first performer 3 as if he or she were in the second venue 20 and performing. In other words, the first performer 3 (user) can obtain a new customer experience in which the listeners in the second venue 20 perceive the first performer 3 as if he or she were in the second venue 20 and performing, even though the first performer 3 is in a remote location.

[0065] (Variation 8) The PC1A of the content information processing system according to the eighth modification may further acquire information on the reproduction environment of the second venue 20. The information on the reproduction environment includes, for example, information on the acoustic equipment (effector, amplifier, speaker, etc.) including the microphone 8 of the second venue 20, and information on the reverberation of the reproduction space. The sound acquired by the microphone 8 also changes depending on the acoustic equipment and the reverberation of the reproduction space of the second venue 20. For example, the reverberation of the sound differs depending on the studio environment such as a trial room, a concert hall, outdoors, etc. The PC1A performs signal processing on the sound of the generated second content information based on the information on the reproduction environment. For example, the PC1A may perform signal processing on the sound signal of the generated sound by convolving impulse response data of the reproduction environment. The PC1A may also perform filter processing on the sound signal of the generated sound to simulate the acoustic equipment (effector, amplifier, speaker, etc.) installed in the second venue 20. Specifically, the information on the playback environment includes parameters of a digital signal processing block that simulates, as a digital filter, the output characteristics for the input of each piece of audio equipment installed in the second venue 20. PC1A applies signal processing to the sound signal of the generated sound using the parameters indicated in the information on the audio equipment. This allows PC1A to reproduce, for the generated sound, the input / output characteristics of the audio equipment (effectors, amplifiers, speakers, etc.) installed in the second venue 20.

[0066] In this case, the PC 1A reproduces the input / output characteristics of the audio equipment (effectors, amplifiers, speakers, etc.) installed in the second venue 20 for the sound of the first instrument 4 played by the first performer 3 in the first venue 10. This makes it easier for users to perceive the performance as if they were in a live performance at their favorite live music venue or concert hall.

[0067] (More examples) In the above example, PC1A, PC1B, and PC1C are shown as examples of the content information processing device of the present invention. However, the content information processing device of the present invention is not limited to the above-mentioned PC1A, PC1B, and PC1C. For example, an electronic musical instrument having the functions of the above-mentioned user I / F 32, flash memory 33, processor 34, RAM 35, communication I / F 36, and audio I / F 37 can also constitute the terminal of the present invention.

[0068] The description of the present embodiment should be considered as illustrative in all respects and not restrictive. The scope of the present invention is indicated by the claims, not by the above-described embodiments. Furthermore, the scope of the present invention includes the scope equivalent to the claims. [Explanation of symbols]

[0069] 3: First speaker 4: Musical Instruments 5: 2nd speaker 6: Musical Instruments 7: 3rd performer 8: Microphone 10: Hall 1 20: Venue 2 30: Venue 3 31: Display I / F 32: User interface 33: Flash memory 34: Processor 35: RAM 36: Communication I / F 37: Audio I / F 50: Camera 51: HMD 71: Projector 80: Microphone 81: Headphones 82: Speaker

Claims

1. Acquire first performance information relating to a live performance of a first performer at a first venue; Acquire first content information relating to video or audio of a second venue connected to the first venue via a network; generating second content information based on the first performance information and the first content information; generating a video or a sound based on the second content information; Content information processing method.

2. acquiring second performance information relating to a live performance of a second performer at the second venue; generating the second content information based on the first performance information, the first content information, and the second performance information; The content information processing method according to claim 1 .

3. Acquire third performance information relating to a live performance by a third performer at a third venue; generating the second content information based on the first performance information, the first content information, and the third performance information; The content information processing method according to claim 1 .

4. Furthermore, information regarding the playback environment of the second venue is acquired, performing signal processing on the generated sound based on information about the playback environment; The content information processing method according to claim 1 .

5. the first performance information includes a performance sound of a first instrument played by the first performer; the second content information includes a performance sound of the first musical instrument, performing the signal processing on the performance sound of the first musical instrument based on the information on the reproduction environment; The content information processing method according to claim 4.

6. The second content information includes a mixed sound obtained by mixing the sound of the first venue and the sound of the second venue. The content information processing method according to claim 1 .

7. The first content information includes information regarding a delay of a sound wave in the second venue; The process of generating the second content information includes a process of reproducing a delay of a sound wave in the second venue. The content information processing method according to any one of claims 1 to 6.

8. The first content information further includes information related to the shape of the second venue, generating information about a delay of a sound wave in the second venue based on information about the shape of the second venue; The process of generating the second content information includes a process of reproducing a delay of a sound wave in the second venue. The content information processing method according to any one of claims 1 to 6.

9. The first content information includes information regarding a delay of a sound wave in the second venue; Accepting an adjustment operation regarding the delay from a user; the process of generating the second content information includes a process of reproducing the delay adjusted by the adjustment operation. The content information processing method according to any one of claims 1 to 6.

10. The video or audio based on the second content information includes a past video or audio. The content information processing method according to any one of claims 1 to 6.

11. The second content information is distributed to a fourth venue. The content information processing method according to any one of claims 1 to 6.

12. performing a billing process for the listeners in the fourth venue; Delivering the second content information to the listener for whom the billing process has been completed; The content information processing method according to claim 11.

13. acquiring position information of the listener in the fourth venue; changing the billing process according to the location information; The content information processing method according to claim 12.

14. Acquire first performance information relating to a live performance of a first performer at a first venue; Acquire first content information relating to video or audio of a second venue connected to the first venue via a network; generating second content information based on the first performance information and the first content information; generating a video or a sound based on the second content information; A content information processing device having a processor.

15. The processor, acquiring second performance information relating to a live performance of a second performer at the second venue; generating the second content information based on the first performance information, the first content information, and the second performance information; The content information processing device according to claim 14.

16. The processor, Acquire third performance information relating to a live performance by a third performer at a third venue; generating the second content information based on the first performance information, the first content information, and the third performance information; The content information processing device according to claim 14.

17. The first content information includes information regarding a delay of a sound wave in the second venue; The process of generating the second content information includes a process of reproducing a delay of a sound wave in the second venue. The content information processing device according to any one of claims 14 to 16.

18. The first content information further includes information related to the shape of the second venue, The processor generates information regarding a delay of sound waves in the second venue based on information regarding the shape of the second venue; The process of generating the second content information includes a process of reproducing a delay of a sound wave in the second venue. The content information processing device according to any one of claims 14 to 16.

19. The first content information includes information regarding past video or audio of the second venue, The content information processing device according to any one of claims 14 to 16.

20. The processor distributes the second content information to a fourth venue. The content information processing device according to any one of claims 14 to 16.

Images