Communication device, control method, and program

Abstract

To reduce the trouble of a user switching a plurality of moving image data to be transmitted.SOLUTION: A communication device includes imaging means for generating first video data, holding means for holding second video data, and transmission means for starting transmission of the held second video data before transmitting the first video data when starting to transmit the first video data generated by the imaging means to an external device.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a communication device capable of switching video data to be transmitted.

Background Art

[0002] In recent years, live distribution services for real-time distribution of video data and audio data have been known. Users can transmit in real time to other users via a live distribution service data generated using cameras, microphones, etc. mounted on communication devices such as smartphones and digital cameras. Patent Document 1 discloses a digital camera capable of live distribution.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] As a method of having more viewers watch a live distribution, there is a method of attracting the interest of viewers by distributing an opening video before the live distribution or an ending video after the live distribution. For example, when distributing an opening video, the user manually switches to the video data being generated in real time after the distribution of the video data that is the opening video is completed. However, the act of performing an operation for manually switching between a plurality of video data is often something that the user who is the distributor does not want the user who is the viewer to see. In order for the user who is the distributor not to show such an appearance to the user who is the viewer, some kind of contrivance was necessary. Thus, when a user distributes while switching between a plurality of video data, it is necessary to spend time that is unnecessary for the distribution.

[0005] Therefore, an object of the present invention is to reduce the trouble for a user to switch between a plurality of video data to be transmitted.

Means for Solving the Problems

[0006] In order to achieve the above object, a communication device of the present invention Imaging means for generating first video data, holding means for holding second video data, and in a first mode, when starting to transmit the first video data generated by the imaging means to an external device, starting to transmit the held second video data before transmitting the first video data, and in a second mode, when starting to transmit the first video data generated by the imaging means to the external device, transmission means for starting to transmit the first video data without transmitting the second video data is characterized by the following.

Effects of the Invention

[0007] According to the present invention, it is possible to reduce the trouble for a user to switch between a plurality of video data to be transmitted.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Modes for Carrying Out the Invention

[0009] Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the accompanying drawings.

[0010] Note that the embodiments described below are examples of means for realizing the present invention, and may be appropriately modified or changed depending on the configuration of the apparatus to which the present invention is applied and various conditions. Also, it is possible to appropriately combine the respective embodiments.

[0011] [First Embodiment] <Configuration of Digital Camera> FIG. 1(a) is a block diagram showing a configuration example of a digital camera 100 which is an example of a communication device according to the present embodiment. Here, although a digital camera is described as an example of the communication device, the communication device is not limited thereto. For example, the communication device may be a device such as a smartphone, a personal computer, a smartwatch, or a tablet terminal.

[0012] The control unit 101 has hardware (for example, a processor) for executing a program stored in the nonvolatile memory 103. The control unit 101 controls the digital camera 100 by executing the program recorded in the nonvolatile memory 103. Note that instead of the control unit 101 controlling the entire apparatus, a plurality of pieces of hardware may share the processing to control the entire apparatus.

[0013] The imaging unit 102 includes, for example, a lens unit, an imaging device for converting an optical image of a subject imaged on an imaging surface through the lens unit into an electrical signal, and an image processing unit for generating still image data or moving image data from the electrical signal generated by the imaging device. Generally, a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled Device) is used as the imaging device. In the first embodiment, a series of processes of generating still image data or moving image data by the imaging unit 102 and outputting it from the imaging unit 102 is referred to as "shooting". The still image data or moving image data generated by the imaging unit 102 is recorded on the recording medium 110 in accordance with the DCF (Design rule for Camera File system) standard. Also, the still image data and moving image data to be transmitted for live distribution described later are temporarily recorded in the working memory 104 and then transmitted. This data is transmitted to the distribution server 300 via the communication unit 111. Note that the imaging unit 102 may be configured to be detachable from the digital camera 100, or may be built into the digital camera 100. That is, the digital camera 100 only needs to have means for acquiring an electrical signal such as moving image data from at least the imaging unit 102.

[0014] The non-volatile memory 103 is a non-volatile memory in which programs and the like executed by the control unit 101 are recorded. Also, the control unit 101 can record moving image data and still image data in the non-volatile memory 103.

[0015] The working memory 104 is used as a buffer memory for temporarily holding the still image data and moving image data imaged by the imaging unit 102, an image display memory for the display unit 106, a working area of the control unit 101, and the like.

[0016] The operation unit 105 is a user interface (UI) for receiving instructions from the user for the digital camera 100. The operation unit 105 can include, for example, a power switch for the user to instruct the on / off of the digital camera 100, a release switch for instructing shooting, a playback button for instructing the playback of still image data, etc. Also, the touch panel formed on the display unit 106 can be included in the operation unit 105. Note that the release switch has SW1 and SW2. When the release switch is in a so-called half-pressed state, SW1 is turned on. Thereby, a preparation instruction for performing preparation operations for imaging such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, EF (flash pre-emission) processing, etc. is received. Also, when the release switch is in a so-called fully pressed state, SW2 is turned on. By such a user operation, an imaging instruction for performing an imaging operation is received. Also, a wireless button for switching the on / off of the wireless communication function via the communication unit 111 is included in the operation unit 105.

[0017] The display unit 106 performs display of a through-image during shooting, display of the captured still image data, character display for interactive operations, etc. The display unit 106 is, for example, a liquid crystal display, an LED display, etc. The display unit 106 does not necessarily have to be built into the digital camera 100 and may be configured to be externally connected to the digital camera 100. That is, the digital camera 100 can be connected to an internal or external display unit 106 and only needs to have at least a display control function for controlling the display of the display unit 106. The external display unit 106 is, for example, a viewfinder that can be connected to the digital camera 100.

[0018] The microphone 107 is a microphone device that picks up sound waves such as voices and generates voice data. The control unit 101 can generate video data with audio from the video data generated by the imaging unit 102 and the voice data generated by the microphone 107 or the microphone of an external device. The video data with audio generated by the control unit 101 is recorded on the recording medium 110 by the control unit 101. Also, the control unit 101 can associate the still image data generated by the imaging unit 102 and the voice data generated by the microphone 107 and record them on the recording medium 110. Further, the voice data generated for transmission in the live distribution described later is recorded in the working memory 104. Note that the microphone 107 may be configured to be detachable from the digital camera 100 or may be built into the digital camera 100. That is, the digital camera 100 only needs to have means for receiving an electrical signal from at least the microphone 107. Note that the process of the microphone 107 generating voice data from sound waves may be partially shared by other hardware (for example, the control unit 101).

[0019] The speaker 108 is an electroacoustic transducer that can output electronic sound data. The electronic sound data is, for example, music, warning sounds, focusing sounds, electronic shutter sounds, and operation sounds. These electronic sound data are recorded in the non-volatile memory 103. The speaker 108 can output the electronic sound data selected by the control unit 101. By listening to the sound output from the speaker 108, the user can, for example, notice that the subject is in focus or an error occurring in the digital camera 100.

[0020] The power supply unit 109 can supply power to each element of the digital camera 100 under the control of the control unit 101. The power supply unit 109 is, for example, a power source such as a lithium-ion battery or an alkaline manganese dry battery.

[0021] The recording medium 110 can record, for example, the still image data output from the imaging unit 102. The recording medium 110 is, for example, an SD card, a CF card, an XQD (registered trademark) card, or the like. The recording medium 110 may be configured to be detachable from the digital camera 100, or may be built into the digital camera 100. That is, the digital camera 100 only needs to have means for accessing at least the recording medium 110.

[0022] The communication unit 111 is an interface for wireless connection with an external device. The digital camera 100 of the present embodiment can transmit and receive data to and from an external device via the communication unit 111. For example, the digital camera 100 can transmit the still image data generated by the imaging unit 102 or the moving image data recorded in the non-volatile memory 103 to an external device via the communication unit 111. The external device of the present embodiment is, for example, a communication device such as an external server, a smartphone, and a PC. In the present embodiment, the communication unit 111 includes an interface for communicating with a relay device and an external device via a so-called wireless LAN (Local Area Network) conforming to the IEEE802.11 standard. The communication unit 111 of the digital camera 100 in the present embodiment has a client mode that operates as a client in the infrastructure mode. By operating the communication unit 111 in the client mode, the digital camera 100 in the present embodiment can operate as a client device in the infrastructure mode. When the digital camera 100 operates as a client device, it can participate in the LAN formed by the access point device by connecting to the surrounding access point device. The control unit 101 realizes wireless communication with the relay device and the external device by controlling the communication unit 111. Note that the communication method is not limited to wireless LAN, and includes, for example, public wireless communication methods such as 4G, LTE, and 5G, wired communication methods conforming to standards such as Ethernet, and wireless communication methods such as Bluetooth (registered trademark).

[0023] Next, an example of the appearance of the digital camera 100 will be described. FIG. 1(b) is a diagram showing an example of the front appearance view of the digital camera 100. FIG. 1(c) is a diagram showing an example of the back appearance view of the digital camera 100. The release switch 105a, the playback button 105b, the direction keys 105c, and the touch panel 105d are operating members included in the operation unit 105. The release switch 105a, the playback button 105b, the direction keys 105c, and the touch panel 105d are operating members for inputting various operation instructions to the control unit 101. Also, on the display unit 106, a still image or a moving image captured by the imaging unit 102 is displayed.

[0024] The above has described an example of the configuration of the digital camera 100.

[0025] <System Configuration of Live Streaming> FIG. 2 is a diagram showing an example of a system configuration for the digital camera 100 to access a distribution server 300 via a network and execute live streaming.

[0026] The network router 200 serves as an access point for a wireless LAN to form a network. The digital camera 100 joins, as a client, the network formed by the network router 200 through the communication unit 111. The digital camera 100 connects to the distribution server 300 via the network router 200. In this embodiment, an example in which the digital camera 100 wirelessly connects to the network router 200 will be described, but the digital camera 100 may be wired-connected to the network router 200. Note that the network router 200 may be an information processing device such as a smartphone, a tablet device, and a personal computer. In this case, the network formed by the network router 200 is a network generated by the tethering function of the information processing device.

[0027] The distribution server 300 provides a cloud service. This cloud service is a cloud service that particularly requires the provision of content with little delay from users. In this embodiment, the distribution server 300 provides a live distribution service.

[0028] Live distribution is the delivery of video data, audio data, etc. in real time from a user who is the distributor to a user who is the viewer via the Internet by streaming technology. The user who is the viewer can view this video data, audio data, etc. in real time, like a live broadcast of a television or radio broadcast. The distribution server 300 transmits, as a live distribution service, video data and audio data transmitted from a user who is the distributor to the viewer as content. In this embodiment, the digital camera 100 sequentially transmits the video data generated in real time to the distribution server 300, and the distribution server 300 sequentially transmits the received video data to the user who is the viewer. In addition, the distribution server 300 also provides a service that allows the user who is the viewer to view the live distribution on a web page or the like. Hereinafter, the video data, audio data, etc. generated by the digital camera 100 and distributed in the live distribution are collectively referred to as distribution data.

[0029] Before starting the live distribution, the user who is the distributor performs the live distribution settings on the distribution server 300 using a personal computer, smartphone, or the like. The live distribution settings are the settings of the video data that is the content provided in the live distribution and the data necessary for the transmission and reception of the video data. For example, the live distribution settings are the identifier of the live distribution, the destination URL, the stream key, the title of the live distribution, the frame rate of the video data, the bit rate of the video data, etc. The destination URL is, for example, the URL to which the distribution data generated by the digital camera 100 is transmitted. The stream key is information for the distribution server 300 to associate the user with the distribution data.

[0030] A user can create multiple live streaming settings on the distribution server 300. For example, when a user who is a distributor conducts consecutive live streams of different distribution contents, the settings for each live stream are generated on the distribution server 300. Also, the user can create live streaming settings using the digital camera 100. In this case, the digital camera 100 transmits the created live streaming settings to the distribution server 300, and the distribution server 300 records the live streaming settings.

[0031] When performing a live stream, the digital camera 100 transmits distribution data according to the live streaming settings received from the distribution server 300. With reference to FIGS. 3(a) to (c), the operations for the user to start a live stream will be described. FIG. 3(a) is an example of a screen for displaying a list of communication functions of the digital camera 100. When the user performs a live stream, the user selects and determines the live stream in item 301 using the operation unit 105. In this case, the digital camera 100 displays the screen shown in FIG. 3(b).

[0032] FIG. 3(b) is an example of a screen for displaying setting items related to the live stream. In this embodiment, the digital camera 100 displays an item 302 for starting the live stream and an item 303 for setting whether to insert a video into the live stream. When the user starts the live stream, the user selects and determines item 302 using the operation unit 105. In this case, the digital camera 100 displays the screen shown in FIG. 3(c). Note that item 303 will be described later.

[0033] FIG. 3(c) is an example of a screen for selecting the live streaming settings. A list of the live streaming settings received by the digital camera 100 from the distribution server 300 is displayed on this screen. The item names displayed on this screen are, for example, the titles of the live streams. When the user selects and determines any item, the digital camera 100 starts the live streaming process based on the live streaming settings. Details of the live streaming process will be described later.

[0034] Further, the communication protocol used by the digital camera 100 and the distribution server 300 for transmitting and receiving data for live distribution preparation processing is different from the communication protocol used for transmitting and receiving distribution data and the like in live distribution. The former protocol is a communication protocol capable of data communication. The former communication protocol assumes a widely used communication protocol. The latter communication protocol is a communication protocol aimed at communication with less delay. For example, the former communication protocol is HTTP (Hypertext Transfer Protocol), and the latter communication protocol is RTMP (Real-Time Messaging Protocol). Communication compliant with the latter communication protocol (RTMP) is characterized by less delay than communication compliant with the former communication protocol (HTTP). In this embodiment, the digital camera 100 transmits distribution data to be distributed in live distribution by RTMP and transmits other data (for example, live distribution settings, etc.) by HTTP.

[0035] <Opening distribution function> In this embodiment, when the digital camera 100 starts live distribution, before sequentially transmitting the video data generated by the imaging unit 102 as distribution data, the video data recorded on the recording medium 110 can be transmitted to the distribution server 300 as distribution data. Hereinafter, this function is referred to as the opening distribution function. The video data recorded on the recording medium 110 is, for example, the video data of the opening video. The opening video is a video for notifying a user who is a viewer that the live distribution has started. Usually, when the user switches the distribution data, the user needs to perform an operation for selecting the transmitted distribution data or an operation for switching. However, with this function, since the digital camera 100 automatically switches from the video data of the opening video to the video data generated by the imaging unit 102, the user does not need to perform such an operation. As a result, the user can naturally switch from the opening video to the video data generated by the imaging unit 102 only by operating to start the live distribution. Hereinafter, a method for the user to use the opening distribution function in this embodiment will be described.

[0036] In this embodiment, when the user uses the opening distribution function, the item 303 shown in FIG. 3(b) is selected and determined. In this case, the digital camera 100 displays the screen shown in FIG. 3(d).

[0037] FIG. 3(d) is a screen for switching whether to insert a video in the live distribution. Here, explanations other than the opening distribution function are omitted. When the user uses the opening distribution function, the item 304 is selected and the "ON / OFF" button is pressed. By this, the user can switch whether to use the opening distribution function. Further, when changing the detailed settings of the opening distribution function, the user presses the "Detailed Settings" button. In response to this, the digital camera 100 displays a screen for performing the detailed settings of the opening distribution function.

[0038] Figure 3(e) is a screen for displaying a list of detailed settings of the opening distribution function. When the user selects item 305, the digital camera 100 displays a screen for selecting video data to be distributed in the opening distribution function as shown in Figure 3(f). On the screen shown in Figure 3(f), the user selects and determines the video data to be distributed as the opening video. The digital camera 100 displays the name of this determined video data in item 305. Note that the settings for items 306 to 308 will be described later.

[0039] Thus, the user can utilize the opening distribution function.

[0040] Here, the item of "ending video" in Figure 3(d) will be described. When the item of "ending video" is ON, the digital camera 100 operates as follows. When the digital camera 100 finishes the live distribution, after completing the transmission of the video data generated by the imaging unit 102 and before sending the end request of the live distribution, it sends the video data recorded in the recording medium 110 to the distribution server 300 as distribution data. Hereinafter, this function is referred to as the ending distribution function. The video data recorded in this recording medium 110 is, for example, an ending video. The ending video is a video for notifying the user who is the viewer that the live distribution has ended. With the ending distribution function, the user can save the trouble of performing operations for selecting or switching the distribution data to be sent in order to distribute the ending video. Note that the method for the user to utilize the ending distribution function in this embodiment is the same as that of the opening distribution function.

[0041] <Live distribution process> Figure 4 is a diagram showing an example of a sequence of processes of the digital camera 100 and the distribution server 300 when the live distribution is executed in this embodiment. Figures 5(a) to (h) are examples of the display screens of the digital camera 100 in this embodiment. Using Figures 5(a) to (h), a series of operations in the live distribution will be described.

[0042] In step S401, the user operates the digital camera 100 to input an instruction to start live distribution. For example, as described above, on the screen shown in FIG. 3(c), the user touches the touch panel to select and determine an arbitrary live distribution setting.

[0043] In step S402, the digital camera 100 displays a standby screen. While referring to this standby screen, the user can adjust shooting settings such as the placement of the digital camera 100, the angle of view, and the white balance. FIG. 5(a) is an example of the standby screen before live distribution starts. As shown in FIG. 5(a), the digital camera 100 sequentially displays the video data generated by the imaging unit 102 on the display unit 106. On the other hand, as shown in FIG. 5(b), since the distribution server 300 has not yet received distribution data from the digital camera 100, it does not transmit the distribution data to the user who is the viewer.

[0044] After the process of step S402 is executed, when the user has completed the preparation for live distribution, the user performs the operation of step S403 to start live distribution. In this sequence, the case where the opening distribution function is valid will be described.

[0045] In step S403, the user operates the digital camera 100 to input an instruction to start transmitting distribution data. For example, on the screen shown in FIG. 5(a), when the user touches the touch panel, by selecting the button 501, an instruction to start the live distribution process is input.

[0046] In step S404, the digital camera 100 transmits a start request for live distribution to the distribution server 300. The start request for live distribution is a request that instructs the distribution server 300 to start transmitting distribution data to the user who is the viewer. This request includes an identifier and a stream key for live distribution.

[0047] In step S405, the digital camera 100 encodes video data that becomes an opening video based on the settings for live distribution, and generates distribution data. This setting for live distribution is, for example, a setting related to video data such as the resolution and frame rate that can be received by the distribution server 300. Note that if the digital camera 100 determines that encoding is unnecessary, it does not have to execute the processing of this step.

[0048] In step S406, the distribution server 300 starts live distribution based on the request received in step S404. For example, the distribution server 300 starts transmitting the distribution data received from the digital camera 100 to the user who is the viewer. Note that the processing of step S405 and the processing of step S406 are executed in parallel.

[0049] In step S407, the digital camera 100 transmits the distribution data of the opening video generated in step S405 to the distribution server 300. Thereafter, the digital camera 100 executes the processing of step S408 in parallel with the processing of step S407.

[0050] In step S408, the digital camera 100 displays the remaining time until the transmission of the distribution data of the opening video is completed. In the present embodiment, as shown in FIG. 5(c), the digital camera 100 displays the time so as to be superimposed on the video data generated by the imaging unit 102. Note that in the present embodiment, in the screen shown in FIG. 5(c), the digital camera 100 does not reproduce the audio of the opening video. On the other hand, as shown in FIG. 5(d), the distribution server 300 transmits the distribution data (that is, the opening video) received from the digital camera 100 to the user who is the viewer. The distribution data transmitted to the distribution server 300 includes audio data, and the viewer views the video and audio of the opening video. Note that whether or not the digital camera 100 displays the time until the transmission of the distribution data of the opening video is completed is based on the setting of item 306 in FIG. 3(e).

[0051] When the transmission of the distribution data of the opening video is completed, the digital camera 100 starts transmitting the video data generated by the imaging unit 102.

[0052] In step S409, since the digital camera 100 has completed transmitting the distribution data of the opening video, it erases the display of the time until the transmission of the distribution data of the opening video is completed.

[0053] In step S410, the digital camera 100 transmits the video data generated by the imaging unit 102 and the audio data generated by the microphone 107 to the distribution server 300 as distribution data. After this step, the digital camera 100 sequentially generates the video data generated by the imaging unit 102 and the audio data generated by the microphone 107 as sequential distribution data and transmits them to the distribution server 300. Note that the digital camera 100 transmits the distribution data in a predetermined data amount. For example, when the video data for 5 seconds of the distribution data is recorded in the working memory 104 of the digital camera 100, the digital camera 100 transmits the video data for 1 second of the previously shot video data to the distribution server 300 as the distribution data.

[0054] Here, FIG. 5(e) is an example of a screen during live distribution of the digital camera 100 in the present embodiment. As shown in FIG. 5(e), the digital camera 100 indicates to the user that it is in the middle of live distribution by displaying "●Live" in the upper left corner of the display unit 106. Further, when the digital camera 100 receives data regarding the state of live distribution from the distribution server 300, it may display that data on the display unit 106. The data regarding the state of live distribution is, for example, the number of viewers, the state of the communication speed with the distribution server 300, numerical values regarding the evaluation of the live distribution, and comments transmitted from viewers to the distribution server 300 during the live distribution. In the present embodiment, as shown in FIG. 5(e), when the digital camera 100 receives data on the number of viewers from the distribution server 300, it displays that number in the lower left corner of the display unit 106. Note that the digital camera 100 may further display on the display unit 106 other data regarding the state of live distribution.

[0055] Also, the distribution data transmitted to the distribution server 300 includes video data generated by the imaging unit 102 of the digital camera 100 and audio data generated by the microphone 107. As shown in FIG. 5(f), the distribution server 300 transmits the distribution data received from the digital camera 100 to the user who is the viewer. Note that the video of this distribution data is the same as the video displayed on the display unit 106 in FIG. 5(e) of the digital camera 100.

[0056] Thereafter, the user performs a live distribution using the digital camera 100. Then, when the user ends the live distribution, the user performs the operation in step S411 to end the live distribution. In this sequence, the case where the ending distribution function is effective will be described.

[0057] In step S411, the user operates the digital camera 100 to input an instruction to end the transmission of the distribution data. For example, on the screen shown in FIG. 5(e), by performing a touch operation on the touch panel and selecting the button 502, the user inputs an instruction to end the live distribution process.

[0058] In step S412, the digital camera 100 encodes video data that will become the ending video based on the settings for live distribution to generate distribution data. This setting for live distribution is, for example, a setting related to video data such as the resolution and frame rate that can be received by the distribution server 300. Note that if the digital camera 100 determines that encoding is unnecessary, it does not have to execute the processing of this step.

[0059] In step S413, the digital camera 100 transmits the distribution data of the ending video generated in step S412 to the distribution server 300. Here, as shown in FIG. 5(g), the digital camera 100 displays the remaining time until the transmission of the distribution data of the ending video is completed. The distribution server 300 transmits the distribution data transmitted from the digital camera 100 to the user who is the viewer. In response to the completion of the transmission of the distribution data, the digital camera 100 executes the processing of step S414.

[0060] In step S414, the digital camera 100 transmits a request to end the live distribution to the distribution server 300.

[0061] In step S415, the distribution server 300 ends the live distribution based on the request received in step S404. For example, the distribution server 300 ends the transmission of the distribution data to the user who is the viewer.

[0062] The live distribution process in this embodiment has been described above.

[0063] In this way, in response to an instruction to start live streaming, before transmitting the video data generated by the imaging unit 102, the digital camera 100 transmits the opening video to the distribution server 300 as distribution data. Also, in response to an instruction to end live streaming, before transmitting a request to end the live streaming to the distribution server 300, the digital camera 100 transmits the ending video to the distribution server 300 as distribution data. Thereby, the user can save the trouble of performing operations for selecting the transmitted distribution data and operations for switching the distribution data.

[0064] <Operation of Digital Camera> FIG. 6 is a flowchart showing an example of the operation of the digital camera 100 in the present embodiment. The processing of the digital camera 100 is realized by expanding the software recorded in the non-volatile memory 103 into the working memory 104 and executing it by the control unit 101. Also, the processing of the digital camera 100 is started triggered by the control unit 101 receiving an instruction from the user to start live streaming. For example, on the screen shown in FIG. 5(a), triggered by the user touching the touch panel and selecting the button 501, the control unit 101 starts the processing of this flowchart. This trigger corresponds to step S401 in FIG. 4.

[0065] In step S601, the control unit 101 displays a standby screen on the display unit 106. For example, as shown in FIG. 5(a), the control unit 101 sequentially displays the video data generated by the imaging unit 102. Note that in this step, when the control unit 101 is operated by the user via the operation unit 105 to change shooting settings such as white balance, the control unit 101 changes to the shooting settings according to the user operation. The processing of this step corresponds to, for example, the processing of step S402 in FIG. 4.

[0066] In step S602, the control unit 101 determines whether to start live distribution. For example, when a touch operation is performed on the button 501 shown in FIG. 5(a), the control unit 101 determines to start live distribution. If the control unit 101 determines to start live distribution, the process of step S603 is executed. If the control unit 101 does not determine to start live distribution, the process of step S601 is repeated. The process of this step corresponds to, for example, the process of step S403 in FIG. 4.

[0067] In step S603, the control unit 101 uses the communication unit 111 to send a start request for live distribution to the distribution server 300. This request includes an identifier for live distribution and a stream key. The process of this step corresponds to, for example, the process of step S404 in FIG. 4.

[0068] In step S604, the control unit 101 determines whether the opening distribution function is valid. For example, the control unit 101 determines whether the item 304 of the opening video in FIG. 3(d) is ON or OFF for the user. If the item 304 is ON, the control unit 101 determines that the opening distribution function is valid. If the item 304 is OFF, the control unit 101 determines that the opening distribution function is invalid. If the opening distribution function is valid, the process of step S605 is executed. If the opening distribution function is invalid, the process of step S611 is executed.

[0069] In step S605, the control unit 101 generates distribution data from the video data determined as the opening video. The video data determined as the opening video is, for example, the video data selected by the user in FIG. 3(f). The control unit 101 generates distribution data from the video data by performing encoding based on the settings for live distribution. The process of this step corresponds to, for example, the process of step S405 in FIG. 4.

[0070] In step S606, the control unit 101 transmits the distribution data generated in step S605 to the distribution server 300 via the communication unit 111. The process of this step corresponds to, for example, the process of step S407 in FIG. 4.

[0071] In step S607, the control unit 101 displays the remaining time until the distribution data is completely transmitted on the display unit 106. For example, as shown in FIG. 5(c), the control unit 101 displays the time so as to superimpose it on the video data generated by the imaging unit 102. The control unit 101 obtains the remaining time in the following manner. For example, when generating the distribution data from the video data of the opening video in step S605, the control unit 101 simultaneously obtains the playback time from the metadata of the video data and sets the playback time as the remaining time. Alternatively, for example, the control unit 101 may calculate the time required until the transmission is completed from the capacity of the distribution data not yet transmitted to the distribution server 300 and the current communication speed, and set the calculated time as the remaining time. Whether or not the control unit 101 displays the remaining time until the distribution data is completely transmitted is based on the setting of item 306 in FIG. 3(e). When item 306 in FIG. 3(e) is ON, the process of this step is executed. When item 306 in FIG. 3(e) is OFF, the control unit 101 does not execute the process of this step, and the process of step S608 is executed. The process of this step corresponds to, for example, the process of step S408 in FIG. 4.

[0072] In step S608, the control unit 101 determines whether to end the live distribution. For example, on the screen shown in FIG. 5(c), the control unit 101 determines whether the button 502 has been touched. If the control unit 101 determines that the button 502 has been touched, it determines to end the live distribution. Here, use cases where the user ends the live distribution while the opening video is being transmitted include, for example, when the user accidentally starts the live distribution or when it is determined that the arrangement or shooting settings of the digital camera 100 need to be changed urgently. In this case, the process of step S616 is executed and the live distribution is ended. Note that in this case, even if the ending distribution function is ON, the ending video is not transmitted to the distribution server 300. This is because ending the live distribution during the transmission of the opening video is an irregular situation, so it is an inappropriate timing to transmit the ending video. If it is determined not to end the live distribution, the process of step S609 is executed.

[0073] In step S609, the control unit 101 determines whether the transmission of the distribution data generated from the opening video has been completed. For example, when the control unit 101 displays the time remaining until transmission completion as the remaining time based on the capacity of the distribution data not yet transmitted to the distribution server 300 and the communication speed, it determines that the transmission of the distribution data has been completed in response to all the distribution data being transmitted. Also, for example, when the control unit 101 displays the playback time of the video data of the opening video as the remaining time, it determines that the transmission of the distribution data has been completed in response to the elapse of the playback time of the video data since the start of the transmission of the distribution data. If it is determined that the transmission of the distribution data generated from the opening video has not been completed, the process of step S606 is executed and the control unit 101 continues to transmit the remaining distribution data. If it is determined that the transmission of the distribution data generated from the opening video has been completed, the process of step S610 is executed.

[0074] In step S610, the control unit 101 erases the display of the remaining time until the distribution data is completely transmitted from the display unit 106. The processing of this step corresponds to, for example, the processing of step S409 in FIG. 4.

[0075] In step S611, the control unit 101 generates distribution data from the video data generated by the imaging unit 102 and the audio data generated by the microphone 107, and transmits it to the distribution server 300 through the communication unit 111. The processing of this step corresponds to, for example, the processing of step S410 in FIG. 4.

[0076] In step S612, the control unit 101 determines whether to end the live distribution. For example, in the screen shown in FIG. 5(e), when the control unit 101 detects that the button 502 has been touched, it determines to end the live distribution. If it is determined not to end the live distribution, the processing of step S611 is repeatedly executed. If it is determined to end the live distribution, the processing of step S613 is executed. The processing of this step corresponds to, for example, the processing of step S411 in FIG. 4.

[0077] In step S613, the control unit 101 determines whether the ending distribution function is valid. For example, the control unit 101 determines whether the ending video item in FIG. 3(d) is ON or OFF for the user. If the ending video item is ON, the control unit 101 determines that the ending distribution function is valid. If the ending video item is OFF, the control unit 101 determines that the ending distribution function is invalid. If the ending distribution function is valid, the processing of step S614 is executed. If the ending distribution function is invalid, the processing of step S616 is executed.

[0078] In step S614, the control unit 101 generates distribution data from the video data determined as the ending video. The video data determined as the ending video is, for example, video data selected as the ending video by the user, in the same manner as the method for determining the opening video. The control unit 101 generates distribution data from the video data by performing encoding based on the settings for live distribution. The processing of this step corresponds to, for example, the processing of step S412 in FIG. 4.

[0079] In step S615, the control unit 101 causes the communication unit 111 to transmit the distribution data generated in step S614 to the distribution server 300 by the communication unit 111. The processing of this step corresponds to, for example, the processing of step S413 in FIG. 4. Here, the control unit 101 causes the display unit 106 to display the remaining time until the transmission of the distribution data is completed on the display unit 106. Then, in response to the completion of the transmission of the distribution data, the control unit 101 erases the display of the remaining time until the transmission of the distribution data is completed and executes the processing of step S616. The processing of this step corresponds to, for example, the processing of step S413 in FIG. 4.

[0080] In step S616, the control unit 101 causes the communication unit 111 to transmit a request to end the live distribution to the distribution server 300. The processing of this step corresponds to, for example, the processing of step S414 in FIG. 4.

[0081] The operation of the digital camera 100 in the present embodiment has been described above.

[0082] In addition, when the control unit 101 can change the live distribution settings during live distribution, it may operate as follows. When the process of step S605 is executed, the control unit 101 changes the live distribution settings according to the video data of the opening video. Then, when the process of step S611 is executed, the control unit 101 changes the live distribution settings according to the video data generated by the imaging unit 102. As a result, the control unit 101 does not need to perform image processing on the video data according to the live distribution settings, so the processing load in the live distribution process can be reduced. The same applies when transmitting the video data of the ending video.

[0083] In addition, the control unit 101 may reproduce the audio data included in the video data of the opening video by the speaker 108 in parallel with the process of step S607. For example, as shown in FIGS. 7(a) and 7(b), the control unit 101 reproduces the audio of the opening video at a timing similar to the timing when the audio of the opening video viewed by the user as the viewer is reproduced. Thereby, even in a situation where the display unit 106 is not visible, the user can measure the timing at which the video data generated by the imaging unit 102 is distributed by the distribution server 300 from the audio reproduced by the speaker 108. The function of reproducing the audio data included in the video data of the opening video by the speaker 108 is enabled when the user turns on item 307 in FIG. 3(e). Further, the function of reproducing the audio data included in the video data of the opening video by the speaker 108 may be executed even when the function of displaying the remaining time until the transmission of the distribution data of the opening video is completed is OFF.

[0084] Incidentally, the control unit 101 may display an opening video on the display unit 106 in a wipe screen in parallel with the process of step S607. For example, as shown in FIGS. 8(a) and 8(b), the control unit 101 displays the opening video on the display unit 106 at a timing similar to the timing when the opening video to be viewed by the user as the viewer is displayed. Thereby, the user can measure the timing at which the video data generated by the imaging unit 102 is distributed by the distribution server 300 by looking at the display unit 106. Note that the function of reproducing the audio data included in the video data of the opening video by the speaker 108 is enabled when the user turns on item 308 in FIG. 3(e). Further, the function of displaying the opening video on the display unit 106 in a wipe screen may be executed even if the function of displaying the remaining time until the transmission of the distribution data of the opening video is completed is OFF. Further, the function of displaying the opening video on the display unit 106 in a wipe screen may be executed in parallel with the function of reproducing the audio data included in the video data of the opening video by the speaker 108.

[0085] Incidentally, although it has been assumed that the operations for the user to start and end the live distribution are performed by the operation unit 105 of the digital camera 100, the digital camera 100 may accept these operations by other methods. For example, when a remote control is connected by the communication unit 111, the digital camera 100 may determine that it has accepted an operation to start the live distribution or an operation to end the live distribution in response to receiving a signal transmitted from the remote control.

[0086] Note that the digital camera 100 was set to switch the opening video distribution function between on and off on the screen as shown in FIG. 3(d), but the opening distribution function may be switched between on and off by other methods. For example, the digital camera 100 may switch the opening distribution function between on and off by determining whether the video data of the opening video is stored in a predetermined folder. In this case, when the digital camera 100 determines that video data exists in the folder, it determines that video data as the video data of the opening video. Further, when the control unit 101 determines that the video data of the opening video exists, it operates in a mode where the opening distribution function is valid, and determines in step S604 of FIG. 6 that the opening distribution is valid. On the other hand, when the control unit 101 determines that the video data of the opening video does not exist, it operates in a mode where the opening distribution function is not valid, and determines in step S604 of FIG. 6 that the opening distribution is not valid. Note that the same applies to the ending distribution function. When storing the video data of the opening video and the ending video in the same folder, the digital camera 100 may determine whether the video data is the video data of the opening video, the ending video, or other videos by referring to the file name. For example, when the digital camera 100 determines that the file name has the character string "opening", it determines that the video data is the video data of the opening video. Also, for example, when the digital camera 100 determines that the file name has the character string "ending", it determines that the video data is the video data of the ending video. Note that when it is determined that neither character string exists, the digital camera 100 determines that neither the opening video nor the ending video exists.

[0087] [Other Embodiments] The present invention can also be realized by supplying a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and causing one or more processors in a computer of the system or apparatus to read and execute the program. It can also be realized by a circuit (for example, an ASIC) that implements one or more functions.

[0088] Note that the present invention is not limited to the above-described embodiments as they are, and at the implementation stage, the components can be modified and embodied without departing from the gist thereof. Also, various inventions can be formed by appropriately combining a plurality of components disclosed in the above-described embodiments. For example, some components may be deleted from all the components shown in the embodiments. Furthermore, components from different embodiments may be appropriately combined.

Claims

[

1. ] An imaging unit that generates first video data, a holding unit that holds second video data, In the first mode, when starting to transmit the first video data generated by the imaging unit to an external device, before transmitting the first video data, start transmitting the held second video data, In the second mode, a transmission unit that starts transmitting the first video data without transmitting the second video data when starting to transmit the first video data generated by the imaging unit to the external device A communication device characterized by comprising the above. [

2. ] In the first mode, the transmission unit starts transmitting the first video data generated by the imaging unit to the external device after the transmission of the held second video data to the external device is completed before transmitting the first video data generated by the imaging unit to the external device. The communication device according to claim 1, characterized in that [

3. ] In the first mode, when the transmission unit finishes transmitting the first video data generated by the imaging unit to the external device, in response to the completion of the transmission of the first video data to the external device, the third video data held by the holding unit is transmitted to the external device. The communication device according to claim 1 or 2, characterized in that [

4. ] Further comprising an operation unit that receives an operation related to the transmission of the first video data generated by the imaging unit, In the first mode, when the transmission unit receives, by the operation unit, an operation for transmitting the first video data generated by the imaging unit to the external device, the transmission unit starts transmitting the held second video data to the external device. The communication device according to any one of claims 1 to 3, characterized in that [

5. ] Further comprising a notification unit that notifies that the second video data being transmitted by the transmission unit is being transmitted. The communication device according to any one of claims 1 to 4, characterized in that [

6. ] While the transmission unit transmits the second video data, the notification unit reproduces the audio of the second video data from a speaker. The communication device according to claim 5, characterized in that [

7. ] While the transmitting means transmits the second video data, the notification means displays, on a display unit, the remaining time until completion of transmission of the second video data being transmitted by the transmitting means. The communication device according to claim 5 or 6, characterized in that.

8. While the transmitting means transmits the second video data, the notification means displays the second video data together with the video data generated by the imaging means on a display unit. The communication device according to any one of claims 5 to 7, characterized in that.

9. The transmitting means sequentially transmits the video data generated by the imaging means to the external device. The communication device according to any one of claims 1 to 8, characterized in that.

10. The transmitting means transmits, in a cloud service provided by the external device, video data that becomes content provided to a user. The communication device according to claim 1, characterized in that.

11. Further comprising generation means for generating third video data for transmission to the external device from the first video data or the second video data based on the settings of the content received from the external device, When the transmitting means transmits the first video data or the second video data, the transmitting means transmits the third video data generated from each video data by the generation means. The communication device according to claim 10, characterized in that.

12. Further comprising receiving means for receiving the settings of the content from the external device, The communication protocol used by the transmitting means is a communication protocol capable of communication with less delay than the communication protocol used by the receiving means. The communication device according to claim 10 or 11, characterized in that.

13. The cloud service is a live distribution service. The communication device according to any one of claims 10 to 12, characterized in that.

14. When the transmitting means transmits video data, the transmitting means also transmits audio data to the external device. The communication device according to any one of claims 1 to 13, characterized in that.

15. A control method for a communication device having imaging means for generating first video data and holding means for holding second video data, In a first mode, when starting to transmit the first moving image data generated by the imaging means to an external device, start transmitting the second moving image data held before transmitting the first moving image data. In a second mode, when starting to transmit the first moving image data generated by the imaging means to the external device, start a transmission step of transmitting the first moving image data without transmitting the second moving image data. A control method characterized by having the above.

16. A computer-readable program for causing a computer to function as each means of the communication device according to any one of claims 1 to 14.

Images