Imaging device and control device
The imaging and control devices synchronize timecodes across multiple cameras during live streaming by automatically setting a free run method, enhancing efficiency in live streaming systems.
Patent Information
- Application Number
- JP2024133984
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-09
- Publication Date
- 2026-02-24
AI Technical Summary
Existing live streaming systems require users to manually configure timecode settings for multiple cameras, which is time-consuming and inefficient.
An imaging device and a control device that communicate with each other to automatically set a free run method for timecode advancement, synchronizing timecodes across multiple cameras when live streaming begins.
Facilitates easy and timely synchronization of timecodes among multiple imaging devices, reducing the effort required for scene-cut editing in live streaming.
Smart Images

Figure 2026030864000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to an imaging device and a control device, and more particularly to control during live streaming of video. [Background technology]
[0002] With the development of infrastructure for streaming videos using social media as a platform, it has become easy for individuals to live stream videos. In live streaming, a device called a switcher is used to switch between multiple cameras (the camera that captures the video to be streamed) depending on the scene. Some smartphone applications that control live streaming on social media have switcher functionality, and using such applications, individuals can easily live stream using multiple cameras.
[0003] After live streaming, many streamers create archive videos of the same quality as the live stream and upload them separately to social media. Creating archive videos is easy when live streaming is performed using a single camera. However, when live streaming is performed using multiple cameras, each camera shoots video and saves it to its own recording media. This necessitates scene-cut editing, which involves cutting out (extracting) multiple scenes from multiple videos corresponding to the multiple cameras and splicing them together. If each camera records video using the same timecode (if the timecode is synchronized between multiple cameras (multiple videos)), it's easy to find the desired scene from multiple videos, making scene-cut editing more efficient.
[0004] There are two time code advancement methods: recording run and free run. Recording run is a method in which the time code advances only while video is being recorded, while free run is a method in which the time code advances regardless of whether video is being recorded or not. Free run must be used to match (synchronize) the time code between multiple cameras (multiple videos).
[0005] In conventional live streaming systems (live streaming systems), users have to individually configure the timecode settings for each camera (timecode-related settings, such as settings to synchronize timecodes between multiple cameras (multiple videos)), which is time-consuming.
[0006] Patent Document 1 discloses a technique for automatically setting free run when a user selects a mode for receiving a time code signal from an external device. [Prior art documents] [Patent documents]
[0007] [Patent Document 1] Patent Publication No. 2021-141532 Summary of the Invention [Problem to be solved by the invention]
[0008] However, while the technology disclosed in Patent Document 1 can reduce the effort required to set the time code for each camera, it still requires the user to set the time code for each camera individually, and therefore does not sufficiently reduce the effort required.
[0009] The present invention aims to provide a technology that allows easy setting changes to be made at suitable timing to synchronize time codes between multiple imaging devices used for live streaming of moving images. The purpose is to [Means for solving the problem]
[0010] The imaging device of the present invention is one of a plurality of imaging devices used for live streaming of video, and is characterized by having a communication means capable of communicating with an external device, and a control means that, when a notification of the start of live streaming is received by the communication means, sets a free run method for advancing the time code, in which the time code advances regardless of whether video recording is in progress or not, as a method for advancing the time code.
[0011] The control device of the present invention is a control device that can be connected to multiple imaging devices used for live streaming of video, and is characterized by having a communication means that can communicate with the multiple imaging devices, and a control means that, when starting live streaming, controls the communication means to send a free run setting instruction to at least one of the multiple imaging devices, which sets a free run as the method of advancing the time code regardless of whether video is being recorded or not, as the method of advancing the time code. [Effects of the Invention]
[0012] According to the present invention, settings can be easily changed at an appropriate timing to synchronize the time codes among a plurality of imaging devices used for live streaming of moving images. [Brief explanation of the drawings]
[0013] [Figure 1] FIG. 2 is a block diagram of a camera. [Figure 2] FIG. 1 is a block diagram of a smart device. [Figure 3] FIG. 1 is a schematic diagram of a live distribution system. [Figure 4] FIG. 10 is a schematic diagram of a time code setting screen. [Figure 5] FIG. 2 is a schematic diagram of a display screen of a smart device. [Figure 6] 10 is a flowchart of a process performed by a smart device. [Figure 7] 10 is a flowchart of a process performed by the camera. DETAILED DESCRIPTION OF THE INVENTION
[0014] First Embodiment A first embodiment of the present invention will be described below with reference to the drawings.
[0015] (Camera configuration) 1 is a block diagram showing an example of the configuration of a camera 100, which is an example of an imaging device according to the first embodiment. Note that the imaging device is not limited to the camera 100. For example, the imaging device may be an information processing device such as a smart device or a personal computer with a camera.
[0016] The control unit 101 controls each unit of the camera 100 in accordance with input signals and a program described below. Note that instead of the control unit 101 controlling the entire camera 100, the entire camera 100 may be controlled by having multiple pieces of hardware share the processing.
[0017] The imaging unit 102 converts the subject light focused by the lens included in the imaging unit 102 into an electrical signal, performs noise reduction processing, etc., and outputs image data, which is digital data. The captured image data is stored in a buffer memory, and then undergoes predetermined processing by the control unit 101 and is recorded on a recording medium 107. The imaging unit 102 is composed of, for example, an optical lens unit, an optical system that controls the aperture, zoom, focus, etc., and an imaging element that converts the light (image) introduced through the optical lens unit into an electrical video signal. As the imaging element, a CMOS (Complementary Metal Oxide Semiconductor), a CCD (Charge Coupled Device), etc. can be used. The captured image data is recorded on the recording medium 107 in accordance with, for example, the DCF (Design Rule for Camera File system) standard. It will be recorded.
[0018] The nonvolatile memory 103 is an electrically erasable and recordable nonvolatile memory, and stores programs executed by the control unit 101, which will be described later.
[0019] The work memory 104 is used as a buffer memory for temporarily storing image data captured by the image capturing unit 102, as an image display memory for the display unit 106, as a work area for the control unit 101, and the like.
[0020] The operation unit 105 is used to accept instructions for the camera 100 from the user. The operation unit 105 includes, for example, a power switch used by the user to turn the power of the camera 100 on / off, a release switch used to instruct shooting, and a playback button used to instruct playback of image data. The operation unit 105 also includes operating members such as a connection button used to start communication with an external device via the communication unit 108. The operation unit 105 also includes a touch panel formed on the display unit 106. The release switch includes switches SW1 and SW2. When the release switch is pressed halfway, switch SW1 turns ON. This allows instructions to perform shooting preparations such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and EF (pre-flash) processing to be accepted. When the release switch is pressed fully, switch SW2 turns ON. This allows instructions to perform shooting preparations such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and EF (pre-flash) processing to be accepted.
[0021] The display unit 106 displays live view images that show the subject in almost real time, captured (recorded) captured images, characters for interactive operation, etc. The camera 100 does not necessarily have to have a built-in display unit 106. The camera 100 can be connected to an internal or external display unit 106, and it is sufficient that the camera 100 has at least a display control function for controlling the display on the display unit 106.
[0022] Recording medium 107 can store image data output from imaging unit 102. Recording medium 107 may be detachable from camera 100, or may be built into camera 100. It is sufficient for camera 100 to have at least the function of accessing recording medium 107.
[0023] The communication unit 108 is an interface capable of communicating with external devices. For example, the communication unit 108 is configured with an antenna for wireless communication, and a modulation / demodulation circuit and a communication controller for processing wireless signals. The communication unit 108 realizes short-range wireless communication in accordance with the IEEE802.15 standard (so-called Bluetooth (registered trademark)) by outputting modulated wireless signals from the antenna and demodulating wireless signals received by the antenna. Note that the communication of the communication unit 108 is not limited to communication using Bluetooth (registered trademark) and may include, for example, infrared communication. Furthermore, the communication of the communication unit 108 is not limited to wireless communication. The communication of the communication unit 108 may include wired communication using, for example, a USB (Universal Serial Bus) cable or a BNC (Bayonet Neill-Concelman connector) cable for inputting and outputting a time code signal.
[0024] (Smart device configuration) 2 is a block diagram showing an example of the configuration of a smart device 200, which is an example of a control device according to the first embodiment. Note that the control device is not limited to the smart device 200 as long as it can be connected to the camera 100. For example, the control device may be an electronic device such as a digital camera, a portable media player, a mobile phone (including a smartphone), a tablet device, a wearable computer, or a personal computer.
[0025] The control unit 201 controls each unit of the smart device 200 in accordance with input signals and programs described below. Note that instead of the control unit 201 controlling the entire smart device 200, the entire smart device 200 may be controlled by multiple pieces of hardware sharing the processing.
[0026] The imaging unit 202 converts the subject light imaged by the lens included in the imaging unit 202 into an electrical signal, performs noise reduction processing, etc., and outputs the digital data as image data. The captured image data is stored in a buffer memory, then undergoes predetermined processing by the control unit 201, and is recorded on the recording medium 210.
[0027] The nonvolatile memory 203 is an electrically erasable and recordable nonvolatile memory, and stores an OS (operating system), which is basic software executed by the control unit 201, and various programs. A camera control application program for communicating with and controlling the camera 100 is also stored in the nonvolatile memory 203. Processing by the smart device 200 when communicating with or controlling the camera 100 is realized by loading the camera control application program. The camera control application has functions for using basic functions of the OS installed in the smart device 200 (e.g., wireless LAN functions, Bluetooth (registered trademark) functions, functions for calling other applications, etc.). Note that the OS of the smart device 200 may also have the functions in the first embodiment (e.g., camera control application functions).
[0028] The working memory 204 is used as a buffer memory for temporarily storing image data captured by the imaging unit 202, as an image display memory for the display unit 206, and as a working area for the control unit 201, etc.
[0029] The operation unit 205 is used to receive instructions from the user for the smart device 200. The operation unit 205 includes, for example, an operation member such as a power button that the user uses to instruct the smart device 200 to power on / off, and a touch panel formed on the display unit 206.
[0030] The display unit 206 displays images, characters for interactive operations, etc. Note that the smart device 200 does not necessarily have to have a built-in display unit 206. The smart device 200 can be connected to an internal or external display unit 206, and it is sufficient that the smart device 200 has at least a display control function for controlling the display of the display unit 206.
[0031] The recording medium 210 can store image data output from the imaging unit 202, image data received from the camera 100, etc. The recording medium 210 may be detachable from the smart device 200, or may be built into the smart device 200. The smart device 200 only needs to have at least a function to access the recording medium 210.
[0032] The communication unit 211 is an interface capable of communicating with external devices such as the camera 100. The communication unit 211 performs wireless LAN communication using, for example, PTP / IP (Picture Transfer Protocol over Internet Protocol). The communication unit 211 may be directly connected to the camera 100 or may be connected via an access point. Note that the communication of the communication unit 211 is not limited to this, and may include wireless communication using, for example, infrared rays or Wireless USB. Furthermore, the communication of the communication unit 211 is not limited to wireless communication, and may be performed using a USB cable, an HDMI (registered trademark) cable, an IEEE1394 cable, or the like. It may also be wired communication using a 94 cable or the like.
[0033] The public network communication unit 213 is an interface used for wireless communication (public wireless communication) via a wide area network (WAN) such as 4G or 5G. The smart device 200 can connect to other devices via the public network communication unit 213, enabling data communication with the other devices and phone calls with users of the other devices. The smart device 200 can also acquire location information of the smart device 200 by communicating with multiple base stations in the wide area network (WAN). The public network communication unit 213 is, for example, an antenna, and the control unit 201 can connect to the wide area network (WAN) via the antenna. During phone calls, the control unit 201 acquires audio signals via a microphone 214 and outputs audio signals via a speaker 215. Note that the communication method of the public network communication unit 213 is not limited to 4G or 5G, and may be, for example, WiMAX, ADSL, or FTTH. The communication unit 211 and the public network communication unit 213 do not necessarily need to be configured as independent hardware; for example, a single antenna may serve as both the communication unit 211 and the public network communication unit 213.
[0034] (Live streaming system configuration) Fig. 3 is a schematic diagram showing an example of the configuration of a live streaming system according to the first embodiment. The live streaming system in Fig. 3 is a system for live streaming of videos, and includes a smart device 200, cameras 100A, 100B, and 100C, and a distribution server 304. The smart device 200 selects and processes videos input from cameras 100A, 100B, and 100C via a network, and outputs the videos to the distribution server 304. The number of cameras may be more or less than three.
[0035] Cameras 100A, 100B, and 100C are cameras 100, and are connected to smart device 200 via network router 301. Network router 301 serves as a Wi-Fi access point and establishes a LAN. Cameras 100A, 100B, and 100C and smart device 200 serve as Wi-Fi clients and connect to the LAN established by network router 301. Note that the connection between cameras 100A, 100B, and 100C and smart device 200 is not limited to Wi-Fi connection, and may be a wired connection such as Ethernet.
[0036] The smart device 200 transmits video to the distribution server 304 via Wi-Fi communication 302 and public wireless communication 303. The smart device 200 receives video data and audio data from the cameras 100A, 100B, and 100C. The smart device 200 then selects and processes the received data and transmits it to the distribution server 304. By transmitting the video data and audio data from the cameras 100A, 100B, and 100C to the distribution server 304 in this manner, multi-angle video distribution can be achieved.
[0037] The cameras 100A, 100B, and 100C acquire setting information related to live streaming, such as streaming image quality, from the smart device 200 via Wi-Fi communication 302, and set the output image quality of the video (the image quality of the video to be output to the smart device 200). Furthermore, the cameras 100A, 100B, and 100C start recording the video onto the recording medium 107 in response to a notification from the smart device 200 that live streaming has started.
[0038] Furthermore, the camera 100A and the camera 100B can receive a time code signal from the time code generator 305 through communication 306. The smart device 200 can also receive a time code signal from the time code generator 305 through communication 306. The communication 306 for transmitting and receiving the time code signal may be wireless communication using Bluetooth (registered trademark) or wired communication using a BNC cable or the like. The communication 306 is performed between the time code generator 305 and the network router 301. The time code signal may be transmitted and received via the communication 306 and the Wi-Fi communication 302.
[0039] (Timecode synchronization) Timecode is time information that is automatically recorded with video. Timecode is recorded in units of hours, minutes, seconds, and frames, and is primarily used when editing recorded video. When creating archive videos with the same quality as the live stream, if the timecode is synchronized between the multiple videos recorded by the multiple cameras used for live streaming, the time required for scene editing can be significantly reduced.
[0040] Professional video cameras used in video production can input an external time code signal to synchronize with other devices on a frame-by-frame basis.
[0041] FIG. 4A is a schematic diagram showing an example of a time code setting screen of a camera 100 (for example, cameras 100A and 100B) that can input a time code signal.
[0042] The start time setting 401 is a setting item for setting the initial value of the time code when starting to record the time code, and options include Preset and Regen. If Preset is selected, an arbitrary value is used as the initial value of the time code. If Regen is selected, the last time code recorded on the recording medium 107 is read and the initial value of the time code is determined to follow that. Regen is often selected together with the recording run setting, which will be described later. Note that if "Yes" (setting to input a time code signal, setting to synchronize with a time code signal) is selected in the time code signal input setting 404, the time code included in the time code signal is used regardless of the setting state of the start time setting 401.
[0043] The time code advancement method setting 402 is a setting item for setting the time code advancement method, and options include recording run and free run. If recording run is selected, the time code advances only while video is being recorded. If free run is selected, the time code advances constantly, regardless of whether video is being recorded or not. In order to synchronize time codes between multiple cameras 100 (multiple videos), it is necessary to use an objective time code that advances regardless of whether video is being recorded or not, and free run must be selected.
[0044] The drop frame setting 403 is a setting item for setting whether or not a drop frame is required, and options include "Yes" to use a drop frame and "No" to not use a drop frame. The drop frame is a function that skips the advancement of the time code according to a predetermined rule, so that the time code matches the time of the camera 100's (its own) internal clock (camera time). If "No" is selected, the time difference between the time code and camera time is not adjusted (non-drop frame). Note that if "Yes" is selected in the time code signal input setting 404, the drop frame setting information included in the time code signal is used regardless of the setting status of the drop frame setting 403.
[0045] The time code signal input setting 404 is a setting item for setting whether or not to input a time code signal. The time code signal input setting 404 includes options "Yes" for inputting a time code signal (synchronizing with a time code signal) and "No" for not inputting a time code signal (not synchronizing with a time code signal). When inputting a time code signal (synchronizing with a time code signal), free run must be selected in the stepping method setting 402. Therefore, if free run is not selected in the stepping method setting 402, the time code setting screen may be displayed so that "Yes" in the time code signal input setting 404 cannot be selected. When "Yes" in the time code signal input setting 404 is selected, In this case, free run may be automatically selected in the stepping method setting 402. When free run is selected in the stepping method setting 402, "Yes" may be automatically selected in the time code signal input setting 404.
[0046] By selecting "Free Run" in the stepping method setting 402 and "Yes" in the time code signal input setting 404, the time code can be synchronized with the time code signal. By synchronizing the time codes of multiple cameras 100 (multiple videos) with the time code signal output from the same time code generator 305, the time codes of the multiple videos will be approximately the same. As a result, the time required for scene cut editing can be significantly reduced.
[0047] In order to roughly align the time codes of multiple cameras 100 (multiple videos), it is necessary to input a time code signal from the same time code generator, but many non-professional general-purpose video cameras do not have the function to input a time code signal.
[0048] FIG. 4B is a schematic diagram showing an example of a time code setting screen of a camera 100 (for example, camera 100C) that is not capable of inputting a time code signal but is capable of setting the time code (settings related to the time code).
[0049] Like the start time setting 401, the start time setting 411 is a setting item for setting the initial value of the time code when starting to record the time code. The start time setting 411 includes options for manual input setting, reset, and set to camera time. If the manual input setting is selected, the time code specified by the user is used as the initial value. If reset is selected, 0:00:00 is used as the initial value of the time code. If set to camera time is selected, the time (camera time) of the internal clock of the camera 100 (itself) is used as the initial value of the time code.
[0050] The stepping method setting 412 is a setting item for setting the stepping method of the time code, similar to the stepping method setting 402, and includes options of REC RUN and FREE RUN. The drop frame setting 413 is a setting item for setting whether or not a drop frame is required, similar to the drop frame setting 403, and includes options of "YES" and "NO".
[0051] By adjusting the camera time to the time on the smart device's internal clock and using the camera time as the initial value for the time code, it is possible to roughly match the time codes of multiple videos corresponding to multiple cameras. In other words, it is possible to synchronize the time codes between multiple cameras 100 (multiple videos). As a result, the time required for scene / cut editing can be significantly reduced. Note that even if a camera is capable of inputting a time code signal, if it is unable to receive the time code signal, it can synchronize the time code with other cameras using a similar method.
[0052] (Smart device screen) 5(A) is a schematic diagram showing an example of a main screen of a live streaming control application, which is an example of a camera control application that operates on the smart device 200. The live streaming control application is an application that controls live streaming of video.
[0053] When the smart device 200 (control unit 201) receives video (video data and audio data) from the connected cameras 100A, 100B, and 100C, it displays the received video in the input video display areas 504, 505, and 506. For example, the video received from the camera 100A is displayed in the input video display area 504, the video received from the camera 100B is displayed in the input video display area 505, and the video received from the camera 100C is displayed in the input video display area 506. Then, the smart device 200 (control unit 201) displays the video received from the three input video display areas 504, 505, and 506. One of the three videos displayed in input video display areas 504, 505, and 506 is determined as the video to be distributed (video to be distributed) and displayed in distribution video display area 501. For example, the video is displayed without audio (muted) in input video display areas 504, 505, and 506, and the video is displayed with audio in distribution video display area 501.
[0054] When the user selects one of input video display areas 504, 505, and 506, smart device 200 (control unit 201) determines the video displayed in selected input video display area 504 as the video to be distributed, and displays it in distribution video display area 501. This realizes a switcher function that switches the video to be distributed (video to be displayed in distribution video display area 501) in response to a user operation.
[0055] Icon 502 indicates that the system is in a standby state before live distribution begins. When live distribution begins, the icon indicating the current state is switched from icon 502 to icon 508 shown in Fig. 5(B). Icon 508 indicates that distribution is currently underway.
[0056] The settings icon 503 in FIG. 5(A) is a button for starting settings related to live streaming. When the user selects the settings icon 503, the smart device 200 (control unit 201) switches the display screen from the main screen of FIG. 5(A) to the streaming settings screen of FIG. 5(C). The user can select the streaming image quality (the image quality of the video to be live streamed) from a streaming image quality list 511 on the streaming settings screen. In FIG. 5(C), a combination of resolution and frame rate is selected as the streaming image quality. The user can also select whether to perform time code synchronization processing when the cameras 100A, 100B, and 100C record videos during live streaming by operating a time code synchronization setting switch 512 on the streaming settings screen. When the user selects the OK button 513, the smart device 200 (control unit 201) returns the display screen from the streaming settings screen of FIG. 5(C) to the main screen of FIG. 5(A). The time code synchronization processing is processing for synchronizing time codes among multiple cameras 100 (multiple videos), and details of this processing will be described later.
[0057] 5A is a button for starting live streaming. When the user selects the start streaming button 507, the smart device 200 (control unit 201) notifies the cameras 100A, 100B, and 100C of the start of live streaming. After preparations for live streaming are complete, the smart device 200 (control unit 201) transmits the video to be distributed (video data and audio data) to the distribution server 304. The video to be distributed is distributed via the distribution server 304. Note that all three videos displayed in the three input video display areas 504, 505, and 506 may be distributed.
[0058] (Smart device processing flow) Fig. 6(A) is a flowchart showing live streaming start processing (processing to start live streaming of video) performed by the smart device 200. The live streaming start processing of Fig. 6(A) is realized by the control unit 201 expanding a program (e.g., a live streaming control application program) recorded in the non-volatile memory 203 into the working memory 204 and executing it. For example, when a user issues an instruction to start the live streaming control application, the control unit 201 starts the live streaming start processing of Fig. 6(A).
[0059] In S601, in response to a user operation to connect the camera 100 to the smart device 200, the control unit 201 connects to the camera 100 via the communication unit 211 (establishes a connection with the camera 100).
[0060] In S602, the control unit 201 receives the configurable parameters of the camera 100 from the camera 100 connected in S601. These are parameters that can be set (the settings can be changed) on the camera 100. For example, configurable parameters are menu items related to live streaming, and from the configurable parameters it is possible to determine whether or not a time code setting function or a time code signal input function is available. The time code setting function is a function for setting the time code, and the time code signal input function is a function for inputting a time code signal.
[0061] In S603, the control unit 201 notifies the delivery image quality to the camera 100 connected in S601. As described above, the delivery image quality is selected from the delivery image quality list 511 in Fig. 5(C).
[0062] In S604, the control unit 201 notifies the camera 100 connected in S601 whether or not to perform time code synchronization processing. As described above, whether or not to perform time code synchronization processing is selected using the time code synchronization setting switch 512 in FIG. 5C. The initial state of the time code synchronization setting switch 512 is a state in which time code synchronization processing is disabled (not executed). In response to a user operation on the time code synchronization setting switch 512, the control unit 201 sets the time code synchronization processing to enabled (executed) or disabled (not executed) (setting change). Then, in response to this setting change, the control unit 201 switches the state of the time code synchronization setting switch 512 between a state in which time code synchronization processing is enabled and a state in which time code synchronization processing is disabled.
[0063] In S605, the control unit 201 starts receiving video of the distribution quality from the camera 100 connected in S601.
[0064] In S606, the control unit 201 determines whether or not a user operation (connection operation) has been performed to connect a new camera 100 to the smart device 200. If the control unit 201 determines that a connection operation has been performed, the process proceeds to S601, and the control unit 201 performs the processes of S601 to S605 for the new camera 100; otherwise, the process proceeds to S607.
[0065] Before live streaming, the user can change the streaming image quality, enable / disable time code synchronization processing, etc. at any time. Each time the streaming image quality, enable / disable time code synchronization processing, etc. is changed, the control unit 201 notifies the camera 100 of the change.
[0066] In S607, the control unit 201 determines whether a user operation (distribution start operation) of selecting the distribution start button 507 in Fig. 5(A) has been performed. The control unit 201 waits for the distribution start operation to be performed, and if it determines that the distribution start operation has been performed, the control unit 201 proceeds to S608. When proceeding to S608, the control unit 201 selects one camera 100 connected to the smart device 200 as a processing target.
[0067] In S608, the control unit 201 notifies the camera 100 to be processed of the start of live distribution.
[0068] In S609, the control unit 201 determines whether or not a time adjustment request has been received from the processing target camera 100. If the control unit 201 determines that a time adjustment request has been received, the process proceeds to S610; otherwise, the process proceeds to S611.
[0069] In S610, the control unit 201 performs control to synchronize the time of the internal clock of the camera 100 to be processed with the time of the internal clock of the smart device 200. The smart device 200 uses the time code signal received from the time code generator 305 to keep the time of its own internal clock accurate.
[0070] In S611, the control unit 201 receives a notification from the camera 100 to be processed that distribution preparation is complete.
[0071] In S612, the control unit 201 determines whether or not the processes of S608 to S611 have been performed for all cameras 100 connected to the smart device 200. If the control unit 201 determines that the processes of S608 to S611 have been performed for all cameras 100, the process proceeds to S613; otherwise, the control unit 201 switches the processing target to a camera 100 for which the processes of S608 to S611 have not been performed, and proceeds to S608. Note that when multiple cameras 100 are connected to the smart device 200, the processes of S608 to S611 may be performed in parallel for the multiple cameras 100.
[0072] In S613, the control unit 201 transmits the moving image (video data and audio data) to be distributed to the distribution server 304.
[0073] Once live streaming has started, it becomes impossible to change the streaming image quality, enable / disable time code synchronization, etc. By performing operations such as tapping on the input video display areas 504, 505, and 506 in Figure 3(A), the user can switch the video to be streamed while live streaming.
[0074] Fig. 6(B) is a flowchart showing a live streaming end process (a process for ending live streaming of a video) performed by the smart device 200. The live streaming end process of Fig. 6(B) is realized by the control unit 201 expanding a program (e.g., a live streaming control application program) recorded in the non-volatile memory 203 into the working memory 204 and executing it. For example, when the live streaming start process of Fig. 6(A) ends, the control unit 201 starts the live streaming end process of Fig. 6(B).
[0075] In S621, the control unit 201 determines whether a user operation to end live streaming (a streaming end operation) has been performed. The control unit 201 waits for the streaming end operation to be performed, and if it determines that the streaming end operation has been performed, the control unit 201 proceeds to S622.
[0076] In S622, the control unit 201 stops transmitting the video to the distribution server 304.
[0077] In S623, the control unit 201 notifies all cameras 100 connected to the smart device 200 that the live distribution has ended.
[0078] In S624, the control unit 201 receives notifications of the completion of the termination process from all cameras 100 connected to the smart device 200.
[0079] (Camera processing flow) Fig. 7(A) is a flowchart showing the live streaming preparation process (processing for preparing for live streaming) performed by the camera 100. The live streaming preparation process of Fig. 7(A) is realized by the control unit 101 expanding a program recorded in the non-volatile memory 103 into the work memory 104 and executing the program. For example, when the camera 100 is started up, the control unit 101 starts the live streaming preparation process of Fig. 7(A).
[0080] In S701, in response to a user operation to connect the camera 100 to the smart device 200, the control unit 101 connects to the smart device 200 via the communication unit 108 (establishes a connection with the smart device 200).
[0081] In S702, the control unit 101 notifies the smart device 200 of the configurable parameters of the control unit 101 itself (the camera 100).
[0082] In S703, the control unit 101 receives a notification of the distribution image quality from the smart device 200.
[0083] In S704, the control unit 101 starts transmitting to the smart device 200 the video of the distribution quality notified in S703.
[0084] In S705, the control unit 101 receives a notification from the smart device 200 as to whether or not to perform time code synchronization processing.
[0085] As described above, before live streaming, notifications of streaming image quality and notifications of whether to perform time code synchronization processing may be sent multiple times at any timing. Each time the control unit 101 receives a notification of streaming image quality, it changes the image quality of the video to be sent to the smart device 200. When the control unit 101 receives multiple notifications of whether to perform time code synchronization processing, it uses the last notification of the multiple notifications.
[0086] In S706, the control unit 101 determines whether or not a notification of the start of live streaming has been received from the smart device 200. The control unit 101 waits for reception of the notification of the start of live streaming, and if it determines that the notification of the start of live streaming has been received, the control unit 101 proceeds to S707.
[0087] In S707, the process branches depending on whether the camera 100 has a time code setting function. If the camera 100 has the time code setting function, the process proceeds to S708; if not, the process proceeds to S712. The process of S707 is not performed by the camera 100, but is shown here for ease of understanding.
[0088] In S708, the control unit 101 saves the current setting information of the time code setting in the working memory 104.
[0089] In S709, the control unit 101 determines whether time code synchronization processing is enabled in accordance with the notification received in S705. This determination may be interpreted as determining whether a notification to perform time code synchronization processing has been received. If the control unit 101 determines that time code synchronization processing is enabled, the process proceeds to S710; otherwise, the process proceeds to S712.
[0090] In S710, the control unit 101 sets free run as the time code advancement method. Note that if the time code synchronization process is set to disabled, the process of S710 is skipped, and the current time code advancement method is maintained.
[0091] In S711, the control unit 101 performs time code synchronization processing. Details of the time code synchronization processing will be described later using Figures 7(B) and 7(C). Note that if the time code synchronization processing is set to disabled, the processing of S711 is skipped, and therefore the time code synchronization processing is not performed.
[0092] In S712, the control unit 101 starts recording the moving image to the recording medium 107. As a result, the transmission of the moving image to the smart device 200 and the recording of the moving image to the recording medium 107 are performed in parallel.
[0093] In S713, the control unit 101 notifies the smart device 200 that the distribution preparation is complete.
[0094] The time code synchronization process performed in step S711 will now be described. The time code synchronization process differs depending on whether the camera 100 has a time code signal input function or not.
[0095] FIG. 7B is a flowchart showing the time code synchronization process performed by a camera 100 that does not have a time code signal input function (for example, camera 100C).
[0096] In S721, the control unit 101 sets the drop frame. Since the camera 100 does not have a time code signal input function and is therefore unable to set the drop frame using the time code signal, the control unit 101 sets the drop frame according to the distribution image quality notified by the smart device 200.
[0097] In S722, the control unit 101 selects the camera time as the setting for the initial value of the time code when starting recording of the time code.
[0098] In S723, the control unit 101 transmits a time adjustment request to the smart device 200.
[0099] In S724, the control unit 101 performs control to synchronize the time of its own (camera 100) internal clock with the time of the internal clock of the smart device 200. For example, the control unit 101 acquires time information from the smart device 200 and adjusts its own time. Because "Set to camera time" was selected in S722, the control unit 101 adopts a time code corresponding to the time of its own (camera 100) internal clock as the time code to be recorded on the recording medium 107 together with the video.
[0100] In the first embodiment, cameras 100A and 100B, which have a time code signal input function, and the smart device 200 receive a time code signal from the same time code generator 305. By making the time of the internal clock of camera 100C, which does not have a time code signal input function, as close as possible to the time of the internal clock of smart device 200, the time code of camera 100C can be made to approximately match the time codes of cameras 100A and 100B. Note that the method of time synchronization is not particularly limited; for example, camera 100C may communicate with camera 100A or camera 100B to synchronize the time of camera 100C to the time of camera 100A or camera 100B.
[0101] Camera 100C, which does not have a time code signal input function, advances its time code in accordance with the advancement of its own internal clock. The time on camera 100C gradually deviates from the time on smart device 200 (and cameras 100A and 100B) depending on the accuracy of the camera 100C's internal clock. However, by adjusting the time just before the start of live streaming (video recording), the difference between the time on camera 100C and the time on smart device 200 (and cameras 100A and 100B) during video recording can be reduced. As a result, the time code on camera 100C can be made to approximately match the time codes on cameras 100A and 100B.
[0102] The time may be adjusted repeatedly during live streaming (video recording). However, if the time on camera 100C advances faster than the time on smart device 200 (and cameras 100A and 100B), a mechanism is required to prevent the time code on camera 100C from reversing.
[0103] FIG. 7C is a flowchart showing the time code synchronization process performed by a camera 100 (for example, cameras 100A and 100B) that has a time code signal input function.
[0104] In S731, the control unit 101 determines whether or not a setting for inputting a time code signal (a setting for adopting a time code corresponding to a time code signal) has been selected. If the control unit 101 determines that a setting for inputting a time code signal has been selected, the process proceeds to S733; otherwise, the process proceeds to S732.
[0105] In S732, the control unit 101 changes the setting from not inputting a time code signal to inputting a time code signal.
[0106] In S733, the control unit 101 determines whether or not a time code signal has been received. If the control unit 101 determines that a time code signal has been received, it ends the time code synchronization process of FIG. 7C. Because the time code signal is set to be input, the control unit 101 adopts the time code corresponding to the time code signal as the time code to be recorded together with the video on the recording medium 107. If the control unit 101 determines that a time code signal has not been received, it proceeds to S734. There are cases where the time code signal is not received, such as when the camera 100 is not connected to a time code generator.
[0107] In S734, the control unit 101 determines whether the initial value of the time code when recording of the time code is started is Preset. If the control unit 101 determines that the initial value is Preset, the process proceeds to S736; otherwise, the process proceeds to S735.
[0108] In S735, the control unit 101 changes the setting of the initial value of the time code when starting recording of the time code to Preset.
[0109] In S736, the control unit 101 performs the time code synchronization process shown in FIG. 7B (time code synchronization process performed by the camera 100 that does not have a time code signal input function).
[0110] Fig. 7(D) is a flowchart showing the live streaming end process performed by the camera 100. The live streaming end process of Fig. 7(D) is realized by the control unit 101 expanding a program recorded in the non-volatile memory 103 into the work memory 104 and executing the program. For example, when the live streaming preparation process of Fig. 7(A) is completed, the control unit 101 starts the live streaming end process of Fig. 7(D).
[0111] In S741, the control unit 101 determines whether or not a notification of the end of live streaming has been received from the smart device 200. The control unit 101 waits for reception of the notification of the end of live streaming, and if it determines that the notification of the end of live streaming has been received, the control unit 101 proceeds to S742.
[0112] In S742, the control unit 101 ends recording of the moving image onto the recording medium 107.
[0113] In S743, the control unit 101 returns the time code setting to the time code setting saved in S708 (the state before live distribution).
[0114] In S744, the control unit 101 notifies the smart device 200 of the completion of the termination process.
[0115] As described above, according to the first embodiment, when the camera 100 receives notification of the start of live streaming, it automatically changes the settings for time code synchronization, such as setting free run as the time code advancement method. This allows the settings for time code synchronization to be easily changed at an appropriate timing. For example, since the user does not need to change the settings of each camera 100 individually, the user's effort can be significantly reduced.
[0116] Second Embodiment A second embodiment of the present invention will be described below with reference to the drawings. In the first embodiment, when the camera 100 receives a notification that live streaming has started, it automatically changes settings for time code synchronization, such as setting free run as the time code advance method. In the second embodiment, when the smart device 200 starts live streaming, it automatically instructs the camera 100 to change settings for time code synchronization. Note that, below, descriptions of configurations and processes similar to those in the first embodiment will be omitted, and only configurations and processes different from those in the first embodiment will be described.
[0117] (Smart device processing flow) Fig. 6(C) is a flowchart showing a live streaming start process performed by the smart device 200 according to the second embodiment. The live streaming start process in Fig. 6(C) is realized by the control unit 201 expanding a program (e.g., a live streaming control application program) recorded in the non-volatile memory 203 into the working memory 204 and executing the program. For example, when a user issues an instruction to start the live streaming control application, the control unit 201 starts the live streaming start process in Fig. 6(C).
[0118] In S631, in response to a user operation to connect the camera 100 to the smart device 200, the control unit 201 connects to the camera 100 via the communication unit 211 (establishes a connection with the camera 100).
[0119] In S632, the control unit 201 receives, from the camera 100 connected in S631, the configurable parameters of the camera 100. As described in the first embodiment, the configurable parameters of the camera 100 are parameters that can be set (settings can be changed) on the camera 100. For example, the configurable parameters are menu items related to live streaming, and it is possible to know from the configurable parameters whether a time code setting function is available, whether a time code signal input function is available, the current setting status of the time code setting, and the like.
[0120] In S633, the control unit 201 notifies the camera 100 connected in S631 of the distribution image quality. As described in the first embodiment, the distribution image quality is selected from the distribution image quality list 511 in Fig. 5(C).
[0121] In S634, the control unit 201 starts receiving video of the distribution quality from the camera 100 connected in S631.
[0122] In S635, the control unit 201 determines whether or not a user operation (connection operation) has been performed to connect a new camera 100 to the smart device 200. If the control unit 201 determines that a connection operation has been performed, the process proceeds to S631, and the control unit 201 performs the processes of S631 to S634 for the new camera 100; otherwise, the process proceeds to S636.
[0123] In the second embodiment, the initial state of the time code synchronization setting switch 512 in Fig. 5(C) is assumed to be an inoperable state (a state in which time code synchronization processing cannot be enabled) as shown in Fig. 5(D). The control unit 201 displays the time code synchronization setting switch 512 in an operable state (a state in which time code synchronization processing can be enabled) only if all of the multiple connected cameras 100 have the time code setting function. By doing so, if a camera 100 without the time code setting function (a camera 100 whose time code cannot be synchronized with that of other cameras 100) is connected, the user can be notified that time code synchronization cannot be achieved.
[0124] The time code synchronization setting switch 512 may be initially set to an operable state. When a camera 100 without a time code setting function is connected and the user operates the time code synchronization setting switch 512 to enable time code synchronization processing, the control unit 201 may issue a predetermined notification to the user. This also notifies the user that time code synchronization cannot be achieved. At this time, the control unit 201 may or may not enable time code synchronization processing.
[0125] Even if a camera 100 without a time code setting function is connected while time code synchronization processing is enabled, the control unit 201 may issue a predetermined notification to the user. In this case, the control unit 201 may change the setting of time code synchronization processing from enabled to disabled, or may maintain the setting of time code synchronization processing enabled.
[0126] The predetermined notification described above is, for example, the display of the warning screen of Fig. 5(E). The warning screen of Fig. 5(E) indicates that the camera 100 cannot synchronize the time code with other cameras 100. By using the warning screen of Fig. 5(E), the user can be informed of the reason why the time codes cannot be synchronized.
[0127] As in the first embodiment, the user can change the streaming image quality, enable / disable time code synchronization processing, etc. at any time before live streaming. Each time the streaming image quality is changed, the control unit 201 notifies the camera 100 of the streaming image quality.
[0128] In S636, the control unit 201 determines whether a user operation (distribution start operation) of selecting the distribution start button 507 in Fig. 5(A) has been performed. The control unit 201 waits for the distribution start operation to be performed, and if it determines that the distribution start operation has been performed, the control unit 201 proceeds to S637. When proceeding to S637, the control unit 201 selects one camera 100 connected to the smart device 200 as the processing target.
[0129] In S637, the control unit 201 determines whether or not time code synchronization processing is enabled. If the control unit 201 determines that time code synchronization processing is enabled, the process proceeds to S641. If not, the control unit 201 proceeds to S638. When proceeding to S638 or S641, the control unit 201 selects one camera 100 connected to the smart device 200 as the processing target.
[0130] In S638, the control unit 201 notifies the camera 100 to be processed of the start of live distribution.
[0131] In S639, the control unit 201 receives a notification from the camera 100 to be processed that distribution preparation is complete.
[0132] In S640, the control unit 201 determines whether the processes of S638 and S639 have been performed for all cameras 100 connected to the smart device 200. If the control unit 201 determines that the processes of S638 and S639 have been performed for all cameras 100, the process proceeds to S647; otherwise, the control unit 201 switches the processing target to a camera 100 for which the processes of S638 and S639 have not been performed, and proceeds to S638. Note that when multiple cameras 100 are connected to the smart device 200, the processes of S638 and S639 may be performed in parallel for the multiple cameras 100.
[0133] In S641, the control unit 201 performs the following based on the configurable parameters received in S632: The control unit 201 determines whether the camera 100 to be processed has a time code setting function. If the control unit 201 determines that the camera 100 to be processed has a time code setting function, the process proceeds to S642; otherwise, the process proceeds to S644.
[0134] In S642, the control unit 201 transmits a free run setting instruction to the camera 100 to be processed, which sets free run as the method for advancing the time code.
[0135] In S643, the control unit 201 performs time code synchronization processing. Details of the time code synchronization processing will be described later with reference to Fig. 6(D). Note that if the time code synchronization processing is set to disabled, the processing of S642 and S643 is skipped, the free run setting instruction is not sent, and the time code synchronization processing is not performed.
[0136] In S644, the control unit 201 notifies the camera 100 to be processed of the start of live distribution.
[0137] In S645, the control unit 201 receives a notification from the camera 100 to be processed that distribution preparation is complete.
[0138] In S646, the control unit 201 determines whether or not the processes of S641 to S645 have been performed for all cameras 100 connected to the smart device 200. If the control unit 201 determines that the processes of S641 to S645 have been performed for all cameras 100, the process proceeds to S647; otherwise, the control unit 201 switches the processing target to a camera 100 for which the processes of S641 to S645 have not been performed, and proceeds to S641. Note that when multiple cameras 100 are connected to the smart device 200, the processes of S641 to S645 may be performed in parallel for the multiple cameras 100.
[0139] In S647, the control unit 201 transmits the moving image (video data and audio data) to be distributed to the distribution server 304.
[0140] FIG. 6D is a flowchart showing the time code synchronization process performed by the smart device 200.
[0141] In S651, the control unit 201 determines whether the camera 100 to be processed has a time code signal input function based on the configurable parameters received in S632. This determination may be interpreted as determining whether the camera 100 to be processed can or cannot adopt a time code corresponding to a time code signal. If the control unit 201 determines that the camera 100 to be processed has a time code signal input function, the control unit 201 proceeds to S652; otherwise, the control unit 201 proceeds to S656.
[0142] In S652, the control unit 201 determines, based on the configurable parameters received in S632, whether or not a setting for inputting a time code signal (a setting for adopting a time code corresponding to a time code signal) has been selected in the processing target camera 100. If the control unit 201 determines that a setting for inputting a time code signal has been selected, it ends the time code synchronization processing of Fig. 6(D) ; otherwise, it proceeds to S653.
[0143] In S653, the control unit 201 sends a time code signal input instruction (an instruction to adopt a time code corresponding to the time code signal) to the camera 100 to be processed, which changes the setting from one that does not input a time code signal to one that inputs a time code signal.
[0144] In step S654, the control unit 201 determines the initial value of the time code when recording of the time code is started. In step S654, the control unit 201 transmits a camera time selection instruction to the camera 100 to be processed, causing the camera 100 to select the camera time as the initial setting. In step S655, the control unit 201 transmits a time adjustment request to the camera 100 to be processed. The combined processing of steps S654 and S655 may be interpreted as processing for adjusting the time of the internal clock of the camera 100 to the time of the internal clock of the smart device 200, and transmitting an instruction to adopt a time code corresponding to that time.
[0145] In S656, the control unit 201 performs control to synchronize the time of the internal clock of the camera 100 to be processed with the time of the internal clock of the smart device 200.
[0146] (Camera processing flow) Fig. 7(E) is a flowchart showing the live streaming preparation process performed by the camera 100 according to the second embodiment. The live streaming preparation process in Fig. 7(E) is realized by the control unit 101 expanding a program recorded in the non-volatile memory 103 into the work memory 104 and executing the program. For example, when the camera 100 is started up, the control unit 101 starts the live streaming preparation process in Fig. 7(E).
[0147] In S751, the control unit 101 connects to the smart device 200 via the communication unit 108 in response to a user operation to connect the camera 100 to the smart device 200 (establishes a connection with the smart device 200).
[0148] In S752, the control unit 101 notifies the smart device 200 of the configurable parameters of the control unit 101 itself (the camera 100).
[0149] In S753, the control unit 101 receives a notification of the distribution image quality from the smart device 200.
[0150] In S754, the control unit 101 starts transmitting to the smart device 200 the video of the distribution quality notified in S753.
[0151] In S755, the control unit 101 determines whether or not a free run setting instruction has been received from the smart device 200. If the control unit 101 determines that a free run setting instruction has been received, the process proceeds to S756; otherwise, the process proceeds to S758.
[0152] In S756, the control unit 101 saves the current setting information of the time code setting in the work memory 104.
[0153] In S757, the control unit 101 sets free run as the method for advancing the time code.
[0154] In S758, the control unit 101 determines whether or not a time code signal input instruction has been received from the smart device 200. If the control unit 101 determines that a time code signal input instruction has been received, the process proceeds to S759; otherwise, the control unit 101 proceeds to S760.
[0155] In S759, the control unit 101 changes the setting from not inputting a time code signal to inputting a time code signal.
[0156] In S760, the control unit 101 determines whether or not a time adjustment request has been received from the smart device 200. If the control unit 101 determines that a time adjustment request has been received, the process proceeds to S761; otherwise, the process proceeds to S762.
[0157] In S761, the control unit 101 performs control to synchronize the time of its own (camera 100) internal clock with the time of the internal clock of the smart device 200. At this time, the control unit 101 also receives a camera time selection instruction from the smart device 200, and in response to the camera time selection instruction, selects the setting to camera time as the initial value setting of the time code when starting to record the time code.
[0158] In S762, the control unit 101 determines whether or not a notification of the start of live streaming has been received from the smart device 200. The control unit 101 waits for reception of the notification of the start of live streaming, and if it determines that the notification of the start of live streaming has been received, the control unit 101 proceeds to S763.
[0159] In S763, the control unit 101 starts recording the moving image to the recording medium 107. As a result, the transmission of the moving image to the smart device 200 and the recording of the moving image to the recording medium 107 are performed in parallel.
[0160] In S764, the control unit 101 notifies the smart device 200 that the distribution preparation is complete.
[0161] Although the camera 100 (control unit 101) saves the current setting information of the time code setting in S756, the smart device 200 (control unit 201) may hold the setting information of each camera 100 and notify each camera 100 of it when the live streaming ends. Then, each camera 100 (control unit 101) may reset the setting information notified from the smart device 200.
[0162] As described above, according to the second embodiment, when starting live streaming, the smart device 200 automatically instructs the camera 100 to change settings for time code synchronization, such as setting free run as the time code advancement method. This makes it possible to easily change settings for time code synchronization at an appropriate timing.
[0163] The various controls described above may or may not be performed by a single piece of hardware (e.g., a processor or circuit). The entire device may be controlled by multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) sharing the processing.
[0164] The above processor is a processor in the broad sense, and includes general-purpose processors and dedicated processors. General-purpose processors include, for example, CPUs (Central Processing Units), MPUs (Micro Processing Units), and DSPs (Digital Signal Processors). Dedicated processors include, for example, GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). Programmable logic devices include, for example, FPGAs (Field Programmable Gate Arrays) and CPLDs (Complex Programmable Logic Devices).
[0165] Although the embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-described embodiments merely represents one embodiment of the present invention, and each embodiment can be combined as appropriate.
[0166] <Other embodiments> The present invention provides a program that realizes one or more functions of the above-described embodiments, over a network or The program may be provided to a system or device via a storage medium, and may be read and executed by one or more processors in the computer of the system or device. It may also be implemented by a circuit that implements one or more functions.
[0167] The disclosure of this embodiment includes the following configuration, method, and program. (Configuration 1) Any one of a plurality of imaging devices used for live streaming of video, A communication means capable of communicating with an external device; a control means for setting a free run time code advance method in which the time code advances regardless of whether a moving image is being recorded or not when a notification of the start of live distribution is received by the communication means; An imaging device comprising: (Configuration 2) When the notification of the start of live distribution is received, the control means sets the free run and performs time code synchronization processing. 2. The imaging device according to claim 1, (Configuration 3) When the notification of the start of live distribution is received, the control means If a notification to perform time code synchronization processing is received by the communication means, the free run is set and the synchronization processing is performed; If the notification to perform the synchronization process is not received by the communication means, the current advancement method of the time code is maintained and the synchronization process is not performed. 3. The imaging device according to configuration 1 or 2. (Configuration 4) When the notification of the start of live distribution is received, the control means sets the free run, performs time code synchronization processing, and controls to start video recording. 4. The imaging device according to any one of configurations 1 to 3. (Configuration 5) The synchronization process is a process of adopting a time code corresponding to a time code signal received by the communication means. 5. The imaging device according to any one of configurations 2 to 4. (Configuration 6) The synchronization process is a process of synchronizing the time of the internal clock with that of a specific external device and adopting a time code corresponding to that time. 5. The imaging device according to any one of configurations 2 to 4. (Configuration 7) When the control means changes the setting related to the time code in response to receiving the notification of the start of the live distribution, the control means returns the setting related to the time code to the setting before the live distribution in response to receiving the notification of the end of the live distribution by the communication means. 7. The imaging device according to any one of configurations 1 to 6, wherein: (Configuration 8) A control device connectable to a plurality of imaging devices used for live streaming of video, a communication means capable of communicating with the plurality of imaging devices; a control means for controlling, when starting live streaming, to transmit, from the communication means to at least one of the plurality of imaging devices, a free run setting instruction for setting a free run in which the time code advances regardless of whether a moving image is being recorded or not, as a time code advance method; A control device comprising: (Configuration 9) A configuration method to enable or disable timecode synchronization. and When starting the live distribution, the control means If the synchronization process is enabled, control is performed to transmit the free run setting instruction, and the synchronization process is performed; If the synchronization process is set to be invalid, the free run setting instruction is not transmitted, and the synchronization process is not performed. 9. The control device according to configuration 8, (Configuration 10) The setting means can set the synchronization process to be valid only when the time code setting can be changed in all of the plurality of image capture devices. 10. The control device according to configuration 9, (Configuration 11) When the plurality of image capture devices includes an image capture device in which the setting related to the time code cannot be changed and a user operation to enable the synchronization process is performed, the control means performs control so as to give a predetermined notification to the user. 10. The control device according to configuration 9, (Configuration 12) The synchronization process includes control of transmitting, from the communication means, an instruction to adopt the time code corresponding to the time code signal to an imaging device that can adopt the time code corresponding to the time code signal, among the plurality of imaging devices. 12. The control device according to any one of configurations 9 to 11, (Configuration 13) The synchronization process includes control of transmitting, from the communication means, to an imaging device among the plurality of imaging devices that cannot adopt a time code corresponding to a time code signal, an instruction to synchronize the time of an internal clock with a predetermined external device and adopt a time code corresponding to the time. 13. The control device according to any one of configurations 9 to 12. (Method 1) A method for controlling any one of a plurality of imaging devices used for live streaming of video, comprising: a communication step of communicating with an external device; a control step of setting a free run time code advance method in which the time code advances regardless of whether a video is being recorded or not, when a notification of the start of live distribution is received in the communication step; A control method comprising: (Method 2) A control method for a control device connectable to a plurality of imaging devices used for live streaming of video, comprising: a communication step of communicating with the plurality of imaging devices; a control step of controlling, at the communication step, to transmit, to at least one of the plurality of image capture devices, a free run setting instruction for setting a free run in which the time code advances regardless of whether a moving image is being recorded, as a method for advancing the time code when starting live streaming; A control method comprising: (Program 1) A program for causing a computer to function as each means of the imaging device according to any one of the first to seventh aspects. (Program 2) A program for causing a computer to function as each means of the control device according to any one of configurations 8 to 13. [Explanation of symbols]
[0168] 100: Camera 101: Control unit 108: Communication unit 200: Smart device 201: Control unit 211: Communication unit
Claims
1. Any one of a plurality of imaging devices used for live streaming of video, A communication means capable of communicating with an external device; a control means for setting a free run time code advance method in which the time code advances regardless of whether a moving image is being recorded or not when a notification of the start of live distribution is received by the communication means; An imaging device comprising:
2. When the notification of the start of live distribution is received, the control means sets the free run and performs time code synchronization processing.
2. The imaging device according to claim 1.
3. When the notification of the start of live distribution is received, the control means If a notification to perform time code synchronization processing is received by the communication means, the free run is set and the synchronization processing is performed; If the notification to perform the synchronization process is not received by the communication means, the current advancement method of the time code is maintained and the synchronization process is not performed.
2. The imaging device according to claim 1.
4. When the notification of the start of live distribution is received, the control means sets the free run, performs time code synchronization processing, and controls to start video recording.
2. The imaging device according to claim 1.
5. The synchronization process is a process of adopting a time code corresponding to a time code signal received by the communication means.
3. The imaging device according to claim 2.
6. The synchronization process is a process of synchronizing the time of the internal clock with that of a specific external device and adopting a time code corresponding to that time.
3. The imaging device according to claim 2.
7. When the control means changes the setting related to the time code in response to receiving the notification of the start of the live distribution, the control means returns the setting related to the time code to the setting before the live distribution in response to receiving the notification of the end of the live distribution by the communication means.
2. The imaging device according to claim 1.
8. A control device connectable to a plurality of imaging devices used for live streaming of video, a communication means capable of communicating with the plurality of imaging devices; a control means for controlling, when starting live streaming, to transmit, from the communication means to at least one of the plurality of imaging devices, a free run setting instruction for setting a free run in which the time code advances regardless of whether a moving image is being recorded or not, as a time code advance method; A control device comprising:
9. A configuration method to enable or disable timecode synchronization. and When starting the live distribution, the control means If the synchronization process is enabled, control is performed to transmit the free run setting instruction, and the synchronization process is performed; If the synchronization process is disabled, the free run setting instruction is not sent. and the synchronization process is not performed.
9. The control device according to claim 8.
10. The setting means can set the synchronization process to be valid only when the time code setting can be changed in all of the plurality of image capture devices. The control device according to claim 9 .
11. When the plurality of image capturing devices includes an image capturing device in which the setting related to the time code cannot be changed and a user operation to enable the synchronization process is performed, the control means performs control so as to give a predetermined notification to the user. The control device according to claim 9 .
12. The synchronization process includes control of transmitting, from the communication means, an instruction to adopt the time code corresponding to the time code signal to an imaging device that can adopt the time code corresponding to the time code signal, among the plurality of imaging devices. The control device according to claim 9 .
13. The synchronization process includes control of transmitting, from the communication means, to an imaging device among the plurality of imaging devices that cannot adopt a time code corresponding to a time code signal, an instruction to synchronize the time of an internal clock with a predetermined external device and adopt a time code corresponding to the time. The control device according to claim 9 .
14. A method for controlling any one of a plurality of imaging devices used for live streaming of video, comprising: a communication step of communicating with an external device; a control step of setting a free run time code advance method in which the time code advances regardless of whether a video is being recorded or not when a notification of the start of live distribution is received in the communication step; A control method comprising:
15. A control method for a control device connectable to a plurality of imaging devices used for live streaming of video, comprising: a communication step of communicating with the plurality of imaging devices; a control step of controlling, at the communication step, to transmit, to at least one of the plurality of image capture devices, a free run setting instruction for setting a free run in which the time code advances regardless of whether a moving image is being recorded, as a time code advance method when starting live distribution; A control method comprising:
16. A program for causing a computer to function as each of the means of the imaging device according to any one of claims 1 to 7.
17. A program for causing a computer to function as each of the means of the control device according to any one of claims 8 to 13.
Citation Information
Patent Citations
Imaging device, control method thereof, and program
JP2021141532A