Wearable camera

By integrating a connection determining unit and image quality adjuster in wearable cameras, the issue of reduced frame rates due to poor connections is addressed, ensuring stable frame rates and improved viewer satisfaction.

JP2025062676APending Publication Date: 2025-04-15XACTI CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023171850
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-10-03
Publication Date
2025-04-15

AI Technical Summary

Technical Problem

Wearable cameras that transmit video data in real time may experience reduced frame rates due to poor connection quality, leading to unsatisfactory viewing experiences for live streaming.

Method used

Incorporating a connection determining unit and an image quality adjuster within the wearable camera to assess the connection status and adjust the image quality, prioritizing frame rate over other factors, thereby ensuring a stable frame rate even in poor connection conditions.

Benefits of technology

This solution maintains a stable frame rate, enhancing viewer satisfaction by minimizing the impact of connection quality on video streaming, and eliminates the need for additional processing by communication modules.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025062676000001_ABST
    Figure 2025062676000001_ABST
Patent Text Reader

Abstract

To suppress the decline in satisfaction caused by a frame rate.SOLUTION: The present invention relates to a camera device CA configured to transmit moving image data in real time to a wirelessly connected external system 4000. The camera device CA includes a connection determination unit 6a that determines whether the connection status with the external system 4000 is good or bad, and an image quality adjustment unit 6c that adjusts the image quality of the moving image data on the basis of the determination result by the connection determination unit 6a, and when the connection determination unit 6a determines that the connection status is poor, the image quality adjustment unit 6c reduces the image quality of the moving image data so as to ensure the frame rate of the moving image data.SELECTED DRAWING: Figure 6
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a wearable camera. [Background technology]

[0002] An example of a wearable camera is disclosed in Patent Document 1. Specifically, the camera device disclosed in Patent Document 1 has a magnet built into the camera body, and is configured to attach the camera body to the temples of glasses by utilizing the magnetic force. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-060139 A Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, moving image data captured by this type of wearable camera may be transmitted to an external device in real time (so-called live distribution). In this case, the moving image data is played back in real time at the transmission destination.

[0005] In this case, the wearer of the wearable camera may enter various places, such as buildings under construction, depending on the purpose of the use. However, depending on the place where the wearer enters, the connection with the outside world may not be good.

[0006] In this case, the frame rate may decrease, and the image may be reproduced as if it were a still image, which is inconvenient in terms of ensuring the satisfaction of the viewer.

[0007] The present disclosure has been made in consideration of such points, and its purpose is to suppress a decrease in satisfaction caused by frame rate in a wearable camera that transmits moving image data in real time to a wirelessly connected external system. [Means for solving the problem]

[0008] A first aspect of the present disclosure relates to a wearable camera configured to transmit video data in real time to a wirelessly connected external system. The wearable camera includes a connection determination unit that determines whether a connection state between the wearable camera and the external system is good or bad, and an image quality adjustment unit that adjusts image quality of the video data based on a result of the determination by the connection determination unit, and when the connection determination unit determines that the connection state is poor, the image quality adjustment unit reduces image quality of the video data so as to ensure a frame rate of the video data.

[0009] According to the first aspect, the image quality adjustment unit reduces the image quality with a priority on the frame rate depending on the connection status. This makes it possible to maintain the frame rate as much as possible, and ultimately improve the satisfaction of the viewer.

[0010] In addition, in the past, a configuration has been considered in which high-quality video data is generated in a camera device, and the video data is reduced in quality when it is transmitted from a communication module or a server connected to the camera device to an external system. However, such a configuration is inconvenient because it requires processing by a communication module or the like.

[0011] In contrast, the image quality adjustment unit according to the first aspect is merely one element of the wearable camera. In other words, the image quality adjustment unit adjusts the image quality by itself. Therefore, the first aspect is also useful in that it does not require processing by a communication module or the like.

[0012] In addition, according to a second aspect of the present disclosure, the wearable camera may have a lens for capturing the video data, and may include a camera body worn by a wearer of the wearable camera, and a motion detection unit for detecting movement of the camera body, and when movement of the camera body is detected by the motion detection unit, the image quality adjustment unit may reduce the image quality of the video data so as to ensure a frame rate of the video data, regardless of the determination result of the connection determination unit.

[0013] According to the second aspect, the image quality adjustment unit reduces the image quality with priority given to the frame rate depending on whether there is motion, which makes it possible to maintain the frame rate as much as possible, and ultimately improves the satisfaction of the viewer.

[0014] Also, similar to the first aspect, this is also useful in that processing by a communication module or the like is not required.

[0015] Furthermore, according to a third aspect of the present disclosure, the image quality adjustment unit may adjust the image quality of the video data by changing at least one of the image resolution, compression ratio, bit rate, and stream format of the video data.

[0016] The third aspect contributes to appropriate adjustment of the image quality of moving image data. Effect of the Invention

[0017] As described above, according to the present disclosure, it is possible to suppress a decrease in satisfaction level caused by the frame rate. [Brief description of the drawings]

[0018] [Figure 1] FIG. 1 is a schematic diagram of the overall configuration of a camera device according to an embodiment. [Diagram 2] FIG. 2 is a perspective view illustrating a state in which the camera body of the embodiment is attached to glasses. [Diagram 3]FIG. 3 is a perspective view illustrating a state in which the camera body of the embodiment is attached to glasses. [Figure 4] FIG. 4 is a schematic block diagram of the camera device according to the embodiment. [Diagram 5] FIG. 5 is a conceptual diagram illustrating a process related to a stream format in the embodiment. [Figure 6] FIG. 6 is a flowchart illustrating a process performed by the camera device according to the embodiment. [Figure 7] FIG. 7 is a view corresponding to FIG. 4, illustrating a camera device according to a first modified example. [Figure 8] FIG. 8 is a diagram corresponding to FIG. 6, illustrating a process according to the first modified example. [Figure 9] FIG. 9 is a diagram corresponding to FIG. 6, illustrating a process according to the second modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] Hereinafter, exemplary embodiments will be described in detail with reference to the drawings. In the following embodiments, a camera device according to the present disclosure will be described using an example in which the camera body is attached to glasses to function as a wearable camera. The glasses are an example of a head-worn device as a predetermined attachment target.

[0020] In this specification, the side of the camera body and mounting parts where the lens for shooting is directed (the front side in the shooting direction) is referred to as the "front," and the side opposite the side where the lens is directed is referred to as the "rear." In addition, the left side of the camera body and mounting parts in the left-right direction when facing forward in the posture when used as a wearable camera attached to glasses is referred to as the "left," and the right side is referred to as the "right," and in the same posture, the upper side in the up-down direction is referred to as the "upper," and the lower side is referred to as the "lower."

[0021] <<Embodiment>> The camera device CA of this embodiment is a device that can be used for remote presence of on-site work, such as construction work, facility construction, infrastructure maintenance work, etc., and factory inspections, etc. The use of the camera device CA of this example as a wearable camera is not limited to remote presence of on-site work, and it can be used for various purposes as long as it is used for photographing while wearing the glasses GL.

[0022] -Overall configuration of the camera device- 1 to 3, the camera device CA includes a camera body 1, a mount part 3, a control unit 5, and a first cable 7. In this embodiment, the camera body 1 is attached to a wearer via the mount part 3 and glasses GL, but the present disclosure is not limited to such "indirect attachment." The camera body 1 may be attached directly to the wearer without the mount part 3 and glasses GL.

[0023] Camera body 1 is a component that takes pictures. Camera body 1 has lens 11 for taking pictures on the front side. Lens 11 is an ultra-wide angle lens. An ultra-wide angle lens here has an angle of view of about 120° to 180°. The angle of view of lens 11 in this example is 180°. When such lens 11 is used, the shooting range is a solid angle of 2π steradians. When the shooting range of camera body 1 does not need to be a solid angle of 2π steradians, lens 11 may have an angle of view of less than 180°.

[0024] The camera body 1 has a first housing 10 that houses components such as an image sensor 12. A lens housing section 10a that opens to the outside is provided on the front part of the first housing 10. A lens holder (not shown) is housed in the opening of the lens housing section 10a. A lens 11 is held by the lens holder and positioned in the opening, and is provided so as to protrude from the opening to the outside of the first housing 10.

[0025] The camera body 1 can be attached to the temple TE of the glasses GL using the mount part 3 so that the lens 11 faces forward of a wearer (hereinafter also referred to as a user) DU of the glasses GL. The temple TE is an element that constitutes the side part of the glasses GL. Note that, although an example of a mode in which the camera body 1 is attached to the left temple TE of the glasses GL is shown in Figs. 2 and 3, it is also possible to attach the camera body 1 to the right temple TE of the glasses GL by changing the attachment direction of the mount part 3 or by replacing the mount part 3.

[0026] The control unit 5 is a component that controls the operation of the camera body 1. The control unit 5 has a second housing 50 that houses components such as a board including a control unit 60. A status lamp 51 that indicates the operating state of the camera device CA is provided on the front side of the second housing 50. The control unit 5 is connected to the camera body 1 by a wire. A first cable 7 is used to connect the control unit 5 and the camera body 1.

[0027] The control unit 5 supplies power to the camera body 1 via a first cable 7 and is communicatively connected thereto. The first cable 7 is connected to the lower part of the camera body 1 in a state in which the camera body 1 is attached to the glasses GL via the mount part 3. The first cable 7 is held by a cable holder 47 provided on the mount part 3 on the rear side of the camera body 1. The first cable 7 is a thin coaxial cable.

[0028] The information terminal 100 is further connected to the control unit 5 by wire. A second cable 8 is used to connect the control unit 5 and the information terminal 100. The second cable 8 is a USB (Universal Serial Bus) Type-C cable. A dedicated application (hereinafter referred to as a dedicated app) for controlling the operation of the camera device CA is installed in the information terminal 100.

[0029] Furthermore, the information terminal 100 has a wireless LAN function such as Wi-Fi (registered trademark) and a communication function based on a mobile communication standard such as LTE (registered trademark). By using this communication function, the information terminal 100 can access the Internet.

[0030] An example of the information terminal 100 is a multi-function mobile phone called a smartphone. The information terminal 100 may be another mobile device such as a tablet terminal, so long as it is portable. In addition, when the camera device CA is used on a table as described later, a notebook or desktop personal computer may be used as the information terminal 100.

[0031] The control unit 5 is further connected to a mobile battery 200 by a wire. A third cable 9 is used to connect the control unit 5 and the mobile battery 200. The third cable 9 is a USB Type-C cable. The mobile battery 200 is a power source for supplying power from the control unit 5 to the camera body 1. The mobile battery 200 can also be used as a power source for charging the built-in battery of the information terminal 100 via the control unit 5.

[0032] 4, the camera body 1 includes a first power supply circuit 13, an image sensor 12, a temperature sensor 14, an acceleration sensor 15, a gyro sensor 16, a microphone 18, and a first connector 19. These components are housed inside a first housing 10.

[0033] First power supply circuit 13 receives power supplied to camera body 1 via first cable 7, and converts the power into a voltage suitable for each component built into camera body 1 and supplies it to each component. Image sensor 12, temperature sensor 14, acceleration sensor 15, gyro sensor 16, and microphone 18 function by receiving power supplied from first power supply circuit 13.

[0034] The imaging element 12 is provided on the rear side of the lens 11. The imaging element 12 converts the light collected by the lens 11 into an electrical signal by photoelectric conversion, and generates an image signal. Examples of the imaging element 12 include a CMOS image sensor and a CCD image sensor. The image signal generated by the imaging element 12 is output to the first connector 19 and transmitted to the control unit 5 via the first cable 7.

[0035] The temperature sensor 14 is a sensor that detects the internal temperature of the camera body 1. Examples of the internal temperature of the camera body 1 include the temperature of the internal space of the first housing 10 and the temperature of the image sensor 12. The temperature sensor 14 is used to perform control to ensure the operation of the image sensor 12. A detection signal indicating the temperature detected by the temperature sensor 14 is output to the first connector 19.

[0036] The acceleration sensor 15 is a sensor that detects acceleration on three axes. The acceleration sensor 15 detects the direction of gravitational acceleration acting on the camera body 1. The gyro sensor 16 is a sensor that detects angular velocity on three axes. The gyro sensor 16 detects angular velocity when the orientation of the camera body 1 changes. A detection signal indicating the acceleration detected by the acceleration sensor 15 and a detection signal indicating the angular velocity detected by the gyro sensor 16 are output to a first connector 19.

[0037] The microphone 18 is a component that detects and collects sounds around the camera body 1. The microphone 18 converts sound vibrations into an electrical signal to generate a sound signal. A MEMS microphone or an electret condenser microphone (ECM) is used as the microphone 18. A sound signal indicating the sound detected by the microphone 18 is output to a first connector 19.

[0038] The first connector 19 is a component to which the first cable 7 is connected. A coaxial thin-wire connector is used for the first connector 19. The first connector 19 transmits the image signal output from the imaging element 12, the detection signals output from the temperature sensor 14, the acceleration sensor 15, and the gyro sensor 16, and the sound signal output from the microphone 18 to the control unit 5 via the first cable 7.

[0039] In addition to the status lamp 51, the control unit 5 includes a first USB port 52, a first protection circuit 53, a second power supply circuit 54, a second USB port 55, a second protection circuit 56, a PD controller 63, a first memory 57, a second memory 58, a second connector 59, and a control unit 60. These components are housed inside the second housing 50.

[0040] The first USB port 52 is a cable insertion port for connecting the mobile battery 200. The third cable 9 is inserted into the first USB port 52, and the mobile battery 200 is connected via the third cable 9. A USB Type-C port is used as the first USB port 52.

[0041] The first USB port 52 is connected to a power line (VBUS) via a first protection circuit 53 and a diode 61. The power line is connected to a second power circuit 54. The first protection circuit 53 is a circuit that performs overvoltage protection also known as OVP. The second power circuit 54 converts the power supplied via the power line into a voltage suitable for each component built into the control unit 5 and supplies it, and also converts it into a voltage suitable for operating the camera body 1 and outputs it to the first cable 7.

[0042] The second USB port 55 is a cable insertion port for connecting the information terminal 100. A second cable 8 is inserted into the second USB port 55, and the information terminal 100 is connected via the second cable 8. A USB Type-C port is used as the second USB port 55.

[0043] The second USB port 55 is connected to a power line connected to the second power circuit 54 via a second protection circuit 56 and a switch 62. The second protection circuit 56 is a circuit that performs overvoltage protection also called OVP. The second USB port 55 is also connected to the control unit 60. The transfer modes of the second USB port 55 support USB 2.0 HS (Hi Speed) and USB 3.0 SS (Super Speed).

[0044] A signal line for charging called a CC line is mounted on the second USB port 55. The CC line of the second USB port 55 is connected to the control unit 60 via a PD controller 63. The PD controller 63 controls the supply of power conforming to the USB PD standard from the control unit 60 to the information terminal 100 connected to the second USB port 55.

[0045] The status lamp 51 is composed of an LED capable of emitting light of multiple colors, such as a two-color LED or a three-color LED. The status lamp 51 is connected to the control unit 60. The lighting pattern of the status lamp 51 is switched by the control unit 60 according to the operating state of the camera device CA, such as during shooting, a sleep state (standby state), an abnormal state, etc.

[0046] The first memory 57 is a volatile memory that temporarily stores moving image data with audio. For example, a DRAM is used for the first memory 57. The second memory 58 is a non-volatile memory that records moving image data with audio. For example, a NAND type flash memory is used for the second memory 58.

[0047] The second connector 59 is a component to which the first cable 7 is connected. A coaxial thin-wire connector is used for the second connector 59. The second connector 59 receives the image signal, each detection signal, and sound signal transmitted from the camera body 1 via the first cable 7, and outputs them to the control unit 60.

[0048] The control unit 60 functions as a signal processing unit that processes image signals and sound signals. The control unit 60 temporarily stores in the first memory 57 the image data indicated by the image signal and the sound data indicated by the sound signal input via the second connector 59. The control unit 60 then adds the sound data to the image data stored in the first memory 57 to generate audio-accompanied video data, which is continuously recorded in the second memory 58 and sequentially transmitted to the information terminal 100 via the second USB port 55.

[0049] Before storing image data in first memory 57, or when generating audio-accompanying video data, control unit 60 performs distortion correction on the image data based on internal parameters of camera body 1 to convert the image into an image free of distortion caused by lens aberration, etc. Control unit 60 further performs a cut-out process to cut out a predetermined range from the distortion-corrected image data.

[0050] In this cropping process, the tilt of the cropped range of image data and the cropping position are corrected based on the rotational movement and translational movement around the optical axis of lens 11 of camera body 1. This type of correction is also called electronic gimbaling, and cancels the displacement of the captured image caused by dynamic changes in the attitude and shaking of camera body 1. The rotational movement and translational movement of camera body 1 are obtained from the detection signals from acceleration sensor 15 and gyro sensor 16.

[0051] The control unit 60 also switches the image output mode between a first mode and a second mode. The first mode is a mode in which the control unit 60 outputs image data having a narrower angle of view than the second mode. The image data output in the first mode corresponds to shooting data having an angle of view of, for example, about 60° to 90°. The second mode is a mode in which the control unit 60 outputs image data of the entire shooting range of the camera body 1. The image data output in the second mode corresponds to shooting data having an angle of view of, for example, about 120° to 180°.

[0052] The above-mentioned cropping process does not have to be performed when the image output mode is the second mode. In the second mode, tilt correction and shake correction by the electronic gimbal are not performed. In addition, when the camera device CA is used as a wearable camera by attaching the camera body 1 to the temple TE of the glasses GL, it is assumed that the image output mode is basically set to the first mode in order to enable tilt correction and shake correction by the electronic gimbal.

[0053] When the photographing range is darkened by, for example, covering the front side of the lens 11 of the camera body 1 with a hand, the control unit 60 detects the darkening and switches the image output mode. The control unit 60 may have a function of recognizing sound data. In this case, the control unit 60 may be configured to recognize a voice uttered by the user DU and switch the image output mode when the recognized voice is a predetermined word. In addition, the user DU may be able to switch the image output mode by setting the output mode using a dedicated application.

[0054] The control unit 60 also controls thermal shutdown. The imaging element 12 has a predetermined guaranteed operating temperature. Therefore, when the temperature indicated by the detection signal from the temperature sensor 14 exceeds a predetermined temperature, the control unit 60 performs processing to interrupt image capture so that the imaging element 12 does not exceed the guaranteed operating temperature. The control unit 60 is realized using an ASIC or the like.

[0055] In the camera device CA, when the mobile battery 200 is connected to the control unit 5, the camera body 1 and the control unit 5 are started up. Then, shooting is automatically performed by the camera body 1, and audio-accompanied video data according to the image output mode in the control unit 60 is transmitted to the information terminal 100. The audio-accompanied video data received by the information terminal 100 is transferred to a remote external system 4000 via the Internet 3000 by a function of a dedicated application.

[0056] A person in charge at a remote location can view the situation at the work site in real time by accessing the external system 4000 to which the audio-accompanied video data has been transferred. Also, if the audio-accompanied video data is uploaded to a cloud server when it is transferred from the information terminal 100, the person in charge at the remote location and the user DU can check the audio-accompanied video data after the fact.

[0057] -Detailed configuration of external system- The external system 4000 plays the moving image data transmitted from the camera device CA. The external system 4000 can be used to monitor the environment around the wearer GU. The external system 4000 can be configured by, for example, a PC. The external system 4000 has at least a display 4000a capable of live-playing the above-mentioned moving image data. The external system 4000 may be called an "information device", an "external device", or an "administration center".

[0058] -Detailed configuration of information terminal- The information terminal 100 functions as a communication module that wirelessly connects the camera device CA and the external system 4000 via the Internet 3000. The camera device CA wirelessly communicates with the external system 4000 via the information terminal 100 and the Internet 3000. By using this wireless communication, the camera device CA transmits video data to the external system 4000 in real time.

[0059] It is not essential that the information terminal 100 functions as a communication module. The control unit 5 of the camera device CA may function as a communication module by incorporating a communication device therein.

[0060] The information terminal 100 may be regarded as one element of the camera device CA. In that case, the camera device CA may be called a "camera system" including the information terminal 100 in addition to the camera body 1, the mount part 3, the control unit 5, and the first cable 7 (see the boxed area S in FIG. 1).

[0061] Furthermore, the information terminal 100 specifies a stream format of video data for the camera device CA. The control unit 60 generates video data in the stream format specified by the information terminal 100. The information terminal 100 transmits the video data generated in the specified stream format to the external system 4000 via the Internet 3000 without expanding or recompressing the data.

[0062] That is, when video data is exchanged between the information terminal 100 and the external system 4000 in a predetermined stream format (format A), the information terminal 100 inputs a signal indicating the format A to the control unit 60 of the camera device CA (see (1) in FIG. 5). The control unit 60 generates video data in the specified format A based on the input signal, and passes the generated video data to the information terminal 100 (see (2) in FIG. 5). The information terminal 100 transmits the passed video data to the external system 4000 (see (3) in FIG. 5). This makes it possible to match the stream format of the video data exchanged between the information terminal 100 and the camera device CA with the stream format of the video data exchanged between the information terminal 100 and the external system 4000.

[0063] At least H.264, MP4, and MJPEG are included in the stream formats that can be specified by the information terminal 100. In the order of H.264, MP4, and MJPEG, high image quality can be maintained even with high compression.

[0064] Furthermore, the information terminal 100 can monitor the connection status with the external system 4000, and inputs an electrical signal indicating the monitoring result to the control unit 60. When monitoring the connection status, for example, the radio wave intensity of a signal received by the information terminal 100 from a base station can be used.

[0065] -Detailed configuration of the control unit- The control unit 60 has a connection determination unit 6a, a motion detection unit 6b, and an image quality adjustment unit 6c as functional elements that perform various functions. These functional elements are merely classified for the sake of convenience in order to clarify the description. In addition, at least a part of these elements, for example, the connection determination unit 6a, may be realized in the information terminal 100.

[0066] The connection determination unit 6a determines whether the connection status with the external system 4000 is good or bad based on the electrical signal input from the information terminal 100. This determination can be made based on the magnitude of the radio wave intensity input from the information terminal 100. For example, the connection determination unit 6a may determine that the connection status is good when the radio wave intensity is equal to or greater than a predetermined first threshold, and may determine that the connection status is poor when the radio wave intensity is less than the first threshold. Note that the first threshold may be a value stored in advance in the control unit 60.

[0067] The determination made by the connection determination unit 6a is not limited to that based on the magnitude of radio wave intensity. The connection determination unit 6a may determine whether the connection status with the external system 4000 is good or bad based on the magnitude of the communication speed. For example, the connection determination unit 6a may determine that the connection status is good when the communication speed is equal to or higher than a predetermined third threshold, and may determine that the connection status is poor when the communication speed is less than the third threshold. The third threshold may be a value stored in advance in the control unit 60.

[0068] The motion detection unit 6b detects the motion (shaking) of the camera body 1 and, in turn, the wearer GU. The motion is detected by applying the principle of an electronic gimbal. That is, the motion detection unit 6b determines the displacement of the captured image as described above based on the rotational motion and translational motion of the camera body 1. The motion detection unit 6b may determine that the motion is large when the displacement is equal to or greater than a predetermined second threshold, and may determine that the motion is small when the displacement is less than the second threshold. Note that the second threshold may be a value stored in advance in the control unit 60.

[0069] 1, when the camera device CA is attached via the glasses GL and the mount part 3, the camera device CA is likely to shake more due to the shaking that occurs at the temple TE than when the camera device CA is attached without the glasses GL. The process described below works effectively under such circumstances.

[0070] The image quality adjustment unit 6c adjusts the image quality of the video data based on the judgment result by the connection judgment unit 6a. More specifically, the image quality adjustment unit 6c controls the output stream when generating the video data based on the judgment result of the quality of the connection status. More specifically, the image quality adjustment unit 6c adjusts the image quality of the video data by changing at least one of the image resolution, compression ratio, bit rate, and stream format of the video data.

[0071] Here, when the connection determination unit 6a determines that the connection status is poor, the image quality adjustment unit 6c reduces the image quality of the video data so as to ensure the frame rate of the video data. In detail, the image quality adjustment unit 6c reduces the image quality by reducing at least one of the image resolution, compression ratio, and bit rate, or in addition to or instead of that, by changing the stream format to one with lower image quality.

[0072] The term "ensuring a frame rate" is not limited to the meaning of "maintaining a constant frame rate." This terminology includes the meaning of "reducing deterioration of the frame rate compared to when the image quality of the video quality data is not adjusted."

[0073] On the other hand, when the connection determination unit 6a determines that the connection status is good, the image quality adjustment unit 6c improves the image quality of the video data. In detail, the image quality adjustment unit 6c improves the image quality by increasing at least one of the image resolution, compression ratio, and bit rate, or in addition to or instead of them, by changing the stream format to one with higher image quality.

[0074] When the connection determination unit 6a determines that the connection status is good, the image quality adjustment unit 6c takes more time to improve the image quality than when the connection determination unit 6a determines that the connection status is poor and the image quality of the video data is reduced. In more detail, when the connection determination unit 6a determines that the connection status is poor, the image quality of the video data is immediately reduced, whereas when the connection determination unit 6a determines that the connection status is good, the image quality of the video data is gradually improved. In this way, it is possible to suppress a sudden change in the image quality of the video data that is expected when the connection status becomes poor immediately after becoming good.

[0075] It is not essential to use different image quality adjustment speeds in this way. When the connection determination unit 6a determines that the connection status is good, the image quality of the video data may be improved immediately.

[0076] Furthermore, when the motion of the camera body 1 is detected by the motion detection unit 6b (when the motion is large), the image quality adjustment unit 6c reduces the image quality of the video data so as to ensure the frame rate of the video data, regardless of the judgment result of the connection judgment unit 6a. The method of reducing the image quality is the same as when the connection judgment unit 6a judges that the connection status is poor.

[0077] On the other hand, when the motion of the camera body 1 is not detected by the motion detection unit 6b (when the motion is small), the image quality of the video data is improved according to the judgment result of the connection judgment unit 6a. The method of improving the image quality is the same as when the connection judgment unit 6a judges that the connection status is good.

[0078] When the motion of the camera body 1 is not detected by the motion detector 6b, the image quality adjuster 6c takes more time to improve the image quality compared to when the motion detector 6b detects motion and reduces the image quality of the video data. In more detail, when the motion detector 6b detects motion of the camera body 1, the image quality of the video data is immediately reduced, whereas when the motion detector 6b does not detect motion of the camera body 1, the image quality of the video data is gradually improved. This makes it possible to suppress a sudden change in the image quality of the video data that would occur when motion is detected immediately after motion of the camera body 1 is no longer detected.

[0079] It should be noted that it is not essential to use different image quality adjustment speeds in this way. If the motion detector 6b does not detect any motion of the camera body 1, the image quality of the video data may be improved immediately.

[0080] Specifically, the control unit 60 adjusts the image quality according to the flow shown in Fig. 6. First, in step ST1, the control unit 60 receives detection signals from the acceleration sensor 15, the gyro sensor 16, and the information terminal 100, and acquires information indicated by the detection signals. The detection signals from the acceleration sensor 15 and the gyro sensor 16 indicate information related to the attitude of the camera body 1, such as the direction in which the camera body 1 faces. The detection signal from the information terminal 100 indicates information related to radio wave intensity.

[0081] In the next step ST2, the connection determination unit 6a determines whether or not the connection status is good based on the detection signal from the information terminal 100. If the determination is YES, that is, if the connection status is good, the control unit 60 advances the control process to step ST3. On the other hand, if the determination in step ST2 is NO, that is, if the connection status is poor, the control unit 60 advances the control process to step ST5.

[0082] Here, when the process proceeds from step ST2 to step ST5, the image quality adjustment unit 6c reduces the image quality of the video data so as to ensure the frame rate of the video data (image quality down). In this case, the camera device CA transmits the video data with the reduced image quality to the external system 4000 via the information terminal 100.

[0083] On the other hand, when the process proceeds from step ST2 to step ST3, the motion detection unit 6b judges whether or not there is motion in the camera device CA and the wearer GU based on the detection signals from the acceleration sensor 15 and the gyro sensor 16, and thus the displacement of the captured image. If this judgment is YES, that is, if there is no motion in the camera device CA, etc., the control unit 60 advances the control process to step ST4. On the other hand, if the judgment in step ST3 is NO, that is, if motion of the camera device CA, etc. is detected, the control unit 60 advances the control process to step ST5.

[0084] Here, when the process proceeds from step ST3 to step ST5, as described above, the image quality adjustment unit 6c reduces the image quality of the video data so as to ensure the frame rate of the video data (image quality down). In this case, the camera device CA transmits the video data with reduced image quality to the external system 4000 via the information terminal 100.

[0085] Although not shown in the figure, when both the condition that the connection is poor and the condition that motion is detected are satisfied, the image quality adjustment unit 6c can reduce the image quality of the video data to a greater extent than when only one of the conditions is satisfied. This makes it possible to control the image quality of the video data more finely.

[0086] On the other hand, when the process proceeds from step ST3 to step ST4, the image quality adjustment unit 6c improves the image quality of the video data (image quality improvement). In this case, the camera device CA transmits the video data with the improved image quality to the external system 4000 via the information terminal 100.

[0087] 6 is repeatedly executed while video data is being transmitted from camera device CA to external system 4000. That is, the image quality of the video data generated in camera device CA changes in real time.

[0088] In addition, when the video data shows characters, the image quality adjustment unit 6c can also reduce the frame rate of the video data so that the image quality (e.g., resolution) of the video data is ensured. The determination of whether the video data shows characters is performed between step ST1 and step ST2 or in step ST2 in Fig. 6. If the video data shows characters, the control unit 60 advances the control process to step ST4 regardless of the determinations in steps ST2 and ST4.

[0089] Similarly, the image quality adjustment unit 6c can also reduce the frame rate of the moving image data so as to ensure the image quality (e.g., resolution) of the moving image data in response to a remote command from the external system 4000. When a remote command to prioritize image quality has been input, the control unit 60 advances the control process to step ST4 regardless of the determinations in steps ST2 and ST4.

[0090] -Features of the embodiment- As described above, the image quality adjustment unit 6c according to the present embodiment reduces the image quality with priority given to the frame rate depending on the connection status, as shown in steps ST2 and ST5 in Fig. 6. This makes it possible to maintain the frame rate as much as possible, and ultimately improve the satisfaction of the viewer.

[0091] In addition, in the past, a configuration has been considered in which high-quality video data is generated in a camera device, and the video data is reduced in quality when it is transmitted from a communication module or a server connected to the camera device to an external system. However, such a configuration is inconvenient because it requires processing by a communication module or the like.

[0092] In contrast, the image quality adjustment unit 6c according to this embodiment is merely one element of the camera device CA. In other words, the image quality adjustment by the image quality adjustment unit 6c is performed by the camera device CA itself. Therefore, this embodiment is also useful in that it does not require processing by a communication module.

[0093] 6, the image quality adjustment unit 6c reduces the image quality with a priority on the frame rate depending on whether there is a movement or not, thereby making it possible to maintain the frame rate as much as possible, and thus improving the satisfaction of the viewer.

[0094] In addition, the present embodiment is also useful in that it eliminates the need for processing by a communication module, as with processing related to the connection status.

[0095] First Modified Example of Control Section Fig. 7 is a diagram illustrating a camera device CA according to a first modified example and corresponds to Fig. 4. Fig. 8 is a diagram illustrating a process according to the first modified example and corresponds to Fig. 6.

[0096] In the embodiment described above, processing based on the connection status and the movement of the camera body 1 is exemplified, but the present disclosure is not limited to such processing. For that purpose, the control unit 60 according to the first modified example has a data amount determination unit 6d shown in Fig. 7. Note that the data amount determination unit 6d and the movement detection unit 6b may be used in combination.

[0097] The data amount determination unit 6d determines the shooting scene of the video data, and estimates the data amount (image data amount) of the video data based on the determination result. Specifically, the data amount determination unit 6d estimates the image data amount to be smaller the more sky and structures (walls, etc.) are included in the video data, and estimates the image data amount to be larger the more people are included in the video data. This estimation can be performed based on the proportion of sky, structures, people, etc. included in the video data, for example.

[0098] The data amount determination unit 6d may determine that there is "a lot of moving image data" when the amount of image data is equal to or greater than a predetermined fourth threshold, and may determine that there is "a little moving image data" when the amount of image data is less than the fourth threshold. Note that the fourth threshold may be a value stored in advance in the control unit 60.

[0099] When the data amount determination unit 6d determines that the amount of image data is large, the image quality adjustment unit 6c reduces the image quality of the video data so as to ensure the frame rate of the video data, regardless of the determination result of the connection determination unit 6a. The method of reducing the image quality and the speed of adjusting the image quality are the same as when the connection determination unit 6a determines that the connection status is poor.

[0100] On the other hand, when the data amount determination unit 6d determines that the image data amount is small, the image quality adjustment unit 6c improves the image quality of the video data according to the determination result of the connection determination unit 6a. The method of improving the image quality and the speed of adjusting the image quality are the same as when the connection determination unit 6a determines that the connection status is good.

[0101] Specifically, the control unit 60 according to the first modified example performs image quality adjustment according to the flow shown in Fig. 8. The contents of steps ST11, ST12, ST14, and ST15 in the flow of Fig. 8 are the same as the contents of steps ST1, ST2, ST4, and ST5 in the flow of Fig. 6, respectively.

[0102] In step S13, which is the difference between the two flows, the data amount determining section 6d determines the amount of image data based on the captured scene of the moving image data, and determines whether the amount of image data is small or not.

[0103] If the determination in step S13 is YES, that is, if the amount of image data is small, the control unit 60 advances the control process to step ST 14. In this case, the control unit 60 improves the image quality of the moving image data.

[0104] On the other hand, if the determination in step ST13 is NO, that is, if the amount of image data is large, the control unit 60 advances the control process to step ST5. In this case, the control unit 60 reduces the image quality of the moving image data so as to ensure the frame rate.

[0105] Second Modified Example of the Control Section Fig. 9 is a diagram corresponding to Fig. 6 illustrating a process according to the second modified example. As shown in Fig. 9, some processes may be added to the flow shown in Fig. 6. The contents of step ST21, step ST22, step ST24, and step ST25 in the flow of Fig. 9 are the same as the contents of step ST1, step ST2, step ST4, and step ST5 in the flow of Fig. 6, respectively.

[0106] Specifically, the control unit 60 according to the second modification determines whether or not the current time is outside the range of a specific time period in step ST215 between steps ST21 and ST22. The "specific time period" here refers to a time period during which imaging by the camera device CA is not desired, such as a lunch break.

[0107] If the determination in step ST215 is YES, that is, if the current time is outside the range of the specific time period, the control unit 60 advances the control process to step ST22. In this case, the control unit 60 determines whether the connection status is good or bad.

[0108] On the other hand, if the determination in step ST215 is NO, that is, if the current time is within the range of the specific time period, the control unit 60 advances the control process to step ST25. If this determination is NO, it is considered to be in a time period (specific time period) where communication conditions tend to deteriorate, such as a lunch break. In this case, the control unit 60 can forcibly lower the image quality, maintain the image quality at a lower level, or gradually restore the image quality depending on the connection status, without making a determination by the communication condition determination unit 6c or regardless of the determination result. This makes it possible to suppress image quality fluttering due to image quality control.

[0109] Furthermore, when the connection state gradually recovers after the image quality is degraded due to the connection state, the control unit 60 according to the second modification judges whether the camera device CA continues to wait at the same location. This judgment can be made based on the detection signal of a GPS sensor (not shown) built into the camera device CA, for example.

[0110] If the camera device CA continues to wait in the same place, the control unit 60 maintains the image quality in a degraded state, whereas if the camera device CA is not waiting in the same place but is moving, the control unit 60 can gradually restore the image quality. This makes it possible to suppress image quality fluttering due to image quality control.

[0111] Other Embodiments In the above embodiment, the image output mode switching operation by the control unit 60 is exemplified by darkening the shooting range of the camera body 1, performing voice recognition, setting by a dedicated application, etc., but is not limited thereto. For example, when the camera body 1 has a built-in touch sensor, the switching operation may be performed by the user DU double tapping a detection point of the touch sensor of the camera body 1. In addition, the control unit 5 may be provided with a switch for switching the image output mode, and the image output mode may be switched by operating the switch.

[0112] In the embodiment, the first cable 7 is connected to the bottom of the camera body 1 in a state where the camera body 1 is attached to the glasses GL via the mount part 3, but this is not limited to this. The first cable 7 may be connected to a part other than the bottom of the camera body, such as a side part or a back part of the camera body 1.

[0113] In the embodiment described above, the camera body 1 and the control unit 5 are connected by wire using the first cable 7, but this is not limited thereto. The camera body 1 and the control unit 5 may be connected to each other so as to be able to communicate wirelessly.

[0114] In the above embodiment, the lens 11 for photographing is an ultra-wide-angle lens, but this is not limited thereto. The lens 11 may be a wide-angle lens or a standard lens. In the above embodiment, the camera device CA is used as a conference camera as an example of a use other than a wearable camera, but this is not limited thereto. The camera device CA can be used for any purpose as long as it is useful to take pictures with the camera body 1 placed vertically with the lens 11 facing upward.

[0115] In the embodiment, the camera device CA of the present disclosure has been described with the camera body 1 attached to glasses GL as an example, but is not limited thereto. Glasses GL are merely one example of an object to which the camera body 1 is attached, and the object to which the camera body 1 is attached may be a head-mounted device attached to the user's head other than glasses, such as a helmet, goggles, a head-mounted display, or a glasses-type mounting frame. The camera body 1 may also be attached to any other object, such as other wearable items such as the user DU's clothing, a selfie stick, a tripod, a car, or a robot arm. The mount part 3 can be replaced with one corresponding to the object to which it is attached, and may have various configurations such as a clip type.

[0116] As described above, a preferred embodiment has been described as an example of the technology of the present disclosure. However, the technology of the present disclosure is not limited to this, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are appropriately performed. It will be understood by those skilled in the art that various modifications of the above embodiment are possible without departing from the spirit of the technology of the present disclosure, and that such modifications also fall within the scope of the technology of the present disclosure.

[0117] Note that the descriptions "first," "second," etc., mentioned above are merely used to distinguish the words to which they are attached, and do not limit the number or order of the words. Also, the description "~" in the numerical ranges mentioned above means a range that includes the numerical values ​​before and after it. In other words, if X and Y are substituted for numerical values, then the description "X~Y" indicates a range of "greater than or equal to X and less than or equal to Y." [Industrial Applicability]

[0118] As described above, the present disclosure is useful for a camera device. [Explanation of symbols]

[0119] CA Camera device (wearable camera) GL Glasses (wearable, head-mounted) 1 Camera body 5. Control Unit 60 Control section 6a Connection determination section 6b Motion detection section 6c Picture quality adjustment section 100 Information terminal 4000 External System

Claims

1. A wearable camera configured to transmit moving image data in real time to an external system wirelessly connected thereto, a connection determination unit that determines whether a connection status with the external system is good or bad; an image quality adjustment unit that adjusts an image quality of the video data based on a result of the determination by the connection determination unit; When the connection determination unit determines that the connection state is poor, the image quality adjustment unit reduces the image quality of the moving image data so as to ensure a frame rate of the moving image data. A wearable camera characterized by:

2. The wearable camera according to claim 1, a camera body having a lens for capturing the moving image data and worn by a wearer of the wearable camera; a motion detection unit that detects the motion of the camera body, When the motion detection unit detects motion of the camera body, the image quality adjustment unit reduces the image quality of the video data so as to ensure a frame rate of the video data, regardless of a determination result of the connection determination unit. A wearable camera characterized by:

3. The wearable camera according to claim 1 or 2, The image quality adjustment unit adjusts the image quality of the video data by changing at least one of an image resolution, a compression ratio, a bit rate, and a stream format of the video data. A wearable camera characterized by:

Citation Information

Patent Citations

  • Camera device

    JP2018060139A