Image sensor and method for indicating that video stream is being output from camera system

Abstract

An image sensor and a method for indicating that a video stream is being output from a camera system, the image sensor including: a control block generating a video interface enable signal; the video interface is used for receiving the video interface starting signal; a pixel array for providing a video stream to the video interface; the output port is used for receiving the video stream from the video interface and outputting the video stream to the outside of an image sensor; a stream indicator pin for receiving the video interface enable signal from the control block when the video interface is receiving the video interface enable signal from the control block, where a terminal of the video interface receiving the video interface enable signal is connected to the stream indicator pin through a conductor, and the video interface, the flow indicator pin and the conductor are sealed in a package of the image sensor.

Description

Technical Field

[0001] The present disclosure relates to a camera, and more particularly to a camera with a video stream indicator, an image sensor, and a method for indicating that a video stream is being output from a camera system. Background Art

[0002] Image sensors, especially complementary metal oxide semiconductor (CMOS) image sensors, are commonly used in cameras. Cameras are installed in public and private places. For example, cameras can be installed in hospital waiting rooms, hotel lobbies, offices, or rooms where people work. People can work in factories, cargo distribution centers, offices, or any workplace. People who are observed by cameras may feel uncomfortable and do not like being recorded by cameras without their knowledge.

[0003] Therefore, there is a need for a camera with an indicator that can alert people when the camera is outputting a video stream. Summary of the invention

[0004] The present invention discloses a camera with an indicator that can remind people when the camera outputs a video stream. The output video stream can be used for recording. The indicator is completely controlled by the video stream and cannot be controlled by software.

[0005] According to an embodiment of the inventive concept, an image sensor includes: an input / output port for receiving a command from outside the image sensor; a control block for receiving the command from the input / output port and generating a video interface enable signal; a video interface for receiving the video interface enable signal from the control block; a pixel array for providing a video stream to the video interface; an output port for receiving the video stream from the video interface and outputting the video stream to the outside of the image sensor; a stream indicator pin for receiving the video interface enable signal from the control block when the video interface is receiving the video interface enable signal from the control block; wherein a terminal of the video interface that receives the video interface enable signal is connected to the stream indicator pin through a conductor; and wherein the video interface, the stream indicator pin, and the conductor connecting the terminal of the video interface to the stream indicator pin are sealed inside the package of the image sensor.

[0006] According to another embodiment of the inventive concept, an image sensor includes: an input / output port for receiving a command from outside the image sensor; a control block for receiving the command from the input / output port and generating a calculation enable signal; a calculation block for receiving the calculation enable signal from the control block; a pixel array for providing a video signal to the calculation block; wherein the calculation block performs calculations on the video signal provided by the pixel array to generate a calculation result; wherein the control block receives the calculation result from the calculation block and transfers the calculation result to the input / output port; wherein the input / output port receives the calculation result from the control block and outputs the calculation result to the outside of the image sensor; a calculation indicator pin for receiving the calculation enable signal from the control block when the calculation block is receiving the calculation enable signal from the control block; wherein a terminal of the calculation block receiving the calculation enable signal is connected to the calculation indicator pin through a conductor; and wherein the calculation block, the calculation indicator pin, and the conductor connecting the terminal of the calculation block to the calculation indicator pin are sealed in a package of the image sensor.

[0007] According to another embodiment of the inventive concept, a method for indicating that a video stream is being output from a camera system includes: generating a video interface enable signal through a control block; providing the generated video interface enable signal to a video interface; providing the video stream to the video interface through a pixel array; when the video interface receives the video interface enable signal, providing the video stream received by the video interface to an output port; wherein an image sensor includes the control block, the video interface, the pixel array and the output port, and the camera system includes the image sensor; outputting the video stream outside the image sensor through the output port; when the generated video interface enable signal is provided to the video interface, providing the generated video interface enable signal to a stream indicator pin; connecting a terminal of the video interface that receives the video interface enable signal to the stream indicator pin through a conductor; and sealing a package of the image sensor including the video interface, the stream indicator pin and the conductor connecting the terminal of the video interface to the stream indicator pin. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Non-limiting and non-exhaustive embodiments of the present invention are described with reference to the following figures, wherein like reference numerals refer to like parts throughout the various views unless otherwise specified.

[0009] Figure 1 A portion of a camera system is shown.

[0010] Figure 2An image sensor of a camera system is shown.

[0011] Figure 3 An image sensor of a camera system is shown.

[0012] Figure 4 The operation of the video streaming process is shown.

[0013] Figure 5 The operation of the calculation process is shown.

[0014] Figure 6 An alternative embodiment is shown.

[0015] Throughout the several views of the accompanying drawings, corresponding reference characters indicate corresponding components. The skilled person will appreciate that the elements in the figures are illustrated for simplicity and clarity and are not necessarily drawn to scale. For example, the dimensions of some of the elements in the figures may be exaggerated relative to other elements to help improve understanding of various embodiments of the present invention.

[0016] [Explanation of Symbols]

[0017] 100: Camera system;

[0018] 102, 202, 302: image sensor;

[0019] 104: application processor;

[0020] 106: pixel array;

[0021] 108: control block;

[0022] 110: calculation enable signal;

[0023] 112: calculation block;

[0024] 114: Video interface (IF) enable signal;

[0025] 116: Video interface;

[0026] 118: Input / output port I3C;

[0027] 120: output port mobile industry processor interface (MIPI) / mobile industry processor interface / mobile industry processor interface output port;

[0028] 122: calculation indicator pin;

[0029] 124: flow indicator pin;

[0030] 126: calculation indicator;

[0031] 128: flow indicator;

[0032] 400: Video streaming process;

[0033] 402, 404, 406, 408, 410, 412, 414, 418, 420, 502, 504, 506, 508, 510, 512, 514, 516, 520, 522: steps;

[0034] 500: calculation process;

[0035] 602: Activity indicator driver;

[0036] 604: Activity indicator. DETAILED DESCRIPTION

[0037] In the following description, many specific details are set forth to provide a thorough understanding of the present invention. However, it will be apparent to those skilled in the art that the present invention does not need to be practiced using the specific details. In other instances, well-known materials or methods are not described in detail in order to avoid obscuring the present invention.

[0038] Reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the phrases "in one embodiment" or "in an embodiment" appearing in various places throughout this specification may not all refer to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable combinations and / or sub-combinations in one or more embodiments.

[0039] Figure 1 A portion of a camera system 100 is shown according to an embodiment of the present invention, and the camera system 100 includes an image sensor 102 and an application processor 104, a flow indicator 128, and a computation indicator 126 located outside the image sensor 102. Here and throughout this disclosure, "compute indicator" has the same meaning as "computation indicator" or "computing indicator". The image sensor 102 can be a CMOS image sensor. The application processor 104 can be part of a host computer, and the flow indicator 128 and the computation indicator 126 can be light emitting diodes (LEDs). The application processor 104 can be included in the image sensor 102.

[0040] The image sensor 102 includes a pixel array 106, a control block 108, a computing block 112, a video interface (IF) 116, an input / output port I3C 118, an output port mobile industry processor interface (MIPI) 120, a computing indicator pin 122, and a flow indicator pin 124. Here and throughout the disclosure, "compute block" has the same meaning as "computation block" or "computing block".

[0041] I3C 118 is a bidirectional communication port or input / output port that is connected to the application processor 104 located outside the image sensor 102 and the control block 108 inside the image sensor 102. Other interfaces, such as I2C and SPI, may also be used. I3C, I2C, and SPI stand for improved interconnect integrated circuit, interconnect integrated circuit, and serial peripheral interface, respectively. I3C 118 may receive control commands or commands from outside the image sensor 102 (e.g., the application processor 104). The command is passed to the control block 108. The control block 108 that receives the command may generate a computing enable signal 110, which is sent to the computing block 112. Here and throughout this disclosure, "compute enabled" has the same meaning as "computation enabled" or "computing enabled". After receiving the computing enable signal 110, a video signal is provided to the computing block 112 through the pixel array 106. The video signal may be a video stream. When image sensor 102 is turned on, pixel array 106 continuously captures a video signal or video stream.

[0042] The computation block 112 computes or analyzes the video signal received from the pixel array 106 using some algorithms to achieve some purpose, such as object recognition, etc. The computation block 112 generates a computation result, which is provided to the control block 108. Here and throughout this disclosure, "compute result" has the same meaning as "computation result" or "computing result". The control block 108 receives the computation result and passes the computation result to the I3C 118. The I3C 118 receives the computation result and outputs the computation result to the outside of the image sensor 102, such as the application processor 104 located outside the image sensor 102. Both the control block 108 and the I3C 118 are located inside the image sensor 102. The computation result is not a video stream. For example, the computation result may be information that a human is detected in a video signal or video frame provided by the pixel array 106 using an object recognition algorithm. The algorithm may include an artificial intelligence (AI) algorithm.

[0043] The same signal used to enable the computation block 112 will set the computation indicator pin 122. When the computation block 112 is receiving the computation enable signal 110 from the control block 108, the computation indicator pin 122 receives the computation enable signal 110 from the control block 108. The terminal of the computation block 112 that receives the computation enable signal 110 is connected to the computation indicator pin 122 by a conductor (hardware). Therefore, when the computation block 112 receives the computation enable signal 110, the computation indicator pin 122 receives the same computation enable signal 110 anyway. The computation indicator pin 122 cannot be manipulated using software because the computation indicator pin 122 is connected to a conductor leading to the terminal of the computation block 112 that receives the computation enable signal 110, and the computation indicator pin 122, the conductor, and the computation block 112 and other components are sealed inside the package of the image sensor 102 at the factory. A computation indicator 126 located outside the image sensor 102 can be connected to the computation indicator pin 122. The computation indicator 126 includes an LED.

[0044] On the other hand, the I3C 118 may receive a control command or command from outside the image sensor 102, such as the application processor 104. The command is passed to the control block 108. The control block 108 receiving the command may generate a video IF enable signal 114, and send the video IF enable signal 114 to the video IF 116. After receiving the video IF enable signal 114, the video stream is provided to the video IF 116 through the pixel array 106. When the image sensor 102 is turned on, the pixel array 106 continuously captures the video stream or video signal.

[0045] The video IF 116 buffers or interfaces the video stream received from the pixel array 106. The video IF 116 then passes the video stream received from the pixel array 106 to the MIPI 120. Output port MIPI (Mobile Industry Processor Interface) is a serial interface between a camera and a host processor, such as a MIPI Camera Serial Interface (CSI). The MIPI 120 that receives the video stream then outputs the video stream to the outside of the image sensor 102, such as an application processor 104 that is located outside the image sensor 102. Both the video IF 116 and the MIPI 120 are located inside the image sensor 102. The MIPI 120 can output the video stream to other devices or parts that are located outside the image sensor 102.

[0046] The same signal used to enable the video IF 116 will set the flow indicator pin 124. When the video IF 116 is receiving the video IF enable signal 114 from the control block 108, the flow indicator pin 124 receives the video IF enable signal 114 from the control block 108. The terminal of the video IF 116 that receives the video IF enable signal 114 is connected to the flow indicator pin 124 by a conductor (hardware). Therefore, when the video IF 116 receives the video IF enable signal 114, the flow indicator pin 124 receives the same video IF enable signal 114 anyway. The flow indicator pin 124 cannot be manipulated using software because the flow indicator pin 124 is connected to a conductor leading to the terminal of the video IF 116 that receives the video IF enable signal 114, and the flow indicator pin 124, the video IF 116 and the conductor and other components are sealed inside the package of the image sensor 102 at the factory. A flow indicator 128 located outside the image sensor 102 can be connected to the flow indicator pin 124. The flow indicator 128 includes an LED.

[0047] The calculation indicator 126 and the flow indicator 128 may have the same color or different colors and may be in the same or different modes, such as a constant on mode and a pulsed mode.

[0048] In this way, a camera with an indicator can be realized, wherein the indicator can remind people when the camera outputs a video stream, and the indicator is completely controlled by the video stream and cannot be manipulated by software.

[0049] Figure 2An image sensor 202 according to an embodiment of the present invention is shown. Image sensor 202 is similar to image sensor 102, but omits calculation enable signal 110, calculation block 112, and calculation indicator pin 122. Image sensor 202 can output a video stream to the outside of image sensor 202 through MIPI 120 without performing any calculations inside image sensor 202.

[0050] Figure 3 An image sensor 302 according to an embodiment of the invention is shown. Image sensor 302 is similar to image sensor 102, but omits video IF enable signal 114, video IF 116, MIPI output port 120, and stream indicator pin 124. Image sensor 302 may perform calculations in calculation block 112 inside image sensor 302, but does not output any video stream outside image sensor 302. I3C 118 may receive commands from outside image sensor 302 and output calculation results outside image sensor 302.

[0051] Figure 4The operation of the video streaming process 400 according to an embodiment of the present invention is shown. In step 402, the application processor 104 located outside the image sensor 202 or the image sensor 102 provides a control command to the input / output port I3C 118. In step 404, the I3C 118 receives the control command. In step 406, the I3C 118 passes the control command to the control block 108. In step 408, the control block 108 generates a video IF enable signal 114. The control block 108 sends the video IF enable signal 114 to both the video IF 116 and the flow indicator pin 124 in parallel. Inside the sealed package of the image sensor 202 or the image sensor 102, the terminal of the video IF 116 that receives the video IF enable signal 114 and the flow indicator pin 124 are connected to the conductor. Therefore, it is impossible to cut this connection unless the package is opened or damaged. In step 410, the pixel array 106 provides the video stream to the video IF 116. In step 412, after receiving the video IF enable signal 114, the video IF 116 provides the video stream from the pixel array 106 to the output port MIPI 120. In step 418, when the video stream is provided to the MIPI 120, the stream indicator pin 124 receives the video IF enable signal 114. In step 420, if the stream indicator 128 is connected to the stream indicator pin 124, the stream indicator 128 will be turned on. The stream indicator 128 can be an LED. In step 414, the MIPI 120 receives the video stream from the video IF 116 and outputs the video stream to the image sensor 202 or outside the image sensor 102, for example, to the application processor 104. The application processor 104 can process the video stream, or can further pass the video stream to other parts of the camera system 100.

[0052] Figure 5The operation of the computing process 500 according to an embodiment of the present invention is shown. In step 502, the application processor 104 located outside the image sensor 302 or the image sensor 102 provides a control command to the input / output port I3C 118. In step 504, the I3C 118 receives the control command. In step 506, the I3C 118 passes the control command to the control block 108. In step 508, the control block 108 generates a computing enable signal 110. The control block 108 sends the computing enable signal 110 to both the computing block 112 and the computing indicator pin 122 in parallel. Inside the sealed package of the image sensor 302 or the image sensor 102, the terminal of the computing block 112 that receives the computing enable signal 110 and the computing indicator pin 122 are connected to the conductor. Therefore, it is impossible to cut off this connection unless the package is opened or damaged. In step 510, the pixel array 106 provides the video signal to the computing block 112. In step 512, after receiving the calculation enable signal 110, the calculation block 112 performs calculations or processes on the video signal received from the pixel array 106 to generate a calculation result. The calculation result is provided to the control block 108. In step 514, the control block 108 passes the calculation result to the input / output port I3C 118. In step 516, the input / output port I3C 118 outputs the calculation result to the application processor 104 located outside the image sensor 302 or the image sensor 102. In step 520, when the calculation block 112 is performing calculations, the calculation indicator pin 122 receives the calculation enable signal 110. In step 522, if the calculation indicator 126 is connected to the calculation indicator pin 122, the calculation indicator 126 will be turned on. The calculation indicator 126 can be an LED.

[0053] The application processor 104 may process the calculation result, or may further pass the calculation result to other parts of the camera system 100. The calculation result is not a video stream. For example, the calculation result may be information that a human is detected in a video signal or video frame provided by the pixel array 106 using an object recognition algorithm. The algorithm may include an artificial intelligence (AI) algorithm. The calculation result may not contain a video image, so the calculation result may not contain individual human images.

[0054] The operation of video streaming process 400 may illustrate the operation of image sensor 202. The operation of computing process 500 may illustrate the operation of image sensor 302. The operation of video streaming process 400 and the operation of computing process 500 may together illustrate the operation of image sensor 102. In image sensor 102, the operation of video streaming process 400 and the operation of computing process 500 may be independent.

[0055] The flow indicator 128 and the calculation indicator 126 may operate independently in various modes (eg, constant on mode, pulse mode, color mode, etc.).

[0056] Figure 6 The embodiment according to the present invention is shown in Figure 1 100 is an embodiment of an image sensor 102 in which a flow indicator pin 124 and a calculation indicator pin 122 are connected to an activity indicator driver 602 located outside the image sensor 102. The activity indicator driver 602 drives a single activity indicator 604. For example, the activity indicator 604 is in a constant on mode or solid mode when the activity indicator driver 602 receives an on signal from the flow indicator pin 124, and is in a pulse mode or flashing mode when the activity indicator driver 602 receives an on signal from the calculation indicator pin 122, or vice versa. If the activity indicator driver 602 receives an on signal from both the flow indicator pin 124 and the calculation indicator pin 122, the flow indicator pin 124 can be set to have priority. The calculation indicator pin 122 can also be set to have priority. The activity indicator 604 includes an LED.

[0057] Although the invention has been described herein with reference to exemplary embodiments and the best mode for practicing the invention, those skilled in the art will appreciate that many modifications, improvements and sub-combinations of various embodiments, adaptations and variations may be made to the invention without departing from the spirit and scope of the invention.

[0058] The terms used in the following claims should not be construed to limit the invention to the specific embodiments disclosed in the specification and the claims. Rather, the scope is to be determined entirely by the appended claims, which are to be interpreted in accordance with established doctrines of claim interpretation. Accordingly, the specification and drawings are to be regarded as illustrative rather than restrictive.

Claims

1. An image sensor, comprising: an input / output port for receiving commands from outside the image sensor; a control block for receiving the command from the input / output port and generating a video interface enable signal; a video interface for receiving the video interface enable signal from the control block; A pixel array for providing a video stream to the video interface; an output port, configured to receive the video stream from the video interface and output the video stream to the outside of the image sensor; a stream indicator pin for receiving the video interface enable signal from the control block when the video interface is receiving the video interface enable signal from the control block; wherein a terminal of the video interface that receives the video interface enable signal is connected to the flow indicator pin via a conductor; and The video interface, the flow indicator pin, and the conductor connecting the terminal of the video interface with the flow indicator pin are sealed inside the package of the image sensor. 2 . The image sensor of claim 1 , wherein the input / output port receives the command from an application processor located outside the image sensor. 3 . The image sensor of claim 1 , wherein the output port outputs the video stream to an application processor external to the image sensor. 4 . The image sensor of claim 1 , wherein a flow indicator located outside the image sensor is connected to the flow indicator pin. 5 . The image sensor according to claim 4 , wherein the operation modes of the flow indicator include a constant-on mode, a pulse mode, and a color mode.

6. The image sensor according to claim 1, wherein the control block further generates a calculation enable signal, the image sensor further comprising: a calculation block, configured to receive the calculation enabling signal from the control block; wherein the pixel array provides a video signal to the computation block; wherein the calculation block performs calculation on the video signal provided by the pixel array to generate a calculation result; wherein the control block receives the calculation result from the calculation block and transmits the calculation result to the input / output port; wherein the input / output port receives the calculation result from the control block and outputs the calculation result to the outside of the image sensor; a computation indicator pin for receiving the computation enable signal from the control block when the computation block is receiving the computation enable signal from the control block; wherein a terminal of the computation block receiving the computation enable signal is connected to the computation indicator pin through a conductor; and The calculation block, the calculation indicator pin, and the conductor connecting the terminal of the calculation block with the calculation indicator pin are further sealed inside the package of the image sensor. The image sensor according to claim 6 , wherein the video signal is the video stream. 8 . The image sensor of claim 6 , wherein the input / output port receives the command from an application processor located outside the image sensor, and outputs the calculation result to the application processor located outside the image sensor.

9. The image sensor of claim 6, wherein a calculation indicator located outside the image sensor is connected to the calculation indicator pin.

10. The image sensor of claim 9, wherein the operation mode of the calculation indicator comprises a constant-on mode, a pulse mode, and a color mode.

11. The image sensor of claim 6, wherein an activity indicator driver external to the image sensor is connected to the flow indicator pin and the compute indicator pin, and wherein the activity indicator driver drives an activity indicator. 12 . The image sensor of claim 11 , wherein an operating mode of the activity indicator comprises a constant-on mode and a pulse mode.

13. An image sensor, comprising: an input / output port for receiving commands from outside the image sensor; a control block for receiving the command from the input / output port and generating a calculation enable signal; a calculation block, configured to receive the calculation enabling signal from the control block; A pixel array for providing a video signal to the computing block; wherein the calculation block performs calculation on the video signal provided by the pixel array to generate a calculation result; wherein the control block receives the calculation result from the calculation block and transmits the calculation result to the input / output port; wherein the input / output port receives the calculation result from the control block and outputs the calculation result to the outside of the image sensor; a computation indicator pin for receiving the computation enable signal from the control block when the computation block is receiving the computation enable signal from the control block; wherein a terminal of the computation block receiving the computation enable signal is connected to the computation indicator pin through a conductor; and The calculation block, the calculation indicator pin, and the conductor connecting the terminal of the calculation block with the calculation indicator pin are sealed in a package of the image sensor. 14 . The image sensor of claim 13 , wherein the input / output port receives the command from an application processor located outside the image sensor, and outputs the calculation result to the application processor located outside the image sensor.

15. The image sensor of claim 13, wherein a calculation indicator located external to the image sensor is connected to the calculation indicator pin.

16. The image sensor of claim 15, wherein the operation modes of the calculation indicator include a constant-on mode, a pulse mode, and a color mode.

17. A method for indicating that a video stream is being output from a camera system, comprising: generating a video interface enable signal via a control block; providing the generated video interface enable signal to a video interface; Providing the video stream to the video interface via a pixel array; providing the video stream received by the video interface to an output port when the video interface receives the video interface enable signal; wherein the image sensor comprises the control block, the video interface, the pixel array and the output port, and the camera system comprises the image sensor; Outputting the video stream to the outside of the image sensor through the output port; providing the generated video interface enable signal to a stream indicator pin when the generated video interface enable signal is provided to the video interface; connecting a terminal of the video interface that receives the video interface enable signal to the stream indicator pin via a conductor; as well as A package for the image sensor is sealed including the video interface, the flow indicator pins, and the conductors connecting the terminals of the video interface with the flow indicator pins.

18. The method according to claim 17, further comprising: A stream indicator is connected to the stream indicator pin, wherein the stream indicator is turned on when the video stream is output from the image sensor of the camera system.

19. The method according to claim 17, further comprising: generating a calculation enabling signal by the control block; providing the generated computation enable signal to a computation block; providing a video signal to the computing block via the pixel array; When the calculation block receives the calculation enable signal, the video signal is calculated by the calculation block to generate a calculation result; providing the calculation result to the control block; transferring the calculation result from the control block to an input / output port; wherein the image sensor further comprises the computing block and the input / output port; Outputting the calculation result to the outside of the image sensor through the input / output port; When the generated calculation enable signal is provided to the calculation block, providing the generated calculation enable signal to a calculation indicator pin; as well as connecting a terminal of the computation block that receives the computation enable signal to the computation indicator pin via a conductor; The sealed package of the image sensor further includes the computation block, the computation indicator pin, and the conductor connecting the terminal of the computation block to the computation indicator pin.

20. The method according to claim 19, further comprising: A calculation indicator is connected to the calculation indicator pin, wherein the calculation indicator is turned on when the calculation block is calculating the video signal.

21. The method of claim 19, wherein the video signal is the video stream.

22. The method of claim 19, further comprising: An activity indicator driver is connected to the flow indicator pin and the compute indicator pin, wherein the activity indicator driver drives an activity indicator.

Images