Image sensor and method for indicating that a video stream is being output from a camera system

Abstract

An image sensor and a method for indicating that a video stream is being output from a camera system, the image sensor comprising: a control block for generating a video interface enable signal; a video interface for receiving the video interface enable signal; a pixel array for providing a video stream to the video interface; an output port for receiving the video stream from the video interface and outputting the video stream to the outside of the image sensor; a stream indicator pin for receiving the video interface enable signal from the control block when the video interface is receiving the video interface enable signal from the control block, wherein a terminal of the video interface for receiving the video interface enable signal is connected to the stream indicator pin via a conductor, and the video interface, the stream indicator pin, and the conductor are sealed in a package of the image sensor.

Description

Technical Field

[0001] The present disclosure relates to a camera, and more particularly to a camera with a video stream indicator, an image sensor, and a method for indicating that a video stream is being output from a camera system. Background Art

[0002] Image sensors, particularly complementary metal oxide semiconductor (CMOS) image sensors, are commonly used in cameras. Cameras are installed in both public and private spaces. For example, cameras can be installed in hospital waiting rooms, hotel lobbies, offices, or rooms where people work. People can work in factories, distribution centers, offices, or any other workplace. People being observed by cameras may feel uneasy and dislike being recorded without their knowledge.

[0003] Therefore, there is a need for a camera with an indicator that can alert people when the camera is outputting a video stream. Summary of the Invention

[0004] The present invention discloses a camera having an indicator that can alert people when the camera is outputting a video stream. The output video stream can be used for recording. The indicator is completely controlled by the video stream and cannot be manipulated by software.

[0005] According to an embodiment of the inventive concept, an image sensor includes: an input / output port for receiving a command from outside the image sensor; a control block for receiving the command from the input / output port and generating a video interface enable signal; a video interface for receiving the video interface enable signal from the control block; a pixel array for providing a video stream to the video interface; an output port for receiving the video stream from the video interface and outputting the video stream to the outside of the image sensor; a stream indicator pin for receiving the video interface enable signal from the control block when the video interface is receiving the video interface enable signal from the control block; wherein a terminal of the video interface that receives the video interface enable signal is connected to the stream indicator pin via a conductor; and wherein the video interface, the stream indicator pin, and the conductor connecting the terminal of the video interface to the stream indicator pin are sealed inside the package of the image sensor.

[0006] According to another embodiment of the inventive concept, an image sensor includes: an input / output port for receiving a command from outside the image sensor; a control block for receiving the command from the input / output port and generating a calculation enable signal; a calculation block for receiving the calculation enable signal from the control block; a pixel array for providing a video signal to the calculation block; wherein the calculation block performs calculations on the video signal provided by the pixel array to generate calculation results; wherein the control block receives the calculation results from the calculation block and passes the calculation results to the input / output port; wherein the input / output port receives the calculation results from the control block and outputs the calculation results to the outside of the image sensor; a calculation indicator pin for receiving the calculation enable signal from the control block when the calculation block is receiving the calculation enable signal from the control block; wherein a terminal of the calculation block receiving the calculation enable signal is connected to the calculation indicator pin by a conductor; and wherein the calculation block, the calculation indicator pin, and the conductor connecting the terminal of the calculation block to the calculation indicator pin are sealed in a package of the image sensor.

[0007] According to another embodiment of the inventive concept, a method for indicating that a video stream is being output from a camera system includes: generating a video interface enable signal through a control block; providing the generated video interface enable signal to a video interface; providing the video stream to the video interface through a pixel array; when the video interface receives the video interface enable signal, providing the video stream received by the video interface to an output port; wherein an image sensor includes the control block, the video interface, the pixel array and the output port, and the camera system includes the image sensor; outputting the video stream outside the image sensor through the output port; when the generated video interface enable signal is provided to the video interface, providing the generated video interface enable signal to a stream indicator pin; connecting a terminal of the video interface that receives the video interface enable signal to the stream indicator pin through a conductor; and sealing a package of the image sensor including the video interface, the stream indicator pin and the conductor connecting the terminal of the video interface to the stream indicator pin. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Non-limiting and non-exhaustive embodiments of the present invention are described with reference to the following figures, wherein like reference numerals refer to like parts throughout the various views unless otherwise specified.

[0009] Figure 1 A portion of a camera system is shown.

[0010] Figure 2An image sensor of a camera system is shown.

[0011] Figure 3 An image sensor of a camera system is shown.

[0012] Figure 4 Illustrate the operation of the video streaming process.

[0013] Figure 5 The operation of the calculation process is shown.

[0014] Figure 6 An alternative embodiment is shown.

[0015] Throughout the several views of the drawings, corresponding reference characters indicate corresponding components. Those skilled in the art will appreciate that the elements in the figures are illustrated for simplicity and clarity and are not necessarily drawn to scale. For example, the dimensions of some of the elements in the figures may be exaggerated relative to other elements to help improve understanding of various embodiments of the present invention.

[0016] [Explanation of Symbols]

[0017] 100: Camera system;

[0018] 102, 202, 302: image sensor;

[0019] 104: application processor;

[0020] 106: pixel array;

[0021] 108: control block;

[0022] 110: calculation enable signal;

[0023] 112: calculation block;

[0024] 114: Video interface (IF) enable signal;

[0025] 116: video interface;

[0026] 118: I / O port I3C;

[0027] 120: output port mobile industry processor interface (MIPI) / mobile industry processor interface / mobile industry processor interface output port;

[0028] 122: calculation indicator pin;

[0029] 124: flow indicator pin;

[0030] 126: calculation indicator;

[0031] 128: flow indicator;

[0032] 400: Video streaming process;

[0033] 402, 404, 406, 408, 410, 412, 414, 418, 420, 502, 504, 506, 508, 510, 512, 514, 516, 520, 522: steps;

[0034] 500: calculation process;

[0035] 602: Activity indicator driver;

[0036] 604: Activity indicator. DETAILED DESCRIPTION

[0037] In the following description, numerous specific details are set forth to provide a thorough understanding of the present invention. However, it will be apparent to those skilled in the art that these specific details are not required to practice the present invention. In other instances, well-known materials or methods are not described in detail in order to obscure the present invention.

[0038] Reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, appearances of the phrases "in one embodiment" or "in an embodiment" throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable combinations and / or subcombinations in one or more embodiments.

[0039] Figure 1 1 shows a portion of a camera system 100 according to an embodiment of the present invention. The camera system 100 includes an image sensor 102 and an application processor 104, a flow indicator 128, and a computation indicator 126 located external to the image sensor 102. Here and throughout this disclosure, "compute indicator" has the same meaning as "computation indicator" or "computing indicator." The image sensor 102 may be a CMOS image sensor. The application processor 104 may be part of a host computer, and the flow indicator 128 and computation indicator 126 may be light emitting diodes (LEDs). The application processor 104 may be included in the image sensor 102.

[0040] The image sensor 102 includes a pixel array 106, a control block 108, a computation block 112, a video interface (IF) 116, an I / O port I3C 118, an output port Mobile Industry Processor Interface (MIPI) 120, a computation indicator pin 122, and a flow indicator pin 124. Here and throughout this disclosure, "compute block" has the same meaning as "computation block" or "computing block."

[0041] I3C 118 is a bidirectional communication port or input / output port that connects to the application processor 104 located outside the image sensor 102 and the control block 108 within the image sensor 102. Other interfaces, such as I2C and SPI, may also be used. I3C, I2C, and SPI stand for Improved Interconnect Integrated Circuit, Interconnect Integrated Circuit, and Serial Peripheral Interface, respectively. I3C 118 can receive control commands or commands from outside the image sensor 102 (e.g., the application processor 104). These commands are passed to the control block 108. Upon receiving the commands, the control block 108 may generate a compute enable signal 110 and send it to the compute block 112. Here and throughout this disclosure, "compute enabled" has the same meaning as "computation enabled" or "computing enabled." After receiving the compute enable signal 110, a video signal is provided to the compute block 112 via the pixel array 106. The video signal may be a video stream. When image sensor 102 is turned on, pixel array 106 continuously captures a video signal or video stream.

[0042] Computation block 112 uses algorithms to compute or analyze the video signal received from pixel array 106 for purposes such as object recognition. Computation block 112 generates a computation result and provides it to control block 108. Here and throughout this disclosure, "compute result" has the same meaning as "computation result" or "computing result." Control block 108 receives the computation result and passes it to I3C 118. I3C 118 receives the computation result and outputs it outside of image sensor 102, such as to application processor 104 located outside image sensor 102. Both control block 108 and I3C 118 are located within image sensor 102. The computation result is not a video stream. For example, the computation result may be information indicating that a human has been detected in the video signal or video frame provided by pixel array 106 using an object recognition algorithm. Such an algorithm may include an artificial intelligence (AI) algorithm.

[0043] The same signal used to enable compute block 112 sets compute indicator pin 122. When compute block 112 is receiving compute enable signal 110 from control block 108, compute indicator pin 122 receives compute enable signal 110 from control block 108. The terminal of compute block 112 that receives compute enable signal 110 is connected to compute indicator pin 122 via a conductor (hardware). Therefore, when compute block 112 receives compute enable signal 110, compute indicator pin 122 also receives the same compute enable signal 110. Compute indicator pin 122 cannot be manipulated using software because it is connected to a conductor leading to the terminal of compute block 112 that receives compute enable signal 110, and compute indicator pin 122, the conductor, and compute block 112 and other components are sealed inside the package of image sensor 102 at the factory. A compute indicator 126 located outside image sensor 102 can be connected to compute indicator pin 122. Compute indicator 126 includes an LED.

[0044] On the other hand, I3C 118 can receive control commands or commands from outside of image sensor 102 (e.g., application processor 104). The commands are passed to control block 108. Control block 108, upon receiving the commands, can generate video IF enable signal 114 and send video IF enable signal 114 to video IF 116. After receiving video IF enable signal 114, a video stream is provided to video IF 116 via pixel array 106. When image sensor 102 is turned on, pixel array 106 continuously captures a video stream or video signal.

[0045] Video IF 116 buffers or interfaces the video stream received from pixel array 106. Video IF 116 then passes the video stream received from pixel array 106 to MIPI 120. Output port MIPI (Mobile Industry Processor Interface) is a serial interface between a camera and a host processor, such as the MIPI Camera Serial Interface (CSI). MIPI 120, having received the video stream, then outputs the video stream to the outside of image sensor 102, such as to application processor 104 located outside image sensor 102. Both video IF 116 and MIPI 120 are located within image sensor 102. MIPI 120 can output the video stream to other devices or components located outside image sensor 102.

[0046] The same signal used to enable video IF 116 sets flow indicator pin 124. When video IF 116 is receiving video IF enable signal 114 from control block 108, flow indicator pin 124 receives video IF enable signal 114 from control block 108. The terminal of video IF 116 that receives video IF enable signal 114 is connected to flow indicator pin 124 via a conductor (hardware). Therefore, when video IF 116 receives video IF enable signal 114, flow indicator pin 124 also receives the same video IF enable signal 114. Flow indicator pin 124 cannot be manipulated using software because it is connected to a conductor that leads to the terminal of video IF 116 that receives video IF enable signal 114, and flow indicator pin 124, video IF 116, the conductors, and other components are sealed inside the package of image sensor 102 at the factory. A flow indicator 128 located outside image sensor 102 can be connected to flow indicator pin 124. The flow indicator 128 includes an LED.

[0047] The count indicator 126 and the flow indicator 128 may have the same color or different colors and may be in the same or different modes, such as a constant on mode and a pulsed mode.

[0048] In this way, a camera with an indicator can be realized, which can remind people when the camera outputs a video stream, and the indicator is completely controlled by the video stream and cannot be manipulated by software.

[0049] Figure 2An image sensor 202 according to an embodiment of the present invention is shown. Image sensor 202 is similar to image sensor 102, but omits compute enable signal 110, compute block 112, and compute indicator pin 122. Image sensor 202 can output a video stream to the outside of image sensor 202 via MIPI 120 without performing any computations within image sensor 202.

[0050] Figure 3 An image sensor 302 according to an embodiment of the present invention is shown. Image sensor 302 is similar to image sensor 102, but omits video IF enable signal 114, video IF 116, MIPI output port 120, and stream indicator pin 124. Image sensor 302 may perform calculations in calculation block 112 within image sensor 302, but may not output any video streams outside image sensor 302. I3C 118 may receive commands from outside image sensor 302 and output calculation results outside image sensor 302.

[0051] Figure 4The operation of a video streaming process 400 according to an embodiment of the present invention is illustrated. In step 402, the application processor 104, located external to the image sensor 202 or image sensor 102, provides a control command to the input / output port I3C 118. In step 404, the I3C 118 receives the control command. In step 406, the I3C 118 passes the control command to the control block 108. In step 408, the control block 108 generates the video IF enable signal 114. The control block 108 sends the video IF enable signal 114 in parallel to both the video IF 116 and the stream indicator pin 124. Inside the sealed package of the image sensor 202 or image sensor 102, the terminal of the video IF 116 that receives the video IF enable signal 114 and the stream indicator pin 124 are connected to conductors. Therefore, it is impossible to sever this connection unless the package is opened or damaged. In step 410, the pixel array 106 provides the video stream to the video IF 116. In step 412, after receiving the video IF enable signal 114, the video IF 116 provides the video stream from the pixel array 106 to the output port MIPI 120. In step 418, when providing the video stream to MIPI 120, the stream indicator pin 124 receives the video IF enable signal 114. In step 420, if the stream indicator 128 is connected to the stream indicator pin 124, the stream indicator 128 will turn on. The stream indicator 128 can be an LED. In step 414, MIPI 120 receives the video stream from the video IF 116 and outputs the video stream to the image sensor 202 or outside of the image sensor 102, for example, to the application processor 104. The application processor 104 can process the video stream or further pass the video stream to other parts of the camera system 100.

[0052] Figure 5The operation of a computing process 500 according to an embodiment of the present invention is shown. In step 502, the application processor 104, located outside the image sensor 302 or image sensor 102, provides a control command to the input / output port I3C 118. In step 504, I3C 118 receives the control command. In step 506, I3C 118 passes the control command to the control block 108. In step 508, the control block 108 generates a computing enable signal 110. The control block 108 sends the computing enable signal 110 in parallel to both the computing block 112 and the computing indicator pin 122. Inside the sealed package of the image sensor 302 or image sensor 102, the terminal of the computing block 112 that receives the computing enable signal 110 and the computing indicator pin 122 are connected to conductors. Therefore, it is impossible to sever this connection unless the package is opened or damaged. In step 510, the pixel array 106 provides a video signal to the computing block 112. In step 512, after receiving the calculation enable signal 110, the calculation block 112 performs calculations or processes the video signal received from the pixel array 106 to generate a calculation result. The calculation result is provided to the control block 108. In step 514, the control block 108 passes the calculation result to the input / output port I3C 118. In step 516, the input / output port I3C 118 outputs the calculation result to the application processor 104 located outside the image sensor 302 or image sensor 102. In step 520, when the calculation block 112 is performing calculations, the calculation indicator pin 122 receives the calculation enable signal 110. In step 522, if the calculation indicator 126 is connected to the calculation indicator pin 122, the calculation indicator 126 will turn on. The calculation indicator 126 can be an LED.

[0053] Application processor 104 may process the computational results or may further transmit the computational results to other parts of camera system 100. The computational results are not video streams. For example, the computational results may be information that a human being is detected in a video signal or video frame provided by pixel array 106 using an object recognition algorithm. The algorithm may include an artificial intelligence (AI) algorithm. The computational results may not contain video images, and therefore, may not contain individual images of humans.

[0054] The operation of video streaming process 400 may illustrate the operation of image sensor 202. The operation of computing process 500 may illustrate the operation of image sensor 302. The operation of video streaming process 400 and the operation of computing process 500 may together illustrate the operation of image sensor 102. In image sensor 102, the operation of video streaming process 400 and the operation of computing process 500 may be independent.

[0055] The flow indicator 128 and the calculation indicator 126 may independently operate in various modes (eg, constant on mode, pulse mode, color mode, etc.).

[0056] Figure 6 The embodiment according to the present invention is shown Figure 1 124 and the count indicator pin 122 are connected to an embodiment of an activity indicator driver 602 located outside the image sensor 102. The activity indicator driver 602 drives a single activity indicator 604. For example, the activity indicator 604 is in a constant on mode or solid mode when the activity indicator driver 602 receives an on signal from the flow indicator pin 124, and is in a pulse mode or blinking mode when the activity indicator driver 602 receives an on signal from the count indicator pin 122, or vice versa. If the activity indicator driver 602 receives an on signal from both the flow indicator pin 124 and the count indicator pin 122, the flow indicator pin 124 can be set to have priority. The count indicator pin 122 can also be set to have priority. The activity indicator 604 includes an LED.

[0057] Although the invention has been described herein with reference to exemplary embodiments and the best mode for practicing the invention, those skilled in the art will appreciate that many modifications, improvements and sub-combinations of various embodiments, adaptations and variations may be made to the invention without departing from the spirit and scope of the invention.

[0058] The terms used in the following claims should not be construed to limit the invention to the specific embodiments disclosed in the specification and the claims. Rather, the scope is to be determined entirely by the following claims, which are to be interpreted in accordance with established doctrines of claim interpretation. Accordingly, the specification and drawings are to be regarded as illustrative rather than restrictive.

Claims

1. An image sensor, comprising: an input / output port for receiving commands from outside the image sensor; a control block for receiving the command from the input / output port and generating a video interface enable signal; a video interface for receiving the video interface enabling signal from the control block; a pixel array for providing a video stream to the video interface; an output port, configured to receive the video stream from the video interface and output the video stream to the outside of the image sensor; a flow indicator pin for receiving the video interface enable signal from the control block when the video interface is receiving the video interface enable signal from the control block; wherein a terminal of the video interface that receives the video interface enable signal is connected to the stream indicator pin via a conductor, so that a stream indicator connected to the stream indicator pin is completely controlled by the video stream; and The video interface, the flow indicator pin, and the conductor connecting the terminal of the video interface with the flow indicator pin are sealed inside the package of the image sensor. 2 . The image sensor of claim 1 , wherein the input / output port receives the command from an application processor located outside the image sensor. 3 . The image sensor of claim 1 , wherein the output port outputs the video stream to an application processor external to the image sensor. 4 . The image sensor of claim 1 , wherein the flow indicator located outside the image sensor is connected to the flow indicator pin. 5 . The image sensor according to claim 4 , wherein an operation mode of the flow indicator comprises a constant-on mode, a pulse mode, and a color mode.

6. The image sensor according to claim 1 , wherein the control block further generates a calculation enable signal, the image sensor further comprising: a calculation block, configured to receive the calculation enable signal from the control block; wherein the pixel array provides a video signal to the computation block; wherein the calculation block performs calculation on the video signal provided by the pixel array to generate a calculation result; wherein the control block receives the calculation result from the calculation block and transmits the calculation result to the input / output port; wherein the input / output port receives the calculation result from the control block and outputs the calculation result to the outside of the image sensor; a compute indicator pin for receiving the compute enable signal from the control block when the compute block is receiving the compute enable signal from the control block; wherein the terminal of the calculation block receiving the calculation enable signal is connected to the calculation indicator pin through a conductor; and The calculation block, the calculation indicator pin, and the conductor connecting the terminal of the calculation block and the calculation indicator pin are further sealed inside the package of the image sensor. The image sensor according to claim 6 , wherein the video signal is the video stream. 8 . The image sensor according to claim 6 , wherein the input / output port receives the command from an application processor located outside the image sensor and outputs the calculation result to the application processor located outside the image sensor.

9. The image sensor of claim 6, wherein a calculation indicator located outside the image sensor is connected to the calculation indicator pin. 10 . The image sensor according to claim 9 , wherein an operation mode of the calculation indicator comprises a constant-on mode, a pulse mode, and a color mode.

11. The image sensor of claim 6, wherein an activity indicator driver external to the image sensor is connected to the flow indicator pin and the computation indicator pin, and wherein the activity indicator driver drives an activity indicator. 12 . The image sensor of claim 11 , wherein an operating mode of the activity indicator comprises a constant-on mode and a pulse mode.

13. An image sensor comprising: an input / output port for receiving commands from outside the image sensor; a control block for receiving the command from the input / output port and generating a calculation enable signal; a calculation block, configured to receive the calculation enable signal from the control block; a pixel array for providing a video signal to the computing block; wherein the calculation block performs calculation on the video signal provided by the pixel array to generate a calculation result; wherein the control block receives the calculation result from the calculation block and transmits the calculation result to the input / output port; wherein the input / output port receives the calculation result from the control block and outputs the calculation result to the outside of the image sensor; a compute indicator pin for receiving the compute enable signal from the control block when the compute block is receiving the compute enable signal from the control block; wherein the terminal of the calculation block receiving the calculation enable signal is connected to the calculation indicator pin via a conductor, so that the calculation indicator connected to the calculation indicator pin is completely controlled by the video signal; and The calculation block, the calculation indicator pin, and the conductor connecting the terminal of the calculation block and the calculation indicator pin are sealed in a package of the image sensor. 14 . The image sensor according to claim 13 , wherein the input / output port receives the command from an application processor located outside the image sensor and outputs the calculation result to the application processor located outside the image sensor.

15. The image sensor of claim 13, wherein the calculation indicator located outside the image sensor is connected to the calculation indicator pin. 16 . The image sensor according to claim 15 , wherein an operation mode of the calculation indicator comprises a constant-on mode, a pulse mode, and a color mode.

17. A method for indicating that a video stream is being output from a camera system, comprising: generating a video interface enable signal via a control block; providing the generated video interface enable signal to a video interface; providing the video stream to the video interface via a pixel array; providing the video stream received by the video interface to an output port when the video interface receives the video interface enable signal; wherein the image sensor includes the control block, the video interface, the pixel array, and the output port, and the camera system includes the image sensor; outputting the video stream to outside of the image sensor through the output port; providing the generated video interface enable signal to a stream indicator pin when the generated video interface enable signal is provided to the video interface; connecting a terminal of the video interface that receives the video interface enable signal to the stream indicator pin via a conductor, so that the stream indicator connected to the stream indicator pin is completely controlled by the video stream; as well as A package is encapsulated that includes the video interface, the flow indicator pins, and the conductors connecting the terminals of the video interface to the flow indicator pins.

18. The method according to claim 17, further comprising: The stream indicator is connected to the stream indicator pin, wherein the stream indicator is turned on when the video stream is output from the image sensor of the camera system.

19. The method according to claim 17, further comprising: generating a calculation enable signal by the control block; providing the generated calculation enable signal to a calculation block; providing a video signal to the computing block via the pixel array; When the calculation block receives the calculation enable signal, the video signal is calculated by the calculation block to generate a calculation result; providing the calculation result to the control block; delivering the calculation result from the control block to an input / output port; wherein the image sensor further comprises the computing block and the input / output port; outputting the calculation result to the outside of the image sensor through the input / output port; When the generated calculation enable signal is provided to the calculation block, providing the generated calculation enable signal to a calculation indicator pin; as well as connecting a terminal of the calculation block receiving the calculation enable signal to the calculation indicator pin through a conductor; The sealed package of the image sensor further includes the calculation block, the calculation indicator pin, and the conductor connecting the terminal of the calculation block to the calculation indicator pin.

20. The method according to claim 19, further comprising: A calculation indicator is connected to the calculation indicator pin, wherein the calculation indicator is turned on when the calculation block is calculating the video signal.

21. The method of claim 19, wherein the video signal is the video stream.

22. The method of claim 19, further comprising: An activity indicator driver is connected to the flow indicator pin and the compute indicator pin, wherein the activity indicator driver drives an activity indicator.

Images