[0036] Here, exemplary embodiments will be described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with the present disclosure. Rather, they are only examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.
[0037] figure 1 It is a flowchart showing a method for video supplement light according to an exemplary embodiment. The video fill light method can be applied to smart devices. For example, the smart device may be a terminal with a video chat function, such as a mobile phone, a tablet computer, a PC, a notebook computer, etc. The video fill light method may include the following steps:
[0038] In step 101, when a smart device is used for a video chat, it is determined whether it is necessary to fill in the light of the camera of the smart device.
[0039] During a video chat, if the environment of the local user is relatively dim, for example, in a low-light environment such as night or cloudy, the image quality of the local user’s image will be poor. This is mainly because the image used to capture the local user’s image The camera cannot collect enough light. To this end, the present disclosure provides a solution for video supplement light through the display screen of a smart device without using an external light source. As an example, the camera in the present disclosure may be a front camera of a smart device.
[0040] When the local user conducts a video chat through a smart device, relevant information can be collected, and based on the collected information, it can be judged whether it is necessary to use the solution of the present disclosure to fill light. For example, the present disclosure can at least use the following two example solutions to determine whether it is necessary to supplement light for the camera of the smart device.
[0041] Example Solution 1: Obtain the light intensity of the environment where the local user is located, and determine whether the light intensity is lower than the preset light intensity; if the light intensity is lower than the preset light intensity, it is determined that the camera needs to be Perform fill light.
[0042] In this example, the related information reflects the light intensity of the environment where the end user is located. Understandably, after the local user starts the video chat function, the smart device can automatically obtain the light intensity of the current environment, for example, the light intensity can be collected through the light sensor of the smart device.
[0043] If the acquired light intensity is lower than the preset light intensity, it can be determined that the camera needs to be filled with light to ensure that the camera can collect enough light, thereby improving the image quality of the local user image captured and presented by the camera. Optionally, if the acquired light intensity is not lower than the preset light intensity, it can be determined that the camera does not need to be filled with light, that is, the light currently collected by the camera can guarantee the image quality of the local user's image.
[0044] As an example, it is possible to pre-calculate the requirements of most users for the user's image quality during a video call, and determine the preset light intensity that matches the requirements, and configure it in the smart device in the form of a default value. Or, when the user is in a video call, the user may be asked about the image quality requirements, and a suitable preset light intensity may be determined for the user according to the user's requirements. Furthermore, the preset light intensity can be set in combination with the above two examples. For example, on the basis of the default value, the user can adjust the default value to the preset light intensity that matches his own use requirements according to his own use requirements. The present disclosure does not limit the way of setting the preset light intensity.
[0045] Example solution 2: Obtain the picture quality of the image of the local user, and determine whether the picture quality is lower than the preset picture quality; if the picture quality is lower than the preset picture quality, it is determined that the camera needs to be Perform fill light.
[0046] In this example, the related information reflects the picture quality of the image of the end user. Understandably, after the local user starts the video chat function, the smart device can automatically obtain the picture quality of the current image.
[0047] If the obtained picture quality is lower than the preset picture quality, it can be determined that the camera needs to be filled with light to ensure that the camera can collect enough light, thereby improving the picture quality of the local user image collected and presented by the camera. Optionally, if the acquired picture quality is not lower than the preset picture quality, it may be determined that the camera does not need to be supplemented with light.
[0048] Similar to the solution for setting the preset light intensity above, when setting the preset image quality, most users' requirements for image quality can be determined as the preset image quality and configured in the smart device in the form of default values; Alternatively, the user’s own requirements for image quality can be determined as the preset image quality; in addition, the above two examples can also be combined, and the user can adjust the default value to match the user’s own requirements based on the default value. Use preset quality that matches the requirements. The present disclosure also does not limit the way of setting the preset image quality.
[0049] In step 102, if it is determined that the camera needs to be supplemented with light, a supplemental light area and an image area are determined on the display screen of the smart device, and the supplemental light area is used to supplement the light of the camera, The image area is used to display the image of the local user and the image of the peer user, and the brightness of the supplementary light area is higher than the brightness of the image area.
[0050] When it is determined in step 101 that the camera needs to be supplemented with light, two areas can be divided from the display screen, one is the supplemental light area for supplementing the light of the camera, and the other is the image area for displaying user images. Among them, in order to achieve the effect of supplement light, the brightness of the supplement light area should be higher than the brightness of the image area.
[0051] Understandably, if the environment of the local user is relatively dim when the video chat function is activated, when the video chat is started using the solution of the present disclosure, the display screen will include the fill light area and the image area. If the environment becomes dim during a video chat, for example, during a video chat at night, from a room with lights on to a room without lights, when the video chat starts, that is, when the local user is in the room with lights on, The display screen includes the image area, but when it is determined that the camera needs to be filled with light, that is, when the local user enters a room without lights, the display screen can be switched to include the fill light area and the image area.
[0052] As an example, the fill light area and the image area can be determined from the display screen by the following scheme: the original image area on the display screen is reduced to obtain the image area, and the display screen is divided by The area outside the image area is determined as the supplemental light area.
[0053] figure 2 It is a schematic diagram showing the switching of the display screen when the smart device performs video fill light according to an exemplary embodiment. Understandably, when supplementary light is needed, the original image area 201 on the display screen can be reduced, for example, the original image area can be reduced according to the display screen, and the remaining area of the display screen can be filled with bright colors. form figure 2 The image area 202 and the light supplement area 203 are shown, and the brightness of the light supplement area is higher than the brightness of the image area.
[0054] In summary, when the local user makes a video call, you can first determine whether the current environment of the local user will affect the image quality of the local user’s image, that is, whether the camera needs to be supplemented with light, and if it is determined that the camera needs to be supplemented Light, you can divide the display screen of the smart device into a light supplement area and an image area, and appropriately increase the brightness of the light supplement area to make the light supplement area play a role in lighting, so as to ensure that the camera can collect enough light to improve video calls The image quality of the local user image presented during the process.
[0055] In a possible implementation manner, in order to improve the flexibility of the solution of the present disclosure, a shape adjustment instruction may be obtained, and the shape and/or position of the supplementary light area may be adjusted according to the shape adjustment instruction. That is to say, the local user can adjust the shape and/or position of the light supplement area through the shape adjustment command according to their actual use needs, so as to realize the personalized light supplement for the camera, which not only improves the flexibility of the disclosed solution, but also combines The actual situation of supplementing light also helps to improve the supplementary light effect of the solution of the present disclosure.
[0056] As an example, when the solution of the present disclosure is used to supplement light, the operation action of the local user can be monitored, and the shape and/or position of the supplement light area can be adjusted according to the operation action.
[0057] Example scheme one, the smart device saves the preset shape of the light supplement area. Corresponding to this, the operation action can be the local user click on the display screen, and the shape adjustment command can select a suitable shape from the preset shapes for the local user .
[0058] Optionally, a dedicated shape adjustment button can be set on the display screen, and when the local user clicks the shape adjustment button, the preset shape is shown to the local user for the local user to select a suitable shape. Or, when the local user clicks on the display, a series of function buttons can be called up. For example, the function buttons can be shape adjustment buttons, brightness adjustment buttons, color adjustment buttons, etc., and when the local user clicks the shape adjustment buttons To show the preset shape to the local user.
[0059] Example solution 2: The operation action may be a dragging action of the local user, and the shape adjustment instruction may be an instruction formed after recognizing the gesture action of the local user to the fill light area.
[0060] Optionally, the gesture action may be a position adjustment action, for example, drag the fill light area from the first position of the display screen to the second position. image 3 It is a schematic diagram showing the adjustment of the position of the light supplement area according to an exemplary embodiment. Among them, the first position is below the display screen, and the second position is above the display screen. By dragging, the local user can adjust the fill light area 301 from the bottom of the display to the top of the display. image 3 As shown, the image area 302 may change with the adjustment of the supplemental light area 301. Alternatively, the gesture action may also be a zooming action, for example, an operation of zooming in on the fill light area to increase the space occupied by the fill light area, which helps to increase the intensity of light collected by the camera.
[0061] Example solution 3: The operation action can change the state of the display screen for the end user. For example, the display screen state can be a horizontal screen state or a vertical screen state, and the shape adjustment instruction can be detecting that the display screen is adjusted to a horizontal screen state.
[0062] Optionally, when it is detected that the display screen is in a landscape state, the position of the light supplement area can be adjusted so that the light supplement area is located at the end of the display screen close to the camera. Figure 4 It is a schematic diagram showing the adjustment of the position of the light supplement area according to an exemplary embodiment. When the local user adjusts the smart device from the vertical screen state to the horizontal screen state, the fill light area 401 is adjusted from the bottom of the display to the left of the display, and Figure 4 As shown, the image area 402 may change with the adjustment of the supplementary light area 401. Keeping the fill light area as close as possible to the position of the camera helps the camera collect light from the fill light area and improve the image quality of the local user's image.
[0063] The solution of the present disclosure may not limit the shape adjustment solution of the supplemental light area.
[0064] In a possible implementation manner, in order to improve the flexibility of the solution of the present disclosure, a brightness adjustment instruction may be obtained, and the brightness of the supplementary light area may be adjusted according to the brightness adjustment instruction. That is to say, the local user can adjust the brightness of the supplementary light area through the brightness adjustment command according to their actual use needs, so as to realize the personalized supplementary light for the camera, which not only improves the flexibility of the solution of the present disclosure, but also supplements the actual situation. Light also helps to improve the light supplement effect of the disclosed solution.
[0065] As an example, when the solution of the present disclosure is used to supplement light, the operation action of the local user can be monitored, and the brightness of the supplement light area can be adjusted according to the operation action. For example, the operation action may be the local user click on the display screen, and the brightness adjustment instruction may be an instruction generated after obtaining the brightness value input by the local user.
[0066] Optionally, a dedicated brightness adjustment button can be set on the display screen, and when the local user clicks the brightness adjustment button, the brightness adjustment progress bar is called up, and the local user inputs the brightness value by dragging the progress bar. Alternatively, when the local user clicks the brightness adjustment button, the brightness adjustment input box can be called up, and the local user can enter the brightness value in the input box.
[0067] Optionally, when the local user clicks on the display, a series of function buttons can be called up. For example, the function buttons can be shape adjustment buttons, brightness adjustment buttons, color adjustment buttons, etc., and the local user clicks brightness adjustment When the key is pressed, the brightness adjustment progress bar or the brightness adjustment input box is called to obtain the brightness value input by the local user.
[0068] The solution of the present disclosure does not limit the brightness adjustment solution of the supplemental light area.
[0069] In a possible implementation manner, in order to improve the flexibility of the solution of the present disclosure, a color adjustment instruction may be obtained, and the color of the supplementary light area may be adjusted according to the color adjustment instruction. That is to say, the local user can adjust the color of the supplementary light area through color adjustment instructions according to their actual use needs, so as to realize the personalized supplementary light for the camera, which not only improves the flexibility of the solution of the present disclosure, but also supplements the actual situation. Light also helps to improve the light supplement effect of the disclosed solution.
[0070] As an example, when the solution of the present disclosure is used to supplement light, the operation action of the local user can be monitored, and the color of the supplement light area can be adjusted according to the operation action. For example, the smart device saves the preset color of the fill light area, the operation action can be the local user click on the display screen, and the color adjustment instruction can select an appropriate color from the preset color for the local user.
[0071] Optionally, a dedicated color adjustment button can be set on the display screen, and when the local user clicks the color adjustment button, the preset color is shown to the local user for the local user to select a suitable color. Or, when the local user clicks on the display, a series of function buttons can be called up. For example, the function buttons can be shape adjustment buttons, brightness adjustment buttons, color adjustment buttons, etc., and when the local user clicks the color adjustment buttons To show the preset color to the local user.
[0072] For example, the preset color may be a solid color, such as white, yellow, etc.; or, the preset color may also include background shading, which is not limited in the solution of the present disclosure.
[0073] Optionally, a switching period can be set, and the preset colors can be switched according to the switching period to achieve a colorful effect. Or, when the local user plays music through the smart device, he can also grab the rhythm of the played music, and switch between various preset colors according to the rhythm, which can also achieve a colorful effect.
[0074] The solution of the present disclosure may not limit the color adjustment solution of the supplemental light area.
[0075] Figure 5 It is a block diagram showing a video supplement light device according to an exemplary embodiment. Reference Figure 5 The device 500 may include a supplementary light judging unit 501 and an area determining unit 502.
[0076] The supplemental light judging unit 501 may be configured to determine whether it is necessary to supplement light for the camera of the smart device when the smart device is used for video chat;
[0077] The area determining unit 502 may be configured to determine a supplemental light area and an image area on the display screen of the smart device when the supplemental light determining unit determines that the camera needs to be supplemented with light. The area is used to fill the camera with light, the image area is used to display the image of the local user and the image of the opposite user, and the brightness of the fill light area is higher than the brightness of the image area.
[0078] In summary, when the light supplement judging unit 501 determines that the camera of the smart device needs to be supplemented, the area determining unit 502 can determine two areas in the display screen of the smart device. One is used to supplement the camera. The fill light area of the light is an image area that normally displays user images during a video call. In this way, the image quality of the local user's image can be effectively improved without affecting the video call. In addition, in order to achieve the purpose of supplementing light for the camera in the solution of the present disclosure, the brightness of the supplemental light area is higher than that of the image area.
[0079] In a possible implementation manner, the supplemental light judging unit 501 includes:
[0080] The light intensity obtaining unit may be configured to obtain the light intensity of the environment where the local user is located;
[0081] The light intensity determining unit may be configured to determine whether the light intensity is lower than a preset light intensity, and if the light intensity is lower than the preset light intensity, it is determined that the camera needs to be supplemented with light.
[0082] In a possible implementation manner, the supplemental light judging unit 501 includes:
[0083] The image quality obtaining unit may be configured to obtain the image quality of the image of the local user;
[0084] The image quality determining unit may be configured to determine whether the image quality is lower than a preset image quality, and if the image quality is lower than the preset image quality, it is determined that the camera needs to be supplemented with light.
[0085] In a possible implementation manner, the area determining unit 502 may be configured to reduce the original image area on the display screen to obtain the image area, and remove the image area from the display screen. The area outside is determined as the supplementary light area.
[0086] In a possible implementation manner, the device 500 further includes at least one of a shape adjustment unit, a brightness adjustment unit, and a color adjustment unit.
[0087] The shape adjustment unit may be configured to obtain a shape adjustment instruction, and adjust the shape and/or position of the supplementary light area according to the shape adjustment instruction;
[0088] The brightness adjustment unit may be configured to obtain a brightness adjustment instruction, and adjust the brightness of the supplemental light area according to the brightness adjustment instruction;
[0089] The color adjustment unit may be configured to obtain a color adjustment instruction, and adjust the color of the supplemental light area according to the color adjustment instruction.
[0090] Regarding the device in the foregoing embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment of the method, and detailed description will not be given here.
[0091] Image 6 It is a block diagram showing a video light supplement device 600 according to an exemplary embodiment. For example, the device 600 may be a mobile phone, a computer, a digital broadcasting terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
[0092] Reference Image 6 , The device 600 may include one or more of the following components: a processing component 602, a memory 604, a power component 606, a multimedia component 608, an audio component 610, an input/output (I/O) interface 612, a sensor component 614, and a communication component 616.
[0093] The processing component 602 generally controls the overall operations of the device 600, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 602 may include one or more processors 620 to execute instructions to complete all or part of the steps of the foregoing image processing method. In addition, the processing component 602 may include one or more modules to facilitate the interaction between the processing component 602 and other components. For example, the processing component 602 may include a multimedia module to facilitate the interaction between the multimedia component 606 and the processing component 602.
[0094] The memory 604 is configured to store various types of data to support the operation of the device 600. Examples of such data include instructions for any application or method operating on the device 600, contact data, phone book data, messages, pictures, videos, etc. The memory 604 can be implemented by any type of volatile or nonvolatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable and Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic Disk or Optical Disk.
[0095] The power component 606 provides power to various components of the device 600. The power component 606 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 600.
[0096] The multimedia component 608 includes a screen that provides an output interface between the device 600 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure related to the touch or slide operation. In some embodiments, the multimedia component 608 includes a front camera and/or a rear camera. When the device 600 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.
[0097] The audio component 610 is configured to output and/or input audio signals. For example, the audio component 610 includes a microphone (MIC), and when the device 600 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive external audio signals. The received audio signal can be further stored in the memory 604 or sent via the communication component 616. In some embodiments, the audio component 610 further includes a speaker for outputting audio signals.
[0098] The I/O interface 612 provides an interface between the processing component 602 and a peripheral interface module. The above-mentioned peripheral interface module may be a keyboard, a click wheel, a button, and the like. These buttons may include but are not limited to: home button, volume button, start button, and lock button.
[0099] The sensor component 614 includes one or more sensors for providing the device 600 with various aspects of status assessment. For example, the sensor component 614 can detect the open/close state of the device 600 and the relative positioning of components. For example, the component is the display and the keypad of the device 600. The sensor component 614 can also detect the position change of the device 600 or a component of the device 600. , The presence or absence of contact between the user and the device 600, the orientation or acceleration/deceleration of the device 600, and the temperature change of the device 600. The sensor component 614 may include a proximity sensor configured to detect the presence of nearby objects when there is no physical contact. The sensor component 614 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 614 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.
[0100] The communication component 616 is configured to facilitate wired or wireless communication between the apparatus 600 and other devices. The device 600 can access a wireless network based on a communication standard, such as WiFi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 616 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 616 further includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
[0101] In an exemplary embodiment, the apparatus 600 may be implemented by one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing equipment (DSPD), programmable logic devices (PLD), field programmable Implemented by a gate array (FPGA), controller, microcontroller, microprocessor, or other electronic components, used to execute the above-mentioned image processing method.
[0102] In an exemplary embodiment, there is also provided a non-transitory computer-readable storage medium including instructions, such as the memory 604 including instructions, which may be executed by the processor 620 of the device 600 to complete the image processing method described above. For example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
[0103] Those skilled in the art will easily think of other embodiments of the present disclosure after considering the specification and practicing the present disclosure. This application is intended to cover any variations, uses, or adaptive changes of the present disclosure. These variations, uses, or adaptive changes follow the general principles of the present disclosure and include common knowledge or conventional technical means in the technical field not disclosed in the present disclosure. . The description and the embodiments are only regarded as exemplary, and the true scope and spirit of the present disclosure are pointed out by the following claims.
[0104] It should be understood that the present disclosure is not limited to the precise structure that has been described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.
