Face focusing method, device and terminal equipment

Abstract

The application provides a face focusing method, device and terminal equipment. The method is applied to the terminal equipment and comprises the following steps: acquiring an image collected by a camera in a video communication, wherein the camera is in a short-focus mode; judging whether there is face information in the image; if there is face information in the image, switching the camera from the short-focus mode to a long-focus mode; judging whether a viewer is in a long-focus shooting area after the switching; and selecting optical zoom or digital zoom according to the judgment result. The application can improve the display effect in the video communication.

Description

Technical Field

[0001] This invention relates to the field of video communication technology, and in particular to a face focusing method, apparatus and terminal equipment. Background Technology

[0002] Currently, with the increasingly widespread use of smart terminal devices and the growing demands of users, the functions of some smart terminal devices (such as smart TVs) are becoming more and more powerful. Many smart terminal devices can now support camera and AI (artificial intelligence) recognition functions. At the same time, with the popularization of online conferencing and online teaching, the demand for video communication using smart terminal devices is also constantly increasing. However, most current video communication tools are based on mobile phone scenarios. In mobile phone scenarios, there is usually only one user, and they are relatively close to the screen. However, when using large-screen displays such as smart TVs for video communication, there are usually multiple viewers, and the viewing distance is much greater. As a result, the user images displayed during video communication are very small, faces are unclear, and the display effect of video communication is poor. Summary of the Invention

[0003] The face focusing method, apparatus, and terminal equipment provided by this invention can improve the display effect during video communication.

[0004] In a first aspect, the present invention provides a face focusing method, the method being applied to a terminal device, the method comprising:

[0005] During video communication, images captured by a camera are obtained, wherein the camera is in short-focus mode;

[0006] Determine whether there is facial information in the image;

[0007] If there is facial information in the image, the camera will be switched from short-focus mode to long-focus mode;

[0008] Determine whether the viewer is within the telephoto shooting area after the switch;

[0009] Choose between optical zoom or digital zoom based on the assessment results.

[0010] Optionally, the method further includes:

[0011] If there is no facial information in the image, then capture the entire image that has been acquired.

[0012] Optionally, the step of selecting optical zoom or digital zoom based on the judgment result includes:

[0013] If the viewer is within the switched telephoto shooting area and chooses to perform optical zoom;

[0014] If the viewer is not within the telephoto shooting area after switching, select digital zoom.

[0015] Optionally, after selecting optical zoom or digital zoom based on the determination result, the method further includes:

[0016] The zoomed image is cropped based on the zoom level selected by the user.

[0017] Secondly, the present invention provides a face focusing device, the device being located in a terminal device, the device comprising:

[0018] An acquisition unit is used to acquire images captured by a camera during video communication, wherein the camera is in short-focus mode;

[0019] The first judgment unit is used to determine whether there is facial information in the image;

[0020] The switching unit is used to switch the camera from short-focus mode to long-focus mode when there is facial information in the image;

[0021] The second judgment unit is used to determine whether the viewer is within the telephoto shooting area after switching;

[0022] The processing unit is used to select between optical zoom and digital zoom based on the judgment result.

[0023] Optionally, the device further includes:

[0024] The capturing unit is used to capture the entire currently acquired image when there is no facial information in the image.

[0025] Optionally, the processing unit includes:

[0026] The first processing module is used to select optical zoom when the viewer is within the switched telephoto shooting area;

[0027] The second processing module is used to select digital zoom when the viewer is not in the switched telephoto shooting area.

[0028] Optionally, the device further includes:

[0029] The cropping unit is used to crop the zoomed image according to the scene size selected by the user after the processing unit selects optical zoom or digital zoom based on the judgment result.

[0030] Thirdly, the present invention provides a terminal device, the terminal device comprising:

[0031] At least one processor; and

[0032] A memory communicatively connected to the at least one processor; wherein,

[0033] The memory stores instructions that can be executed by the at least one processor, which, when executed by the at least one processor, enables the at least one processor to perform the aforementioned face focusing method.

[0034] Fourthly, the present invention provides a chip, the chip comprising:

[0035] At least one processor; and

[0036] A memory communicatively connected to the at least one processor; wherein,

[0037] The memory stores instructions that can be executed by the at least one processor, which, when executed by the at least one processor, enables the at least one processor to perform the aforementioned face focusing method.

[0038] Fifthly, the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions that, when executed by a processor, implement the above-described face focusing method.

[0039] The face focusing method, apparatus, and terminal device provided in this invention can automatically zoom based on the position of the viewer in the image when there are multiple viewers, the viewer is far away from the camera, and the viewer is moving, in order to obtain an accurate and effective image, thereby improving the display effect of video communication. Attached Figure Description

[0040] Figure 1 This is a flowchart of a face focusing method according to an embodiment of the present invention;

[0041] Figure 2 This is a flowchart of another embodiment of the face focusing method of the present invention;

[0042] Figure 3 This is a schematic diagram illustrating the shooting range of the camera in short-focus mode and long-focus mode according to an embodiment of the present invention;

[0043] Figure 4 This is a schematic diagram of the structure of a face focusing device according to an embodiment of the present invention;

[0044] Figure 5 This is a schematic diagram of the structure of a face focusing device according to another embodiment of the present invention;

[0045] Figure 6 This is a schematic diagram of the structure of a face focusing device according to another embodiment of the present invention;

[0046] Figure 7 This is a schematic diagram of the structure of a face focusing device according to another embodiment of the present invention. Detailed Implementation

[0047] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0048] This invention provides a face focusing method, which is applied to a terminal device, such as... Figure 1 As shown, the method includes:

[0049] S11. During video communication, acquire images captured by a camera, wherein the camera is in short-focus mode.

[0050] S12. Determine whether there is facial information in the image.

[0051] S13. If there is facial information in the image, switch the camera from short-focus mode to long-focus mode.

[0052] S14. Determine whether the viewer is within the telephoto shooting area after switching.

[0053] S15. Based on the judgment result, choose to perform optical zoom or digital zoom.

[0054] The face focusing method provided in this embodiment of the invention can automatically zoom based on the position of the viewer in the image when there are multiple viewers in the video communication process, the viewers are far away from the camera and are moving, and choose to perform optical zoom or digital zoom to obtain an accurate and effective image, thereby improving the display effect of video communication.

[0055] The face focusing method of the present invention will be described in detail below with reference to specific embodiments.

[0056] like Figure 2 As shown, the face focusing method provided in this embodiment of the invention includes:

[0057] S21. During video communication, the terminal device acquires images captured by the camera.

[0058] S22. Determine whether there is facial information in the image. If there is facial information, proceed to step S23; otherwise, proceed to step S28.

[0059] During video communication, the terminal device's camera defaults to short-focus mode, which has a relatively large shooting range and can cover part of the front of the display screen, ensuring that the viewer is within the camera's frame. At this time, a face scan can be performed first to determine if a face is present in the captured image.

[0060] S23. Switch the camera from short-focus mode to long-focus mode.

[0061] S24. Determine if the viewer is in the telephoto shooting area. If so, proceed to step S25; otherwise, proceed to step S26.

[0062] Once the terminal device recognizes facial and human body information in an image, it will provide the range of key feature points for the face and body. The range of the face is a rectangle encompassing the coordinate points in the image. The range of the body is also a rectangle, encompassing the area containing all the body's limbs.

[0063] The camera can identify whether a viewer is within the telephoto shooting area based on the range of their face and body. This is because the shooting range decreases when the camera switches from short-focus to telephoto mode. Figure 3 As shown. If the viewer is in the telephoto shooting area, optical zoom is triggered; if the viewer is not in the telephoto shooting area, digital zoom is triggered.

[0064] S25. Trigger optical zoom and execute step S27.

[0065] Optical zoom is achieved by changing the positions of the lens, the object, and the focal point. When the imaging plane moves horizontally, the angle of view and focal length change, making distant objects appear sharper and creating the illusion of objects moving closer.

[0066] If the image is found to be smaller than the target range, or the target image cannot be found, shorten the focal length, expand the image range, and perform the next search until a suitable image range is reached.

[0067] S26. Trigger digital zoom and execute step S27.

[0068] Unlike optical zoom, digital zoom creates the zoom effect by changing the vertical direction of the image sensor. The smaller the area on the sensor, the more the user sees only a portion of the scene. However, because the focal length remains unchanged, the image quality is lower compared to optical zoom.

[0069] If the target is outside the shooting area of ​​the optical zoom, such as Figure 3 As shown, in the image edge area, digital zoom is directly triggered to crop the corresponding area from the image and return the image.

[0070] S27. Crop the zoomed image according to the zoom level selected by the user.

[0071] During optical zoom, the camera tracks the target image to determine the appropriate focus. After focusing, face and body recognition is performed again. If the face and body areas are still too small, the zoomed image is cropped to a suitable size based on the framing selected by the user at the other end of the video communication. Users can choose from the following framing options:

[0072] Distant view: An image that includes the user's entire body;

[0073] Mid-range shot: An image containing half of the user's body;

[0074] Close-up: An image that includes the user's face.

[0075] S28. The terminal device captures the entire original image it has acquired and provides it to the video communication peer.

[0076] If no facial information is detected in the image captured by the camera, it may be because the viewer is not in the frame or is difficult to identify. In this case, the terminal device captures the original image and provides it to the other end of the video communication to ensure that the viewer information can be correctly fed back.

[0077] The automatic zoom process in steps S23-S27 is repeated periodically to ensure that the subject remains within the image area. If the subject has moved out of the camera's field of view, the entire captured image is displayed.

[0078] The face focusing method provided in this embodiment of the invention can automatically zoom based on the position of the viewer in the image when there are multiple viewers in the video communication process, the viewers are far away from the camera and are moving, and choose to perform optical zoom or digital zoom to obtain an accurate and effective image, thereby improving the display effect of video communication.

[0079] This invention also provides a face focusing device, which is located in a terminal device, such as... Figure 4 As shown, the device includes:

[0080] The acquisition unit 11 is used to acquire images captured by a camera during video communication, wherein the camera is in short-focus mode;

[0081] The first judgment unit 12 is used to determine whether there is facial information in the image;

[0082] The switching unit 13 is used to switch the camera from short-focus mode to long-focus mode when there is facial information in the image;

[0083] The second judgment unit 14 is used to determine whether the viewer is within the telephoto shooting area after switching.

[0084] The processing unit 15 is used to select optical zoom or digital zoom based on the judgment result.

[0085] The face focusing device provided in this embodiment of the invention can automatically zoom according to the position of the viewer in the image when there are multiple viewers in the video communication process, the viewer is far away from the camera and is moving, and can choose to perform optical zoom or digital zoom to obtain an accurate and effective image, thereby improving the display effect of video communication.

[0086] Optionally, such as Figure 5 As shown, the device further includes:

[0087] The shooting unit 16 is used to capture the entire currently acquired image when there is no facial information in the image.

[0088] Optionally, such as Figure 6 As shown, the processing unit 15 includes:

[0089] The first processing module 151 is used to select optical zoom when the viewer is in the switched telephoto shooting area;

[0090] The second processing module 152 is used to select digital zoom when the viewer is not in the switched telephoto shooting area.

[0091] Optionally, such as Figure 7 As shown, the device further includes:

[0092] The cropping unit 17 is used to crop the zoomed image according to the field size selected by the user after the processing unit 15 selects optical zoom or digital zoom based on the judgment result.

[0093] The apparatus in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0094] This invention also provides a terminal device, the terminal device comprising:

[0095] At least one processor; and

[0096] A memory communicatively connected to the at least one processor; wherein,

[0097] The memory stores instructions that can be executed by the at least one processor, which, when executed by the at least one processor, enables the at least one processor to perform the aforementioned face focusing method.

[0098] This invention also provides a chip, the chip comprising:

[0099] At least one processor; and

[0100] A memory communicatively connected to the at least one processor; wherein,

[0101] The memory stores instructions that can be executed by the at least one processor, which, when executed by the at least one processor, enables the at least one processor to perform the aforementioned face focusing method.

[0102] This invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, which, when executed by a processor, implement the above-described face focusing method.

[0103] This invention is applicable to situations where multiple viewers are present, the viewers are far from the camera, and they are moving when using terminal devices for video communication. This invention enables automatic zooming to focus on the viewers for video communication, thereby improving the display effect of the video communication.

[0104] In this embodiment of the invention, the terminal device may be a smart display device such as a smart TV, smart monitor, smart projector, or smart conferencing equipment, but is not limited to these.

[0105] Those skilled in the art will understand that all or part of the processes in the above method embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0106] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A face focusing method, the method being applied to a terminal device, characterized in that, The method includes: During video communication, images captured by a camera are obtained, wherein the camera is in short-focus mode; Determine whether there is facial information in the image; If there is facial information in the image, the camera will be switched from short-focus mode to long-focus mode; Determine whether the viewer is within the telephoto shooting area after the switch; Choose between optical zoom or digital zoom based on the assessment result; The step of selecting optical zoom or digital zoom based on the judgment result includes: If the viewer is within the switched telephoto shooting area and chooses to perform optical zoom; If the viewer is not within the telephoto shooting area after switching, select digital zoom.

2. The method according to claim 1, characterized in that, The method further includes: If there is no facial information in the image, then capture the entire image that has been acquired.

3. The method according to claim 1, characterized in that, After selecting between optical zoom and digital zoom based on the judgment result, the method further includes: The zoomed image is cropped based on the zoom level selected by the user.

4. A face focusing device, the device being located in a terminal device, characterized in that, The device includes: An acquisition unit is used to acquire images captured by a camera during video communication, wherein the camera is in short-focus mode; The first judgment unit is used to determine whether there is facial information in the image; The switching unit is used to switch the camera from short-focus mode to long-focus mode when there is facial information in the image; The second judgment unit is used to determine whether the viewer is within the telephoto shooting area after switching; The processing unit is used to select between optical zoom and digital zoom based on the judgment result; The processing unit includes: The first processing module is used to select optical zoom when the viewer is within the switched telephoto shooting area; The second processing module is used to select digital zoom when the viewer is not in the telephoto shooting area after switching.

5. The apparatus according to claim 4, characterized in that, The device further includes: The shooting unit is used to capture the entire currently acquired image when there is no facial information in the image.

6. The apparatus according to claim 4, characterized in that, The device further includes: The cropping unit is used to crop the zoomed image according to the scene size selected by the user after the processing unit selects optical zoom or digital zoom based on the judgment result.

7. A terminal device, characterized in that, The terminal device includes: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1 to 3.

8. A chip, characterized in that, The chip includes: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1 to 3.

9. A computer-readable storage medium, wherein, The computer-readable storage medium stores computer instructions that, when executed by a processor, implement the method as described in any one of claims 1 to 3.

Images