Implementation method based on front camera module of full-screen electronic equipment and electronic equipment
Through prism flip and free curved lens translation technology, the optical path system of the full-screen mobile phone is transformed into two independent systems, solving the contradiction between the photography function and the display function of the full-screen mobile phone, realizing time-sharing photography and display, and improving user experience and efficiency.
Patent Information
- Application Number
- CN202510413285.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-04-01
- Publication Date
- 2025-07-29
AI Technical Summary
It is difficult for existing full-screen mobile phones to achieve a true full-screen experience without sacrificing photography functions, and display and imaging functions are usually difficult to complete at the same time through the same optical system.
Through the prism flip and the left and right translation technology of free-curved lenses, a single optical path system is transformed into two independent systems to realize the time-sharing photography and display functions.
Without affecting the photography function, the real full-screen experience of a full-screen mobile phone is achieved, improving the user's interactive experience and photography efficiency.
Smart Images

Figure CN120390139A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of electronic communication technologies, and particularly to a method for implementing a front camera module of a full-screen electronic device and an electronic device. Background Art
[0002] With the wide popularization of full-screen smartphones, almost every new mobile phone in people's hands now is equipped with a full-screen design. This design not only enhances the aesthetic appearance of the mobile phone but also provides users with a broader field of view and a more immersive visual experience. At the same time, users are particularly averse to the notch design on full-screen mobile phones, and they urgently hope to enjoy the visual experience brought by a truly full screen, rather than being disturbed by the notch on the screen.
[0003] Therefore, in order to improve the user experience of full-screen mobile phones, this article has carried out innovative transformation and optimization on the basis of the traditional mobile phone camera optical path. We are committed to developing a new type of camera technology that can achieve a truly full-screen experience without sacrificing the mobile phone's photography function. Our goal is to ensure that the mobile phone's photography function is retained while maximizing the display area of the screen, thereby providing users with a borderless visual enjoyment. Through unremitting efforts and continuous technological exploration, we believe that in the near future, users will be able to enjoy a more perfect full-screen mobile phone and experience the infinite possibilities brought by technology.
[0004] Normally, the display and imaging functions are achieved through the same set of optical path systems, which is technically difficult to complete simultaneously within the same set of systems. However, the present invention ingeniously transforms the original single optical path system into two independent systems through the flipping of a prism and the left-right translation technology of a free-form surface lens. This innovation enables the mobile phone to achieve the functions of time-sharing photography and display, that is, at different time points, the system can be used for photography or display respectively, thereby providing users with a more pure and complete full-screen experience without sacrificing the photography function. Summary of the Invention
[0005] Aiming at the deficiencies of the prior art, the present invention discloses a method for implementing a front camera module of a full-screen electronic device and an electronic device to solve the above problems.
[0006] The present invention is achieved through the following technical solutions:
[0007] In a first aspect, the present invention provides a method for implementing a front camera module of a full-screen electronic device, including the following steps:
[0008] Initialization, sending a front camera shooting instruction to the central processing system through an application program;
[0009] The actuator is used to control the translation of the free-form lens to the focusing end and the flipping of the prism to the image sensor end;
[0010] The front camera starts taking pictures. After the shooting is completed, the application is closed, and the central processing system executes the full-screen display instruction;
[0011] The actuator is used to control the translation of the free-form lens to the diverging end and the flipping of the prism to the small OLED end to display the image normally.
[0012] Furthermore, in the method, during the process of taking pictures with the front camera, first, the prism needs to be flipped to one side of the image sensor. At this time, the light rays carrying image data from the outside will enter the system through the TP small hole on the electronic device. After entering, these light rays will first pass through a group of free-form lenses, and the function of these lenses is to precisely focus the light rays. The focused light rays will then pass through the prism, and the function of the prism is to turn the direction of the light rays by 90 degrees. After such processing, the light rays will continue to move forward and pass through a series of carefully designed lens groups. Finally, the light rays passing through the lens group will form a clear image on the image sensor, thus completing the entire process of taking pictures with the front camera.
[0013] Furthermore, in the method, before taking pictures with the front camera, the central processing system controls the LED light of the front camera to turn on to provide sufficient lighting for shooting;
[0014] After the shooting is completed, the system automatically analyzes the image quality. If the image quality does not meet the preset standard, the user is prompted to retake the picture;
[0015] After the user confirms that the image quality is correct, the system saves the image data to the memory and sends the image data to the specified device or platform through the wireless transmission module;
[0016] During the process of taking pictures with the front camera, the system monitors the working state of the camera in real time to ensure that the camera is working properly. If an abnormality is detected, the shooting is immediately stopped and the user is prompted.
[0017] Furthermore, in the method, after the front camera completes the shooting task, the central processing system will be immediately started. It will perform intelligent analysis and judgment based on the light intensity in the current environment. Subsequently, the system will automatically adjust the brightness setting of the screen to ensure that the user can obtain the best visual experience under various different ambient light conditions. Whether outdoors in bright light or indoors in dim light, the user can enjoy a clear and comfortable screen display effect, making the preview and subsequent operations of the photos more convenient.
[0018] Furthermore, in the method, after the front camera capture function is completed, the central processing unit immediately initiates the command sequence for full-screen display. This process involves a series of complex software algorithms designed to carefully optimize the captured image. Through the application of these algorithms, image distortion during display can be significantly reduced, thereby significantly improving image display quality and ensuring a clearer and more realistic visual experience for users.
[0019] Furthermore, in the method, after the front camera is turned off, the free-form surface lens is located at the diverging end, and the prism is flipped to the micro OLED screen end. The light emitted by the OLED screen is focused by the lens system and the propagation direction is changed 90 degrees under the action of the prism. The light is projected through the free-form surface system into the aperture range of the touch screen of the electronic device, achieving seamless connection with the image displayed on the electronic device.
[0020] Furthermore, in the method, after the front camera takes the photo, the central processing system automatically executes the image processing program to optimize the captured image, including color correction, brightness adjustment and contrast enhancement, and automatically adjusts the exposure time and ISO value shooting parameters according to the user's facial features and expressions to ensure that the image quality is optimal.
[0021] Furthermore, in the method, after the front-facing camera completes its capture task, the central processing system immediately activates and uses advanced image recognition technology to conduct in-depth analysis of the captured image. The system can automatically identify key elements in the image, such as facial features of people, color distribution of the scene, and possible presence of specific objects. Based on these recognition results, the system intelligently recommends a series of appropriate editing tools or filter effects to help users better edit and beautify their photos. This process not only improves editing efficiency but also greatly enhances the user's editing experience, allowing users to create satisfactory works more easily and enjoyably.
[0022] Furthermore, in this method, after a photo session with the front camera is successfully completed, the central processing system intelligently recommends the next shooting mode or scene setting based on the user's usage habits and personal preferences. The system utilizes deep learning algorithms to conduct in-depth analysis of the user's shooting behavior and image content, continuously learning and improving shooting strategies. This process aims to provide users with a more personalized and optimized shooting experience, ensuring that each shot meets the user's unique needs and aesthetic standards.
[0023] In a second aspect, the present invention provides an electronic device comprising a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor. The memory is coupled to the processor, and when the processor executes the computer program, the implementation method of the front camera module based on the full-screen electronic device described in the first aspect is implemented.
[0024] The beneficial effects of the present invention are:
[0025] This invention innovatively transforms and further utilizes the traditional mobile phone camera optical path, aiming to provide a technical solution that achieves a true full-screen experience while retaining photography functionality. By cleverly utilizing the prism's flipping mechanism and the left-right translation of the free-form lens, the invention successfully transforms the original single optical path system into two independent systems. This technological breakthrough enables mobile phones to simultaneously achieve time-sharing photography and time-sharing display functions, greatly improving the user's interactive experience and photography efficiency. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0027] Figure 1 This is a block diagram of the principle steps of an implementation method based on a front camera module of a full-screen electronic device;
[0028] Figure 2 This is a flowchart of the front camera photography workflow of a mobile phone in this embodiment;
[0029] Figure 3 This is a schematic diagram of the front camera structure of the mobile phone in this embodiment;
[0030] Figure 4 This is a flowchart of the full-screen display workflow of the mobile phone in this embodiment;
[0031] Figure 5 This is a diagram of the full-screen display structure of the mobile phone in this embodiment;
[0032] Figure 6 It is a functional block diagram of an electronic device. DETAILED DESCRIPTION
[0033] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Apparently, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.
[0034] In one embodiment, please refer to Figure 1 as shown, a method for implementing a front camera module of a full-screen electronic device is provided, including the following steps:
[0035] Initialization: Send a front camera shooting instruction to the central processing system through an application program;
[0036] Control the free-form surface lens to translate to the focusing end through an actuator, and control the prism to flip to the image sensor end;
[0037] The front camera starts taking pictures. After the shooting is completed, close the application program, and the central processing system executes a full-screen display instruction;
[0038] Control the free-form surface lens to translate to the divergence end through an actuator, control the prism to flip to the small OLED end, and display the image normally.
[0039] In one embodiment, the method further includes controlling the LED light of the front camera to turn on during the front camera shooting process through the central processing system to provide sufficient illumination for shooting. This measure ensures that users can still take clear and bright photos in an environment with insufficient light.
[0040] In addition, after the photo is taken, the system automatically analyzes the image quality. If the image quality does not meet the preset standard, the user is prompted to retake the photo. This intelligent quality detection function ensures that users will not miss important moments due to an unsatisfactory shooting, improving the shooting success rate.
[0041] After the user confirms that the image quality is correct, the system saves the image data to the memory and sends the image data to a specified device or platform through the wireless transmission module. The automation of this process greatly simplifies the user operation process and makes it more convenient to share photos.
[0042] During the front camera shooting process, the system monitors the working status of the camera in real time to ensure that the camera works properly. If an abnormality is detected, the shooting is immediately stopped and the user is prompted. This safety mechanism ensures that users will not lose important data due to device failures during use.
[0043] After the front camera completes the photographing task, the central processing unit immediately initiates a command sequence for full-screen display. This process involves a series of complex software algorithms aimed at meticulously optimizing the captured images. Through the application of these algorithms, the distortion phenomenon of the images during display can be significantly reduced, thereby greatly enhancing the display quality of the images and ensuring that users can obtain a clearer and more vivid visual experience.
[0044] After the front camera is turned off, the free-form lens is located at the divergent end, and the prism flips to the micro-OLED screen end. The light emitted by the OLED screen is focused through the lens system and, under the action of the prism, changes its propagation direction by 90 degrees. The light passes through the free-form surface system and is projected within the aperture range of the touch screen of the electronic device, achieving seamless docking with the image displayed on the electronic device. This design not only improves the display efficiency but also ensures the integrity and coherence of the image.
[0045] After the front camera finishes taking pictures, the central processing system automatically executes an image processing program to optimize the captured images, including color correction, brightness adjustment, and contrast enhancement. It also automatically adjusts shooting parameters such as exposure time and ISO value according to the user's facial features and expressions to ensure that the image quality reaches the best state. This intelligent image processing function enables users to obtain high-quality image output even under different lighting conditions.
[0046] After the front camera completes the photographing task, the central processing system will be immediately activated to conduct an in-depth analysis of the captured images using advanced image recognition technology. The system can automatically identify key elements in the images, such as the facial features of people, the color distribution of the scene, and specific objects that may exist. Based on these recognition results, the system will intelligently recommend a series of suitable editing tools or filter effects to help users better edit and beautify their photos. This process not only improves the editing efficiency but also greatly enhances the user's editing experience, enabling users to create satisfactory works more easily and pleasantly.
[0047] After the front camera's photographing activity is successfully completed, the central processing system will intelligently recommend the next shooting mode or scene settings based on the user's usage habits and personal preferences. The system uses deep learning algorithms to conduct an in-depth analysis of the user's shooting behavior and image content, continuously learning and improving the shooting strategy. This process aims to provide users with a more personalized and optimized shooting experience, ensuring that each shooting can meet the user's unique needs and aesthetic standards.
[0048] In one embodiment, during the process of proactive photography, the prism needs to be flipped to the side of the image sensor first. At this time, the light rays carrying image data from the outside enter the system through the TP small hole on the electronic device. After entering, these light rays will first pass through a group of free-form lenses, whose function is to precisely focus the light rays. The focused light rays will then pass through the prism, and the function of the prism is to turn the direction of the light rays by 90 degrees. After such processing, the light rays will continue to move forward and pass through a series of carefully designed lens groups. Finally, the light rays passing through the lens group will form a clear image on the image sensor, thus completing the entire process of proactive photography.
[0049] In one embodiment, before proactive photography, the central processing system controls the LED light of the front camera to turn on to provide sufficient lighting for shooting;
[0050] After the photographing is completed, the system automatically analyzes the image quality. If the image quality does not meet the preset standard, the user is prompted to take a re-shot;
[0051] After the user confirms that the image quality is correct, the system saves the image data to the memory and sends the image data to the specified device or platform through the wireless transmission module;
[0052] During the process of proactive photography, the system monitors the working state of the camera in real time to ensure that the camera is working properly. If an abnormality is detected, the photographing is immediately stopped and the user is prompted.
[0053] In this embodiment, for the total reflection prism, when light travels from an optically denser medium to an optically less dense medium, when the incident angle exceeds a certain angle C (critical angle), the refracted light completely disappears and only the reflected light remains, which is called total reflection.
[0054] In one embodiment, after the front camera successfully completes the photographing task, the central processing system will quickly start its working process. It will conduct in-depth intelligent analysis and precise judgment based on the light intensity in the current environment. Immediately afterwards, the system will automatically adjust the brightness setting of the screen to ensure that the user can obtain the best visual experience under various different ambient light conditions. Whether in bright outdoor sunlight or in dim indoor lighting, the user can enjoy a clear and comfortable screen display effect. Such a design makes the preview and subsequent operations of the photo more convenient and greatly improves the user experience.
[0055] In one embodiment, after the front camera's photographing function is completed, the central processing unit immediately initiates a command sequence for full-screen display. This process involves a series of complex software algorithms designed to perform meticulous optimization on the captured images. By applying these algorithms, the distortion phenomenon of the images during display can be significantly reduced, thereby greatly enhancing the display quality of the images and ensuring that users can obtain a clearer and more vivid visual experience.
[0056] In one embodiment, after the front camera is turned off, the free-form lens is located at the divergent end, and the prism flips to the micro-OLED screen end. The light emitted by the OLED screen is focused through the lens system and, under the action of the prism, changes its propagation direction by 90 degrees. The light passes through the free-form surface system and is projected within the aperture range of the touch screen of the electronic device, achieving seamless docking with the image displayed on the electronic device.
[0057] In one embodiment, after the front camera finishes taking pictures, the central processing system automatically executes an image processing program to optimize the captured images, including color correction, brightness adjustment, and contrast enhancement. And according to the user's facial features and expressions, it automatically adjusts shooting parameters such as exposure time and ISO value to ensure that the image quality reaches the best state.
[0058] In one embodiment, after the front camera completes its photographing task, the central processing system will immediately start and use advanced image recognition technology to deeply analyze the captured images. The system can automatically identify key elements in the images, such as the facial features of people, the color distribution of the scene, and specific objects that may exist. Based on these recognition results, the system will intelligently recommend a series of suitable editing tools or filter effects to help users better edit and beautify their photos. This process not only improves the editing efficiency but also greatly enhances the user's editing experience, enabling users to create satisfactory works more easily and pleasantly.
[0059] In one embodiment, after the front camera's photographing activity is successfully completed, the central processing system will intelligently recommend the next shooting mode or scene settings based on the user's usage habits and personal preferences. The system uses deep learning algorithms to deeply analyze the user's shooting behavior and image content, continuously learning and improving the shooting strategy. This process aims to provide users with a more personalized and optimized shooting experience, ensuring that each shooting can meet the unique needs and aesthetic standards of users.
[0060] In one embodiment, referring to Figure 2 and 3 As shown, for the front camera of the mobile phone to take pictures, it uses the small holes on the existing front TP of the mobile phone. The light enters the inner free-form lens through the small holes, completing the focusing operation of the light, simplifying the operation steps and reducing the connection time at the same time. The specific implementation steps are as follows:
[0061] The mobile phone apk turns on the front camera;
[0062] The apk issues commands to move the free-form lens to the focusing end;
[0063] The apk issues commands to flip the prism to the sensor end;
[0064] The front camera starts taking pictures.
[0065] In this process, when the mobile phone is about to open an application (apk), it will simultaneously activate the front camera. At this time, the mobile phone will send commands to the free-form lens translation device and the prism flipping device. The free-form lens translation device will respond to these commands and move the free-form lens to the position at the focusing end. At the same time, the prism flipping device will also act to flip the prism to the position at the sensor end. In this way, external light or images can enter the mobile phone through a small hole on the mobile phone touch screen. These lights will first pass through the free-form lens, and the function of the lens is to focus the light. The focused light will then encounter the prism, and the function of the prism is to turn the direction of the light by 90 degrees. After such processing, the light will pass through the lens group and finally form a clear image on the image sensor.
[0066] In one embodiment, referring to Figure 4 and 5 As shown, the realization of the full-screen display technology of the mobile phone depends on an additional OLED display screen installed inside the mobile phone. This OLED display screen is responsible for generating images, which are then focused through a carefully designed optical system. The focused images will pass through a prism system, and the function of this system is to turn the optical path by 90 degrees. Then, the light will pass through a free-form lens, which has a diverging surface, and it projects the image within a small hole range on the mobile phone touch screen (TP), thus achieving seamless connection and display with the main screen of the mobile phone.
[0067] When the mobile phone turns off the front camera function, the system will simultaneously send commands to the translation device of the free-form lens and the prism flipping device. These commands cause the free-form lens to move correspondingly at the diverging end, while the prism flips to the side facing the small OLED display screen. At this time, the light emitted from the OLED display screen is focused through the lens system, and then the light is turned by 90 degrees through the prism system. After being processed by the free-form system, the light is finally projected within the small hole range on the mobile phone touch screen and perfectly merged with the large image displayed on the main screen of the mobile phone, achieving seamless link display.
[0068] This embodiment features a free-form lens, particularly suitable for applications with complex, asymmetric optical surfaces. The free-form lens design allows for different asymmetric shapes on the front and back surfaces, enabling individual optimization of multiple localized areas. This optimization enables the production of thinner and lighter lenses while significantly reducing aberrations and chromatic aberration, lowering distortion, and improving light transmission efficiency. This lens design and manufacturing technology not only enhances optical system performance but also opens up new possibilities for innovative applications of optical components.
[0069] Secondly, refer to Figure 6 As shown, the present invention provides an electronic device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, the memory is coupled to the processor, and when the processor executes the computer program, the implementation method of the front camera module based on the full-screen electronic device described in the first aspect is implemented.
[0070] In summary, this invention innovatively transforms and further utilizes the traditional mobile phone camera optical path, aiming to provide a technical solution that achieves a true full-screen experience while retaining photography functionality. By cleverly utilizing the prism's flipping mechanism and the left-right translation of the free-form lens, the invention successfully transforms the original single optical path system into two independent systems. This technological breakthrough enables mobile phones to achieve time-sharing photography and time-sharing display functions simultaneously, greatly improving the user's interactive experience and photography efficiency.
[0071] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims
1. An implementation method of a front camera module for a full-screen electronic device, characterized in that, It includes the following steps: Initialization: The front camera shooting instruction is sent to the central processing system through the application; Control the free-form lens to translate to the focusing end through the actuator, and control the prism to flip to the image sensor end; The front camera starts taking pictures. After the shooting is completed, close the application, and the central processing system executes the full-screen display instruction; Control the free-form lens to translate to the divergent end through the actuator, control the prism to flip to the small OLED end, and display the image normally.
2. The implementation method of the front camera module based on the full-screen electronic device according to claim 1, wherein In the method, when the front camera takes pictures, the prism flips to the image sensor end. The external light with image data enters through the TP small hole of the electronic device, is focused by the free-form lens, and then the light is rotated 90 degrees by the prism and forms an image on the image sensor through the lens group.
3. The implementation method of the front camera module based on the full-screen electronic device according to claim 1, wherein In the method, before the front camera takes pictures, the central processing system controls the LED light of the front camera to turn on to provide sufficient illumination for shooting; After the shooting is completed, the system automatically analyzes the image quality. If the image quality does not meet the preset standard, the user is prompted to retake the picture; After the user confirms that the image quality is correct, the system saves the image data to the memory and sends the image data to the specified device or platform through the wireless transmission module; During the front camera shooting process, the system monitors the working state of the camera in real time to ensure that the camera works normally. If an abnormality is detected, the shooting is immediately stopped and the user is prompted.
4. The implementation method of the front camera module based on the full-screen electronic device according to claim 1, wherein In the method, after the front camera shooting is completed, the central processing system automatically adjusts the screen brightness according to the current ambient light intensity to ensure the user's visual experience in different environments.
5. The implementation method of the front camera module based on the full-screen electronic device according to claim 1, wherein In the method, after the front camera shooting is completed, the central processing system executes the full-screen display instruction, optimizes the image display effect through software algorithms, reduces image distortion, and improves the display quality.
6. The implementation method of the front camera module based on the full-screen electronic device according to claim 1, wherein, In the method, after turning off the front camera, the free-form lens is located at the divergent end, the prism flips to the micro OLED screen end, the light emitted by the OLED screen is focused through the lens system, and the propagation direction is changed by 90 degrees under the action of the prism. The light is projected within the touch screen aperture range of the electronic device through the free-form surface system and seamlessly docks with the image displayed on the electronic device.
7. The implementation method of the front camera module based on the full-screen electronic device according to claim 1, wherein, In the method, after the front camera shooting is completed, the central processing system automatically executes the image processing program to optimize the captured image, including color correction, brightness adjustment, and contrast enhancement, and automatically adjusts shooting parameters such as exposure time and ISO value according to the user's facial features and expressions to ensure that the image quality reaches the best state.
8. The implementation method of the front camera module based on the full-screen electronic device according to claim 1, wherein, In the method, after the front camera shooting is completed, the central processing system can automatically identify key elements in the image through image recognition technology and recommend corresponding editing tools or filter effects according to the recognition results to enhance the user's editing experience.
9. The implementation method of the front camera module based on the full-screen electronic device according to claim 1, wherein In the method, after the front camera shooting is completed, the central processing system intelligently recommends subsequent shooting modes or scene settings according to the user's usage habits and preferences. Through deep learning algorithms, it analyzes the user's shooting behavior and image content, continuously learns and optimizes the shooting strategy to provide a more personalized shooting experience.
10. An electronic device, characterized in that, It includes a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor. The memory is coupled to the processor, and when the processor executes the computer program, it implements the method for AI intelligent detection and killing of Android background processes as described in any one of claims 1 to 9.