Lens picture processing method and apparatus, and computer-readable storage medium, computer program product and electronic device
By adjusting the intensity of reflected light, the problem of balancing realism and stability in lens imagery was solved, achieving the effect of improving stability and concealment while maintaining realism.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- TENCENT TECHNOLOGY (SHENZHEN) CO LTD
- Filing Date
- 2025-09-10
- Publication Date
- 2026-04-23
AI Technical Summary
The realism and stability of the displayed image cannot be achieved simultaneously. Frequent camera switching and adjustments increase the complexity of operation and the computational burden, affecting the refresh rate and response speed of the display.
By processing the reflected light under the first and second light intensities, the realism of the virtual optical lens is maintained and the intensity of the reflected light is reduced, thereby reducing lens switching and adjustments and saving computing resources.
It improves the refresh rate and response speed of the lens image, enhances the stability of the display, and maintains the realism and concealment of the image.
Smart Images

Figure CN2025120370_23042026_PF_FP_ABST
Abstract
Description
Methods, devices, computer-readable storage media, computer program products, and electronic devices for processing camera images.
[0001] Cross-references to related applications
[0002] This application is based on Chinese Patent Application No. 202411441402.5, filed on October 15, 2024, and claims priority to that Chinese Patent Application, the entire contents of which are incorporated herein by reference. Technical Field
[0003] This application relates to the field of computers, and more specifically, to a method, apparatus, computer-readable storage medium, computer program product, and electronic device for processing camera images. Background Technology
[0004] In video display scenarios, virtual optical lens technology is typically used to simulate focused visible light to capture and present distant scenes. However, in pursuit of realism, virtual optical lenses also simulate the reflection of light on their surfaces, i.e., emitted light. While this emitted light enhances the realism of the displayed video, it can also reveal the location of the virtual optical lens, posing a potential risk to the user.
[0005] From a technical perspective, the presence of this emitted light raises a series of problems. First, to maintain stealth, users have to frequently adjust the position or usage status of the virtual optical lens to avoid revealing their location. This frequent switching not only interrupts the user's continuous observation of the lens image but also increases operational complexity and cognitive load.
[0006] Secondly, each time the lens position or usage state is changed, the system needs to recalculate the light focusing and reflection effects, which consumes a significant amount of computing resources. With limited resources, this additional computational burden leads to a decrease in the refresh rate and response speed of the lens image, directly affecting display stability. Therefore, there is a trade-off between ensuring the realism and stability of the lens image display. Summary of the Invention
[0007] This application provides a method, apparatus, computer-readable storage medium, computer program product, and electronic device for processing camera images, in order to at least solve the technical problem that the display realism and stability of camera images cannot be simultaneously achieved.
[0008] According to one aspect of the embodiments of this application, a method for processing lens images is provided, including:
[0009] The first lens image is displayed, wherein the first lens image is the image presented when a visible light is focused through a virtual optical lens. During the process of simulating focusing the visible light, the virtual optical lens will generate reflected light of a first light intensity. The reflected light is the light generated when the visible light is reflected on the virtual optical lens.
[0010] In response to the reflection processing operation performed on the virtual optical lens, a second lens image is displayed, wherein the second lens image is the image presented when the visible light is simulated by the virtual optical lens after reflection processing. During the process of simulating focusing the visible light, the virtual optical lens after reflection processing will generate reflected light with a second light intensity, which is less than the first light intensity.
[0011] According to one aspect of the embodiments of this application, another method for processing camera images is provided, including:
[0012] The reflected light ray of the first illumination intensity is a reflected light ray generated by the virtual optical lens in the process of simulating focusing visible light, and the reflected light ray is the light ray generated when the visible light is reflected on the virtual optical lens;
[0013] The reflected light shows a second light intensity, wherein the reflected light of the second light intensity is the reflected light generated by the virtual optical lens after reflection processing during the process of simulating focusing the visible light, and the second light intensity is less than the first light intensity.
[0014] According to one aspect of the embodiments of this application, a lens image processing apparatus is also provided, comprising:
[0015] The first display unit is configured to display a first lens image, wherein the first lens image is an image presented by simulating the focusing of visible light through a virtual optical lens. During the process of simulating the focusing of the visible light, the virtual optical lens will generate reflected light of a first light intensity. The reflected light is the light generated when the visible light is reflected on the virtual optical lens.
[0016] The second display unit is configured to display a second lens image in response to a reflection processing operation performed on the virtual optical lens. The second lens image is the image presented when the visible light is simulated by the virtual optical lens after reflection processing. During the process of simulating focusing the visible light, the virtual optical lens after reflection processing will generate reflected light with a second light intensity, which is less than the first light intensity.
[0017] According to one aspect of the embodiments of this application, another lens image processing apparatus is also provided, comprising:
[0018] The sixteenth display unit is configured to display reflected light of a first illumination intensity, wherein the reflected light of the first illumination intensity is reflected light generated by the virtual optical lens during the process of simulating focusing visible light, and the reflected light is light generated when the visible light is reflected on the virtual optical lens;
[0019] The seventeenth display unit is configured to display reflected light of a second light intensity, wherein the reflected light of the second light intensity is reflected light generated by the virtual optical lens after reflection processing during the process of simulating focusing the visible light, and the second light intensity is less than the first light intensity.
[0020] According to one aspect of the embodiments of this application, a computer program product or computer program is provided, which includes computer instructions stored in a computer-readable storage medium. A processor of an electronic device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the electronic device to perform the processing method for the above-described camera image.
[0021] According to one aspect of the embodiments of this application, a computer-readable storage medium is provided, the computer-readable storage medium including a stored program, the program being executed by an electronic device to perform the above-described processing method for camera images.
[0022] According to one aspect of the embodiments of this application, an electronic device is also provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the above-described processing method for the lens image through the computer program.
[0023] In this embodiment, the relationship between the realism and stability of the lens image is balanced by reflecting light with a first intensity and reflecting light with a second intensity. The first intensity of reflected light maintains the realism of the virtual optical lens, i.e., by simulating focused visible light and light reflection to present a highly realistic scene. The second intensity of reflected light undergoes reflection processing, reducing the intensity of the reflected light to enhance the concealment and security of using the virtual optical lens, thereby avoiding frequent lens switching and adjustments. Furthermore, since frequent lens switching and adjustments are reduced, there is no need to constantly recalculate the lighting effects, thus saving computational resources. This improves the refresh rate and response speed of the lens image, further enhancing its display stability. This achieves the goal of maintaining the realism of the lens image while improving its stability, thus realizing a technical effect that balances the realism and stability of the lens image, and solving the technical problem of the inability to simultaneously achieve both. Attached Figure Description
[0024] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:
[0025] Figure 1 is a schematic diagram of the application environment of a lens image processing method according to an embodiment of this application;
[0026] Figure 2 is a schematic flowchart of a method for processing a lens image according to an embodiment of this application;
[0027] Figure 3 is a schematic diagram of a method for processing a lens image according to an embodiment of this application;
[0028] Figure 4 is a schematic flowchart of another method for processing camera images according to an embodiment of this application;
[0029] Figure 5 is a schematic diagram of another method for processing camera images according to an embodiment of this application;
[0030] Figure 6 is a schematic diagram of another method for processing camera images according to an embodiment of this application;
[0031] Figure 7 is a schematic diagram of another method for processing camera images according to an embodiment of this application;
[0032] Figure 8 is a schematic diagram of another method for processing camera images according to an embodiment of this application;
[0033] Figure 9 is a schematic diagram of another method for processing camera images according to an embodiment of this application;
[0034] Figure 10 is a schematic diagram of another method for processing camera images according to an embodiment of this application;
[0035] Figure 11 is a schematic diagram of a lens image processing device according to an embodiment of the present application;
[0036] Figure 12 is a schematic diagram of another lens image processing apparatus according to an embodiment of the present application;
[0037] Figure 13 is a schematic diagram of the structure of an electronic device according to an embodiment of this application. Detailed Implementation
[0038] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.
[0039] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.
[0040] According to one aspect of the embodiments of this application, a method for processing camera footage is provided. As one implementation, the above-described camera footage processing method can be applied, but is not limited to, the environment shown in FIG1. This environment may include, but is not limited to, a terminal device 102 and a server 112. The terminal device 102 may include, but is not limited to, a display 104, a processor 106, and a memory 108. The server 112 includes a database 114 and a processing engine 116. The specific process of the camera footage processing method can be as follows:
[0041] In step S102, the terminal device 102 obtains a camera-opening command triggered by the virtual lens, wherein the virtual lens may be a virtual optical lens or a virtual optical lens after reflection processing.
[0042] In step S104, the terminal device 102 sends the opening command to the server 112 via the network 110.
[0043] In step S106, server 112 responds to the opening command through processing engine 116 and obtains the lens image. The lens image can be a first lens image or a second lens image. The first lens image is the image presented when focusing visible light through a virtual optical lens. The second lens image is the image presented when focusing visible light through a virtual optical lens after reflection processing.
[0044] In step S108, server 112 sends the camera footage to terminal device 102 via network 110.
[0045] The terminal device 102 displays the lens image on the display 104 through the processor 106 and stores the lens image in the memory 108.
[0046] The above-mentioned image processing methods can be applied to various virtual environments, such as virtual reality education and product design previews.
[0047] Taking virtual reality (VR) education scenarios as an example, especially in courses involving precision instrument observation and exploration of the microscopic world, the way the camera view is processed can significantly improve teaching effectiveness and students' learning experience. For instance, in a high school biology VR course on "Cell Structure Observation," teachers use VR devices to create a virtual microscope observation scenario for students. At the beginning of the course, the first view is displayed. This view is presented by simulating the focusing of visible light through a virtual optical lens, just like observing cell slices using a regular optical microscope in a real laboratory. At this point, the virtual optical lens generates reflected light of the initial light intensity during the simulated focusing process. These reflected rays simulate the reflection effect produced by a real microscope lens under ambient light, allowing students to initially experience a realistic microscope operation scenario and understand the basic imaging principles of an optical microscope.
[0048] However, this reflected light can interfere with students' observation of fine cellular structures (such as the nucleus and mitochondria), especially for those new to microscopes, who may find it difficult to accurately identify different cellular structures due to the reflection. To address this issue, the course includes an "Optimized Observation Mode" option. When students click this option, the reflection processing of the virtual optical lens is adjusted, displaying a second lens image. This image is formed by simulating focused visible light through a virtual optical lens after the reflection processing. At this point, the intensity of the reflected light generated by the virtual optical lens is reduced to a second light intensity (the second light intensity is less than the first light intensity).
[0049] With the second-view camera, the details of the cell structure are clearly presented to students, and the interference of reflected light on observation is greatly reduced. Students can more accurately distinguish the various components of the cell and even clearly see the flow of substances inside the cell. Teachers can also use the second-view camera to explain the function of each cell structure in detail, allowing students to deeply understand the knowledge points under a clear observation view, which greatly improves the teaching quality of biology courses and students' learning efficiency.
[0050] Taking product design preview as an example, designers need to preview and evaluate the product's appearance, structure, and usage scenarios in a virtual environment. The processing methods used in the camera shots help designers grasp product details more accurately, improving design quality and decision-making efficiency. For example, in the automotive design field, "car exterior and interior design preview" uses VR technology to build virtual models of the car, previewing aspects such as exterior styling and interior layout. In the initial design preview stage, the first camera shot can be displayed. This shot uses a virtual optical lens to simulate the car's exterior and interior imaging effects under different natural lighting conditions (such as strong sunlight on a sunny day and diffused light on a cloudy day). At this time, the virtual optical lens generates reflected light of the first light intensity. These reflected rays simulate the reflection of the real car's paint, windows, and interior metal trim under different lighting conditions, allowing designers to initially assess the light and shadow effects of the car's exterior and the visual atmosphere of the interior, determining whether the design conforms to the overall style positioning.
[0051] However, when evaluating the subtle lines of a car's exterior, the accuracy of its paint color, and the rationality of the interior button layout, reflected light in the first-view image can cause interference. For example, the waistline design on the side of the car may appear less smooth under strong light, and the buttons on the center console may be difficult to clearly distinguish under reflected light. To conduct more accurate design evaluation and modifications, designers can activate the "detail preview mode," triggering a reflection processing operation on the virtual optical lens, at which point the system displays a second-view image.
[0052] In the second shot, the intensity of reflected light is significantly reduced (the second light intensity is less than the first light intensity), and every line of the car body is clearly visible. Designers can accurately judge whether the curvature of the waistline meets the design requirements and whether the paint color is uniform under different angles. As for the interior, details such as button labels and material textures are clearly displayed to the designers, making it easier for them to evaluate the rationality and aesthetics of the interior layout, identify design problems in a timely manner, and make modifications, effectively shortening the product design cycle and improving the accuracy and feasibility of the design scheme.
[0053] Besides the example shown in Figure 1, the aforementioned terminal device can be a terminal device configured with a target client, which may include, but is not limited to, at least one of the following: mobile phone (such as Android phone, iOS phone, etc.), laptop computer, tablet computer, PDA, MID (Mobile Internet Device), PAD, desktop computer, smart TV, etc. The target client may be a video client, instant messaging client, browser client, educational client, etc. The aforementioned network may include, but is not limited to, wired network and wireless network, wherein the wired network includes: local area network, metropolitan area network and wide area network, and the wireless network includes: Bluetooth, WIFI and other networks that enable wireless communication. The aforementioned server may be a single server, a server cluster composed of multiple servers, or a cloud server. The above is only an example, and no limitation is made in this embodiment.
[0054] As one implementation method, as shown in Figure 2, the processing method for the lens image can be executed by an electronic device, such as the terminal device or server shown in Figure 1. The specific steps include:
[0055] S202, display the first lens image, wherein the first lens image is the image presented when the visible light is focused through a virtual optical lens. In the process of simulating the focusing of the visible light, the virtual optical lens will generate reflected light of the first light intensity. The reflected light is the light generated when the simulated visible light is reflected on the virtual optical lens.
[0056] S204, in response to the reflection processing operation performed on the virtual optical lens, a second lens image is displayed, wherein the second lens image is the image presented when focusing visible light through the virtual optical lens after reflection processing. During the process of simulating focusing visible light, the virtual optical lens after reflection processing will generate reflected light with a second light intensity, which is less than the first light intensity.
[0057] In some embodiments, the above-described method for processing camera shots can be applied to multiple scenarios, including, but not limited to, virtual game scenarios, where players need to use a virtual telescope to observe distant targets. Firstly, for the application of the first-view shot, the player initially uses a regular virtual telescope, and the game displays the first-view shot. The player can see the distant scenery focused through the virtual optical lens in the virtual telescope, while noting that there is some light reflection, which affects the clarity of the observation.
[0058] Secondly, regarding the application of the second-view camera, the game offers an upgrade option that allows players to switch to a virtual telescope with enhanced reflection. In this mode, the second-view camera view is displayed, with significantly reduced intensity of reflected light, making distant targets much clearer and reducing the likelihood of distant targets detecting the player's location through reflected light.
[0059] Alternatively, players can take on the role of a sniper in a virtual game, using a sniper rifle to complete various missions. The sniper rifle in the game is equipped with a virtual optics lens to simulate the aiming and shooting experience in the real world. When a player aims using the sniper rifle's scope (i.e., the virtual optics lens), the game first displays a first-view shot. This shot uses the virtual optics lens to simulate focusing visible light, presenting distant targets and their surroundings.
[0060] During the simulation of focusing visible light, the virtual optics lens generates reflected light at the initial light intensity. These reflected rays enhance the game's realism, allowing players to experience the effects of sunlight or ambient light reflecting off the scope. However, these reflected rays can sometimes interfere with aiming, especially in brightly lit or complex environments. They may also reveal the player's sniping position.
[0061] To address potential interference from reflected light in the first-view camera, the game offers an option to switch to a second-view camera. The second-view simulates the focused view of visible light through a virtual optical lens with reduced reflections. In this mode, the intensity of reflected light is reduced (the second light intensity is less than the first light intensity), thus minimizing interference with aiming. Players can switch to the second-view camera when more precise aiming or to avoid light interference, improving shooting accuracy and stability.
[0062] Beyond virtual game scenarios, the aforementioned image processing methods can be applied to other virtual environments, such as virtual reality education, simulation training, and product design previews. In these applications, simulating realistic optical effects is crucial for providing an immersive user experience. Furthermore, reducing the intensity of reflected light in these scenarios helps users see details more clearly, improving the accuracy of observation and operation.
[0063] In some embodiments, the first shot can be an image generated by simulating the focusing of visible light through a virtual optical lens without any special processing. This image realistically reflects the focusing effect of light on the lens, including any reflected light that may occur.
[0064] In some embodiments, a virtual optical lens can be a technical tool used to simulate the working principle of a real optical lens. It can simulate effects such as the focusing, scattering, and reflection of light, thereby generating realistic visual images.
[0065] In some embodiments, visible light can refer to light rays simulated in a virtual environment that can be "seen." These rays undergo focusing, reflection, and other effects when passing through a virtual optical lens.
[0066] For example, light intensity can refer to a physical quantity that describes the brightness of light. In a virtual environment, it determines the brightness of the simulated light and its impact on the surrounding environment.
[0067] In some embodiments, the first intensity of reflected light can be the intensity of reflected light simulated when simulated visible light passes through a virtual optical lens. This reflection simulates the phenomenon of light reflecting off a lens surface in the real world. The second intensity of reflected light can be reflected light generated by the virtual optical lens after reflection processing during the simulated focusing of visible light. Its intensity is lower than the first intensity, meaning that in the second lens image, due to the reflection processing, the intensity of the reflected light is weaker than that in the first lens image. This reduction helps users observe details in the image more clearly and reduces visual interference from reflected light.
[0068] To illustrate further, in virtual photography simulation software, users can observe different visual effects of the same scene by switching between different lens settings. When the user selects a normal lens, the software displays the first lens image, which includes obvious reflected light effects; while when the user switches to a lens with reflective properties, the software displays the second lens image, where the intensity of reflected light is significantly reduced, making the image clearer.
[0069] In some embodiments, reflection processing can be an operation that allows a user to perform on a virtual optical mirror, with the aim of reducing or altering reflected light from the lens surface. In the real world, lens surfaces may reflect light, affecting image clarity. In a virtual environment, reflection processing can simulate reducing this reflection. Reflection processing includes both contact and non-contact operations. Contact operations refer to interactive operations performed actively by the user on the virtual optical mirror using a specific input device (such as a touchscreen, mouse, or drawing pen). Non-contact operations do not require physical contact between the user or input device and the virtual optical mirror's display interface. They can achieve reflection processing effects by recognizing user gestures, eye movement paths, and laser pointing trajectories. This expands the operational scenarios (e.g., when users are wearing gloves and cannot directly touch the device screen, or in scenarios where the virtual optical mirror is remotely controlled) and further enhances operational flexibility. It is a key and diverse interactive means to achieve reflection processing of virtual optical mirrors, precise addition of auxiliary blocking elements, and ultimately, reduction of reflected light.
[0070] In some embodiments, the second camera view can be opposite to the first camera view, and may refer to the image generated when a virtual optical lens with reflective processing simulates focusing visible light. This image is characterized by weaker light intensity from the reflected light.
[0071] In some embodiments, reflective processing can be a technical treatment applied to a virtual optical lens to alter the lens's light reflection characteristics. Specifically, reflective processing can reduce the intensity of reflected light, thereby reducing interference from reflected light on the image and preventing the exposure of one's own position or state due to emitted light.
[0072] To illustrate further, consider a virtual shooting game where players use sniper rifles for long-range shooting. To aim more accurately, players choose to use a reflective sniper scope. When the player observes the target through this scope, the game engine generates a second view with lower intensity reflected light, which doesn't interfere with the player's aim and doesn't easily reveal the player's aiming position to the enemy. This allows the player to see and lock onto the target more clearly without being hindered by strong reflected light, and makes it more difficult for the enemy to locate the player's aiming position.
[0073] It should be noted that this application embodiment uses two different lens settings to simulate focusing light and generate corresponding visual images. First, a common virtual optical lens is used to simulate focusing visible light to generate a first lens image, during which reflected light with a certain intensity is produced. Second, by processing the virtual optical lens to reflect light, the focus of visible light is simulated again to generate a second lens image, in which the intensity of reflected light is weaker than that of reflected light in the first lens image.
[0074] To further illustrate, for example, as shown in Figure 3(a), a virtual optical lens 302 without reflective processing is displayed, and as shown in Figure 3(b), in response to the opening operation performed on the virtual optical lens 302, a first lens image 304 is displayed. The first lens image 304 is the image presented when the virtual optical lens 302 simulates focusing visible light. During the process of simulating focusing visible light, the virtual optical lens 302 will generate reflected light with a first light intensity.
[0075] Furthermore, as shown in Figure 3(c), the virtual optical lens 302 is processed into a virtual optical lens 306 through reflection processing. As shown in Figure 3(d), in response to the lens opening operation performed on the virtual optical lens 306, a second lens image 308 is displayed. The second lens image 308 is the image presented when the virtual optical lens 306 simulates focusing visible light. During the process of simulating focusing visible light, the virtual optical lens 306 will generate reflected light with a second illumination intensity, which is less than the first illumination intensity. For example, the lens surface of the virtual optical lens 306 has a light-shielding component (indicated by shaded areas). The function of the light-shielding component can be to reduce the emission intensity of visible light on the lens surface, that is, to reduce the illumination intensity of the reflected light generated by the virtual optical lens 306 during the process of simulating focusing visible light.
[0076] The embodiments provided in this application balance the realism and stability of the lens image display by using reflected light of a first intensity and a second intensity. The first intensity of reflected light maintains the realism of the virtual optical lens, presenting a highly realistic scene by simulating focused visible light and light reflection. The second intensity of reflected light undergoes reflection processing, reducing its intensity to enhance concealment and security, thus avoiding frequent lens switching and adjustments. Furthermore, by reducing frequent lens switching and adjustments, the system does not need to constantly recalculate lighting effects, saving computational resources. This improves the refresh rate and response speed of the lens image, further enhancing its display stability. Therefore, it achieves the goal of maintaining the realism of the lens image while improving its stability, thus realizing a technical effect that balances both display realism and stability.
[0077] In some embodiments, after displaying the first lens image, a virtual optical lens with an added blocking element is displayed, wherein the reflective virtual optical lens includes a virtual optical lens with an added blocking element, the blocking element being used to reduce the amount of reflected light.
[0078] In this context, the blocking element refers to a specific component attached to the virtual optical lens. This component has a clear functional purpose: to reduce the amount of reflected light generated by the virtual optical lens during the simulated focusing of visible light. Furthermore, since the virtual optical lens after reflection processing includes the virtual optical lens with this component attached, this component is also a key component in achieving the reflection processing of the virtual optical lens. For example, the blocking element can be a specific design or material attached to the virtual optical lens; it can be a physical structure, coating, or software algorithm, designed to reduce light reflection on the lens surface, thereby reducing the amount of reflected light.
[0079] It should be noted that after displaying the image from a certain lens, this embodiment of the application will also display a virtual optical mirror with added blocking elements. This virtual optical mirror is after reflective processing, and the main function of the added blocking elements is to reduce the amount of reflected light.
[0080] Meanwhile, for the sake of realism, the addition of occlusion elements can be set to reduce the collection of visible light by the virtual optical lens. For example, the virtual optical lens can simulate focusing visible light of the first visible intensity, while the virtual optical lens after reflection processing can simulate focusing visible light of the second visible intensity, where the first visible intensity is greater than the second visible intensity.
[0081] To illustrate further, consider a player observing a target area through a sniper rifle's scope. The game displays this first-view image using a standard virtual optical lens. Due to lens reflection, the scope's surface reflects light, increasing the likelihood of the player's position being exposed. However, since there are no obstructions, the virtual optical lens captures ample sunlight, resulting in a bright overall image and clearly visible details in the target area—representing the initial visual intensity.
[0082] Subsequently, to avoid revealing their position, the player switched to a virtual optical lens with added obstruction elements, further showcasing a second viewpoint. This time, the obstruction elements effectively suppressed reflected light, reducing the lens's glare. However, at the same time, the obstruction elements partially blocked the field of view, causing the overall image within the scope to darken or narrow. This effect simulates another visual challenge faced by snipers in real-world outdoor environments when using a scope to reduce glare; the light intensity at this point is the second visible intensity.
[0083] Thus, by introducing virtual optical lenses with added occlusion elements, the amount of reflected light can be significantly reduced, thereby improving the user's visual experience in virtual reality or augmented reality environments and reducing the likelihood of users exposing their critical information due to reflected light. In short, on the one hand, reducing the amount of reflected light effectively avoids interference with the lens image, making the image clearer and more stable, thus improving the user's viewing experience; on the other hand, reducing reflected light also enhances the concealment when using virtual optical lenses, reducing the risk of exposing the device's location or usage status due to reflected light, further improving security. Furthermore, reducing the amount of reflected light means reducing the computational load on lighting effects, saving computing resources and helping to improve the refresh rate and response speed of the lens image, thereby further improving the stability of the lens image. This approach maintains the realism of the displayed image while comprehensively considering its display stability.
[0084] In some embodiments, before displaying the virtual optical lens with the attached occlusion element, the virtual environment in which the virtual optical lens is located is displayed, wherein the virtual environment includes environmental elements that can be attached to the virtual optical lens as occlusion elements, that is, the occlusion elements are environmental elements within the virtual environment that can be attached to the virtual optical lens.
[0085] In this context, a virtual environment refers to the scene space associated with a virtual optical lens. This scene space needs to be displayed by an electronic device and contains specific types of virtual elements. These virtual elements possess the attribute of being "attached to the virtual optical lens and used as occlusion elements," providing a source of occlusion elements that meet the scene's requirements for subsequent reflection processing by the virtual optical lens. It is a key scene carrier connecting the virtual optical lens and the selection of occlusion elements. For example, a virtual environment can be understood as a simulated space created in virtual reality or augmented reality, which can contain various simulated objects, landscapes, or scenarios.
[0086] Environmental elements refer to virtual elements existing within the virtual environment of the virtual optical lens. These virtual elements possess key attributes, allowing them to be attached to the virtual optical lens and act as occlusion elements. During subsequent reflection processing operations on the virtual optical lens, they assist in reducing the amount of light reflected by the lens. They are the core source and carrier providing occlusion elements and supporting reflection processing for the virtual optical lens. Environmental elements can be understood as objects or features within the virtual environment that can interact with or influence the user.
[0087] It should be noted that before demonstrating the virtual optical mirror with attached occlusion elements, this embodiment of the application will first demonstrate the virtual environment in which the virtual optical lens is located. Certain elements in this environment (i.e., occlusion elements) can be attached to the virtual optical mirror to reduce the amount of reflected light.
[0088] For example, suppose in a game, a player enters a jungle environment, simulated through a virtual environment. In this environment, trees, leaves, and other natural elements are environmental elements. When a player tries to use a virtual telescope (i.e., a virtual optical lens) to observe distant enemies, they can choose some leaves (i.e., obstructing elements) to block the telescope, thereby reducing the light reflected back from the telescope's surface and preventing their crucial information from being exposed.
[0089] In this way, by first showcasing the virtual environment in which the virtual optical lens is located, and allowing elements from that environment to be attached to the virtual optical lens, a more realistic and immersive experience is provided to the user. The addition of occluding elements not only reduces the amount of reflected light but also simulates visual obstacles that may occur in the real world, thereby enhancing the realism and interactivity of the virtual environment.
[0090] In some embodiments, when the virtual environment includes a first environment element and a second environment element, displaying a virtual optical mirror with an attached occlusion element can be achieved in the following ways:
[0091] In response to a first additional operation performed on a first ambient element, a virtual optical mirror with an attached occlusion element is displayed, wherein the occlusion element is the first ambient element; or,
[0092] In response to a second additional operation performed on a second ambient element, a virtual optical mirror with an attached occlusion element is displayed, wherein the occlusion element is the second ambient element; or,
[0093] In response to a third additional operation performed on a first environmental element and a second environmental element, a virtual optical mirror with an attached occlusion element is displayed, wherein the occlusion element is the first environmental element and the second environmental element.
[0094] Here, the first environmental element and the second environmental element can be understood as two different environmental elements in the virtual environment, both of which can be attached to the virtual optical mirror as occlusion elements. When the first attachment operation is performed on the first environmental element, the first environmental element is attached to the virtual optical mirror as an occlusion element to reduce the amount of reflected light; when the second attachment operation is performed on the second environmental element, the second environmental element is attached to the virtual optical mirror as an occlusion element to reduce the amount of reflected light; when the third attachment operation is performed on the first environmental element and the second environmental element, both the first environmental element and the second environmental element are attached to the virtual optical mirror as occlusion elements to reduce the amount of reflected light.
[0095] Furthermore, different types of environmental elements can indeed affect the intensity of reflected light differently. This variability not only increases the diversity of visual effects but also provides users with a richer interactive experience.
[0096] For example, the first environmental element reduces the amount of reflected light less than the second environmental element, which might be a highly reflective material such as a metal sheet or water surface. When these elements are attached to a virtual optical mirror, they significantly increase the amount of reflected light and the intensity of illumination, simulating the effect of light reflecting off metal or water surfaces in the real world. This high intensity of reflected light can make the image brighter and even produce glare.
[0097] In contrast, the second environmental element might be a material with lower reflectivity, such as fabric or leaves. These elements, when attached to the virtual optical mirror, have less impact on reflected light, and the changes in light intensity are relatively gentle. They may produce soft shadows or subtle reflections, adding more detail and depth to the image.
[0098] By combining different types of environmental elements, users can create a variety of unique visual effects. For example, in a virtual photography scene, users can choose to add metal sheets and water elements to the lens of a virtual camera to simulate the strong reflections and glare that may occur when shooting in sunlight. Alternatively, users can choose to add cloth and foliage elements to create soft shadows and richly detailed images.
[0099] The additional operation can be understood as a specific action or instruction performed by the user to attach environmental elements to the virtual optical mirror.
[0100] It should be noted that in a virtual environment, if multiple environmental elements exist (such as a first environmental element and a second environmental element), users can choose to attach these environmental elements to the virtual optical mirror as occlusion elements by performing different additional operations. These additional operations may be user input commands, such as clicking, dragging, or other interactive actions. Based on the user's actions, the virtual optical mirror with the corresponding environmental element attached will be displayed.
[0101] For example, suppose in a virtual photography scene, the first environmental element is leaves, and the second environmental element is petals. Users can choose which elements to attach to the virtual camera lens through different actions. If the user selects to attach leaves (the first environmental element), the virtual camera lens will display an image obscured by leaves; if the user selects to attach petals (the second environmental element), the image will display an image obscured by petals; if the user selects both leaves and petals, the image will be obscured by both elements simultaneously.
[0102] By allowing users to select and attach different environmental elements to the virtual optical lens in a virtual environment, this application embodiment achieves a highly personalized visual effect. Users can adjust the occlusion elements of the lens image according to their preferences and needs.
[0103] Thus, the embodiments of this application can respond to different additional operations (a first additional operation on a first environmental element, a second additional operation on a second environmental element, and a third additional operation on both) to respectively use the corresponding environmental element as an occlusion element and display the added virtual optical lens, which has the following significant beneficial effects: On the one hand, it provides a diversified path for the selection of occlusion elements. Users can flexibly select a single environmental element or a combination of environmental elements as occlusion elements according to the actual situation such as the needs of the virtual scene and the target of reducing reflected light, avoiding the singleness of the selection of occlusion elements and greatly improving the practicality and scene adaptability of the occlusion elements; on the other hand, the diversified selection of occlusion elements can specifically adjust the degree of reduction of reflected light (for example, a combination of environmental elements may reduce more reflected light than a single element), and can more accurately balance the realism (by retaining reasonable reflected light) and stability (by reducing reflected light as needed) of the virtual optical lens, further optimizing the reflection processing effect; at the same time, through the clear operation and result correspondence, the process of adding occlusion elements is clearer and more controllable, reducing the picture problems caused by operation errors, indirectly ensuring the stable display of the lens picture, thereby more comprehensively solving the technical problem that the realism and stability of the lens picture cannot be taken into account at the same time.
[0104] In some embodiments, before displaying the virtual optical mirror with the attached occlusion element, in response to a smearing operation performed on the virtual optical mirror, at least one of the following is performed:
[0105] The virtual optical mirror displays the smearing trajectory of the occluding element, that is, it displays the smearing trajectory of the occluding element on the virtual optical mirror;
[0106] Shows the action of applying occluding elements to the virtual optical mirror;
[0107] The reflective treatment process includes a coating process.
[0108] The smearing operation refers to an interactive operation performed by the user on a virtual optical mirror using an input device (such as a touchscreen, mouse, or drawing pen; or a non-contact device such as a gesture sensor or laser locator). This operation falls under the category of reflective processing and aims to add obscuring elements to the virtual optical mirror through smearing, preparing for the subsequent stable attachment of these elements. Non-contact operations using non-contact devices eliminate the need for physical contact between the user or input device and the virtual optical mirror's display interface. The smearing effect is achieved by recognizing user gestures, eye movement paths, and laser pointing trajectories. This expands the operational scenarios (e.g., when the user cannot directly touch the device screen) and further enhances operational flexibility. It is a crucial and diverse interactive method for achieving reflective processing of the virtual optical mirror and assisting in the precise attachment of obscuring elements. For example, the smearing operation can be understood as an operation performed by the user on a virtual optical mirror using a specific input device (such as a touchscreen, mouse, or drawing pen) to add obscuring elements to the virtual optical mirror through smearing.
[0109] The smearing trajectory can be understood as the path left on the virtual optical mirror by the occluding element as the user moves the input device during the smearing operation. The smearing trajectory refers to the path trace displayed on the virtual optical mirror by the electronic device in response to the smearing operation (which is a reflection processing operation), related to the process of attaching the occluding element. This smearing trajectory directly corresponds to the attached position and range of the occluding element on the virtual optical mirror, intuitively presenting the coverage area of the occluding element. It provides a visual reference for the user to perceive the attached state of the occluding element and adjust the attached range, serving as a key visual carrier to assist in achieving precise reflection processing.
[0110] It should be noted that before displaying the virtual optical mirror with the added occlusion elements, users can perform a smearing operation on the virtual optical mirror. This operation allows users to add occlusion elements to the virtual optical mirror in an intuitive way. During the smearing process, the smearing trajectory of the occlusion element on the virtual optical mirror can be displayed, or the action of smearing the occlusion element on the virtual optical mirror can be displayed, thus providing users with immediate visual feedback.
[0111] The introduction of the smudge function not only increases user interactivity with the virtual environment but also provides users with greater creative freedom. Through this operation, users can freely adjust the occlusion elements on the virtual optical mirror, thereby creating unique visual effects. Furthermore, the smudge function can be combined with other interaction methods (such as dragging and zooming) to provide users with richer editing and creation tools.
[0112] For example, in a virtual photography application, a user can use their finger to smudge a virtual optical lens on a touchscreen. As the finger moves, a black smudge trail appears on the screen, representing the element being smudged. The user can adjust the speed, direction, and pressure of the smudge to control the distribution and density of the smudged elements.
[0113] By responding to smearing operations performed on a virtual optical lens and displaying the smearing trajectory or action of the occluding element on the virtual optical lens, this method provides users with an intuitive and dynamic interactive interface. Users can observe the distribution of occluding elements on the lens in real time and adjust it as needed. This instant visual feedback mechanism not only improves user operational efficiency but also enhances the user's creative experience.
[0114] Thus, the embodiments of this application, by responding to the smearing operation on the virtual optical mirror and displaying the smearing trajectory or action of the occluding element, have the following significant beneficial effects: First, by introducing the smearing operation and synchronously displaying the trajectory / action, the reflection processing operation is extended to a "visualized additional process," enhancing the interactivity between the user and the virtual optical mirror. This allows the user to intuitively perceive the additional position and range of the occluding element, avoiding image disharmony caused by improper additional position of the occluding element, further ensuring the integration of the lens image with the virtual scene, and maintaining display realism. Second, the visual feedback of the smearing operation can help the user adjust the occluding element in a timely manner. Additional states of elements (such as correcting the smear trajectory to optimize the occlusion range) ensure that the occluded elements can accurately reduce reflected light, avoiding excessive reflected light from affecting stability and preventing excessive occlusion from destroying the realistic reflection effect of the virtual optical lens, thus more accurately balancing realism and stability. At the same time, it is clear that the smearing operation belongs to the reflection processing operation, which further enriches the implementation path of reflection processing, making the reflection processing process more flexible and controllable, reducing the waste of computing resources or image malfunctions caused by operation ambiguity, indirectly improving the lens image refresh rate and response speed, thereby more comprehensively solving the technical problem of not being able to balance the realism and stability of the lens image.
[0115] In some embodiments, when the virtual optical lens includes a collimation area, displaying the smearing trajectory of the occluding element on the virtual optical lens can be achieved by displaying the smearing trajectory of the occluding element in a non-collimation area on the virtual optical lens, that is, displaying the smearing trajectory of the occluding element in the non-collimation area on the virtual optical lens.
[0116] The reticle area is a specific region on the virtual optical lens used for aiming or positioning. No smearing trails from obstructing elements will be displayed within this region. The reticle area refers to a pre-defined area on the virtual optical lens with functional attributes (usually related to lens focus and core field of view). This area is excluded from displaying smearing trails from obstructing elements and is not used to present them. The non-reticle area, in contrast to the reticle area, refers to the remaining areas on the virtual optical lens other than the reticle area. It is a dedicated area for displaying smearing trails from obstructing elements, covering the portion of the virtual optical lens not covered by the reticle area. It provides a specific spatial basis for displaying smearing trails, and by functionally distinguishing it from the reticle area, it ensures that the original function of the reticle area is not interfered with by the display of smearing trails.
[0117] It's important to note that there's a specific area on the virtual scope called the "collision zone." When the smear trail of an occluding element is displayed on the virtual scope, this trail won't appear within the collision zone; it will only appear in the non-collision zone. This is to maintain the clarity of the collision zone so that the user can accurately aim or position themselves.
[0118] This application's embodiments take into account the actual needs of users when using virtual optical lenses. The collimation area is a key area for users to perform precise operations, so keeping it clear and undisturbed is crucial. By displaying the smearing trajectory only in the non-collimation area, it ensures that users are not subjected to unnecessary visual interference when performing precise operations.
[0119] For example, suppose in a virtual shooting game, players can aim at targets using a virtual scope. This scope has a central reticle area for precise aiming. When players apply obstructive elements (such as dirt or paint) to the lens, these strokes will avoid the reticle area, ensuring the player's line of sight remains unobstructed while aiming.
[0120] When the virtual optical lens includes a crosshair area, it displays the smearing trajectory of occlusion elements in the non-crosshair area, effectively balancing the user's needs for creative freedom and operational precision. Users can freely smear occlusion elements on the lens to create unique visual effects, while ensuring the clarity of the crosshair area, so that users are not disturbed when making precise aiming or positioning.
[0121] In some embodiments, before displaying the virtual optical mirror with the attached occlusion element, in response to a removal operation performed on the virtual optical mirror, at least one of the following is performed:
[0122] The removal trajectory of the occluding element is displayed on the virtual optical mirror, that is, the removal trajectory of the occluding element on the virtual optical mirror is displayed.
[0123] This shows the action of removing the occluding element from the virtual optical mirror.
[0124] The removal operation refers to an interactive operation performed by the user on the virtual optical mirror through an input device (such as a touch screen, mouse, drawing pen, or other contact-based device, or a gesture sensor, laser locator, or other non-contact device). Non-contact operations, achieved through non-contact devices, do not require physical contact between the user or input device and the virtual optical mirror's display interface. The removal effect is achieved by recognizing the user's gesture trajectory, eye movement path, laser pointing trajectory, etc., which broadens the operational scenarios (e.g., when the user cannot directly touch the device screen) and further enhances operational flexibility. For example, a removal operation could be a user's action on an obstructing element on the virtual optical mirror using a specific input method (such as touching, clicking, or dragging), aiming to remove the obstructing element from the lens.
[0125] The removal trajectory can be the trajectory left on the virtual optical mirror as the occluding element is removed during the removal operation.
[0126] It's important to note that before displaying the virtual optical mirror with the attached occluding element, the user can perform a removal operation to remove the occluding element from the virtual optical mirror. In response to this operation, the removal trajectory of the occluding element on the virtual optical mirror is displayed, or the action of removing the occluding element from the virtual optical mirror is shown. This provides immediate visual feedback, helping the user better control the removal process.
[0127] The introduction of removal operations provides users with greater flexibility and control, allowing them to make corrections and adjustments during the creative process. This interactive method not only enhances the user experience but also makes the use of the virtual optical mirror more aligned with actual creative needs. Furthermore, by displaying the removal trajectory or removal action, the system provides users with intuitive visual feedback, helping them to control the removal process more precisely.
[0128] For example, in a virtual photography application, a user might accidentally add unwanted obstructions to the virtual optical lens. To correct this error, the user can remove them using a mouse or touchscreen. As the user interacts with the lens, the system will display a trail of the obstructing element gradually disappearing, or an animation demonstrating the process of erasing the obstruction, allowing the user to visually see the removal effect.
[0129] Before displaying the virtual optical mirror with attached occlusion elements, this method provides users with an interactive correction tool by responding to removal operations performed on the virtual optical mirror and displaying the removal trajectory or action of the occlusion elements. Users can easily remove unwanted occlusion elements while receiving immediate visual feedback.
[0130] In some embodiments, after displaying the second camera view, the following processing is performed:
[0131] In response to the lens retraction operation performed on the virtual optical lens after reflection processing, the virtual optical lens in the closed state is displayed;
[0132] In response to an opening operation performed on a virtual optical lens that is in a closed state, a second lens view is displayed.
[0133] The "close the lens" operation can be understood as the user instructing the virtual optical lens to close or retract through some interactive method (such as clicking a button, making a specific gesture, etc.). The "open the lens" operation can be understood as the opposite of the "close the lens" operation, where the user instructs the system to open or open the virtual optical lens through some interactive method. The "close the lens" operation refers to the user's action to the electronic device after the electronic device displays the second lens image (i.e., the image presented by the virtual optical lens after reflection processing, simulating focused visible light), instructing the user to close or retract the reflected virtual optical lens through a specific interactive method (such as clicking a preset button on the device interface, making a specific gesture in the virtual environment, triggering a physical button, or recognizing a preset action through a non-contact device, etc.). The core function of the "close the lens" operation is to trigger the state switch of the virtual optical lens; that is, after the electronic device responds to this operation, it will display the virtual optical lens in the closed state, realizing the transition of the virtual optical lens from the "reflected processing working state" to the "closed state". Meanwhile, the lens retraction operation corresponds to the subsequent "lens opening operation," together forming a closed loop of "closed-on" state control for the virtual optical lens. This not only meets the user's need to close the virtual optical lens when it is not in use (such as saving device computing resources and simplifying the interface display), but also provides an operational basis for quickly restoring the second lens image. This further improves the operational integrity and scene adaptability of the entire lens image processing method, and together with the aforementioned smearing operation and reflection processing operation, it supports the technical goal of "balancing the realism and stability of the lens image."
[0134] It should be noted that after the user views the second-lens image presented by the virtual optical lens after reflection processing, the electronic device provides further operational responses. When the user performs a "lens retraction" operation, the electronic device displays a virtual optical lens in a closed state, simulating the action of retracting or closing a camera in the real world. Subsequently, when the user wants to view the image again, they can perform a "lens retraction" operation on the closed virtual optical lens, at which point the system will redisplay the second-lens image.
[0135] This zoom-in and zoom-out design not only increases user interactivity with the virtual environment but also makes the entire experience closer to real-world usage habits. By simulating the operation of a real camera, users can more naturally control the state of the virtual optical lens, thereby enhancing immersion and ease of operation.
[0136] For example, in a virtual photography simulator, a user can observe and photograph scenery in a virtual world through a virtual lens. When the user wants to pause shooting or view other functions, they can click a "Close Lens" button. The virtual lens will then close, and a compact lens appearance will be displayed on the screen, indicating that the lens is currently closed. Later, when the user is ready to continue shooting, they can click the "Open Lens" button again. The virtual lens will then reopen, restoring the previous second-lens view.
[0137] The embodiments provided in this application, after displaying the second lens image, re-display the virtual optical lens in a closed state in response to the user's zoom-out operation, and re-display the second lens image in response to the zoom-on operation. This method provides the user with a smooth and intuitive interactive experience. Users can easily control the on and off state of the virtual optical lens, thus flexibly viewing or hiding the lens image as needed.
[0138] In some embodiments, after displaying the second camera view, the following processing is performed:
[0139] In response to the discard operation performed on the virtual optical lens after reflection processing, the virtual optical lens in the pick-up state is displayed;
[0140] In response to a pickup operation performed on a virtual optical lens that is in a pending pickup state, the virtual optical lens in a picked-up state is displayed;
[0141] In response to the opening operation performed on the virtual optical lens that is in the picked-up state, the first lens view is displayed.
[0142] The "discard" operation can be understood as the user placing the reflected virtual optical lens into a ready-to-pickup state through some interactive method. The discard operation refers to the user's action after the electronic device displays the second lens image (i.e., the image presented by the reflected virtual optical lens simulating focused visible light), using a specific interactive method (such as dragging the virtual optical lens to a designated area in the virtual environment, clicking the "discard" icon on the interface, making a preset throwing gesture, or recognizing a "release" action through a non-contact device), to switch the reflected virtual optical lens from its current working state to a ready-to-pickup state. The core function of this operation is to trigger the state transition of the virtual optical lens; that is, after the electronic device responds to this operation, it displays the virtual optical lens in a ready-to-pickup state, realizing the transformation of the virtual optical lens from "reflected working state" to "ready-to-pickup state," and the ready-to-pickup state provides a prerequisite for the subsequent "pickup operation."
[0143] The "pending pickup" state can be understood as the state where the virtual optical lens is discarded and is waiting to be picked up by the user again.
[0144] The "pickup" operation can be understood as the user's interaction to restore the virtual optical lens from a pending-pickup state to a picked-up state. Specifically, after the electronic device responds to a discard operation and displays the virtual optical lens in a pending-pickup state (this lens was previously in a reflective state and has entered the pending-pickup state after the discard operation), the user sends a specific interaction (such as clicking / dragging the lens in the pending-pickup state in the virtual environment, making a preset "grab" gesture, long-pressing to select the lens on a touchscreen, or recognizing "pickup" actions through a contactless device) to the electronic device to switch the virtual optical lens from the pending-pickup state to the picked-up state. The core function of this operation is to take over the lens state after the discard operation and trigger the transition of the virtual optical lens from the "pickup pending state" to the "picked-up state." That is, after the electronic device responds to this operation, it displays the virtual optical lens in the picked-up state, and this picked-up state provides the necessary prerequisites for subsequent lens-opening operations and restoring the first lens image.
[0145] In some embodiments, the picked-up state can be understood as the state after the virtual optical lens has been picked up again by the user.
[0146] It should be noted that after displaying the second lens image, this embodiment provides the possibility of performing more operations on the virtual optical lens after the reflection processing. When the user selects the "discard operation," the virtual optical lens will enter a pick-up-ready state, simulating a real-world scenario of discarding an item. Subsequently, the user can perform a "pick-up operation" on this lens in the pick-up-ready state to restore it to the picked-up state. Finally, when the user performs a "lens-open operation" on the picked-up virtual optical lens, this embodiment will display the first lens image instead of the previous second lens image. This means that after the lens is discarded and then picked up again, its reflection processing effect is removed or disabled.
[0147] For example, in a virtual battlefield game, a player might choose to discard their virtual scope for strategic reasons (e.g., to upgrade to a more advanced scope). When the player discards the scope, it falls to the ground and appears to be ready to be picked up. Later, when the player or a teammate decides to retrieve the scope, they can do so, restoring it to its picked-up state. Subsequently, when the player uses the scope again, because the scope may be damaged or its reflective properties may be malfunctioning, the original first-view view will be displayed when aiming down sights.
[0148] Through the embodiments provided in this application, after displaying the second camera view, a virtual optical lens in a pending pickup state is displayed in response to the user's discard operation, a virtual optical lens in a picked-up state is displayed in response to a pickup operation, and finally the first camera view is displayed in response to an zoom-in operation. This series of processes provides the user with a strategic and interactive experience. Users can flexibly handle the virtual optical lens according to the needs of the game or application, thereby increasing the diversity and fun of the entire experience.
[0149] In some embodiments, during the display of the first lens image, a first prompt message is displayed, wherein the first prompt message is used to indicate the operation method corresponding to the trigger operation of the reflection processing.
[0150] In some embodiments, during the display of the second lens image, a second prompt message is displayed, wherein the second prompt message is used to indicate the operation method corresponding to the reflection restoration operation.
[0151] The first prompt message can be understood as a prompt that appears when the first lens image is displayed. Its main function is to explain to the user how to trigger the reflection processing operation. The first prompt message refers to the information carrier actively presented to the user in various forms during the process of the electronic device displaying the first lens image (i.e., the image that simulates focusing visible light through a virtual optical lens to generate the first intensity of reflected light). Its presentation forms may include, but are not limited to: text form (such as displaying a text prompt in the corner of the screen that says "Click the lens icon / slide to smooth the lens to reduce reflected light"), icon form (such as displaying simplified icons such as "slide your finger" and "laser pointing" next to the virtual optical lens), animation form (such as playing a dynamic demonstration clip that shows "the lens reflection light is reduced after clicking the icon"), and interactive guidance form (such as displaying a flashing "trigger area" on the edge of the lens to prompt the user to click). Its core function is to clearly prompt users with the "operation method corresponding to the reflection processing trigger operation". Through a concrete form, it helps users quickly understand how to transition from the current first lens view to the second lens view (the image after reflection processing), avoiding usage obstacles caused by unclear operation. At the same time, it provides intuitive guidance for subsequent smooth execution of reflection processing steps such as smearing operation and selecting masking elements, indirectly ensuring a smooth transition of the lens image from "real reflection" to "stable display".
[0152] The second prompt message can be understood as a prompt that appears when the second lens image is displayed. Its main function is to guide the user to restore the reflected light. The second prompt message refers to the information carrier that is actively presented to the user in a scene-appropriate manner during the process of the electronic device displaying the second lens image (that is, the image that simulates focusing visible light and generating a second intensity of reflected light through a virtual optical lens after reflection processing). Its presentation form may include, but is not limited to: text + icon combination form (such as displaying "Click the 'Recycle' icon / make a grab gesture to restore the original lens image" with a "Pick Up" icon), step-by-step guidance form (such as prompting with numbers "1. Discard the lens → 2. Pick up the lens → 3. Click to open the scope and restore the original image"), and floating prompt form (such as a bubble text "Long press to open the scope and restore the reflected light" floating next to the lens in the picked-up state). Its core function is to guide users on how to restore the reflection. It helps users understand the path from the stable second screen to the real reflection first screen through a clear format. It forms a closed loop of operation guidance of "trigger-restore" with the first prompt message. For example, the first prompt message uses an animation to demonstrate "smear to trigger reflection", and the second prompt message uses a step-by-step guide to demonstrate "discard-pick-open the scope to restore". The two complement each other and further reduce the difficulty of understanding.
[0153] It should be noted that during the display of the first lens image, this embodiment of the application will simultaneously display a first prompt message, which is mainly used to tell the user how to trigger the reflection processing. Similarly, when displaying the second lens image, this embodiment of the application will display a second prompt message, which is used to guide the user on how to perform the reflection processing restoration operation.
[0154] For example, suppose that when the first shot of the photography simulation software is displayed, a prompt box appears on the screen saying "Right-click to process the reflection," which is the first prompt message. After the user follows the prompt, the shot changes to the second shot, and another prompt box appears on the screen saying "Right-click again to restore the reflection," which is the second prompt message.
[0155] Through the embodiments provided in this application, during the display of the first camera view, the user can clearly understand how to trigger the reflection processing by displaying the first prompt information, thus enabling a smoother transition to the next operation. Similarly, when displaying the second camera view, the appearance of the second prompt information allows the user to easily find the method to restore the reflection processing. This design not only enhances the user's operating experience but also ensures the smoothness and ease of use of the software or game.
[0156] As shown in Figure 4, the processing method for the camera image can be executed by an electronic device, such as the terminal device or server shown in Figure 1. The specific steps include:
[0157] S402, displaying the reflected light of the first illumination intensity, wherein the reflected light of the first illumination intensity is the reflected light generated by the virtual optical lens in the process of simulating focusing visible light, and the reflected light is the light generated when the simulated visible light is reflected on the virtual optical lens;
[0158] S404, Displaying the reflected light of the second illumination intensity, wherein the reflected light of the second illumination intensity is the reflected light generated by the virtual optical lens after reflection processing during the process of simulating focusing visible light, and the second illumination intensity is less than the first illumination intensity.
[0159] It should be noted that during the process of simulating the focusing of visible light, the virtual optical lens will generate reflected light. First, the reflected light, displaying the first light intensity, is generated by the virtual optical lens without any reflection processing. Subsequently, after the virtual optical lens undergoes reflection processing, the reflected light, displaying the second light intensity, is shown, and its light intensity is weaker than the previous first light intensity.
[0160] For specific implementation examples, please refer to the examples shown in the above-described lens image processing method; these examples will not be repeated here.
[0161] The embodiments provided in this application balance the realism and stability of the lens image display by using reflected light of a first intensity and a second intensity. The first intensity maintains the realism of a traditional virtual optical lens, simulating focused visible light and light reflection to present a highly realistic scene. The second intensity, however, undergoes reflection processing, reducing the intensity of the reflected light to enhance concealment and security, thus avoiding frequent lens switching and adjustments. Furthermore, by reducing frequent lens switching and adjustments, the system does not need to constantly recalculate lighting effects, saving computational resources. This improves the refresh rate and response speed of the lens image, further enhancing its display stability. Ultimately, this achieves the goal of maintaining display realism while improving stability, thus realizing a technical effect that balances display realism and stability.
[0162] In some embodiments, at least one of the following is performed:
[0163] The illumination intensity corresponding to the reflected light of the second illumination intensity is set to be less than the illumination intensity corresponding to the reflected light of the first illumination intensity;
[0164] The number of reflected rays corresponding to the second light intensity is set to be less than the number of reflected rays corresponding to the first light intensity;
[0165] The illumination range corresponding to the reflected light of the second light intensity is set to be smaller than the illumination range corresponding to the reflected light of the first light intensity.
[0166] Set the transparency of the reflected light at the second light intensity to be greater than the transparency of the reflected light at the first light intensity.
[0167] Illuminance can refer to the brightness of reflected light.
[0168] The number of light rays can refer to the number or density of light rays that make up the reflected light rays.
[0169] The illumination range can refer to the size of the area covered by reflected light.
[0170] Transparency can refer to the clarity of reflected light; the higher the transparency, the less noticeable the reflected light.
[0171] It should be noted that the embodiments of this application describe several methods for adjusting the visual difference between reflected light of a second illumination intensity and reflected light of a first illumination intensity. Specifically, the two types of reflected light can be distinguished by adjusting the illumination intensity, the number of light rays, the illumination range, and the transparency, so that the reflected light of the second illumination intensity is visually significantly weaker than the reflected light of the first illumination intensity.
[0172] Taking brightness setting as an example, the brightness of reflected light corresponding to a second brightness level is lower than that corresponding to a reflected light level of a first brightness level. This can be achieved as follows: When the electronic device simulates focusing visible light through a virtual optical lens, it first configures a basic brightness parameter for the reflected light in the first lens image (without reflection processing). This parameter corresponds to the first brightness level and can represent the true brightness of light reflection from the virtual optical lens, conforming to the reflection effect of a lens after receiving light in reality. When switching to the second lens image after performing reflection processing, the electronic device adjusts the brightness parameter of the reflected light, reducing it to a value lower than the basic parameter (corresponding to the second brightness level). Through this setting, the presence of reflected light in the second lens image can be preserved to maintain the scene realism of the virtual optical lens, while reducing the brightness level reduces the interference of reflected light on the main content of the image (such as avoiding local overexposure caused by strong light reflection), thereby improving the display stability of the second lens image and meeting the technical goal of "balancing realism and stability".
[0173] Taking the number of light rays as an example, setting the number of reflected light rays corresponding to the second illumination intensity to be less than the number of reflected light rays corresponding to the first illumination intensity can be achieved in the following way: When generating the first lens image, the electronic device configures a higher number parameter for the reflected light rays based on the lighting conditions of the virtual environment (such as simulating a strong light environment) (corresponding to the first illumination intensity, restoring the scene of multiple light rays reflecting off the lens under strong light in reality); when switching to the second lens image after performing reflection processing, the electronic device reduces the number parameter of reflected light rays (corresponding to the second illumination intensity). This setting reduces the impact of reflected light rays on the lens image from the source by reducing the number of reflected light rays, avoiding image clutter due to excessive light rays, retaining a small number of reflected light rays to maintain the realistic attributes of the virtual lens, and reducing the rendering calculation load of the device on reflected light rays, indirectly improving the screen refresh rate and further ensuring display stability.
[0174] Taking the setting of illumination range as an example, the illumination range corresponding to the reflected light with a second illumination intensity is smaller than the illumination range corresponding to the reflected light with a first illumination intensity. This can be achieved in the following way: When the electronic device displays the first lens image, it sets a larger illumination range parameter for the reflected light (corresponding to the first illumination intensity, simulating the effect of a large area of light reflection on the lens surface in reality, ensuring the realism of the scene); when switching to the second lens image after performing reflection processing, the electronic device reduces the illumination range parameter of the reflected light (corresponding to the second illumination intensity). This setting, by limiting the coverage area of the reflected light, concentrates the interference of the reflected light on the image in non-core areas, ensuring the clarity of the core content of the lens image (such as the focused visible light image), while retaining a small range of reflected light to maintain the realism of the virtual lens. At the same time, because the illumination range is reduced, the rendering range of the reflected light by the device is correspondingly reduced, reducing the computational load and helping to improve the stability and response speed of the image display.
[0175] Taking transparency settings as an example, setting the transparency of reflected light at the second light intensity to be greater than that at the first light intensity can be achieved as follows: When generating the first scene, the electronic device configures a lower transparency parameter for the reflected light (at this time, the reflected light is clearly visible, corresponding to the first light intensity, restoring the obvious effect of lens reflection in reality, ensuring image realism); when switching to the second scene after reflection processing, the electronic device increases the transparency parameter of the reflected light (at this time, the reflected light is blurred and inconspicuous, corresponding to the second light intensity). This setting weakens the visibility of reflected light by increasing transparency, avoiding the obscuring of the main subject due to overly clear reflected light, while maintaining the realism of the virtual lens by retaining low-resolution reflected light. It also avoids completely deleting reflected light (reducing rendering logic complexity), effectively reducing the impact of reflected light on display stability while ensuring image realism, thus meeting the technical goal of "balancing both."
[0176] These settings not only affect visual effects but also simulate the realistic effects of different lens materials and processing. For example, some high-end lenses use special anti-reflective coatings that reduce light reflection, resulting in sharper images. By adjusting the parameters mentioned above, similar effects can be simulated, helping users better understand and choose suitable lenses.
[0177] For example, suppose we simulate a camera lens in 3D modeling software. Without reflection processing, the reflected light from the lens at its initial illumination intensity is very bright (high brightness), composed of many dense rays (high ray count), covering most of the lens (large illumination range), and is very sharp (low transparency). After reflection processing, the brightness of the reflected light decreases (low brightness), the rays become sparser (low ray count), covering only a small area of the lens (small illumination range), and becomes more blurred (high transparency).
[0178] By adjusting at least one of the following: illumination intensity, light quantity, illumination range, or transparency, embodiments of this application can simulate the visual difference in reflected light between a virtual optical lens with reflective processing and an unprocessed lens. This difference not only enhances the realism of the virtual environment but also provides users with more intuitive feedback.
[0179] As one approach, for ease of understanding, the aforementioned camera image processing method is applied to battlefield simulation games (this is just an example and not limited to this type of game). This simulates a realistic, concealed sniping experience, avoiding enemy detection while preventing environmental vegetation from interfering with the sniper's field of vision. Battlefield simulation games can be understood as a multiplayer online shooting game mode that simulates large-scale battle scenarios, emphasizing teamwork and strategic planning. The core gameplay revolves around real-time battles between players, stressing the importance of teamwork. Players need to cooperate closely with teammates to complete tasks and achieve objectives. Players also need to develop strategies and plans, rationally allocating resources and forces to deal with enemy attacks and defenses.
[0180] In some embodiments, as shown in Figure 5, once the player opens the scope, a strong reflection 501 (such as "sniper position reflection") will be generated in the field of vision of the target, exposing the player's position and preventing the player from carrying out concealed sniping. Here, scope reflection can refer to a bright or flashing phenomenon that can be detected by the target or enemy observer at a distance due to light shining on the surface of the scope and being reflected during sniping.
[0181] This glare can reveal a sniper's position. To avoid being detected by the enemy due to scope glare, snipers typically take a series of measures, such as reducing direct light shining onto the scope and using obstructions (i.e., blocking elements) to reduce glare. These measures aim to reduce the risk of scope glare and protect the sniper's concealment and safety. In virtual games, a flash is usually displayed at the sniper's position within the player's field of view to indicate a glare, highlighting the sniper's location.
[0182] In some embodiments, when a player opens the scope in a specific environment, an option to remove reflections is provided. Responding to the click of this option, environmental textures are applied to the edge of the scope to reduce reflections; for example, mud or leaves can be applied. Additionally, vegetation models near the gun can be bent or peeled off to avoid obstructing the scope's view, providing a more realistic and immersive concealed sniping experience. Furthermore, players can remove the environmental textures at any time to restore the field of view and reduce reflections.
[0183] For example, as shown in Figure 6, when a player arrives in a specific virtual environment and opens the scope, a key operation prompt will appear on the screen, such as "F Remove Glare" 601. When the player presses the "F" key on the keyboard, the glare removal operation will be triggered. The specific environment depends on the game design and could be dirt, bushes, wetlands, jungles, etc.
[0184] Based on the scenario shown in Figure 6, and continuing as shown in Figure 7, when the player triggers the de-reflection operation, the character begins the painting (i.e., smearing) action. After the action is completed, obstructions corresponding to the player's environment appear around the scope, such as dirt 701 or leaves. During the painting process, the character can apply the obstructions 702 on their hand (such as dirt 703) to the scope 704, so that the scope is painted with obstructions (such as dirt 705). However, the player should avoid obstructing the view of the central crosshair. At this time, when the player aims at the enemy, the reflections appearing in the enemy's field of vision will be greatly reduced.
[0185] Based on the scenario shown in Figure 7, and continuing as shown in Figure 8, after the player completes the glare removal operation, a key operation prompt 801 will appear on the screen, such as "F Restore Vision". At this time, the player can press the "F key" on the keyboard to trigger the restoration of vision operation. The character will begin playing the glare removal animation. After the animation is completed, the obstruction on the scope will be removed. When the player aims at the enemy, the glare in the enemy's field of vision will return to its original intensity.
[0186] The obstruction on the scope will remain with the item gun. Even after the player leaves the specific environment and reopens the scope, they will still see the obstruction and the "F Restore View" prompt. If the item gun is dropped by the player, the obstruction will disappear, and it will no longer be visible when picked up again.
[0187] As shown in Figure 9, this embodiment of the application describes the process of how a player handles scope glare when using a sniper rifle in a battlefield simulation game. The entire process, through environmental detection, user interface (UI) prompts, button responses, action playback, and effect processing, enables the player to remove scope glare and restore their field of vision in a specific environment. The specific steps are as follows:
[0188] S904, open the scope.
[0189] For example, in response to the opening operation of the scope, the scope is opened, and preparation for aiming is made.
[0190] S906, Environmental Testing.
[0191] For example, it detects whether the player-controlled character is within a specific environment trigger box (such as dirt, bushes, wetlands, jungles, etc.). If the virtual object controlled by the player is not within the specific environment trigger box, S910 is executed, no subsequent operation is triggered, and the "Remove Reflection" operation prompt is hidden; if the virtual object controlled by the player is within the specific environment trigger box, S908 is executed, and the "Remove Reflection" operation prompt is displayed.
[0192] S908 displays an operation prompt to "remove reflections".
[0193] For example, the player's screen displays an operation prompt to "remove glare," indicating that the player can perform this action.
[0194] S910, hide the "Remove Reflection" operation prompt.
[0195] S912, key detection.
[0196] For example, if the F key is pressed by the player, the anti-reflection function is triggered, S914 is executed, and the "anti-reflection" operation prompt is hidden.
[0197] For example, if the F key is not pressed by the player and the scope is closed or the player leaves the trigger box, then S910 is executed, the "remove glare" operation prompt is hidden, and the glare removal operation is not performed.
[0198] S914, begin removing reflections.
[0199] For example, after triggering the de-glare function, the character begins to play the animation of applying a paint-on scope. Paint effects (such as yellow soil, leaf graphics, etc.) appear around the scope, displaying different UI depending on the environment, while avoiding obstructing the central view.
[0200] S916-1, play the smearing action.
[0201] For example, after triggering the anti-reflection function, the animation of the painted scope is played.
[0202] S916-2, the aiming lens displays the smearing effect.
[0203] For example, after playing the action of painting a scope, the aiming lens displays the painting effect.
[0204] S916-3, hide the "Remove Reflection" operation prompt.
[0205] For example, while displaying the smearing effect through the lens, the "remove reflection" operation prompt is hidden.
[0206] S916-4 displays the "Restore View" operation prompt.
[0207] For example, hide the "Remove Reflection" prompt and display the "Restore Vision" prompt.
[0208] S916-5 reduces the amount of reflection produced.
[0209] For example, after the smearing effect is displayed on the lens, the resulting reflection is reduced.
[0210] It should be noted that there is no clear order between S916-1 and S916-5.
[0211] S918, regaining visibility.
[0212] For example, a button prompt appears on the screen to "Restore View".
[0213] S920-1, play the removal action.
[0214] For example, when the player presses the F key, the character will perform an action of removing the paint.
[0215] S920-2, the aiming lens displays the effect of removing smears.
[0216] S920-3, hide the "Restore View" operation prompt.
[0217] S920-4, Reflective Restoration.
[0218] For example, after the action is completed, the obstruction on the scope is removed, and the reflection in the enemy's field of vision returns to its original intensity.
[0219] Similarly, there is no obvious order between S920-1 and S920-4.
[0220] Trigger boxes are created in specific environments, such as dirt, bushes, wetlands, and jungles. When a scope is detected activated within the trigger box, a signal is sent to the player, and the player's screen displays the "F - Deglare" prompt. The specific content displayed depends on the game's design. Simultaneously, the system checks if the F key is pressed by the player. If the F key is pressed, the deglare removal function is triggered, and the "F - Deglare" prompt is hidden. If the scope is deactivated without the F key being pressed, or if the character leaves the trigger box, the "F - Deglare" prompt is hidden. When the deglare removal function is triggered, the character begins the animation of applying a scope.
[0221] After the player finishes the de-glare removal animation, a paint effect will appear around the scope. This effect can be achieved through UI-drawn graphics, which can be pre-drawn, such as loess or leaf patterns. Different paint effects will be displayed depending on the environment the player's character is in. The paint effect should avoid obstructing the player's central field of view to prevent affecting aiming. Since different attack items have different scope models, styles, and sizes, the paint area needs to be planned for different scopes, allowing the paint effect to appear on different areas of the scope according to the planned area.
[0222] Based on the scenario shown in Figure 5, and continuing as shown in Figure 10, when the player triggers the function to remove reflections, the reflections appearing in the enemy's field of vision will be greatly weakened when the player aims at the enemy. In other words, the reflections at the sniper's position will be processed from strong reflections 1001 to weak reflections 1002. The process of processing strong reflections into weak reflections can be achieved by reducing the brightness, size, and opacity of the reflections.
[0223] For example, after the player finishes removing the glare, a key operation prompt will appear on the screen, such as "F Restore Vision". At this time, the player presses the "F" key on the keyboard, and the character will start playing the action of removing the paint. After the action is completed, the obstruction on the scope will be removed. When the player aims at the enemy, the glare in the enemy's field of vision will return to its original intensity.
[0224] Through the embodiments of this application, when the scope is opened in a specific environment, an option to remove reflections is provided. After the option is clicked, environmental materials (i.e., environmental elements) are applied to the edge of the scope to reduce reflections, allowing the player-controlled character to better conceal themselves. Players can remove the environmental materials at any time to restore the field of view and reduce reflections. In addition, the vegetation model near the gun body is bent or peeled off to avoid obstructing the scope's field of view, providing a more realistic and immersive concealed sniping experience.
[0225] It is understood that in the specific embodiments of this application, data such as user information are involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.
[0226] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application.
[0227] According to another aspect of the embodiments of this application, a lens image processing apparatus for implementing the above-described lens image processing method is also provided. As shown in FIG11, the apparatus includes:
[0228] The first display unit 1102 is configured to display the first lens image, wherein the first lens image is the image presented when the visible light is focused through a virtual optical lens. During the process of simulating the focusing of the visible light, the virtual optical lens will generate reflected light of a first light intensity. The reflected light is the light generated when the simulated visible light is reflected on the virtual optical lens.
[0229] The second display unit 1104 is configured to display a second lens image in response to a reflection processing operation performed on a virtual optical lens. The second lens image is an image presented when focusing visible light through a virtual optical lens after reflection processing. During the process of simulating focusing visible light, the virtual optical lens after reflection processing will generate reflected light with a second light intensity, which is less than the first light intensity.
[0230] For specific implementation examples, please refer to the examples shown in the above-described lens image processing method; these examples will not be repeated here.
[0231] As one option, the device also includes:
[0232] The third display unit is configured to display a virtual optical lens with added blocking elements after displaying the first lens image. The virtual optical lens after reflection processing includes a virtual optical lens with added blocking elements, which are used to reduce the amount of reflected light.
[0233] For specific implementation examples, please refer to the examples shown in the above-described lens image processing method; these examples will not be repeated here.
[0234] As one option, the device also includes:
[0235] The fourth display unit is configured to display the virtual environment in which the virtual optical lens is located, wherein the virtual environment includes environmental elements that can be attached to the virtual optical lens as occlusion elements.
[0236] For specific implementation examples, please refer to the examples shown in the above-described lens image processing method; these examples will not be repeated here.
[0237] As one solution, the third display unit includes:
[0238] A first display module is configured to display a virtual optical mirror with an attached occlusion element in response to a first additional operation performed on a first ambient element; or,
[0239] The second display module is configured to display a virtual optical mirror with an attached occlusion element in response to a second additional operation performed on a second ambient element; or,
[0240] The third display module is configured to display a virtual optical mirror with an additional occlusion element in response to a third additional operation performed on the first and second environmental elements, wherein the occlusion element is the first and second environmental elements.
[0241] For specific implementation examples, please refer to the examples shown in the above-described lens image processing method; these examples will not be repeated here.
[0242] As one option, the device also includes at least one of the following:
[0243] The fifth display unit is configured to, in response to a smearing operation performed on the virtual optical mirror, display the smearing trajectory of the occluding element on the virtual optical mirror before displaying the virtual optical mirror with the occluding element attached;
[0244] The sixth display unit is configured to, in response to a smearing operation performed on the virtual optical mirror, display the action of applying the smearing element to the virtual optical mirror before displaying the virtual optical mirror with the smearing element attached;
[0245] The reflective treatment process includes a coating process.
[0246] For specific implementation examples, please refer to the examples shown in the above-described lens image processing method; these examples will not be repeated here.
[0247] As one solution, the fifth display unit includes:
[0248] The fourth display module is configured to display the smearing trajectory of the occluding element in the non-collision area of the virtual optical lens when the collimation area is included on the virtual optical lens.
[0249] For specific implementation examples, please refer to the examples shown in the above-described lens image processing method; these examples will not be repeated here.
[0250] As one option, the device also includes at least one of the following:
[0251] The seventh display unit is configured to, in response to a removal operation performed on the virtual optical mirror, display the removal trajectory of the occluding element on the virtual optical mirror before displaying the virtual optical mirror with the occluding element attached;
[0252] The eighth display unit is configured to, in response to a removal operation performed on the virtual optical mirror, display an action that removes the occluding element from the virtual optical mirror before displaying the virtual optical mirror with the occluding element attached.
[0253] For specific implementation examples, please refer to the examples shown in the above-described lens image processing method; these examples will not be repeated here.
[0254] As one option, the device also includes:
[0255] The ninth display unit is configured to display the virtual optical lens in a closed state after displaying the second lens image, in response to the lens retraction operation performed on the virtual optical lens after reflection processing;
[0256] The tenth display unit is configured to display the second lens image after displaying the second lens image, in response to an opening operation performed on the virtual optical lens that is in a closed state.
[0257] For specific implementation examples, please refer to the examples shown in the above-described lens image processing method; these examples will not be repeated here.
[0258] As one option, the device also includes:
[0259] The eleventh display unit is configured to, after displaying the second lens image, display the virtual optical lens in a state of being ready to be picked up in response to a discard operation performed on the virtual optical lens after reflection processing;
[0260] The twelfth display unit is configured to, after displaying the second lens image, display the virtual optical lens in the picked-up state in response to a pickup operation performed on the virtual optical lens in the pickup state.
[0261] The thirteenth display unit is configured to display the first lens image after displaying the second lens image, in response to an opening operation performed on the virtual optical lens that is in the picked-up state.
[0262] For specific implementation examples, please refer to the examples shown in the above-described lens image processing method; these examples will not be repeated here.
[0263] As one embodiment, the device further includes: a fourteenth display unit, configured to display a first prompt message during the display of the first lens image, wherein the first prompt message is used to indicate the operation mode corresponding to the trigger operation of the reflection processing;
[0264] The device also includes a fifteenth display unit, configured to display a second prompt message during the display of the second lens image, wherein the second prompt message is used to indicate the operation mode corresponding to the reflection processing restoration operation.
[0265] For specific implementation examples, please refer to the examples shown in the above-described lens image processing method; these examples will not be repeated here.
[0266] According to another aspect of the embodiments of this application, another lens image processing apparatus for implementing the above-described lens image processing method is also provided. As shown in FIG12, the apparatus includes:
[0267] The sixteenth display unit 1202 is configured to display reflected light of a first illumination intensity, wherein the reflected light of the first illumination intensity is the reflected light generated by the virtual optical lens in the process of simulating focusing visible light, and the reflected light is the light generated when the simulated visible light is reflected on the virtual optical lens;
[0268] The seventeenth display unit 1204 is configured to display reflected light of a second light intensity, wherein the reflected light of the second light intensity is reflected light generated by the virtual optical lens after reflection processing during the process of simulating focusing visible light, and the second light intensity is less than the first light intensity.
[0269] For specific implementation examples, please refer to the examples shown in the above-described lens image processing method; these examples will not be repeated here.
[0270] As one option, the device also includes at least one of the following:
[0271] The first setting unit is configured to set the illuminance corresponding to the reflected light of the second light intensity to be less than the illuminance corresponding to the reflected light of the first light intensity.
[0272] The second setting unit is configured to set the number of reflected rays corresponding to the second illumination intensity to be less than the number of reflected rays corresponding to the first illumination intensity.
[0273] The third setting unit is configured to set the illumination range corresponding to the reflected light of the second illumination intensity to be smaller than the illumination range corresponding to the reflected light of the first illumination intensity.
[0274] The fourth setting unit is configured to set the transparency corresponding to the reflected light of the second illumination intensity to be greater than the transparency corresponding to the reflected light of the first illumination intensity.
[0275] For specific implementation examples, please refer to the examples shown in the above-described lens image processing method; these examples will not be repeated here.
[0276] According to another aspect of the embodiments of this application, an electronic device for implementing the above-described processing method for lens images is also provided. The electronic device may be, but is not limited to, the terminal device 102 or the server 112 shown in FIG1. This embodiment uses the terminal device 102 as an example for illustration. Further, as shown in FIG13, the electronic device includes a memory 1302 and a processor 1304. The memory 1302 stores a computer program, and the processor 1304 is configured to execute the steps in any of the above-described method embodiments through the computer program.
[0277] In some embodiments, the aforementioned electronic device may be located in at least one of a plurality of network devices in a computer network.
[0278] In some embodiments, the processor described above may be configured to perform the following steps via a computer program:
[0279] The first shot image is displayed. The first shot image is the image presented when the visible light is focused through a virtual optical lens. During the process of simulating the focusing of the visible light, the virtual optical lens will generate reflected light of the first light intensity. The reflected light is the light produced when the simulated visible light is reflected on the virtual optical lens.
[0280] In response to the reflection processing operation performed on the virtual optical lens, a second lens image is displayed. This second lens image simulates the image presented when visible light is focused using the reflected virtual optical lens. During the simulation of focusing visible light, the reflected virtual optical lens generates reflected light with a second intensity lower than the first intensity.
[0281] The reflected light ray of the first illumination intensity is the reflected light ray generated by the virtual optical lens in the process of simulating focusing visible light. The reflected light ray is the light ray generated when the simulated visible light ray is reflected on the virtual optical lens.
[0282] In response to the reflection processing operation performed on the virtual optical lens, a reflected ray with a second illumination intensity is displayed, wherein the reflected ray with the second illumination intensity is the reflected ray generated by the virtual optical lens after reflection processing during the process of simulating focusing visible light, and the second illumination intensity is less than the first illumination intensity.
[0283] Those skilled in the art will understand that the structure shown in FIG13 is merely illustrative and does not limit the structure of the electronic device described above. For example, the electronic device may include more or fewer components (such as network interfaces) than shown in FIG13, or have a different configuration than that shown in FIG13.
[0284] The memory 1302 can be used to store software programs and modules, such as the program instructions / modules corresponding to the lens image processing method and apparatus in this embodiment. The processor 1304 executes various functional applications and data processing by running the software programs and modules stored in the memory 1302, thereby realizing the lens image processing method described above. The memory 1302 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 1302 may further include memory remotely located relative to the processor 1304, and these remote memories can be connected to electronic devices via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof. Specifically, the memory 1302 may be used, but is not limited to, to store information such as virtual optical lenses, reflected light, and visible light. As an example, as shown in FIG13, the memory 1302 may include, but is not limited to, the first display unit 1102 and the second display unit 1104 (or the sixteenth display unit 1202 and the seventeenth display unit 1204 not shown in the figure) in the lens image processing device. In addition, other module units in the lens image processing device may also be included, but not limited to, those not described in this example.
[0285] In some embodiments, the transmission device 1306 described above is used to receive or send data via a network. Specific examples of the network described above may include wired networks and wireless networks. In one example, the transmission device 1306 includes a Network Interface Controller (NIC), which can be connected to other network devices and a router via a network cable to communicate with the Internet or a local area network. In another example, the transmission device 1306 is a Radio Frequency (RF) module, used for wireless communication with the Internet.
[0286] In addition, the aforementioned electronic device also includes: a display 1308 for displaying information such as the virtual optical lens, reflected light, and visible light; and a connection bus 1310 for connecting various module components in the aforementioned electronic device.
[0287] In other embodiments, the aforementioned terminal device or server can be a node in a distributed system, wherein the distributed system can be a blockchain system, which is a distributed system formed by connecting multiple nodes through network communication. The nodes can form a peer-to-peer network, and any form of computing device, such as a server, terminal device, or other electronic device, can become a node in the blockchain system by joining this peer-to-peer network.
[0288] According to one aspect of this application, a computer program product is provided, comprising a computer program / instructions containing program code for performing the methods shown in the flowchart. In such embodiments, the computer program can be downloaded and installed from a network via a communication component, and / or installed from a removable medium. When the computer program is executed by a central processing unit, it performs various functions provided in embodiments of this application.
[0289] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0290] It should be noted that the computer system of the electronic device is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of this application.
[0291] A computer system includes a Central Processing Unit (CPU), which performs various appropriate actions and processes based on programs stored in Read-Only Memory (ROM) or loaded from RAM. ROM also stores various programs and data required for system operation. The CPU, ROM, and RAM are interconnected via a bus. Input / output interfaces (I / O interfaces) are also connected to the bus.
[0292] The following components are connected to the input / output interface: input sections including keyboards, mice, etc.; output sections including cathode ray tubes (CRTs), liquid crystal displays (LCDs), and speakers; storage sections including hard drives; and communication sections including network interface cards such as LAN cards and modems. The communication section performs communication processing via a network such as the Internet. Drives are also connected to the input / output interface as needed. Removable media, such as disks, optical discs, magneto-optical discs, semiconductor memories, etc., are installed on the drive as needed so that computer programs read from them can be installed into the storage section as required.
[0293] Specifically, according to embodiments of this application, the processes described in the various method flowcharts can be implemented as computer software programs. For example, embodiments of this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication component, and / or installed from a removable medium. When the computer program is executed by a central processing unit, it performs various functions defined in the system of this application.
[0294] According to one aspect of this application, a computer-readable storage medium is provided, wherein a processor of a computer device reads computer instructions from the computer-readable storage medium, and executes the computer instructions, causing the computer device to perform the methods provided in the various alternative implementations described above.
[0295] In some embodiments, the computer-readable storage medium described above may be configured to store a computer program for performing the following steps:
[0296] The first shot image is displayed. The first shot image is the image presented when the visible light is focused through a virtual optical lens. During the process of simulating the focusing of the visible light, the virtual optical lens will generate reflected light of the first light intensity. The reflected light is the light produced when the simulated visible light is reflected on the virtual optical lens.
[0297] The display shows a second lens image, which simulates the image presented when visible light is focused using a virtual optical lens with reflective processing. During the simulation of focusing visible light, the virtual optical lens generates reflected light with a second intensity, which is less than the first intensity. Alternatively,
[0298] The reflected light ray of the first illumination intensity is the reflected light ray generated by the virtual optical lens in the process of simulating focusing visible light. The reflected light ray is the light ray generated when the simulated visible light ray is reflected on the virtual optical lens.
[0299] The reflected light shows a second light intensity, wherein the reflected light of the second light intensity is the reflected light generated by the virtual optical lens after reflection processing during the process of simulating focusing visible light, and the second light intensity is less than the first light intensity.
[0300] In the embodiments of this application, the terms "module" or "unit" refer to a computer program or part of a computer program that has a predetermined function and works with other related parts to achieve a predetermined goal, and can be implemented wholly or partially using software, hardware (such as processing circuitry or memory), or a combination thereof. Similarly, a processor (or multiple processors or memory) can be used to implement one or more modules or units. Furthermore, each module or unit can be part of an overall module or unit that includes the functionality of that module or unit.
[0301] In some embodiments, those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing related hardware of an electronic device. The program can be stored in a computer-readable storage medium, which may include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, etc.
[0302] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0303] If the integrated units in the above embodiments are implemented as software functional units and sold or used as independent products, they can be stored in the aforementioned computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause one or more computer devices (which may be personal computers, servers, or network devices, etc.) to execute all or part of the steps of the methods of the various embodiments of this application.
[0304] In the above embodiments of this application, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.
[0305] In the several embodiments provided in this application, it should be understood that the disclosed terminal device can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling or direct coupling or communication connection may be through some interfaces; the indirect coupling or communication connection of units or modules may be electrical or other forms.
[0306] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0307] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0308] The above description is only a preferred embodiment of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications should also be considered within the scope of protection of this application.
Claims
1. A method for processing camera images, applied to electronic devices, comprising: The first lens image is displayed, wherein the first lens image is the image presented when a visible light is focused through a virtual optical lens. During the process of simulating focusing the visible light, the virtual optical lens will generate reflected light of a first light intensity. The reflected light is the light generated when the visible light is reflected on the virtual optical lens. In response to the reflection processing operation performed on the virtual optical lens, a second lens image is displayed, wherein the second lens image is the image presented when the visible light is simulated by the virtual optical lens after reflection processing. During the process of simulating focusing the visible light, the virtual optical lens after reflection processing will generate reflected light with a second light intensity, which is less than the first light intensity.
2. The method according to claim 1, wherein, After displaying the first shot image, the method further includes: The virtual optical lens is shown with an added blocking element, wherein the virtual optical lens after reflection processing includes the virtual optical lens with the added blocking element, the blocking element being used to reduce the amount of reflected light.
3. The method according to claim 2, wherein, Before displaying the virtual optical mirror with the attached occlusion element, the method further includes: The virtual environment in which the virtual optical lens is located is displayed, wherein the virtual environment includes environmental elements that can be attached to the virtual optical lens as occlusion elements.
4. The method according to claim 3, wherein, When the virtual environment includes a first environmental element and a second environmental element, the virtual optical mirror with attached occlusion elements includes: In response to a first additional operation performed on the first ambient element, the virtual optical mirror with the attached occlusion element is displayed, wherein the occlusion element is the first ambient element; or, In response to a second additional operation performed on the second ambient element, the virtual optical mirror with the occlusion element attached is displayed, wherein the occlusion element is the second ambient element; or, In response to a third additional operation performed on the first ambient element and the second ambient element, the virtual optical mirror with the occlusion element attached is displayed, wherein the occlusion element is the first ambient element and the second ambient element.
5. The method according to any one of claims 2-4, wherein, Before displaying the virtual optical mirror with the attached occlusion element, in response to a smearing operation performed on the virtual optical mirror, the method further includes at least one of the following: The smearing trajectory of the occluding element is displayed on the virtual optical mirror; The action of applying the occluding element to the virtual optical mirror is displayed; The reflective treatment operation includes the coating operation.
6. The method according to claim 5, wherein, When the virtual optical lens includes a collimation area, displaying the smearing trajectory of the occluding element on the virtual optical lens includes: In the non-collision area on the virtual optical mirror, the smearing trajectory of the occluding element is displayed.
7. The method according to any one of claims 2-6, wherein, Before displaying the virtual optical mirror with the attached occlusion element, in response to a removal operation performed on the virtual optical mirror, the method further includes at least one of the following: The removal trajectory of the occluding element is displayed on the virtual optical mirror; This shows the action of removing the occluding element from the virtual optical mirror.
8. The method according to any one of claims 1-7, wherein, After displaying the second camera view, the method further includes: In response to the lens retraction operation performed on the virtual optical lens after reflection processing, the virtual optical lens is displayed as being in a closed state; In response to an opening operation performed on the virtual optical lens that is in a closed state, the second lens image is displayed.
9. The method according to any one of claims 1-8, wherein, After displaying the second camera view, the method further includes: In response to a discard operation performed on the virtual optical lens after reflection processing, the virtual optical lens is displayed in a pick-up state; In response to a pickup operation performed on the virtual optical lens in a pending pickup state, the virtual optical lens in a picked-up state is displayed; In response to the opening operation performed on the virtual optical lens that is in the picked-up state, the first lens image is displayed.
10. The method according to any one of claims 1-9, wherein, During the process of displaying the first lens image, the method further includes: displaying a first prompt message, wherein the first prompt message is used to indicate the operation mode corresponding to the triggering operation of the reflection processing; and / or, During the process of displaying the second lens image, the method further includes: displaying a second prompt message, wherein the second prompt message is used to indicate the operation mode corresponding to the reflection processing restoration operation.
11. A method for processing camera images, applied to electronic devices, comprising: The reflected light ray of the first illumination intensity is the reflected light ray generated by the virtual optical lens in the process of simulating focusing visible light, and the reflected light ray is the light ray generated when the visible light is reflected on the virtual optical lens; The reflected light shows a second light intensity, wherein the reflected light of the second light intensity is the reflected light generated by the virtual optical lens after reflection processing during the process of simulating focusing the visible light, and the second light intensity is less than the first light intensity.
12. The method according to claim 11, wherein, The method further includes at least one of the following: The illuminance corresponding to the reflected light of the second light intensity is set to be less than the illuminance corresponding to the reflected light of the first light intensity; The number of reflected rays corresponding to the second light intensity is set to be less than the number of reflected rays corresponding to the first light intensity; The illumination range corresponding to the reflected light of the second light intensity is set to be smaller than the illumination range corresponding to the reflected light of the first light intensity; The transparency of the reflected light at the second light intensity is set to be greater than the transparency of the reflected light at the first light intensity.
13. A processing apparatus for a camera image, comprising: The first display unit is configured to display a first lens image, wherein the first lens image is an image presented by simulating the focusing of visible light through a virtual optical lens. During the process of simulating the focusing of the visible light, the virtual optical lens will generate reflected light of a first light intensity. The reflected light is the light generated when the visible light is reflected on the virtual optical lens. The second display unit is configured to display a second lens image in response to a reflection processing operation performed on the virtual optical lens. The second lens image is the image presented when the visible light is simulated by the virtual optical lens after reflection processing. During the process of simulating focusing the visible light, the virtual optical lens after reflection processing will generate reflected light with a second light intensity, which is less than the first light intensity.
14. A processing apparatus for a camera image, comprising: The sixteenth display unit is configured to display reflected light of a first illumination intensity, wherein the reflected light of the first illumination intensity is reflected light generated by the virtual optical lens during the process of simulating focusing visible light, and the reflected light is light generated when the visible light is reflected on the virtual optical lens; The seventeenth display unit is configured to display reflected light of a second light intensity, wherein the reflected light of the second light intensity is reflected light generated by the virtual optical lens after reflection processing during the process of simulating focusing the visible light, and the second light intensity is less than the first light intensity.
15. A computer-readable storage medium comprising a stored program that, when executed by an electronic device, performs the method of any one of claims 1 to 10 or 11 to 12.
16. A computer program product comprising a computer program / instructions that, when executed by a processor, implement the steps of the method as described in any one of claims 1 to 10 or 11 to 12.
17. An electronic device comprising a memory and a processor, the memory storing a computer program, the processor being configured to perform the method of any one of claims 1 to 10 or 11 to 12 via the computer program.