A visual assistance enhancement method and electronic device

By obtaining the environmental brightness value in electronic devices and adjusting the difference in projection brightness value, combined with laser projection technology, the problem of poor projection image clarity in electronic devices when environmental changes is solved, and effective projection effect in different environments is achieved.

CN116320367BActive Publication Date: 2024-11-26SHANGHAI HONGJI INFORMATION TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310251798.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-03-15
Publication Date
2024-11-26
Estimated Expiration
2043-03-15

AI Technical Summary

Technical Problem

When existing electronic devices with projection function change in the environment, especially when they are transferred from indoors to outdoors, it is difficult to maintain the clarity of the projection image because the projection brightness is similar to the environmental brightness, making it difficult for human eyes to see clearly.

Method used

By obtaining the difference between the ambient brightness value and the projected brightness value, if the difference is less than the preset threshold, the difference is increased to enhance the projected brightness. If the difference is greater than or equal to the threshold, the difference is reduced to control it within the preset range Inside, use a camera or sensor to collect the ambient brightness values ​​and use a laser emitter to project lasers when necessary to improve the projection brightness.

Benefits of technology

It effectively enhances the visual projection effect of electronic devices under environmental changes, ensuring that the projected images can be clearly displayed in different environments, meeting the projection requirements from indoor to outdoor.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116320367B_ABST
    Figure CN116320367B_ABST
Patent Text Reader

Abstract

The present application provides a visual assistance enhancement method and an electronic device, the method comprising: obtaining an ambient brightness value of an electronic device; if the difference between the ambient brightness value and the projection brightness value of the electronic device is less than the minimum value of a preset threshold range, increasing the difference between the ambient brightness value and the projection brightness value to visually assist in enhancing the projection image of the electronic device; if the difference between the ambient brightness value and the projection brightness value of the electronic device is greater than or equal to the maximum value of a preset threshold range, reducing the difference between the ambient brightness value and the projection brightness value to visually assist in enhancing the projection image of the electronic device. When the difference between the ambient brightness value and the projection brightness value of the electronic device is not within the preset threshold range, the difference is controlled within the preset threshold range to visually assist in enhancing the projection image of the electronic device, thereby effectively enhancing the visual projection effect of the electronic device adapting to environmental changes.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of visual assistance, and in particular, to a visual assistance enhancement method and electronic device. Background Art

[0002] Current electronic devices with projection functions (such as projectors or augmented reality (AR) glasses, etc.) use visible light for projection, and the projection brightness of visible light is generally 300 nits. This brightness can meet the requirements for indoor projection (i.e., it can be clearly seen by the human eye), but when the environment of the electronic device changes, for example: when moving from indoors to outdoors, if there is strong sunlight, then the projection brightness of the electronic device is close to the background brightness of the sunlight, making it difficult for the human eye to see the projection image of the electronic device clearly. Therefore, current electronic devices with projection functions are difficult to meet the projection requirements of environmental changes (such as moving from indoors to outdoor environments). Summary of the invention

[0003] The purpose of the embodiments of the present application is to provide a visual assistance enhancement method and an electronic device, which are used to improve the problem that electronic devices with projection functions are difficult to meet the projection requirements of environmental changes.

[0004] The embodiment of the present application provides a visual assistance enhancement method, including: obtaining an ambient brightness value of an electronic device; if the difference between the ambient brightness value and the projection brightness value of the electronic device is less than a preset threshold, increasing the difference between the ambient brightness value and the projection brightness value to visually assist in enhancing the projection image of the electronic device; if the difference between the ambient brightness value and the projection brightness value of the electronic device is greater than or equal to the maximum value of the preset threshold range, reducing the difference between the ambient brightness value and the projection brightness value to visually assist in enhancing the projection image of the electronic device. In the implementation process of the above scheme, when the difference between the ambient brightness value and the projection brightness value of the electronic device is not within the preset threshold range, the difference is controlled within the preset threshold range to visually assist in enhancing the projection image of the electronic device, thereby effectively enhancing the visual projection effect of the electronic device to adapt to environmental changes, so as to meet the projection requirements of the electronic device under environmental changes (for example, from indoor to outdoor environment).

[0005] Optionally, in an embodiment of the present application, obtaining the ambient brightness value of the electronic device includes: obtaining a video stream captured by a camera of the electronic device, and parsing the ambient brightness value from the video stream; or, collecting the ambient brightness value through a sensor of the electronic device. Collecting the ambient brightness value through the sensor of the electronic device improves the situation where the amount of calculation is large due to parsing the ambient brightness value from the image, and effectively improves the speed of obtaining the ambient brightness value.

[0006] Optionally, in an embodiment of the present application, parsing the ambient brightness value from the video stream includes: obtaining an ambient image of the electronic device from the video stream, and parsing the ambient brightness value from the ambient image; or, obtaining a projection image of the electronic device from the video stream, and segmenting a background image from the projection image, and parsing the ambient brightness value from the background image. In the implementation of the above scheme, the ambient brightness value is parsed from the ambient image or the background image in the projection image, thereby reducing hardware such as sensors and effectively saving battery power consumption.

[0007] Optionally, in an embodiment of the present application, increasing the difference between the ambient brightness value and the projection brightness value includes: if the ambient brightness value is less than the projection brightness value, then after using the projection device of the electronic device to perform visible light projection, using the laser emitter of the electronic device to perform laser projection, the projection brightness value of the visible light projection is less than the projection brightness value of the laser projection. In the implementation process of the above scheme, by additionally projecting a laser projection with a higher brightness value after the visible light projection, since the projection brightness value of the visible light projection is less than the projection brightness value of the laser projection, the effect of increasing the projection brightness value can be achieved.

[0008] Optionally, in an embodiment of the present application, laser projection is performed using a laser emitter of an electronic device, including: obtaining the position coordinates of the electronic device, and / or obtaining the environmental image of the electronic device, and / or obtaining the environmental sound of the electronic device; performing laser projection according to the position coordinates, environmental image and / or environmental sound by the laser emitter. In the implementation process of the above scheme, laser projection is performed according to the position coordinates, environmental image and / or environmental sound by the laser emitter, thereby improving the situation in which the projection cannot be adapted to change in time (projecting a projection image of high voltage danger) in different environments (such as high-voltage and strong light environments), and effectively enhancing the adaptability of the projection function of the electronic device in different environments (such as strong light environments).

[0009] Optionally, in an embodiment of the present application, laser projection is performed according to the position coordinates, environmental image and / or environmental sound by a laser transmitter, including: sending the position coordinates, environmental image and / or environmental sound to a server, so that the server determines and returns an image identifier according to the position coordinates, environmental image and / or environmental sound; receiving the image identifier sent by the server; and performing laser projection according to the image identifier by a laser transmitter. In the implementation process of the above scheme, the server determines and returns the image identifier according to the position coordinates, environmental image and / or environmental sound, and uses a laser transmitter to perform laser projection according to the image identifier, thereby reducing the amount of calculation of the electronic device and effectively improving the battery life of the electronic device.

[0010] Optionally, in an embodiment of the present application, laser projection is performed by a laser emitter according to position coordinates, environmental images and / or environmental sounds, including: detecting the target relative position of the target object relative to the position coordinates from the environmental image, and / or analyzing the target relative position of the target object relative to the position coordinates from the environmental sounds; and controlling the rotation angle of the laser emitter by a pan-tilt platform so that the laser emitter performs laser projection toward the target relative position. In the implementation process of the above scheme, the rotation angle of the laser emitter is controlled by a pan-tilt platform so that the laser emitter performs laser projection toward the target relative position analyzed from the environmental image or the environmental sound, thereby increasing the accuracy of the laser projection.

[0011] Optionally, in an embodiment of the present application, the electronic device is an AR glasses; increasing the difference between the ambient brightness value and the projection brightness value includes: if the ambient brightness value is greater than the projection brightness value, reducing the projection brightness value of the projected image output on the lenses of the AR glasses. In the implementation process of the above scheme, by reducing the projection brightness value of the projected image output on the lenses of the AR glasses, the situation that the electronic device is difficult to see the projected image in a strong light environment is improved, and the projection image effect of the electronic device is effectively visually assisted and enhanced.

[0012] An embodiment of the present application also provides an electronic device, including: an acquisition device and a control processor; the acquisition device is used to obtain the ambient brightness value of the electronic device; the control processor is used to increase the difference between the ambient brightness value and the projection brightness value if the difference between the ambient brightness value and the projection brightness value of the electronic device is less than the minimum value of a preset threshold range, so as to visually assist in enhancing the projection image of the electronic device; the control processor is also used to reduce the difference between the ambient brightness value and the projection brightness value if the difference between the ambient brightness value and the projection brightness value of the electronic device is greater than or equal to the maximum value of the preset threshold range, so as to visually assist in enhancing the projection image of the electronic device.

[0013] Optionally, in an embodiment of the present application, the acquisition device includes: a camera or a sensor; the camera is used to obtain a video stream captured by a camera of the electronic device, and the control processor is used to parse the ambient brightness value from the video stream; or, the sensor is used to collect the ambient brightness value.

[0014] Optionally, in an embodiment of the present application, the control processor is also used to obtain an environmental image of the electronic device from the video stream, and parse the environmental brightness value from the environmental image; or, the control processor is also used to obtain a projection image of the electronic device from the video stream, segment a background image from the projection image, and parse the environmental brightness value from the background image.

[0015] Optionally, in an embodiment of the present application, the electronic device further includes: a projection device and a laser emitter; the control processor is also used to control the projection device to perform visible light projection if the ambient brightness value is less than the projection brightness value; and control the laser emitter to perform laser projection, and the projection brightness value of the visible light projection is less than the projection brightness value of the laser projection.

[0016] Optionally, in an embodiment of the present application, the acquisition device also includes: a global positioning system GPS chip, a camera and / or a microphone; the GPS chip is used to obtain the location coordinates of the electronic device, and / or the camera is used to obtain the environmental image of the electronic device, and / or the microphone is used to collect environmental sounds; the laser transmitter is also used to perform laser projection according to the location coordinates, environmental images and / or environmental sounds.

[0017] Optionally, in an embodiment of the present application, the electronic device also includes: a communication module; the communication module is used to send location coordinates, environmental images and / or environmental sounds to a server, so that the server determines and returns an image identification based on the location coordinates, environmental images and / or environmental sounds; the communication module is also used to receive the image identification sent by the server; the laser transmitter is also used to perform laser projection based on the image identification.

[0018] Optionally, in an embodiment of the present application, the electronic device also includes: a gimbal; the control processor is also used to detect the target relative position of the target object relative to the position coordinates from the environmental image, and / or, analyze the target relative position of the target object relative to the position coordinates from the environmental sound; the gimbal is used to control the rotation angle of the laser emitter so that the laser emitter projects laser toward the target relative position.

[0019] Optionally, in an embodiment of the present application, the electronic device is AR glasses; the control processor is also used to reduce the projection brightness value of the projected image output on the lenses of the AR glasses if the ambient brightness value is greater than the projection brightness value.

[0020] An embodiment of the present application also provides a visual assistance enhancement device, including: an ambient brightness acquisition module, used to acquire the ambient brightness value of the electronic device; a brightness difference increase module, used to increase the difference between the ambient brightness value and the projection brightness value if the difference between the ambient brightness value and the projection brightness value of the electronic device is less than a preset threshold value, so as to visually assist in enhancing the projection image of the electronic device; a brightness difference reduction module, used to reduce the difference between the ambient brightness value and the projection brightness value if the difference between the ambient brightness value and the projection brightness value of the electronic device is greater than or equal to the maximum value of a preset threshold value range, so as to visually assist in enhancing the projection image of the electronic device.

[0021] Optionally, in an embodiment of the present application, the ambient brightness acquisition module includes: a first brightness acquisition module, used to acquire a video stream captured by a camera of an electronic device and parse the ambient brightness value from the video stream; or, a second brightness acquisition module, used to collect the ambient brightness value through a sensor of the electronic device.

[0022] Optionally, in an embodiment of the present application, the first brightness acquisition module includes: a first brightness acquisition sub-module, used to acquire an ambient image of the electronic device from a video stream, and parse out an ambient brightness value from the ambient image; or, a second brightness acquisition sub-module, used to acquire a projection image of the electronic device from the video stream, and segment a background image from the projection image, and parse out the ambient brightness value from the background image.

[0023] Optionally, in an embodiment of the present application, the brightness difference increasing module includes: a projection brightness increasing sub-module, which is used to perform laser projection using a laser emitter of the electronic device after performing visible light projection using a projection device of the electronic device if the ambient brightness value is less than the projection brightness value, and the projection brightness value of the visible light projection is less than the projection brightness value of the laser projection.

[0024] Optionally, in an embodiment of the present application, the laser projection emission unit includes: an environmental information acquisition subunit, used to obtain the position coordinates of the electronic device, and / or, to obtain the environmental image of the electronic device, and / or, to obtain the environmental sound of the electronic device; a laser projection emission subunit, used to perform laser projection according to the position coordinates, environmental image and / or environmental sound through a laser emitter.

[0025] Optionally, in an embodiment of the present application, the laser projection emission subunit includes: an information sending subunit, used to send location coordinates, environmental images and / or environmental sounds to a server, so that the server determines and returns an image identifier based on the location coordinates, environmental images and / or environmental sounds; an information receiving subunit, used to receive an image identifier sent by the server; and a laser projection subunit, used to perform laser projection based on the image identifier through a laser transmitter.

[0026] Optionally, in an embodiment of the present application, the laser projection emission unit includes: a relative position acquisition subunit, used to detect the target relative position of the target object relative to the position coordinates from the environmental image, and / or, to analyze the target relative position of the target object relative to the position coordinates from the environmental sound; a rotation angle control subunit, used to control the rotation angle of the laser emitter through the pan-tilt head so that the laser emitter performs laser projection toward the target relative position.

[0027] Optionally, in an embodiment of the present application, the electronic device is AR glasses; the brightness difference increasing module includes: a projection brightness reducing sub-module, which is used to reduce the projection brightness value output by the projection image on the lenses of the AR glasses if the ambient brightness value is greater than the projection brightness value.

[0028] An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor controlled to execute the method described above.

[0029] Other features and advantages of the embodiments of the present application will be described in the subsequent description, and in part will become apparent from the description, or will be understood by implementing the embodiments of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.

[0031] Figure 1 A schematic diagram of a flow chart of a visual assistance enhancement method provided in an embodiment of the present application is shown;

[0032] Figure 2 A schematic diagram of AR glasses provided with lenses provided in an embodiment of the present application is shown;

[0033] Figure 3 A schematic diagram showing a method of reducing the projection brightness value provided by an embodiment of the present application is shown;

[0034] Figure 4 A schematic diagram of the structure of an electronic device provided by an embodiment of the present application is shown;

[0035] Figure 5 A schematic diagram of the structure of a collection device in an electronic device provided in an embodiment of the present application is shown;

[0036] Figure 6 A schematic diagram of a projection image of an image mark provided by an embodiment of the present application is shown;

[0037] Figure 7 A schematic diagram of the pan / tilt structure in an electronic device provided in an embodiment of the present application is shown;

[0038] Figure 8 A schematic diagram showing the ranges of the x-axis and y-axis of the gimbal provided in an embodiment of the present application;

[0039] Fig. 9A schematic diagram of the structure of a visual aid enhancement device provided in an embodiment of the present application is shown.

[0040] Icons: 200-electronic device; 201-AR glasses; 202-lens; 210-acquisition device; 211-camera; 212-sensor; 213-GPS chip; 214-microphone; 220-control processor; 230-projection device; 240-laser transmitter; 250-communication module; 260-pan head; 261-first rotating table; 262-second rotating table; 300-visual aid enhancement device; 310-ambient brightness acquisition module; 320-brightness difference increase module; 330-brightness difference reduction module. DETAILED DESCRIPTION

[0041] To make the purpose, technical scheme and advantages of the embodiment of the present application clearer, the technical scheme in the embodiment of the present application will be clearly and completely described below in conjunction with the drawings in the embodiment of the present application. It should be understood that the drawings in the embodiment of the present application only serve the purpose of explanation and description, and are not used to limit the protection scope of the embodiment of the present application. In addition, it should be understood that the schematic drawings are not drawn in real proportion. The flowchart used in the embodiment of the present application shows the operation implemented according to some embodiments of the embodiment of the present application. It should be understood that the operation of the flowchart can be implemented out of order, and the steps without logical context can be reversed in order or implemented simultaneously. In addition, those skilled in the art can add one or more other operations to the flowchart under the guidance of the content of the embodiment of the present application, or remove one or more operations from the flowchart.

[0042] In addition, the described embodiments are only a part of the embodiments of the present application, rather than all embodiments. The components of the embodiments of the present application described and shown in the drawings generally here can be arranged and designed in various configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the embodiments of the present application claimed, but merely represents the selected embodiments of the embodiments of the present application.

[0043] It is understandable that the "first" and "second" in the embodiments of the present application are used to distinguish similar objects. Those skilled in the art will understand that the words "first" and "second" do not limit the quantity and execution order, and the words "first" and "second" do not necessarily limit the difference. In the description of the embodiments of the present application, the term "and / or" is merely a description of the association relationship of associated objects, indicating that there may be three relationships, such as A and / or B, which can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the related objects before and after are in an "or" relationship. The term "multiple" refers to more than two (including two), and similarly, "multiple groups" refers to more than two groups (including two groups).

[0044] Before introducing the visual assistance enhancement method provided in the embodiment of the present application, some concepts involved in the embodiment of the present application are first introduced:

[0045] Augmented Reality (AR) is a technology that cleverly combines virtual images with real images of the real world. It simulates computer-generated virtual information such as text, images, three-dimensional models, music, and videos, and applies them to the real world. The information in the virtual images here complements the information in the real world, thereby achieving "enhancement" of the real world.

[0046] It should be noted that the visual assistance enhancement method provided in the embodiment of the present application can be executed by an electronic device (specifically, it can be executed by a control chip in the electronic device). The electronic device here can be a terminal device with the function of executing a computer program, such as a projector, augmented reality AR glasses, a smart phone, a personal computer, a tablet computer, a personal digital assistant or a mobile Internet device and other devices with a projection function.

[0047] The following introduces the application scenarios to which the visual assistance enhancement method is applicable, and the application scenarios here include but are not limited to: the scenario of switching the projection environment, for example: the ambient brightness value of the above-mentioned electronic device may change, for example: when the projection image of the electronic device needs to be displayed outdoors, the electronic device needs to be moved from indoors to outdoors, and the ambient brightness value will increase; for example: when the lighting in the space where the electronic device is located (or the adjacent space) is turned off, the ambient brightness value will decrease. Therefore, the ambient brightness value of the electronic device may change, which may cause the difference between the ambient brightness value and the projection brightness value of the electronic device to change. In the case where the difference between the ambient brightness value and the projection brightness value of the electronic device is less than the minimum value of the preset threshold range, the visual assistance enhancement method can be used to increase the difference between the ambient brightness value and the projection brightness value, thereby visually assisting in enhancing the display effect of the projection image of the electronic device, that is, allowing the user to see the projection image more clearly, etc.

[0048] See also Figure 1 The flowchart of the visual assistance enhancement method provided by the embodiment of the present application is shown; the main idea of ​​the visual assistance enhancement method is to control the difference between the ambient brightness value and the projection brightness value of the electronic device within the preset threshold range when the difference between the ambient brightness value and the projection brightness value of the electronic device is not within the preset threshold range, thereby visually enhancing the projection effect of the electronic device. The implementation of the above-mentioned visual assistance enhancement method may include:

[0049] Step S110: Acquire the ambient brightness value of the electronic device.

[0050] It is understandable that the above-mentioned electronic device can be a device with a projection function, such as: a projector, augmented reality AR glasses, a smart phone with a projection function, a personal computer or tablet computer with a projection function, etc.

[0051] There are many implementation methods of the above step S110. The ambient brightness value can be parsed using an image captured by a camera, or the ambient brightness value can be directly captured by a sensor. Therefore, the implementation method of step S110 will be described in detail below.

[0052] Step S120: If the difference between the ambient brightness value and the projection brightness value of the electronic device is less than the minimum value of the preset threshold range, the difference between the ambient brightness value and the projection brightness value is increased to visually enhance the projection image of the electronic device.

[0053] It is understandable that when the difference between the ambient brightness value and the projection brightness value of the electronic device is not within the preset threshold range, it will cause the human eye to be unable to see clearly. For example, when the projection brightness value of the projection device of the electronic device is similar to the indoor light brightness (that is, the difference is less than the minimum value within the preset threshold range), it will cause the projection image of the projection device to be unable to be seen clearly. At this time, the difference between the ambient brightness value and the projection brightness value can be increased, such as turning off the light or adjusting to increase the projection brightness of the projection device, so that the projection image can be displayed more clearly. In the case where the difference between the ambient brightness value and the projection brightness value of the electronic device is less than the minimum value of the preset threshold range, the difference between the ambient brightness value and the projection brightness value can be increased according to the relationship between the ambient brightness value and the projection brightness value, including but not limited to: if the ambient brightness value is less than the projection brightness value, then increase the projection brightness value, or reduce the ambient brightness value (for example, when the projection device is projected on the wall, an umbrella can be used to block the sunlight, reduce the direct sunlight on the projection image on the wall, and make the projection image on the wall clearer). On the contrary, if the ambient brightness value is greater than the projection brightness value, then reduce the projection brightness value, or enhance the ambient brightness value. Specifically, different technical means may be used on different electronic devices to increase the difference between the ambient brightness value and the projection brightness value. Therefore, the implementation of the above step S120 will be described in detail below.

[0054] Step S130: If the difference between the ambient brightness value and the projection brightness value of the electronic device is greater than or equal to the maximum value of the preset threshold range, the difference between the ambient brightness value and the projection brightness value is reduced to visually enhance the projection image of the electronic device.

[0055] It is understandable that when the difference between the ambient brightness value and the projection brightness value of the electronic device is not within the preset threshold range, the human eye will not be able to see clearly. For example, when the visible light projection device (such as a mobile phone screen) is transferred to an outdoor environment with too strong sunlight (that is, the difference is greater than the maximum value within the preset threshold range), the projection image of the projection device will not be able to be seen clearly. At this time, the difference between the ambient brightness value and the projection brightness value can be reduced. For example, blocking the projection device (such as a mobile phone screen) is to reduce the difference between the two by lowering the ambient brightness, or directly increasing the projection brightness of the projection device (for example, switching visible light projection to laser projection), etc., can make the projection image appear clearer.

[0056] In the above implementation process, when the difference between the ambient brightness value and the projection brightness value of the electronic device is not within the preset threshold range, the difference is controlled within the preset threshold range, thereby effectively enhancing the visual projection effect of the electronic device to adapt to environmental changes, thereby being able to meet the projection requirements of the electronic device when the environment changes (for example, from indoor to outdoor environment).

[0057] As a first optional implementation of the above step S110, when obtaining the ambient brightness value of the electronic device, the video stream collected by the camera can be used to parse the ambient brightness value. This implementation may include:

[0058] Step S111: obtaining a video stream captured by a camera of the electronic device, and parsing the ambient brightness value from the video stream.

[0059] There are many implementation methods of the above step S111, including but not limited to: first, directly using the camera of the electronic device to capture the video stream, and second, reading the video stream from the storage medium of the electronic device. Similarly, there are also many implementation methods for parsing the ambient brightness value from the video stream, so the implementation method of step S111 will be described in detail below.

[0060] As a second optional implementation of the above step S110, when obtaining the ambient brightness value of the electronic device, a sensor of the electronic device (such as a light sensor or a photoelectric sensor, etc.) may be used to collect the ambient brightness value. This implementation may include:

[0061] Step S112: Collecting the ambient brightness value through the sensor of the electronic device.

[0062] An implementation example of the above step S112 is as follows: a sensor for collecting the ambient brightness value may also be provided on the above electronic device, for example, a photosensitive sensor or a photoelectric sensor may be provided. After the photosensitive sensor or the photoelectric sensor collects the ambient brightness value, the ambient brightness value may be sent to the electronic device. Then, the electronic device receives the ambient brightness value sent by the photosensitive sensor or the photoelectric sensor, and obtains the ambient brightness value collected by the photosensitive sensor or the photoelectric sensor.

[0063] As a first optional implementation of the above step S111, when obtaining the ambient brightness value of the electronic device, the ambient brightness value may be parsed from the ambient image obtained from the video stream. This implementation may include:

[0064] Step S111a: Acquire an environment image of the electronic device from the video stream, and parse the environment brightness value from the environment image.

[0065] Environmental image refers to the image captured by the camera of the electronic device when the projection device and laser emitter of the electronic device are turned off. Since the projection device (and / or laser emitter) of the electronic device is turned off, the environmental image only includes the background image (i.e., the image composed of non-projected pixels), and does not include the foreground image (i.e., the image composed of pixels of visible light projection or laser projection). In the specific implementation process, the environmental video can be captured by the camera of the electronic device, and then the environmental image can be extracted from the environmental video captured by the camera. Since the computing power of the electronic device is relatively high, the environmental image extracted from the environmental video can be analyzed in the specific implementation process, and (if the computing power of the electronic device is sufficient) the environmental video itself can also be directly analyzed according to the specific situation.

[0066] The implementation method of the above step S111a is, for example: assuming that the electronic device is an AR glasses, then the video stream of the electronic device can be obtained through the micro camera set on the AR glasses, and the environmental image of the electronic device can be obtained from the video stream; assuming that the electronic device is a smart phone with a projection function, a personal computer or a tablet computer with a projection function, then the environmental image of the electronic device can be obtained through the front camera or rear camera of the smart phone, personal computer or tablet computer. After obtaining the environmental image of the electronic device, the environmental image can be segmented to obtain a background image (i.e., an image composed of non-projected pixels). Specifically, the average brightness value of all pixels of the background image can be calculated, and the average brightness value of all pixels of the background image is determined as the environmental brightness value. Of course, the average brightness value of all pixels of the environmental image can also be directly calculated, and the average brightness value of all pixels of the environmental image is determined as the environmental brightness value.

[0067] As a second optional implementation of the above step S111, when obtaining the ambient brightness value of the electronic device, the projection image obtained from the video stream may be used to parse the ambient brightness value. This implementation may include:

[0068] Step S111b: acquiring a projection image of the electronic device from the video stream, segmenting a background image from the projection image, and parsing an ambient brightness value from the background image.

[0069] The projected image refers to the image captured by the camera of the electronic device when the projection device and / or laser emitter of the electronic device is turned on. The projection device here is used for visible light projection, and the laser emitter is used for laser projection. Since the camera collects images in real time, it usually captures the foreground image (i.e., the image composed of pixels of visible light projection or laser projection) and the background image (i.e., the image composed of pixels other than visible light projection or laser projection).

[0070] The implementation method of the above step S111b is for example: the implementation method of obtaining the projection image of the electronic device from the video stream here can refer to the implementation method of step S111a, which will not be repeated here. It can be understood that the projection image may include a foreground image and a background image (that is, an image composed of pixels other than visible light projection or laser projection). Therefore, the projection image can be segmented to obtain the background image, and the ambient brightness value can be parsed from the background image. The implementation method of parsing the ambient brightness value from the background image here can refer to the implementation method of step S111, which will not be repeated here.

[0071] As an optional implementation of the above step S120, when increasing the difference between the ambient brightness value and the projection brightness value, the projection brightness value may be increased when the ambient brightness value is less than the projection brightness value. This implementation may include:

[0072] Step S121: If the ambient brightness value is less than the projection brightness value, increase the projection brightness value.

[0073] It is understandable that there are many ways to increase the projection brightness value. You can directly adjust the projection brightness value of the plateau visible light projection, or you can project a projection with a higher brightness value (such as laser projection or high-energy synchrotron radiation, etc.) after the visible light projection. Optionally, after the projection with a higher brightness value is projected, in order to save energy, the visible light projection can be turned off. Of course, you can also turn off the visible projection light first, and then directly project a projection with a higher brightness value (such as laser projection or high-energy synchrotron radiation, etc.). These methods will be described in detail below.

[0074] As an optional implementation of the above step S121, when increasing the projection brightness value, laser projection may be added after visible light projection, so as to achieve the effect of increasing the projection brightness value. This implementation may include:

[0075] Step S121a: After performing visible light projection using the projection device of the electronic device, performing laser projection using the laser emitter of the electronic device, the projection brightness value of the visible light projection is smaller than the projection brightness value of the laser projection.

[0076] An implementation example of the above step S121a is as follows: the above electronic device may also be provided with a projection device and a laser emitter. After using the projection device of the electronic device to perform visible light projection, the laser emitter of the electronic device is additionally used to perform laser projection. Since the projection brightness value of the visible light projection is less than the projection brightness value of the laser projection, the effect of increasing the projection brightness value can be achieved. Optionally, after additionally projecting a projection with a higher brightness value, the visible light projection may be turned off in order to save electric energy. Optionally, when increasing the projection brightness value, the visible light projection may be replaced with the laser projection, thereby achieving the effect of increasing the projection brightness value. A specific implementation example is as follows: first turn off the visible light projection of the projection device of the electronic device, and then use the laser emitter of the electronic device to perform laser projection. Since the projection brightness value of the visible light projection is less than the projection brightness value of the laser projection, the effect of increasing the projection brightness value can be achieved.

[0077] As an optional implementation of the above step S121a, when laser projection is performed using a laser transmitter of an electronic device, laser projection may be performed according to position coordinates, environmental images and / or environmental sounds. This implementation may include:

[0078] Step S121b: Acquire the location coordinates of the electronic device, and / or, acquire the environment image of the electronic device, and / or, acquire the environment sound of the electronic device.

[0079] The implementation method of the above step S121b is, for example: the above electronic device may be provided with a global positioning system GPS chip, and then the GPS chip may be used to obtain the location coordinates of the electronic device. Optionally, the above electronic device may also be provided with a camera, and then the camera may be used to obtain the environmental image of the electronic device. Optionally, the above electronic device may also be provided with a microphone, and then the microphone may be used to collect the environmental sound of the electronic device.

[0080] Step S121c: Perform laser projection according to the position coordinates, environmental images and / or environmental sounds through a laser transmitter.

[0081] It is understandable that when the computing power of the electronic device can support the analysis and computing power of the position coordinates, environmental images and / or environmental sounds, the above step S121c can be performed by the electronic device itself. Since the position coordinates have low requirements for computing power, the position coordinates are used as an example here for explanation (the environmental images and / or environmental sounds are similar). For example, it is determined whether the position coordinates of the electronic device are in a preset area (for example, a high-voltage area, a high-temperature area, or an artificially set prohibited area, etc.), and the electronic device uses a laser transmitter to project a projection image for prompting (for example, a high-voltage danger sign, etc.).

[0082] Optionally, when the computing power of the electronic device cannot support the analysis and computing power of the location coordinates, environmental images and / or environmental sounds, the location coordinates, environmental images and / or environmental sounds can be sent to a server, allowing the server to analyze the location coordinates, environmental images and / or environmental sounds and use the returned image identification for laser projection. This process will be described in detail below.

[0083] As an optional implementation of the above step S121c, when laser projection is performed according to the position coordinates, the environmental image and / or the environmental sound, the image identification analyzed and returned by the server may be used to perform laser projection, and the implementation may include:

[0084] Step S121d: Send the location coordinates, the environment image and / or the environment sound to the server, so that the server determines and returns the image identification according to the location coordinates, the environment image and / or the environment sound.

[0085] An implementation example of the above step S121d is: the electronic device sends location coordinates, environmental images and / or environmental sounds to the server via the Transmission Control Protocol (TCP) or the User Datagram Protocol (UDP), so that the server determines and returns an image identifier based on the location coordinates, environmental images and / or environmental sounds.

[0086] Step S121e: receiving the image identifier sent by the server.

[0087] An implementation example of the above-mentioned step S121e is as follows: after receiving the location coordinates, environmental images and / or environmental sounds, the server can analyze the current location coordinates based on the environmental images and / or environmental sounds, and correct the received location coordinates based on the current location coordinates. It can also send an image mark (such as a high-voltage danger mark, etc.) to the electronic device when the location coordinates of the electronic device are in a preset area (for example: a high-voltage area, a high-temperature area, or an artificially set prohibited area, etc.).

[0088] Step S121f: Perform laser projection according to the image identification through the laser transmitter.

[0089] An implementation example of the above step S121f is as follows: after the electronic device receives the image logo sent by the server through the TCP protocol or the UDP protocol, it can use a laser transmitter to project a projection image corresponding to the image logo (for example, a logo image corresponding to a high voltage hazard logo, etc.).

[0090] As an optional implementation of the above step S121c, when laser projection is performed according to the position coordinates, the environmental image and / or the environmental sound, the target relative position may be calculated locally on the electronic device, and laser projection may be performed according to the target relative position. This implementation may include:

[0091] Step S121g: Detecting the target relative position of the target object relative to the position coordinates from the environmental image, and / or analyzing the target relative position of the target object relative to the position coordinates from the environmental sound.

[0092] An example of an implementation of the above step S121g is: the electronic device performs target detection on the environmental image, thereby detecting the target relative position of the target object relative to the position coordinates, and can determine whether the target relative position is a preset position. Assuming that the target object is a workpiece (such as a screw or a buckle, etc.), it can be determined whether the workpiece is installed in the preset correct position (for example, whether the employee wears labor protection gloves correctly, etc.). Another example: Assuming that the target object is a gathering place where a broadcast is being played, it can be analyzed from the environmental sound whether the sound source is the target relative position where the broadcast is being played. If the sound of the broadcast is getting louder and louder, it is approaching the target relative position. On the contrary, if the sound of the broadcast is getting smaller and smaller, it is moving away from the target relative position. If the sound of the broadcast is greater than the preset sound amplitude, it can be considered that the current position of the electronic device is the target relative position.

[0093] Step S121h: Control the rotation angle of the laser emitter through the gimbal of the electronic device so that the laser emitter faces the target relative position for laser projection.

[0094] The implementation method of the above step S121h is, for example: if the target relative position is the preset position, the rotation angle of the laser emitter is controlled by the pan / tilt of the electronic device so that the laser emitter projects the laser toward the target relative position. Specifically, for example: it is determined whether the workpiece is installed at the preset correct position. If it is determined that the workpiece is installed at the preset correct position, the laser emitter is controlled to project the correct "√" symbol to the correct position. Otherwise, the laser emitter is controlled to project the wrong "×" symbol. Another example: assuming that the target object is a gathering place where a broadcast is being played, it can be analyzed from the ambient sound whether the sound source is the target relative position where the broadcast is being played. If the sound of the broadcast is getting louder, the laser emitter is controlled to project the correct "√" symbol. On the contrary, if the sound of the broadcast is getting quieter, the laser emitter is controlled to project the wrong "×" symbol.

[0095] As an optional implementation of the above step S120, when increasing the difference between the ambient brightness value and the projection brightness value, the projection brightness value may be reduced when the ambient brightness value is greater than the projection brightness value. This implementation may include:

[0096] Step S122: If the ambient brightness value is greater than the projection brightness value, then reduce the projection brightness value.

[0097] It is understandable that there are many ways to reduce the projection brightness value. The projection brightness value of the original visible light projection can be directly reduced, or the projection brightness value can be reduced by using visible light shielding after the visible light projection. The following describes this visible light shielding method in detail.

[0098] See also Figure 2 The schematic diagram of the AR glasses provided with lenses provided in the embodiment of the present application is shown; as an optional implementation of the above step S122, the above electronic device 200 may be an AR glasses 201, and the AR glasses 201 may be provided with lenses 202. At this time, the projected image may be projected on the lenses of the AR glasses. Of course, the projected image may also be formed by the projection device projecting directly in front of the lenses. On the contrary, the AR glasses 201 may not be provided with lenses 202 (refer to Figure 4 and Figure 5 ), the projected image at this time can be formed by directly projecting onto the retina of the human eye. Of course, the projected image can also be formed by projecting the projection device directly in front of the retina of the human eye.

[0099] In the case where the AR glasses 201 are not provided with the lens 202, the projection brightness value of the original visible light projection can be directly reduced, thereby achieving the effect of reducing the projection brightness value. In the case where the AR glasses 201 are provided with the lens 202, the projection brightness value output on the lens of the AR glasses can be reduced to achieve the effect of reducing the projection brightness value. This implementation may include:

[0100] Step S122a: reducing the projection brightness value of the projected image output on the lenses of the AR glasses.

[0101] AR glasses are electronic devices that perfectly superimpose virtual information and the real world. They can display virtual information such as text, images, videos, 3D models, etc. to users without affecting real life.

[0102] See also Figure 3A schematic diagram of reducing the projection brightness value provided in an embodiment of the present application is shown; an implementation method of the above-mentioned step S122a is, for example: assuming that the user wears AR glasses 201 in an indoor environment, and after outputting the projection image on the lenses 202 of the AR glasses 201, walks out to the vicinity of a preset area (e.g., a high-voltage area) in the outdoor environment, at this time, the AR glasses 201 reduce the projection brightness value output by the lenses 202, and output a projection image with a lower brightness value (e.g., a logo image corresponding to a high-voltage hazard logo, etc.) on the lenses 202 of the AR glasses 201, and the projection image can be used to prompt the user to leave the preset area as soon as possible.

[0103] In the above step S130, when the difference between the ambient brightness value and the projection brightness value of the electronic device is greater than or equal to the maximum value of the preset threshold range, there are many implementation methods of step S130, including but not limited to the following:

[0104] In a first implementation, if the ambient brightness value is less than the projection brightness value, the projection brightness value is reduced, wherein the implementation of reducing the projection brightness value is, for example: after using the laser emitter of the electronic device for laser projection, and then using the projection device of the electronic device for visible light projection, the projection brightness value of the visible light projection is less than the projection brightness value of the laser projection. The specific implementation can refer to the implementation of step S121a, which will not be repeated here.

[0105] Optionally, the projection brightness value may be reduced by reducing the projection brightness value of the lens of the AR glasses, for example, by controlling the processor to reduce the projection brightness value of the projected image output on the lens of the AR glasses. The specific implementation method may refer to the implementation method of step S122a, which will not be described in detail here.

[0106] In a second implementation, if the ambient brightness value is greater than or equal to the projection brightness value, the projection brightness value is increased, wherein the specific implementation of increasing the projection brightness value is, for example, after using the projection device of the electronic device to perform visible light projection, using the laser emitter of the electronic device to perform laser projection, and the projection brightness value of the visible light projection is less than the projection brightness value of the laser projection. The specific implementation can refer to the implementation of step S121a, which will not be repeated here.

[0107] See also Figure 4The schematic diagram of the structure of an electronic device provided by an embodiment of the present application is shown; it can be understood that the electronic device can be a projector, augmented reality AR glasses (the figure shows AR glasses without lenses), a smart phone, a personal computer, a tablet computer, a personal digital assistant or a mobile Internet device and other devices with projection functions. For ease of understanding, the following detailed description is given by taking AR glasses as an example. The embodiment of the present application also provides an electronic device 200, including: an acquisition device 210 and a control processor 220.

[0108] The acquisition device 210 is used to obtain the ambient brightness value of the electronic device, and the acquisition device can be.

[0109] The control processor 220 is used to increase the difference between the ambient brightness value and the projection brightness value if the difference between the ambient brightness value and the projection brightness value of the electronic device is less than the minimum value of the preset threshold range, so as to visually assist in enhancing the projection image of the electronic device.

[0110] The control processor 220 is also used to reduce the difference between the ambient brightness value and the projection brightness value if the difference between the ambient brightness value and the projection brightness value of the electronic device is greater than or equal to the maximum value of the preset threshold range, so as to visually assist in enhancing the projection image of the electronic device.

[0111] See also Figure 5 The schematic diagram of the structure of the acquisition device in the electronic device provided in the embodiment of the present application is shown; optionally, in the embodiment of the present application, the acquisition device 210 may include: a camera 211 and / or a sensor 212.

[0112] The camera 211 can be used to obtain a video stream captured by the camera of the electronic device, and the control processor is used to parse the ambient brightness value from the video stream.

[0113] Alternatively, the sensor 212 may be used to collect ambient brightness values.

[0114] It is understandable that when the projection is turned on, the camera can collect the video stream in real time, so the camera can collect the video stream of the electronic device in real time and extract the projection image from the video stream. When the projection is turned off, the camera can directly obtain the environment image. Of course, when the projection is turned on, the background image can be segmented from the projection image obtained by the camera. Therefore, the camera can obtain both the environment image and the projection image.

[0115] The control processor is also used to obtain an environment image of the electronic device from the video stream, and parse the environment brightness value from the environment image.

[0116] Alternatively, the control processor is further configured to obtain a projection image of the electronic device from the video stream, segment a background image from the projection image, and parse an ambient brightness value from the background image.

[0117] Optionally, in an embodiment of the present application, the control processor 220 is also used to increase the projection brightness value if the ambient brightness value is less than the projection brightness value. Specifically, the method of increasing the projection brightness value may include: controlling the projection device to perform visible light projection, and controlling the laser emitter to perform laser projection through the control processor, and the projection brightness value of the visible light projection is less than the projection brightness value of the laser projection.

[0118] See also Figure 6 The schematic diagram of the projection image of the image identification provided in the embodiment of the present application is shown; optionally, in the embodiment of the present application, the electronic device 200 may also include: a projection device 230 and a laser emitter 240. The projection image of the above-mentioned image identification may be a lens installed in front of the laser emitter 240. When it is necessary to switch to the projection image of other image identifications, the lens can be directly rotated to switch to the projection image of other image identifications. Of course, the above-mentioned projection device 230 and laser emitter 240 can also pre-store projection images of multiple image identifications (only 8 projection images of image identifications are shown in the figure), and can be projected according to the image identification received (for example, sent by the server) (that is, according to the image identification, the projection image corresponding to the image identification is found, and the found projection image is projected). The shape of the projection image includes but is not limited to: "passable", "no passage", "be careful", "high voltage danger", "upward arrow", "downward arrow", "left arrow" and "right arrow" and other shapes.

[0119] The projection device 230 is used to perform visible light projection, which can be specifically projected onto a target object. For example, a YOLO algorithm model is used to identify a wall from an environmental image acquired by a camera, and visible light is projected onto the wall, so that a visible light projection image is formed on the wall.

[0120] The laser emitter 240 is used for laser projection, which can be projected onto a target object, for example, onto a wall, so that a projection image of the laser is formed on the wall. Since the projection brightness value of the visible light projection is less than the projection brightness value of the laser projection, the effect of increasing the projection brightness value can be achieved.

[0121] Optionally, in the embodiment of the present application, the acquisition device 210 may further include: a global positioning system GPS chip 213, a camera 211 and / or a microphone 214. It is understandable that when the microphone 214 is turned on, the microphone 214 can collect the audio stream in real time, so the microphone 214 can collect the ambient sound of the electronic device, for example, remove noise from the audio stream (for example, the noise when the electronic device is working) and extract the ambient sound.

[0122] The GPS chip 213 is used to obtain the location coordinates of the electronic device, and / or the camera 211 is used to obtain the environment image of the electronic device, and / or the microphone 214 is used to collect the environment sound of the electronic device.

[0123] The laser transmitter 240 is also used to perform laser projection according to the location coordinates, the environment image and / or the environment sound.

[0124] Optionally, in the embodiment of the present application, the electronic device also includes: a communication module 250, and the specific communication method of the communication module 250 includes but is not limited to: Bluetooth, wireless local area network 802.11 (Wi-Fi), infrared data transmission (Infrared Data Association, IrDA), ZigBee, Ultra Wide Band (Ultra WideBand), short-range communication (Nearfield communication, NFC), 4G communication or 5G communication, etc.

[0125] The communication module 250 is used to send the location coordinates, the environment image and / or the environment sound to the server, so that the server determines and returns the image identification according to the location coordinates, the environment image and / or the environment sound.

[0126] The communication module 250 is also used to receive the image identifier sent by the server.

[0127] The laser emitter 240 is also used to perform laser projection according to the image identification.

[0128] See also Figure 7 A schematic diagram of the gimbal structure in an electronic device provided in an embodiment of the present application is shown; optionally, in an embodiment of the present application, the electronic device further includes: a gimbal 260, which is movably connected to the above-mentioned laser emitter 240 (the specific connection method is described below).

[0129] The control processor 220 may also be used to detect the target relative position of the target object relative to the position coordinates from the environmental image, and / or to analyze the target relative position of the target object relative to the position coordinates from the environmental sound.

[0130] The pan / tilt platform 260 is used to control the rotation angle of the laser emitter 240 so that the laser emitter is directed toward a target relative position for laser projection.

[0131] See also Figure 8 A schematic diagram of the range of the x-axis and y-axis of the gimbal provided in an embodiment of the present application is shown; the above-mentioned gimbal 260 may also include: a first rotating table 261 and a second rotating table 262; the first rotating table 261 is used to actively control the rotation angle of the laser emitter in the vertical direction (i.e., the Y-axis direction), and the second rotating table 262 is used to actively control the rotation angle of the laser emitter in the horizontal direction (i.e., the X-axis direction).

[0132] Optionally, in an embodiment of the present application, the control processor is also used to reduce the projection brightness value if the ambient brightness value is greater than the projection brightness value, which can directly reduce the projection brightness value of the original visible light projection. Specifically, if the above-mentioned electronic device is AR glasses, the projection brightness value can be reduced by reducing the projection brightness value of the projected image output on the lenses of the AR glasses. Of course, if the above-mentioned electronic device is a smart helmet, the projection brightness value can also be reduced by reducing the projection brightness value of the projected image output on the AR mask of the smart helmet.

[0133] Optionally, in an embodiment of the present application, the electronic device may be an AR glasses, specifically a monocular AR glasses. The control processor is also used to reduce the projection brightness value of the projected image output on the lens of the AR glasses.

[0134] Optionally, the AR glasses may further include: a memory. The memory is used to store data such as the environmental image, environmental sound and / or position coordinates of the electronic device above. The environmental image at this time may refer to a background image separated from a projection image captured in front of the wearer of the AR glasses when the projection device (or laser transmitter) is turned on, or may refer to the entire environmental image captured in front of the wearer of the AR glasses when the projection device (and laser transmitter) is turned off.

[0135] It is understandable that the above-mentioned memory is a computer-readable storage medium, on which a computer program is stored, and the computer program is controlled to execute the above method when the processor is running. Wherein, the computer-readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (Static Random Access Memory, referred to as SRAM), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, referred to as EEPROM), erasable programmable read-only memory (Erasable Programmable Read Only Memory, referred to as EPROM), programmable read-only memory (Programmable Read-Only Memory, referred to as PROM), read-only memory (Read-Only Memory, referred to as ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0136] Optionally, the above-mentioned AR glasses may also include: a battery, which may specifically be a lithium battery (for example, a lithium battery with a voltage of 3.7V and a capacity of 1200mA); the battery is used to provide a power source for the above-mentioned control processor, acquisition device, memory and other components, so that these components use the power source to work normally.

[0137] See also Fig. 9 The structure diagram of the visual assistance enhancement device provided by the embodiment of the present application is shown. The embodiment of the present application provides a visual assistance enhancement device 300, including:

[0138] The ambient brightness acquisition module 310 is used to acquire the ambient brightness value of the electronic device.

[0139] The brightness difference increasing module 320 is used to increase the difference between the ambient brightness value and the projection brightness value if the difference between the ambient brightness value and the projection brightness value of the electronic device is less than a preset threshold, so as to visually assist in enhancing the projection image of the electronic device.

[0140] The brightness difference reduction module 330 is used to reduce the difference between the ambient brightness value and the projection brightness value if the difference between the ambient brightness value and the projection brightness value of the electronic device is greater than or equal to the maximum value of the preset threshold range, so as to visually assist in enhancing the projection image of the electronic device.

[0141] Optionally, in an embodiment of the present application, the ambient brightness acquisition module includes:

[0142] A first brightness acquisition module is used to acquire a video stream collected by a camera of the electronic device and parse the ambient brightness value from the video stream;

[0143] Alternatively, the second brightness acquisition module is used to collect the ambient brightness value through a sensor of the electronic device.

[0144] Optionally, in an embodiment of the present application, the first brightness acquisition module includes:

[0145] The first brightness acquisition submodule is used to acquire an environment image of the electronic device from the video stream and parse the environment brightness value from the environment image.

[0146] Alternatively, the second brightness acquisition submodule is used to acquire a projection image of the electronic device from the video stream, segment a background image from the projection image, and parse an ambient brightness value from the background image.

[0147] Optionally, in an embodiment of the present application, the brightness difference value increasing module includes:

[0148] The projection brightness increasing submodule is used to perform laser projection using the laser emitter of the electronic device after performing visible light projection using the projection device of the electronic device if the ambient brightness value is less than the projection brightness value, and the projection brightness value of the visible light projection is less than the projection brightness value of the laser projection.

[0149] Optionally, in an embodiment of the present application, the laser projection emission unit includes:

[0150] The environment information acquisition subunit is used to acquire the location coordinates of the electronic device, and / or acquire the environment image of the electronic device, and / or acquire the environment sound of the electronic device.

[0151] The laser projection emission subunit is used to perform laser projection according to position coordinates, environmental images and / or environmental sounds through a laser emitter.

[0152] Optionally, in an embodiment of the present application, the laser projection emission subunit includes:

[0153] The information sending subunit is used to send the location coordinates, environmental image and / or environmental sound to the server, so that the server determines and returns the image identification according to the location coordinates, environmental image and / or environmental sound.

[0154] The information receiving subunit is used to receive the image identifier sent by the server.

[0155] The laser projection subunit is used to perform laser projection according to the image identification through the laser transmitter.

[0156] Optionally, in an embodiment of the present application, the laser projection emission unit includes:

[0157] A relative position acquisition subunit, used to detect the target relative position of the target object relative to the position coordinates from the environmental image, and / or to analyze the target relative position of the target object relative to the position coordinates from the environmental sound;

[0158] The rotation angle control subunit is used to control the rotation angle of the laser transmitter through the pan / tilt platform so that the laser transmitter is directed toward the target relative position for laser projection.

[0159] Optionally, in an embodiment of the present application, the electronic device is AR glasses; the brightness difference increasing module includes:

[0160] The projection brightness reduction submodule is used to reduce the projection brightness value of the projected image output on the lenses of the AR glasses if the ambient brightness value is greater than the projection brightness value.

[0161] It should be understood that the device corresponds to the above-mentioned visual assistance enhancement method embodiment and can execute the various steps involved in the above-mentioned method embodiment. The specific functions of the device can be found in the description above, and the detailed description is appropriately omitted here. The device includes at least one software function module that can be stored in a memory in the form of software or firmware or solidified in the operating system (OS) of the device.

[0162] It should be noted that each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the embodiments can be referred to each other. For the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0163] In several embodiments provided by the embodiments of the present application, it should be understood that the disclosed device and method can also be implemented in other ways. The device embodiments described above are only schematic, for example, the flowcharts and block diagrams in the accompanying drawings show the possible implementation architecture, functions and operations of the devices, methods and computer program products according to the multiple embodiments of the embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a part of a module, a program segment or a code, and a part of a module, a program segment or a code includes one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also be different from the order of occurrence marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which is mainly determined by the functions involved.

[0164] In addition, each functional module of each embodiment in the embodiment of the present application can be integrated together to form an independent part, or each module can exist separately, or two or more modules can be integrated to form an independent part. In addition, in the description of this specification, the description of reference terms "one embodiment", "some embodiments", "example", "specific example", "some examples", etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the embodiment of the present application. In this specification, the schematic representation of the above terms does not necessarily target the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples without contradiction.

[0165] The above description is only an optional implementation manner of the embodiments of the present application, but the protection scope of the embodiments of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or replacements within the technical scope disclosed in the embodiments of the present application, which should be covered within the protection scope of the embodiments of the present application.

Claims

1. A visual assistance enhancement method, characterized in that: include: Get the ambient brightness value of the electronic device; If the difference between the projection brightness value of the electronic device and the ambient brightness value is less than the minimum value of the preset threshold range, then increasing the difference between the projection brightness value and the ambient brightness value to visually enhance the projection image of the electronic device; If the difference between the projection brightness value of the electronic device and the ambient brightness value is greater than or equal to the maximum value of the preset threshold range, then reducing the difference between the projection brightness value and the ambient brightness value to visually enhance the projection image of the electronic device; Wherein, the increasing the difference between the projection brightness value and the ambient brightness value includes: if the ambient brightness value is less than the projection brightness value, after using the projection device of the electronic device to perform visible light projection, using the laser emitter of the electronic device to perform laser projection, the projection brightness value of the visible light projection is less than the projection brightness value of the laser projection; The laser projection using the laser emitter of the electronic device includes: obtaining the position coordinates of the electronic device, and / or obtaining the environmental image of the electronic device, and / or obtaining the environmental sound of the electronic device; and performing laser projection according to the position coordinates, the environmental image and / or the environmental sound by the laser emitter.

2. The method according to claim 1, characterized in that The step of obtaining the ambient brightness value of the electronic device includes: Acquire a video stream captured by a camera of the electronic device, and parse the ambient brightness value from the video stream; or, The ambient brightness value is collected by a sensor of the electronic device.

3. The method according to claim 2, characterized in that Parsing the environment brightness value from the video stream includes: Acquire an environment image of the electronic device from the video stream, and parse the environment brightness value from the environment image; or, A projection image of the electronic device is acquired from the video stream, a background image is segmented from the projection image, and the ambient brightness value is parsed from the background image.

4. The method according to claim 1, characterized in that: The performing laser projection according to the position coordinates, the environmental image and / or the environmental sound by the laser transmitter includes: Sending the location coordinates, the environment image and / or the environment sound to a server, so that the server determines and returns an image identifier according to the location coordinates, the environment image and / or the environment sound; receiving the image identifier sent by the server; Laser projection is performed according to the image mark by a laser transmitter.

5. The method according to claim 1, characterized in that The performing laser projection according to the position coordinates, the environmental image and / or the environmental sound by the laser transmitter includes: Detecting a target relative position of the target object relative to the position coordinates from the environmental image, and / or analyzing a target relative position of the target object relative to the position coordinates from the environmental sound; The rotation angle of the laser emitter is controlled by a pan / tilt platform so that the laser emitter projects laser light toward the relative position of the target.

6. An electronic device, characterized in that: include: Acquisition equipment and control processor; The acquisition device is used to obtain the ambient brightness value of the electronic device; The control processor is used to increase the difference between the projection brightness value and the ambient brightness value if the difference between the projection brightness value and the ambient brightness value is less than a minimum value of a preset threshold range, so as to visually enhance the projection image of the electronic device; The control processor is further configured to reduce the difference between the projection brightness value and the ambient brightness value if the difference between the projection brightness value and the ambient brightness value is greater than or equal to the maximum value of the preset threshold range, so as to visually enhance the projection image of the electronic device; Wherein, the increasing the difference between the projection brightness value and the ambient brightness value includes: if the ambient brightness value is less than the projection brightness value, after using the projection device of the electronic device to perform visible light projection, using the laser emitter of the electronic device to perform laser projection, the projection brightness value of the visible light projection is less than the projection brightness value of the laser projection; The laser projection using the laser emitter of the electronic device includes: obtaining the position coordinates of the electronic device, and / or obtaining the environmental image of the electronic device, and / or obtaining the environmental sound of the electronic device; and performing laser projection according to the position coordinates, the environmental image and / or the environmental sound by the laser emitter.

7. The electronic device according to claim 6, characterized in that: The acquisition device includes: a camera or a sensor; The camera is used to obtain a video stream captured by the camera of the electronic device, and the control processor is used to parse the ambient brightness value from the video stream; Alternatively, the sensor is used to collect the ambient brightness value.

8. The electronic device according to claim 7, characterized in that: The control processor is further used to obtain an environment image of the electronic device from the video stream, and parse the environment brightness value from the environment image; or, The control processor is further used to obtain a projection image of the electronic device from the video stream, segment a background image from the projection image, and parse the ambient brightness value from the background image.

9. The electronic device according to claim 6, characterized in that: The electronic device further comprises: a projection device and a laser transmitter; The control processor is also used to control the projection device to perform visible light projection and control the laser emitter to perform laser projection if the ambient brightness value is smaller than the projection brightness value, and the projection brightness value of the visible light projection is smaller than the projection brightness value of the laser projection.

10. The electronic device according to claim 9, characterized in that: The acquisition device also includes: a global positioning system GPS chip, a camera and / or a microphone; The GPS chip is used to obtain the location coordinates of the electronic device, and / or the camera is used to obtain an environmental image of the electronic device, and / or the microphone is used to collect environmental sounds; The laser transmitter is further used to perform laser projection according to the position coordinates, the environmental image and / or the environmental sound.

11. The electronic device according to claim 10, characterized in that: The electronic device further comprises: a communication module; The communication module is used to send the location coordinates, the environment image and / or the environment sound to the server, so that the server determines and returns the image identifier according to the location coordinates, the environment image and / or the environment sound; The communication module is also used to receive the image identifier sent by the server; The laser transmitter is also used to perform laser projection according to the image identification.

12. The electronic device according to claim 10, characterized in that: The electronic device further comprises: a pan / tilt platform; The control processor is further configured to detect a target relative position of the target object relative to the position coordinates from the environmental image, and / or to analyze a target relative position of the target object relative to the position coordinates from the environmental sound; The pan / tilt platform is used to control the rotation angle of the laser emitter so that the laser emitter performs laser projection toward the relative position of the target.