Image processing method based on shared visual angle, intelligent AI glasses and related device

Abstract

The invention discloses an image processing method based on a shared visual angle, intelligent AI glasses and a related device, and is applied to the intelligent AI glasses, and the intelligent AI glasses comprise a first camera module, a second camera module and a communication module; the method comprises the following steps: determining a gazing direction of a target object through the first camera module; the target object is a user wearing the intelligent AI glasses; shooting the gazing direction through the second camera module to obtain a first image; processing the first image to obtain a second image; and sending the second image to a specified device through the communication module. By adopting the embodiment of the invention, the intelligence of the intelligent AI glasses can be improved.

Description

Technical Field

[0001] This application relates to the technical field of wearable devices, or the field of artificial intelligence technology, and specifically relates to an image processing method, an intelligent AI glasses, and related devices based on a shared perspective. Background Art

[0002] With the rapid development of electronic technology, various electronic products have entered people's lives, greatly facilitating people's clothing, food, shelter, and transportation.

[0003] Currently, intelligent AI glasses have also entered people's lives, but their functions are relatively single. Therefore, the problem of how to improve the intelligence of intelligent AI glasses needs to be solved urgently. Summary of the Invention

[0004] Embodiments of this application provide an image processing method, an intelligent AI glasses, and related devices based on a shared perspective, which can improve the intelligence of intelligent AI glasses.

[0005] In a first aspect, embodiments of this application provide an image processing method based on a shared perspective, which is applied to intelligent AI glasses. The intelligent AI glasses include a first camera module, a second camera module, and a communication module. The method includes:

[0006] Determine the gaze direction of a target object through the first camera module. The target object is the user wearing the intelligent AI glasses.

[0007] Take a picture of the gaze direction through the second camera module to obtain a first image.

[0008] Process the first image to obtain a second image.

[0009] Send the second image to a specified device through the communication module.

[0010] In a second aspect, embodiments of this application provide an image processing device based on a shared perspective, which is applied to intelligent AI glasses. The intelligent AI glasses include a first camera module, a second camera module, and a communication module. The device includes: a determination unit, a shooting unit, a processing unit, and an interaction unit, where

[0011] The determination unit is configured to determine the gaze direction of a target object through the first camera module. The target object is the user wearing the intelligent AI glasses.

[0012] The shooting unit is configured to take a picture of the gaze direction through the second camera module to obtain a first image.

[0013] The processing unit is configured to process the first image to obtain a second image.

[0014] The interaction unit is configured to send the second image to a specified device through the communication module.

[0015] In a third aspect, an embodiment of the present application provides an intelligent AI glasses, including a processor, a memory, a communication interface, and one or more programs. Wherein, the above one or more programs are stored in the above memory and are configured to be executed by the above processor. The above programs include instructions for performing the steps in the first aspect of the embodiment of the present application.

[0016] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium. Wherein, the computer-readable storage medium stores a computer program for electronic data exchange. Wherein, the computer program enables a computer to execute some or all of the steps described in the first aspect of the embodiment of the present application.

[0017] In a fifth aspect, an embodiment of the present application provides a computer program product. Wherein, the computer program product includes a non-transitory computer-readable storage medium storing a computer program. The computer program is operable to enable a computer to execute some or all of the steps described in the first aspect of the embodiment of the present application. The computer program product may be a software installation package.

[0018] Implementing the embodiments of the present application has the following beneficial effects:

[0019] It can be seen that the image processing method, intelligent AI glasses, and related devices based on the shared perspective described in the embodiments of the present application are applied to intelligent AI glasses. The intelligent AI glasses include a first camera module, a second camera module, and a communication module. The gaze direction of a target object is determined through the first camera module. The target object is the user wearing the intelligent AI glasses. The gaze direction is photographed through the second camera module to obtain a first image. The first image is processed to obtain a second image. The second image is sent to a specified device through the communication module. In this way, the user can allow the user to live broadcast the picture he sees to friends or family members far away, enhancing the connection between each other. Therefore, remote shared perspective can be realized, the intelligence and interest of the intelligent AI glasses can be improved, and the user experience is improved. Description of the Drawings

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0021] Figure 1AIt is a schematic flowchart of an image processing method based on a shared perspective provided by an embodiment of the present application;

[0022] Figure 1B It is a schematic structural diagram of an intelligent AI glasses provided by an embodiment of the present application;

[0023] Figure 2 It is a schematic flowchart of another image processing method based on a shared perspective provided by an embodiment of the present application;

[0024] Figure 3 It is a schematic structural diagram of another intelligent AI glasses provided by an embodiment of the present application;

[0025] Figure 4 It is a block diagram of the functional units of an image processing device based on a shared perspective provided by an embodiment of the present application. Detailed implementation manners

[0026] In order to enable those skilled in the art to better understand the solution of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0027] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally further includes steps or units not listed, or optionally further includes other steps or units inherent to these processes, methods, products or devices.

[0028] Referring to "embodiment" herein means that a specific feature, structure or characteristic described in connection with the embodiment may be included in at least one embodiment of the present application. The phrase appears in various places in the specification and does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that the embodiments described herein may be combined with other embodiments.

[0029] In the embodiments of the present application, the designated device may include: a smart phone (such as an Android phone, an iOS phone, a Windows Phone, etc.), a personal digital assistant, a tablet computer, a Bluetooth speaker, a smart TV, a smart refrigerator, a smart robot, a driving recorder, a laptop computer, a Mobile Internet Device (MID), or a wearable device (such as smart AI glasses, a smart bracelet, a smart watch, a Bluetooth headset), etc. The above are only examples, not an exhaustive list, including but not limited to the above-mentioned designated devices. The designated device may also include a server, for example, a cloud server.

[0030] The embodiments of the present application will be introduced in detail below.

[0031] Please refer to Figure 1A , Figure 1A which is a schematic flowchart of an image processing method based on a shared perspective provided by the embodiments of the present application, applied to smart AI glasses. The smart AI glasses include a first camera module, a second camera module, and a communication module. As shown in the figure, the image processing method based on a shared perspective includes:

[0032] 101. Determine the gaze direction of the target object through the first camera module; the target object is the user wearing the smart AI glasses.

[0033] Among them, the target object may be the user wearing the smart AI glasses.

[0034] Among them, as Figure 1B shown, the smart AI glasses include a first camera module, a second camera module, a communication module, an environmental sensor, and a display module.

[0035] Among them, the communication module may include at least one of the following: an infrared communication module, a near-field communication module, a mobile communication module (2G, 3G, 4G, 5G, 6G, etc.), a millimeter-wave communication module, a wireless fidelity (Wi-Fi), a Bluetooth communication module, a radar communication module, etc., which are not limited herein.

[0036] Among them, the first camera module may include at least one of the following: a visible light camera, an infrared camera, etc., which are not limited herein.

[0037] Among them, the second camera module may include at least one of the following: a visible light camera, an infrared camera, etc., which are not limited herein.

[0038] In specific implementation, the first camera module may be used to detect the gaze direction of the target object. The second camera module may be used to capture the image corresponding to the user's line of sight.

[0039] Among them, the display module can be used to implement the display function. The display module can include at least one of the following: a display screen, a projection module, etc., which are not limited herein.

[0040] In specific implementation, the first camera module can be used to determine the gazing direction of the target object, so as to timely capture the user's line of sight direction.

[0041] 102. Shoot the gazing direction through the second camera module to obtain a first image.

[0042] In specific implementation, the second camera module can be used to shoot the gazing direction to obtain a first image, that is, an image of the user's line of sight direction can be obtained, and the user's seen image can be timely recorded.

[0043] 103. Process the first image to obtain a second image.

[0044] In specific implementation, the first image can be processed to achieve image enhancement to obtain a second image, thereby ensuring the image quality of the shared perspective image and helping to improve the user experience.

[0045] 104. Send the second image to a specified device through the communication module.

[0046] In specific implementation, the second image can be sent to a specified device through the communication module, that is, the user can be allowed to live broadcast the image he sees to friends or family members far away, enhancing the connection between each other. Thus, remote shared perspective can be realized, which can improve the intelligence and interest of the intelligent AI glasses and enhance the user experience.

[0047] Among them, the second image can be a single frame image, or one or more frames in a video sequence.

[0048] Among them, the specified device can be one or more devices. For example, it can realize screen sharing, or for another example, it can realize multi-person interactive video.

[0049] In some possible examples, the intelligent AI glasses further include a display module; the following steps can also be included:

[0050] Receive a third image from the specified device, where the third image is a real-time image captured by the camera of the specified device;

[0051] Stitch the third image and the first image to obtain a fourth image;

[0052] Display the fourth image through the display module.

[0053] In specific implementation, a third image of a specified device can be received. The third image is a real-time image captured by a camera of the specified device. Then, the third image is stitched with the first image to obtain a fourth image, that is, the environment picture of the users in an instant messaging session can be shared in the same image. Then, the fourth image is displayed through a display module. In this way, users can live broadcast the picture they see to friends or family members far away, enhancing the connection between each other. Thus, remote sharing of perspectives can be realized, which can improve the intelligence and interest of the smart AI glasses and enhance the user experience.

[0054] In some possible examples, the smart AI glasses further include an environmental sensor. The above step 102 of capturing the gazing direction through the second camera module to obtain the first image may include the following steps:

[0055] Obtain first environmental parameters through the environmental sensor;

[0056] Determine first shooting parameters corresponding to the first environmental parameters;

[0057] Capture the gazing direction through the second camera module with the first shooting parameters to obtain the first image.

[0058] Among them, the first environmental parameters may include at least one of the following: ambient light brightness, weather, temperature, humidity, atmospheric pressure, magnetic field interference intensity, etc., which are not limited here.

[0059] Among them, the first shooting parameters may include at least one of the following: exposure duration, sensitivity, white balance parameter, shooting mode, etc., which are not limited here.

[0060] In specific implementation, first environmental parameters can be obtained through the environmental sensor, and a mapping relationship between preset environmental parameters and shooting parameters can also be pre-stored. Furthermore, based on this mapping relationship, first shooting parameters corresponding to the first environmental parameters can be determined. Then, the gazing direction is captured through the second camera module with the first shooting parameters to obtain the first image. In this way, shooting parameters corresponding to the actual environment can be obtained, which helps to ensure the shooting quality. Thus, users can live broadcast the picture they see to friends or family members far away with high quality, deeply enhancing the connection between each other. Thus, remote sharing of perspectives can be realized, which can improve the intelligence and interest of the smart AI glasses and enhance the user experience.

[0061] In some possible examples, the above step of capturing the gazing direction through the second camera module with the first shooting parameters to obtain the first image may include the following steps:

[0062] The second camera module captures the gazing direction according to the first shooting parameters to obtain a first reference image;

[0063] Perform image quality evaluation on the first reference image to obtain an image quality evaluation value;

[0064] When the image quality evaluation value is less than a preset threshold, determine a first difference between the preset threshold and the image quality evaluation value;

[0065] Determine a first image enhancement algorithm corresponding to the first difference;

[0066] Perform image enhancement processing on the first reference image according to the first image enhancement algorithm to obtain the first image.

[0067] Among them, the preset threshold can be set in advance or be the system default.

[0068] In specific implementation, the second camera module can capture the gazing direction according to the first shooting parameters to obtain a first reference image. Then, at least one image quality evaluation index can be used to perform image quality evaluation on the first reference image to obtain an image quality evaluation value. The image quality evaluation index can include at least one of the following: information entropy, sharpness, average gradient, etc., which is not limited here. Specifically, at least one image quality evaluation index can be used to perform image quality evaluation on the first reference image to obtain at least one evaluation result, and then a weighted operation can be performed according to the at least one evaluation result and the weight corresponding to each evaluation result to obtain the image quality evaluation value.

[0069] Next, when the image quality evaluation value is less than the preset threshold, it indicates that the image quality does not meet the preset requirements. The first difference between the preset threshold and the image quality evaluation value can also be determined. The first difference = preset threshold - image quality evaluation value. The mapping relationship between the preset difference and the image enhancement algorithm can also be stored in advance. Furthermore, the first image enhancement algorithm corresponding to the first difference can be determined based on this mapping relationship, and the first reference image can be subjected to image enhancement processing according to the first image enhancement algorithm to obtain the first image. In this way, based on the gap between the actual image quality and the preset image quality, the corresponding image enhancement algorithm can be dynamically selected, which helps to make the image enhancement effect deeply meet the preset requirements, helps the user to live broadcast the picture they see to friends or family members far away, deeply enhances the connection between each other, and thus, remote sharing of perspectives can be realized, which can improve the intelligence and interest of the intelligent AI glasses and enhance the user experience.

[0070] Of course, when the image quality evaluation value is greater than or equal to the preset threshold, it indicates that the image quality meets the preset conditions, and then this first reference image can be used as the first image.

[0071] In some possible examples, the above steps of performing image enhancement processing on the first reference image according to the first image enhancement algorithm to obtain the first image may include the following steps:

[0072] Divide the first reference image into multiple regions;

[0073] Determine the clarity of each of the multiple regions to obtain multiple clarities;

[0074] Determine the first mean value and the first mean square deviation of the multiple clarities;

[0075] Determine the first algorithm control parameter of the first image enhancement algorithm corresponding to the first mean value;

[0076] Determine the first adjustment parameter corresponding to the first mean square deviation;

[0077] Adjust the first algorithm control parameter according to the first adjustment parameter to obtain a second algorithm control parameter;

[0078] Perform image enhancement processing on the first reference image according to the first image enhancement algorithm and the second algorithm control parameter to obtain the first image.

[0079] In specific implementation, the first reference image can be divided into multiple regions, and the clarity of each of the multiple regions can be determined to obtain multiple clarities. Then, the mean value of the multiple clarities can be determined to obtain the first mean value, and the mean square deviation of the multiple clarities can be determined to obtain the first mean square deviation. The mean value reflects the baseline situation of the image, and the mean square deviation reflects the correlation between regions of the image.

[0080] Furthermore, the mapping relationship between the preset mean value and the algorithm control parameter of the first image enhancement algorithm can be stored in advance. Furthermore, based on this mapping relationship, the first algorithm control parameter of the first image enhancement algorithm corresponding to the first mean value can be determined. In this way, the corresponding algorithm control parameter can be adapted based on the baseline situation of the image, so that the image enhancement effect is deeply adapted to the actual situation of the image itself, thereby preventing over-enhancement or under-enhancement.

[0081] Among them, the algorithm control parameter is used to control the image enhancement effect of the image enhancement algorithm. The image enhancement effect may include at least one of the following: image enhancement speed, image enhancement region, image enhancement degree, etc., which are not limited here.

[0082] Next, the mapping relationship between the preset mean value and the adjustment parameter can also be pre-stored. Furthermore, based on this mapping relationship, the first adjustment parameter corresponding to the first mean square error can be determined, and then the first algorithm control parameter can be adjusted according to the first adjustment parameter to obtain the second algorithm control parameter. The second algorithm control parameter = (1 + the first adjustment parameter) * the first algorithm control parameter. Image enhancement processing is performed on the first reference image according to the first image enhancement algorithm and the second algorithm control parameter to obtain the first image. In this way, the algorithm control parameter can be optimized in terms of the depth of the association between regions of the image, so that the final algorithm control parameter depth conforms to the image characteristics, which helps to make the image enhancement effect deeply meet the preset requirements, helps the user to live broadcast the picture he sees to friends or family members far away with high quality, deeply enhances the connection between each other, and thus, the remote sharing of perspectives can be realized, which can improve the intelligence and interest of the intelligent AI glasses and enhance the user experience.

[0083] In some possible examples, the following steps may further be included:

[0084] When the image quality evaluation value is less than the specified threshold, frame dropping processing is performed on the first reference image, and the step of obtaining the first reference image by shooting the gazing direction with the first shooting parameter through the second camera module is re-executed.

[0085] Among them, the specified threshold can be set in advance or be the system default. The specified threshold is less than the preset threshold.

[0086] In specific implementation, when the image quality evaluation value is less than the specified threshold, it means that the image quality is poor. Then, frame dropping processing can be performed on the first reference image, and the step of obtaining the first reference image by shooting the gazing direction with the first shooting parameter through the second camera module is re-executed. That is, when an image with poor quality is captured, it can be frame-dropped, which helps the user to live broadcast the picture he sees to friends or family members far away with high quality, deeply enhances the connection between each other, and thus, the remote sharing of perspectives can be realized, which can improve the intelligence and interest of the intelligent AI glasses and enhance the user experience.

[0087] In some possible examples, the following steps may further be included:

[0088] When the image quality evaluation value is greater than or equal to the specified threshold and less than or equal to the preset threshold, the step of determining the first difference between the preset threshold and the image quality evaluation value is executed.

[0089] In a specific implementation, when the image quality evaluation value is greater than or equal to a specified threshold and less than or equal to a preset threshold, it indicates that the image quality is average. After image enhancement, it can meet the requirements, which helps the user to live broadcast the picture they see to friends or family far away, deeply enhancing the connection between each other. Thus, remote sharing of perspectives can be achieved, which can improve the intelligence and interestingness of the intelligent AI glasses and enhance the user experience.

[0090] It can be seen that the image processing method based on shared perspective described in the embodiments of the present application is applied to intelligent AI glasses. The intelligent AI glasses include a first camera module, a second camera module, and a communication module. By using the first camera module, the gaze direction of the target object, which is the user wearing the intelligent AI glasses, is determined. The second camera module takes a picture of the gaze direction to obtain a first image. The first image is processed to obtain a second image. The second image is sent to a specified device through the communication module. In this way, the user can live broadcast the picture they see to friends or family far away, enhancing the connection between each other. Thus, remote sharing of perspectives can be achieved, which can improve the intelligence and interestingness of the intelligent AI glasses and enhance the user experience.

[0091] Please refer to Figure 2 , Figure 2 FIG. is a schematic flowchart of another image processing method based on shared perspective provided by the embodiments of the present application, which is applied to intelligent AI glasses. The intelligent AI glasses include a first camera module, a second camera module, and a communication module. As shown in the figure, the image processing method based on shared perspective includes:

[0092] 201. Determine the gaze direction of the target object through the first camera module; the target object is the user wearing the intelligent AI glasses.

[0093] 202. Take a picture of the gaze direction through the second camera module to obtain a first image.

[0094] 203. Process the first image to obtain a second image.

[0095] 204. Send the second image to a specified device through the communication module.

[0096] 205. Receive the third image from the specified device. The third image is a real-time image captured by the camera of the specified device.

[0097] 206. Stitch the third image and the first image to obtain a fourth image.

[0098] 207. Display the fourth image through the display module.

[0099] Among them, for the specific descriptions of the above steps 201 - 207, reference can be made to Figure 1A the descriptions of the relevant steps of the image processing method based on a shared perspective described therein.

[0100] It can be seen that the image processing method based on a shared perspective described in the embodiments of the present application is applied to a smart AI glasses. The smart AI glasses include a first camera module, a second camera module, and a communication module. The gaze direction of the target object is determined through the first camera module, where the target object is the user wearing the smart AI glasses. The gaze direction is photographed through the second camera module to obtain a first image. The first image is processed to obtain a second image. The second image is sent to a specified device through the communication module. The third image is received from the specified device, where the third image is a real-time image captured by the camera of the specified device. The third image and the first image are stitched together to obtain a fourth image. The fourth image is displayed through the display module. In this way, the user can allow the picture they see to be live-streamed to friends or family far away, enhancing the connection between each other. Thus, remote shared perspective can be achieved, which can improve the intelligence and interestingness of the smart AI glasses and enhance the user experience.

[0101] Consistent with the above embodiments, please refer to Figure 3 , Figure 3 which is a schematic structural diagram of another smart AI glasses provided by the embodiments of the present application. As shown in the figure, the smart AI glasses include a processor, a memory, a communication interface, and one or more programs. The above one or more programs are stored in the above memory and are configured to be executed by the above processor. In the embodiments of the present application, the smart AI glasses include a first camera module, a second camera module, and a communication module; the above programs include instructions for performing the following steps:

[0102] Determine the gaze direction of the target object through the first camera module; the target object is the user wearing the smart AI glasses;

[0103] Photograph the gaze direction through the second camera module to obtain a first image;

[0104] Process the first image to obtain a second image;

[0105] Send the second image to a specified device through the communication module.

[0106] In some possible examples, the smart AI glasses further include a display module; the above programs further include instructions for performing the following steps:

[0107] Receive the third image from the specified device, where the third image is a real-time image captured by the camera of the specified device;

[0108] Stitch the third image and the first image to obtain a fourth image;

[0109] Display the fourth image through the display module.

[0110] In some possible examples, the intelligent AI glasses further include an environmental sensor. In terms of capturing the gaze direction through the second camera module to obtain a first image, the above program includes instructions for performing the following steps:

[0111] Obtain first environmental parameters through the environmental sensor;

[0112] Determine first shooting parameters corresponding to the first environmental parameters;

[0113] Capture the gaze direction through the second camera module with the first shooting parameters to obtain the first image.

[0114] In some possible examples, in terms of capturing the gaze direction through the second camera module with the first shooting parameters to obtain the first image, the above program includes instructions for performing the following steps:

[0115] Capture the gaze direction through the second camera module with the first shooting parameters to obtain a first reference image;

[0116] Evaluate the image quality of the first reference image to obtain an image quality evaluation value;

[0117] When the image quality evaluation value is less than a preset threshold, determine a first difference between the preset threshold and the image quality evaluation value;

[0118] Determine a first image enhancement algorithm corresponding to the first difference;

[0119] Perform image enhancement processing on the first reference image according to the first image enhancement algorithm to obtain the first image.

[0120] In some possible examples, in terms of performing image enhancement processing on the first reference image according to the first image enhancement algorithm to obtain the first image, the above program includes instructions for performing the following steps:

[0121] Divide the first reference image into multiple regions;

[0122] Determine the clarity of each region in the multiple regions to obtain multiple clarity values;

[0123] Determine a first mean value and a first mean square deviation of the multiple clarity values;

[0124] Determine the first algorithm control parameter of the first image enhancement algorithm corresponding to the first mean value;

[0125] Determine the first adjustment parameter corresponding to the first mean square deviation;

[0126] Adjust the first algorithm control parameter according to the first adjustment parameter to obtain a second algorithm control parameter;

[0127] Perform image enhancement processing on the first reference image according to the first image enhancement algorithm and the second algorithm control parameter to obtain the first image.

[0128] It can be seen that the intelligent AI glasses described in the embodiments of the present application include a first camera module, a second camera module, and a communication module. The gaze direction of the target object is determined through the first camera module, where the target object is the user wearing the intelligent AI glasses. The gaze direction is photographed through the second camera module to obtain a first image, and the first image is processed to obtain a second image. The second image is sent to a specified device through the communication module. In this way, the user can allow the user to live broadcast the picture they see to friends or family far away, enhancing the connection between each other. Therefore, remote sharing of perspectives can be realized, which can improve the intelligence and interest of the intelligent AI glasses and enhance the user experience.

[0129] Figure 4 It is a functional unit composition block diagram of an image processing device 400 based on shared perspectives involved in the embodiments of the present application. The image processing device 400 based on shared perspectives is applied to intelligent AI glasses, and the intelligent AI glasses include a first camera module, a second camera module, and a communication module; the image processing device 400 based on shared perspectives includes: a determination unit 401, a photographing unit 402, a processing unit 403, and an interaction unit 404, where,

[0130] The determination unit 401 is configured to determine the gaze direction of the target object through the first camera module; the target object is the user wearing the intelligent AI glasses;

[0131] The photographing unit 402 is configured to photograph the gaze direction through the second camera module to obtain a first image;

[0132] The processing unit 403 is configured to process the first image to obtain a second image;

[0133] The interaction unit 404 is configured to send the second image to a specified device through the communication module.

[0134] In some possible examples, the intelligent AI glasses further include a display module; the image processing device 400 based on the shared perspective is further specifically configured to:

[0135] Receive a third image from the specified device, where the third image is a real-time image captured by a camera of the specified device;

[0136] Stitch the third image and the first image to obtain a fourth image;

[0137] Display the fourth image through the display module.

[0138] In some possible examples, the intelligent AI glasses further include an environmental sensor. In terms of capturing the first image by the second camera module in the direction of gaze, the capturing unit 402 is specifically configured to:

[0139] Obtain first environmental parameters through the environmental sensor;

[0140] Determine first shooting parameters corresponding to the first environmental parameters;

[0141] Capture the direction of gaze with the first shooting parameters by the second camera module to obtain the first image.

[0142] In some possible examples, in terms of capturing the first image by the second camera module with the first shooting parameters in the direction of gaze, the capturing unit 402 is specifically configured to:

[0143] Capture the direction of gaze with the first shooting parameters by the second camera module to obtain a first reference image;

[0144] Evaluate the image quality of the first reference image to obtain an image quality evaluation value;

[0145] When the image quality evaluation value is less than a preset threshold, determine a first difference between the preset threshold and the image quality evaluation value;

[0146] Determine a first image enhancement algorithm corresponding to the first difference;

[0147] Perform image enhancement processing on the first reference image according to the first image enhancement algorithm to obtain the first image.

[0148] In some possible examples, in terms of performing image enhancement processing on the first reference image according to the first image enhancement algorithm to obtain the first image, the capturing unit 402 is specifically configured to:

[0149] Divide the first reference image into a plurality of regions;

[0150] Determine the clarity of each of the plurality of regions to obtain a plurality of clarities;

[0151] Determine the first mean value and the first mean square deviation of the plurality of clarities;

[0152] Determine the first algorithm control parameter of the first image enhancement algorithm corresponding to the first mean value;

[0153] Determine the first adjustment parameter corresponding to the first mean square deviation;

[0154] Adjust the first algorithm control parameter according to the first adjustment parameter to obtain a second algorithm control parameter;

[0155] Perform image enhancement processing on the first reference image according to the first image enhancement algorithm and the second algorithm control parameter to obtain the first image.

[0156] It can be seen that the image processing device based on the shared perspective described in the embodiments of the present application is applied to a smart AI glasses. The smart AI glasses include a first camera module, a second camera module, and a communication module. The gaze direction of the target object is determined by the first camera module. The target object is the user wearing the smart AI glasses. The first image is obtained by shooting the gaze direction through the second camera module, the first image is processed to obtain the second image, and the second image is sent to the specified device through the communication module. In this way, the user can allow the user to live broadcast the picture he sees to friends or family members far away, enhancing the connection between each other. Therefore, remote shared perspective can be realized, the intelligence and interest of the smart AI glasses can be improved, and the user experience can be improved.

[0157] It can be understood that the functions of the respective program modules of the image processing device based on the shared perspective in this embodiment can be specifically implemented according to the methods in the above method embodiments. The specific implementation process can refer to the relevant descriptions in the above method embodiments and will not be elaborated here.

[0158] The embodiments of the present application further provide a computer storage medium. The computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute some or all of the steps of any of the methods recorded in the above method embodiments.

[0159] The embodiments of the present application further provide a computer program product. The computer program product includes a non-transitory computer-readable storage medium storing a computer program. The computer program is operable to enable a computer to execute some or all of the steps of any of the methods recorded in the above method embodiments. The computer program product can be a software installation package.

[0160] It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. However, those skilled in the art should be aware that this application is not limited by the described action sequence, because according to this application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0161] In the above embodiments, the descriptions of the respective embodiments have their own emphases. For parts not detailed in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0162] In several embodiments provided by this application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the above division of units is only a logical function division. In actual implementation, there can be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces. The indirect couplings or communication connections of the devices or units can be in electrical or other forms.

[0163] The units described above as separate components may or may not be physically separated. The components shown as units may or may not be physical units, that is, they can be located in one place, or they can be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0164] In addition, in each embodiment of this application, the functional units can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above integrated units can be implemented in the form of hardware or in the form of software functional units.

[0165] If the above integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the above methods in various embodiments of this application. The aforementioned memory includes various media that can store program codes, such as USB flash drives, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), external hard drives, magnetic disks, or optical discs.

[0166] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program. This program can be stored in a computer-readable memory, and the memory can include: flash drives, read-only memories (abbreviation: ROM, English: Read-Only Memory), random access memories (abbreviation: RAM, English: Random Access Memory), magnetic disks, or optical discs, etc.

[0167] The above has introduced the embodiments of this application in detail. Specific examples are used in this article to elaborate on the principles and implementation manners of this application. The description of the above embodiments is only used to help understand the method and its core idea of this application; at the same time, for those of ordinary skill in the art, according to the idea of this application, there will be changes in the specific implementation manners and application scopes. In summary, the content of this specification should not be construed as a limitation to this application.

Claims

1. An image processing method based on shared perspective, characterized in that: Applied to smart AI glasses, the smart AI glasses include a first camera module, a second camera module and a communication module; the method includes: Determine the gaze direction of a target object by using the first camera module; the target object is a user wearing the smart AI glasses; The second camera module is used to capture the gaze direction to obtain a first image; Processing the first image to obtain a second image; The second image is sent to a designated device through the communication module.

2. The method according to claim 1, characterized in that The smart AI glasses also include a display module; the method also includes: receiving a third image of the designated device, where the third image is a real-time image captured by a camera of the designated device; splicing the third image with the first image to obtain a fourth image; The fourth image is displayed through the display module.

3. The method according to claim 1 or 2, characterized in that: The smart AI glasses further include an environmental sensor, and the second camera module is used to shoot the gaze direction to obtain a first image, including: Acquiring a first environmental parameter through the environmental sensor; Determining a first shooting parameter corresponding to the first environmental parameter; The first image is obtained by photographing the gaze direction using the second camera module with the first shooting parameters.

4. The method according to claim 3, characterized in that The step of photographing the gaze direction with the first photographing parameter by the second camera module to obtain the first image includes: photographing the gaze direction using the second camera module with the first photographing parameters to obtain a first reference image; Performing image quality evaluation on the first reference image to obtain an image quality evaluation value; When the image quality evaluation value is less than a preset threshold, determining a first difference between the preset threshold and the image quality evaluation value; determining a first image enhancement algorithm corresponding to the first difference; Performing image enhancement processing on the first reference image according to the first image enhancement algorithm to obtain the first image.

5. The method according to claim 4, characterized in that The performing image enhancement processing on the first reference image according to the first image enhancement algorithm to obtain the first image includes: dividing the first reference image into a plurality of regions; Determine the definition of each of the plurality of regions to obtain a plurality of definitions; determining a first mean and a first mean square error of the plurality of sharpnesses; determining a first algorithm control parameter of the first image enhancement algorithm corresponding to the first mean value; Determining a first adjustment parameter corresponding to the first mean square error; Adjust the first algorithm control parameter according to the first adjustment parameter to obtain a second algorithm control parameter; The first reference image is enhanced according to the first image enhancement algorithm and the second algorithm control parameters to obtain the first image.

6. An image processing device based on a shared view, characterized in that: Applied to smart AI glasses, the smart AI glasses include a first camera module, a second camera module and a communication module; the device includes: a determination unit, a shooting unit, a processing unit and an interaction unit, wherein: The determining unit is used to determine the gaze direction of the target object through the first camera module; the target object is a user wearing the smart AI glasses; The shooting unit is used to shoot the gaze direction through the second camera module to obtain a first image; The processing unit is used to process the first image to obtain a second image; The interaction unit is configured to send the second image to a designated device through the communication module.

7. The device according to claim 6, characterized in that The smart AI glasses also include a display module; the device is also specifically used for: receiving a third image of the designated device, where the third image is a real-time image captured by a camera of the designated device; splicing the third image with the first image to obtain a fourth image; The fourth image is displayed through the display module.

8. The device according to claim 6 or 7, characterized in that The smart AI glasses further include an environmental sensor. In the aspect of photographing the gaze direction through the second camera module to obtain the first image, the photographing unit is specifically used for: Acquiring a first environmental parameter through the environmental sensor; Determining a first shooting parameter corresponding to the first environmental parameter; The first image is obtained by photographing the gaze direction using the second camera module with the first shooting parameters.

9. A smart AI glasses, characterized in that: The method comprises a processor and a memory, wherein the memory is used to store one or more programs and is configured to be executed by the processor, wherein the program comprises instructions for executing the steps in the method according to any one of claims 1 to 5.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a processor, the processor is caused to perform the method according to any one of claims 1 to 5.

Images