Prompt information output method and device, electronic equipment and readable storage medium

Abstract

The invention discloses a prompt information output method and device, electronic equipment and a readable storage medium. The prompt information output method is applied to the mixed reality equipment, the mixed reality equipment comprises a camera module and a display module, and the prompt information output method comprises the following steps: determining a target object distance range in an augmented reality mode according to hardware parameters of the camera module; under the condition that the augmented reality mode is operated, a first distance between a first position and a second position is obtained, the first position comprises the position of the target object, and the second position comprises the position of the mixed reality device or the position of a part of modules in the mixed reality device; outputting prompt information according to the first distance and the target object distance range, wherein the prompt information is used for identifying the relative position of the target object distance range and the first object; wherein the hardware parameters comprise at least one of the following items: an aperture value, a confusion circle diameter, an image distance, a focal length and a modulus transfer function value.

Description

Technical Field

[0001] The present application belongs to the technical field of electronic devices, and specifically relates to a prompt information output method, device, electronic device and readable storage medium. Background Art

[0002] Mixed reality (XR, Extended Reality) devices are devices that combine virtual reality (VR, Virtual Reality) and augmented reality (AR, Augmented Reality) technologies. With the advancement of technology, XR devices are gradually entering people's lives.

[0003] In the related art, when using XR devices to simulate scenes of real environments through perspective (VST, Video see through) technology, since the camera module used to build the VST environment has a fixed focal length and lacks the ability to push the lens to focus, when the user observes an object in the scene through XR or takes a photo of the object, it is difficult to find the best shooting and best observation distance of the object. It is necessary to frequently move oneself or move the object for observation and shooting, and the convenience of use is low. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a prompt information output method, device, electronic device and readable storage medium, which solves the problem of difficulty in finding the best shooting and best observation distance for objects, the need to frequently move oneself or move objects for observation and shooting, and low ease of use.

[0005] In a first aspect, an embodiment of the present application provides a prompt information output method, which is applied to a mixed reality device, wherein the mixed reality device includes: a camera module and a display module, and the prompt information output method includes: determining a target object distance range in an augmented reality mode according to hardware parameters of the camera module; when running the augmented reality mode, obtaining a first distance between a first position and a second position, wherein the first position includes the position of the target object, and the second position includes the position of the mixed reality device, or the position of some modules in the mixed reality device; outputting prompt information according to the first distance and the target object distance range, the prompt information being used to identify the relative position of the target object distance range and the target object; wherein the hardware parameters include at least one of the following: aperture value, circle of confusion diameter, image distance, focal length, and modulus transfer function value.

[0006] In a second aspect, an embodiment of the present application provides a prompt information output device, which is applied to a mixed reality device, and the mixed reality device includes: a camera module and a display module, and the prompt information output device includes: a determination module, which is used to determine the target object distance range in the augmented reality mode according to the hardware parameters of the camera module; an acquisition module, which is used to acquire a first distance between a first position and a second position when running the augmented reality mode, wherein the first position includes the position of the target object, and the second position includes the position of the mixed reality device, or the position of some modules in the mixed reality device; an output module, which is used to output prompt information according to the first distance and the target object distance range, and the prompt information is used to identify the relative position of the target object distance range and the target object; wherein the hardware parameters include at least one of the following: aperture value, confusion circle diameter, image distance, focal length and modulus transfer function value.

[0007] In a third aspect, an embodiment of the present application provides an electronic device, including a processor and a memory, wherein the memory stores programs or instructions that can be executed on the processor, and when the programs or instructions are executed by the processor, the steps of the method of the first aspect are implemented.

[0008] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method of the first aspect are implemented.

[0009] In a fifth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the steps of the method of the first aspect.

[0010] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the method of the second aspect.

[0011] In an embodiment of the present application, the mixed reality device can determine the target object distance range of the mixed reality device based on the hardware parameters of the camera module, and obtain a first distance between a first position of the target object and the camera module. By comparing the first distance with the target object distance range, it can determine whether the target object at the first position is within the target object distance range, and output corresponding prompt information to prompt the user to adjust the relative position between the target object and the mixed reality device, so that the user can find the optimal observation distance for the object to be observed or photographed without frequent movement, thereby improving the convenience of the user in using the mixed reality device. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 A schematic diagram showing a flow chart of a prompt information output method provided in some embodiments of the present application;

[0013] Figure 2 A diagram showing the imaging relationship between a photographing object and a camera module provided in some embodiments of the present application is shown;

[0014] Figure 3 A schematic diagram showing an optimal object distance range provided in some embodiments of the present application;

[0015] Figure 4 A schematic diagram of scene display provided in some embodiments of the present application is shown;

[0016] Figure 5 A schematic diagram showing target display content provided in some embodiments of the present application is shown;

[0017] Figure 6 A software framework diagram provided in some embodiments of the present application is shown;

[0018] Figure 7 A schematic block diagram of a prompt information output device provided in some embodiments of the present application is shown;

[0019] Figure 8 A structural block diagram of an electronic device according to an embodiment of the present application is shown;

[0020] Fig. 9 A schematic diagram of the hardware structure of an electronic device provided in some embodiments of the present application is shown. DETAILED DESCRIPTION

[0021] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0022] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0023] The following is combined with Figures 1 to 9, the prompt information output method, device, electronic device and readable storage medium provided in the embodiments of the present application are described in detail through specific embodiments and their application scenarios.

[0024] In some embodiments of the present application, a prompt information output method is provided, which is applied to a mixed reality device, wherein the mixed reality device includes a camera module and a display module. Figure 1 FIG. 1 is a flow chart showing a method for outputting prompt information provided in some embodiments of the present application. Figure 1 As shown, the prompt information output method includes:

[0025] Step 102, determining the target object distance range in the augmented reality mode according to the hardware parameters of the camera module;

[0026] In an embodiment of the present application, the mixed reality device can obtain the hardware parameters of the camera module. Exemplarily, the mixed reality device can be a mixed reality head display, mixed reality glasses, a mixed reality camera, etc.

[0027] In an embodiment of the present application, the mixed reality device includes a camera module and a display module. Exemplarily, the camera module can be selected as a camera, and the display module can be selected as a display screen, a projection screen, etc.

[0028] In the embodiment of the present application, the number of camera modules is at least one, and the camera module is a camera module with a fixed focal length. Exemplarily, the virtual reality device is a virtual reality head display, the number of camera modules is two, and the two camera modules are arranged on the left and right sides of the mixed reality head display.

[0029] In the embodiment of the present application, after obtaining the hardware parameters of the camera module, the target object distance range of the camera module can be determined by calculation based on the hardware parameters of the camera module, and the target object distance range is the optimal shooting range of the camera module. Specifically, when the object to be photographed by the camera module is within the target object distance range, the image features of the object in the image taken by the camera module are clearer.

[0030] Step 104, when the augmented reality mode is running, obtaining a first distance between a first position and a second position, wherein the first position includes a position of a target object, and the second position includes a position of a mixed reality device, or a position of a part of a module in the mixed reality device;

[0031] In an embodiment of the present application, the mixed reality device has an augmented reality function and a virtual reality function. When the mixed reality device operates in an augmented reality mode, the mixed reality device captures environmental images through a camera module, and a user can view the environmental images captured by the camera module through a display device in the mixed reality device.

[0032] In the embodiment of the present application, the target object is the object that the user needs to shoot, and the first position is the position of the object that the user needs to shoot. The position of the target object is taken as the first position.

[0033] Exemplarily, the target object includes an item that the user is looking at. The mixed reality device collects the user's eye movement signals and determines the user's gaze point position based on the eye movement signals. At this time, the target object is located at the user's gaze point position, so the user's gaze point position is taken as the first position.

[0034] Exemplarily, the target object includes an object held by a user, and a distance sensor is provided in the mixed reality device. The object held by the user can be located by the distance sensor, and the position of the object held by the user is determined as the first position.

[0035] In the embodiment of the present application, the second position includes any one of the following: the position of the mixed reality device, the position of some modules in the camera module and the display module in the mixed reality device.

[0036] Exemplarily, the second position may be the position of the mixed reality device, the position of the camera module in the mixed reality device, or the position of the display module in the mixed reality device. For example, when all modules of the mixed reality device are in the same position and the user uses the mixed reality device, the position of the mixed reality device as a whole is taken as the second position. When the user carries some modules in the mixed reality device, such as the camera module, the position of the camera module is taken as the second position; and when the user carries the display module, the position of the display module is taken as the second position.

[0037] Exemplarily, the mixed reality device is a mixed reality headset, and the mixed reality device operates in augmented reality mode. The first position of the user's gaze point is the position of the target object that the user needs to view, the second position is the position of the mixed reality device, and the first distance between the first position and the second position is the distance between the camera module and the object that the user needs to view.

[0038] Exemplarily, the augmented reality mode includes a perspective (VST, Video see through) mode, in which the user can view the external environment image through the mixed reality device.

[0039] Step 106, outputting prompt information according to the first distance and the target object distance range, where the prompt information is used to identify the relative position of the target object distance range and the target object;

[0040] The hardware parameters include at least one of the following: aperture value, diameter of the circle of confusion, image distance, focal length and modulus transfer function value.

[0041] In an embodiment of the present application, the prompt information can indicate the relative position between the target object and the target object distance range, so that the user can understand whether the target object or the mixed reality device needs to be moved to improve the shooting effect.

[0042] In the embodiment of the present application, before determining the target object distance range according to the hardware parameters, it is necessary to obtain the hardware parameters of the camera module, which are the parameters calibrated before the mixed reality device leaves the factory, and the calibrated hardware parameters are stored in the local storage area of ​​the mixed reality device. Before the mixed reality device runs in the augmented reality mode, it is necessary to call the hardware parameters in the local storage area.

[0043] It should be noted that the hardware parameters include at least one of the aperture value, the diameter of the circle of confusion, the image distance, the focal length and the modulus transfer function value. The foreground depth of field and the back depth of field when the camera module is shooting can be calculated by the above hardware parameters, and the corresponding target object distance range can be determined according to the foreground depth of field and the back depth of field.

[0044] Specifically, when the mixed reality device system is started, the Camera Service process is started and keeps running. This process is used to manage the hardware devices of the camera module and various software execution function processes, and to provide control interfaces and output image data to applications. When the Camera Service is started, the hardware parameters of the camera module can be obtained.

[0045] In an embodiment of the present application, by storing the hardware parameters of the factory-calibrated camera module in a local storage area of ​​the mixed reality device, and after the mixed reality device starts running, reading and calling the hardware parameters stored in the local storage area, the mixed reality device can calculate the target object distance range through the hardware parameters of the camera module before running in the augmented reality mode, thereby improving the timeliness of outputting prompt information based on the target object distance range and the first distance value.

[0046] In the embodiment of the present application, after determining the first distance and the target object distance range, the first distance is compared with the target object distance range to determine whether the target object at the first position of the target object is within the target object distance range. Based on the relative position of the target object and the target object distance range, corresponding prompt information is output, and the user can be prompted whether to move the mixed reality device or whether to move the object to be viewed or photographed.

[0047] If the target object is within the target object distance range, the user can determine based on the prompt information that there is no need to adjust the relative position between the target object and the mixed reality device. If the target object is outside the target object distance range, the user can adjust the position of the target object or the mixed reality device based on the prompt information to achieve the best shooting effect.

[0048] Exemplarily, when the target object is not within the target object distance range, the prompt information can prompt the user to move the target object, so that the user moves the target object into the target object distance range based on the prompt information.

[0049] Exemplarily, when the target object is not within the target object distance range, the prompt information can prompt the user to move to drive the mixed reality device to move. At this time, the target object distance range also moves accordingly, so that the target object enters the target object distance range.

[0050] In an embodiment of the present application, the mixed reality device can determine the target object distance range of the mixed reality device based on the hardware parameters of the camera module, and obtain a first distance between a first position of the target object and a second position of the mixed reality device or a portion of the modules in the mixed reality device. By comparing the first distance with the target object distance range, it can be determined whether the target object at the first position is within the target object distance range, and corresponding prompt information can be output to prompt the user to adjust the relative position between the target object and the mixed reality device, so that the user can find the optimal observation distance for the object to be observed or photographed without frequent movement, thereby improving the convenience of the user in using the mixed reality device.

[0051] In some embodiments of the present application, the target object distance range in the augmented reality mode is determined according to the hardware parameters of the camera module, including: determining the foreground depth of field and the back depth of field of the camera module according to the aperture value, the diameter of the circle of confusion, the image distance, and the focal length; determining the optimization coefficient according to the modulus transfer function value, which is related to the image clarity and image resolution of the camera module; determining the target object distance range according to the foreground depth of field and the product of the back depth of field and the optimization coefficient.

[0052] In the embodiment of the present application, the target object distance range is a range determined according to the foreground depth of field and the back depth of field when the camera module is shooting, that is, when the target object photographed by the camera module is within the range of the foreground depth of field and the back depth of field, the camera module has a better shooting effect on the target object.

[0053] The calculation formula (1) of the front depth of field of the camera module and the calculation formula (2) of the back depth of field of the camera module are as follows:

[0054] ΔL1=F×δ×L 2 / (f 2 +F×δ×L); (1)

[0055] ΔL2= F×δ×L 2 / (f 2 -F×δ×L); (2)

[0056] Among them, ΔL1 is the foreground depth of field, ΔL2 is the back depth of field, F is the aperture value, δ is the diameter of the circle of confusion, f is the focal length, and L is the target shooting distance.

[0057] It can be seen from the above formulas (1) and (2) that the parameters required to determine the foreground depth of field and the background depth of field of the camera module are the aperture value, the diameter of the circle of confusion, the focal length and the target shooting distance. Among them, the aperture value, the diameter of the circle of confusion and the focal length are all hardware parameters that can be directly called, and the target shooting distance is the optimal shooting distance when the target camera module is shooting.

[0058] Figure 2 The imaging relationship diagram of the photographed object and the camera module provided in some embodiments of the present application is shown, such as Figure 2 As shown, the target shooting distance L is the sum of the target distance U between the object being photographed and the lens and the image distance V of the camera module.

[0059] Specifically, the target shooting distance is calculated using the following formula (3):

[0060] L=U+V; (3)

[0061] Among them, L is the target shooting distance, U is the target distance between the photographed object and the lens, and V is the image distance V of the camera module.

[0062] It should be noted that the image distance, focal length and the distance between the photographed object and the lens satisfy the following relationship (4), as follows:

[0063] 1 / U +1 / V=1 / f; (4)

[0064] Among them, U is the target distance between the photographed object and the lens, V is the image distance of the camera module, and f is the focal length of the camera module.

[0065] In the embodiment of the present application, the image distance V of the camera module and the focal length f of the camera module in the above relationship (4) are hardware parameters pre-stored in the local storage area, and the target distance U between the photographed object and the lens can be calculated by the image distance V and the focal length f. After the target distance U is calculated by the above relationship (4), the calculation result is substituted into the above calculation formula (3) to calculate the target shooting distance L. Then, the calculated shooting distance L is substituted into the above calculation formula (1) and calculation formula (2) respectively to calculate the foreground depth of field ΔL1 and the back depth of field ΔL2.

[0066] In the embodiment of the present application, the modulus transfer function value is MTF (Modulation Transfer Function), which is tested by using an ISO12233 resolution test card. During the test, the ISO12233 resolution test card is photographed by a camera module, and the modulus transfer function value is determined by the maximum brightness value and the minimum brightness value of the test image obtained by the photographing. The expression (5) of the modulus transfer function value is as follows:

[0067] MTF = (maximum brightness value - minimum brightness value) / (maximum brightness value + minimum brightness value); (5)

[0068] In the embodiment of the present application, the value range of the optimization coefficient t is 0 to 1. The specific value of t can be determined by linearly converting the modulus transfer function value. Specifically, when the MTF is low, the value of t is small, and the target object distance range is small. When the MTF is high, the value of t is large, and the optimal area will be wide.

[0069] Specifically, the target area corresponding to the target object distance range is determined by the following calculation formula (6), as follows:

[0070] W1=ΔL1+ΔL2×t; (6)

[0071] Wherein, W1 is the target area corresponding to the target object distance range, ΔL1 is the foreground depth of field, ΔL2 is the back depth of field, and t is the optimization coefficient.

[0072] Figure 3 A schematic diagram showing the optimal object distance range provided in some embodiments of the present application is shown in FIG. Figure 3 As shown, the target object distance region includes the entire foreground depth of field region and at least a portion of the back depth of field region.

[0073] In the embodiment of the present application, the expression (7) of the target object distance range is as follows:

[0074] W2=[U-ΔL1, U+ΔL2×t]; (7)

[0075] Wherein, W2 is the target object distance range, U is the target distance between the photographed object and the lens, ΔL1 is the foreground depth of field, ΔL2 is the back depth of field, and t is the optimization coefficient.

[0076] Specifically, the target distance between the photographed object and the lens is subtracted from the foreground depth of field to obtain the minimum value of the target object distance range, the target distance between the photographed object and the lens is summed with the back depth of field after the optimization coefficient is optimized to obtain the maximum value of the target object distance range, and the target object distance range is determined based on the minimum value of the target object distance range and the minimum value of the target object distance range.

[0077] In an embodiment of the present application, before running the augmented reality mode, the mixed reality device can calculate the foreground depth of field and back depth of field of the camera module based on the hardware parameters of the camera module, and determine the corresponding optimization coefficient based on the modulus transfer function value. The target object distance range can be calculated through the optimization coefficient, the foreground depth of field and the back depth of field, thereby improving the accuracy of the subsequent prompt information output based on the target object distance range and the actually detected first distance, so that the user can adjust the relative position between the mixed reality device and the target object according to the prompt information.

[0078] In some embodiments of the present application, the mixed reality device includes: an eye movement sensor and a distance measurement sensor, and when the augmented reality mode is running, obtaining a first distance between the first position and the camera module includes:

[0079] Determine the gaze point position according to the eye movement signal collected by the eye movement sensor, and use the gaze point position as the first position;

[0080] A first distance between the first position and the second position is determined by a distance measuring sensor.

[0081] In the embodiment of the present application, the mixed reality device includes an eye tracking sensor and a distance measuring sensor. When the user uses the mixed reality device, the eye tracking sensor (EyetrackingSensor) dynamically monitors the position of the gaze point of the user's eyes, and uses the gaze point position as the first position. The distance measuring sensor (DTOFSensor, Direct Time of FlightSensor) can be used to measure the first distance between the first position and the second position.

[0082] Exemplarily, when the mixed reality device operates in the augmented reality mode, the eye movement sensor and the ranging sensor are started, the first position of the gaze point is determined by the eye movement sensor, and the first distance between the first position and the second position is measured by the ranging sensor.

[0083] In an embodiment of the present application, an eye movement sensor and a distance measuring sensor are set in a mixed reality device, so that the first distance between the first position and the second position can be continuously monitored by the eye movement sensor and the distance measuring sensor, thereby improving the accuracy of the subsequent output of prompt information based on the target object distance range and the actually detected first distance.

[0084] In some embodiments of the present application, outputting prompt information according to the first distance and the target object distance range includes:

[0085] Determine a movement parameter and a third position of the target object according to the first distance and the target object distance range, wherein the movement parameter includes at least one of the following: a movement direction and a movement distance, and the third position includes a position of the target object after the movement, and the third position is within the target object distance range;

[0086] Based on the movement parameter and / or the third position, prompt information is output.

[0087] In the embodiment of the present application, the first distance is the actual distance between the target object that the user needs to observe or photograph and the mixed reality device. By comparing the first distance with the target object distance range, it can be determined whether the target object is located in the target area corresponding to the target object distance range.

[0088] When the target object is not within the target area corresponding to the target object distance range, the positional relationship between the position of the target object and the target area can be determined. After determining the positional relationship between the position of the target object and the target area, at least one of the moving direction and the moving distance of the target object, i.e., the moving parameter of the target object, can be determined. The third position is within the target object distance range, i.e., the third position is the position of the target object when it moves into the target area corresponding to the target object distance range.

[0089] In an embodiment of the present application, when outputting prompt information, the mixed reality device can choose to generate and output corresponding prompt information only based on the movement parameters or only based on the third position, and can also choose to generate and output corresponding prompt information based on the movement parameters and the third position.

[0090] Exemplarily, the prompt information includes voice prompt information, and the voice prompt information is information generated based on the third position and the movement parameter, for example: the voice prompt information is "move the photographed object forward 10 centimeters and place it on the table."

[0091] Exemplarily, the prompt information includes an image mark, which indicates the direction in which the user needs to move the target object by displaying an "arrow mark" in the displayed environmental image, and indicates that the target object moves to a third position within the target area by displaying a "highlight mark" in the displayed environmental image.

[0092] Figure 4 Schematic diagrams showing scenes provided in some embodiments of the present application are shown, such as Figure 4 As shown, the mixed reality device 402 operates in the augmented reality mode. When the user wears the mixed reality device 402, the user observes and shoots the environment image through the camera module 408 and the display module 410 in the mixed reality device 402, and the user's gaze point is the mobile phone 404. After the mixed reality device 402 outputs the first prompt information through the display module 410 and the audio playback module 412, the user can move the mobile phone 404 to the optimal observation area 406 corresponding to the target object distance range based on the first prompt information.

[0093] In an embodiment of the present application, by comparing the first distance and the target object distance range, the movement parameters for moving the target object and the third position of the target object within the target area corresponding to the target object distance range after the target object moves can be determined, and corresponding prompt information is output based on the movement parameters and the third position, so that the user can move the target object accordingly according to the content of the prompt information.

[0094] In some embodiments of the present application, the prompt information includes a first image identifier and / or a second image identifier;

[0095] Based on the movement parameter and / or the third position, output prompt information, including:

[0096] displaying target display content, the target display content including a first image feature, the first image feature including an image feature of a target object;

[0097] Displaying a first image mark in the target display content, with the first icon mark surrounding a third position; and / or

[0098] A second image logo is displayed in the target reality content, one end of the second image logo is located at the first position, the other end of the second image logo is located at the third position, and the second image logo is used to prompt the movement parameter.

[0099] In the embodiment of the present application, the prompt information includes at least one of a first image identifier and a second image identifier displayed in the target display content by the display device. The target display content includes an environment image collected by the virtual reality device, and the target reality content includes a first image feature corresponding to the target object.

[0100] Exemplarily, the target object is a mobile phone, that is, the first image feature is an image feature corresponding to the mobile phone in the target display content.

[0101] In the embodiment of the present application, the second image identifier is used to prompt the movement parameters, that is, the first image identifier is used to prompt the user to move the target object in a direction and a distance. The first image identifier is used to prompt the user to move the target object to a third position. Figure 5 A schematic diagram showing target display content provided in some embodiments of the present application is shown in FIG. Figure 5 As shown, the target display content 500 includes the first image feature of the target object, and an arrow mark 502 and a circle mark 504 are displayed in the target display content 500. The starting point of the arrow mark 502 is the position where the first image feature is located, and the end point of the arrow mark 502 corresponds to the circle mark 504. Among them, the arrow mark 502 is the second image mark, and the circle mark 504 is the first image mark.

[0102] In an embodiment of the present application, the prompt information includes at least one of a first image identifier and a second image identifier. The first image identifier is displayed in the target display content, and the third position recommended by the mixed reality device can be marked through the first image identifier. The second image identifier can also be displayed in the target display content, and the movement parameters of the user moving the target object are marked through the second image identifier, thereby improving the accuracy and intuitiveness of the prompt information for the user.

[0103] In some embodiments of the present application, the target display and prompt information output method further includes:

[0104] The display parameter of the first image feature is adjusted to the first parameter, and the display parameter of the second image feature is adjusted to the second parameter, and the second image feature is the image feature corresponding to the third position; wherein the display parameter includes at least one of the following: transparency, brightness, and color.

[0105] In the embodiment of the present application, the target display content displayed by the mixed reality device includes the captured environment image, the first image feature is the image feature of the target object in the environment image, and the second image feature is the image feature of the third position in the environment image. By adjusting the display parameters of the first image feature and the second image feature, the first image feature and the second image feature correspond to different display parameters, which makes it easier for the user to distinguish the first image feature and the second image feature, thereby improving the clarity of the prompt information output by the mixed reality device to prompt the user to move the target object.

[0106] In some embodiments of the present application, the mixed reality device further includes an audio playback module, which outputs prompt information based on the movement parameter and / or the third position, including:

[0107] The voice prompt information is outputted through the audio playback module, wherein the voice prompt information includes movement guidance information and / or target location information, the movement guidance information matches the movement parameters, and the target location information includes location information of a third location.

[0108] In the embodiment of the present application, the prompt information may include voice prompt information output by the mixed reality device. The voice prompt information may include movement guidance information, and the movement guidance information is used to prompt the user to move the target object according to the movement parameters, for example: the voice prompt information is "Move the object forward 10 centimeters to achieve the best shooting effect". The voice prompt information may also include target position information, and the target position information is used to prompt the user the best shooting position of the target object, for example: the voice prompt information is "Put the object on the table to achieve the best shooting effect".

[0109] Exemplarily, the number of audio playback modules may be at least two, and the audio playback module may be a speaker or a headset.

[0110] For example, the display parameters of the first image feature corresponding to the target object can be adjusted, and a voice prompt can be provided. For example, the first image feature corresponding to the target object can be displayed in green, and the third image feature corresponding to the third position can be displayed in yellow, and a voice prompt can be provided to "move the green object to the yellow position", thereby improving the convenience of the user in performing operations based on the prompt information.

[0111] In the embodiment of the present application, by outputting voice prompt information, the user using the mixed reality device can be prompted, which further improves the clarity and clarity of the prompt. In some embodiments of the present application, before outputting the prompt information according to the first distance and the target object distance range, it also includes:

[0112] When the target image is acquired, acquiring a third image feature in the target image;

[0113] When the first gesture information in the third image feature matches the preset gesture information, a step of outputting prompt information according to the first distance and the target object distance range is performed.

[0114] In the embodiment of the present application, before the mixed reality device outputs the prompt information, the target image can be acquired through the camera module, and the target image includes the user's gesture image. The first gesture information in the third image feature is extracted by the image recognition method. If the first gesture information matches the preset gesture information, it is determined that the user needs to observe or shoot the target object through the mixed reality device at this time, and the corresponding steps of outputting the prompt information are started, which improves the convenience of the user starting the shooting object prompt function of the mixed reality device.

[0115] Figure 6 The software framework diagram provided in some embodiments of the present application is shown as follows: Figure 6 As shown in the figure, the driver layer covers the driving functions of the VST sensor, eye movement sensor and ranging sensor, and supports the output of respective images and related information data. The software service layer operates the actual hardware and obtains the hardware output data, and provides a logic control interface to the application layer. The application layer obtains various data through the service layer. VST apk (Video see through Android application package) is an application used by mixed reality devices to open VST scenes. The application integrates relevant functions to provide users with assistance and related prompt information when performing certain specific operations, thereby improving the user experience.

[0116] The prompt information output method provided in the embodiment of the present application can be executed by a prompt information output device. In the embodiment of the present application, the prompt information output method provided in the embodiment of the present application is described by taking a prompt information output device executing the prompt information output method as an example.

[0117] In some embodiments of the present application, a prompt information output device is provided, which is applied to a mixed reality device, wherein the mixed reality device includes a camera module and a display module. Figure 7 FIG. 1 is a schematic block diagram of a prompt information output device provided in some embodiments of the present application. Figure 7 As shown, the prompt information output device 700 includes:

[0118] A determination module 702, for determining a target object distance range in an augmented reality mode according to hardware parameters of a camera module;

[0119] An acquisition module 704 is used to acquire a first distance between a first position and a second position when the augmented reality mode is running, wherein the first position includes a position of a target object, and the second position includes a position of a mixed reality device, or a position of a part of modules in the mixed reality device;

[0120] An output module 706, configured to output prompt information according to the first distance and the target object distance range, wherein the prompt information is used to identify a relative position between the target object distance range and the target object;

[0121] The hardware parameters include at least one of the following: aperture value, diameter of the circle of confusion, image distance, focal length and modulus transfer function value.

[0122] In an embodiment of the present application, the mixed reality device can determine the target object distance range of the mixed reality device based on the hardware parameters of the camera module, and obtain a first distance between a first position of the target object and a second position where the mixed reality device or some modules in the mixed reality device are located. By comparing the first distance with the target object distance range, it can be determined whether the target object at the first position is within the target object distance range, and corresponding prompt information can be output to prompt the user to adjust the relative position between the target object and the mixed reality device, so that the user can find the optimal observation distance for the object to be observed or photographed without frequent movement, thereby improving the convenience of the user in using the mixed reality device.

[0123] In some embodiments of the present application, the determination module 702 is used to determine the foreground depth of field and the back depth of field of the camera module according to the aperture value, the diameter of the circle of confusion, the image distance, and the focal length;

[0124] A determination module 702, for determining an optimization coefficient according to a modulus transfer function value, wherein the modulus transfer function value is associated with image clarity and image resolution of the camera module;

[0125] The determination module 702 is used to determine the target object distance range according to the foreground depth of field and the product of the back field depth and the optimization coefficient.

[0126] In an embodiment of the present application, before running the augmented reality mode, the mixed reality device can calculate the foreground depth of field and back depth of field of the camera module based on the hardware parameters of the camera module, and determine the corresponding optimization coefficient based on the modulus transfer function value. The target object distance range can be calculated through the optimization coefficient, the foreground depth of field and the back depth of field, thereby improving the accuracy of the subsequent prompt information output based on the target object distance range and the actually detected first distance, so that the user can adjust the relative position between the mixed reality device and the target object according to the prompt information.

[0127] In some embodiments of the present application, a mixed reality device includes: an eye movement sensor and a range finding sensor;

[0128] A determination module 702 is used to determine the gaze point position according to the eye movement signal collected by the eye movement sensor, and use the gaze point position as the first position;

[0129] The determination module 702 is configured to determine a first distance between a first position and a second position by using a distance measuring sensor.

[0130] In an embodiment of the present application, an eye movement sensor and a distance measuring sensor are set in a mixed reality device, so that the first distance between the first position and the second position can be continuously monitored by the eye movement sensor and the distance measuring sensor, thereby improving the accuracy of the subsequent output of prompt information based on the target object distance range and the actually detected first distance.

[0131] In some embodiments of the present application, the determination module 702 is used to determine the movement parameter and the third position of the target object according to the first distance and the target object distance range, wherein the movement parameter includes at least one of the following: a movement direction and a movement distance, and the third position includes the position of the target object after the movement, and the third position is within the target object distance range;

[0132] The output module 706 is used to output prompt information based on the movement parameter and / or the third position.

[0133] In an embodiment of the present application, by comparing the first distance and the target object distance range, the movement parameters for moving the target object and the third position of the target object within the target area corresponding to the target object distance range after the target object moves can be determined, and corresponding prompt information is output based on the movement parameters and the third position, so that the user can move the target object accordingly according to the content of the prompt information.

[0134] In some embodiments of the present application, the prompt information includes a first image identifier and / or a second image identifier;

[0135] The prompt information output device 700 further includes:

[0136] A display module, configured to display target display content, wherein the target display content includes a first image feature, and the first image feature includes an image feature of a target object;

[0137] The display module is further configured to display a first icon mark in the target display content, wherein the first icon mark is surrounded by a peripheral side of the third position; and / or

[0138] The display module is also used to display a second image logo in the target reality content, one end of the second image logo is located at the first position, and the other end of the second image logo is located at the third position, and the second image logo is used to prompt the movement parameters.

[0139] In an embodiment of the present application, the prompt information includes at least one of a first image identifier and a second image identifier. The first image identifier is displayed in the target display content, and the third position recommended by the mixed reality device can be marked through the first image identifier. The second image identifier can also be displayed in the target display content, and the movement parameters of the user moving the target object are marked through the second image identifier, thereby improving the accuracy and intuitiveness of the prompt information for the user.

[0140] In some embodiments of the present application, the display module is used to adjust the display parameters of the first image feature to the first parameter, and adjust the display parameters of the second image feature to the second parameter, and the second image feature is the image feature corresponding to the third position; wherein the display parameters include at least one of the following: transparency, brightness, and color.

[0141] In the embodiment of the present application, the target display content displayed by the mixed reality device includes the captured environment image, the first image feature is the image feature of the target object in the environment image, and the second image feature is the image feature of the third position in the environment image. By adjusting the display parameters of the first image feature and the second image feature, the first image feature and the second image feature correspond to different display parameters, which makes it easier for the user to distinguish the first image feature and the second image feature, thereby improving the clarity of the prompt information output by the mixed reality device to prompt the user to move the target object.

[0142] In some embodiments of the present application, the mixed reality device further includes an audio playback module, and the prompt information output device 700 further includes:

[0143] The voice output module is used to output voice prompt information through the audio playback module, wherein the voice prompt information includes movement guidance information and / or target location information, the movement guidance information matches the movement parameters, and the target location information includes location information of a third location.

[0144] In the embodiment of the present application, the user using the mixed reality device can be prompted by outputting voice prompt information, which further improves the clarity and clarity of the prompt. In some embodiments of the present application, the acquisition module 704 is used to acquire the third image feature in the target image when the target image is acquired;

[0145] The prompt information output device 700 further includes:

[0146] The execution module is used to execute the step of outputting prompt information according to the first distance and the target object distance range when the first gesture information in the third image feature matches the preset gesture information.

[0147] In the embodiment of the present application, before the mixed reality device outputs the prompt information, the target image can be acquired through the camera module, and the target image includes the user's gesture image. The first gesture information in the third image feature is extracted by the image recognition method. If the first gesture information matches the preset gesture information, it is determined that the user needs to observe or shoot the target object through the mixed reality device at this time, and the corresponding steps of outputting the prompt information are started, which improves the convenience of the user starting the shooting object prompt function of the mixed reality device.

[0148] The prompt information output device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or it can be other devices other than the terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a car-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0149] The prompt information output device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0150] The prompt information output device provided in the embodiment of the present application can implement each process implemented in the above method embodiment. To avoid repetition, it will not be repeated here.

[0151] Optionally, an embodiment of the present application further provides an electronic device, which includes a prompt information output method as in any of the above embodiments, and thus has all the beneficial effects of the prompt information output method in any of the embodiments, which will not be elaborated herein.

[0152] Optionally, an embodiment of the present application further provides an electronic device, Figure 8 A structural block diagram of an electronic device according to an embodiment of the present application is shown. Figure 8 As shown, the electronic device 800 includes a processor 802, a memory 804, and a program or instruction stored in the memory 804 and executable on the processor 802. When the program or instruction is executed by the processor 802, each process of the above-mentioned prompt information output method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0153] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0154] Fig. 9 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0155] The electronic device 900 includes but is not limited to: a radio frequency unit 901, a network module 902, an audio output unit 903, an input unit 904, a sensor 905, a display unit 906, a user input unit 907, an interface unit 908, a memory 909, a processor 910 and other components.

[0156] Those skilled in the art will appreciate that the electronic device 900 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 910 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig. 9 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0157] The processor 910 is used to determine the target object distance range in the augmented reality mode according to the hardware parameters of the camera module;

[0158] Processor 910, configured to obtain a first distance between a first position and a second position when running an augmented reality mode, wherein the first position includes a position of a target object, and the second position includes a position of a mixed reality device, or a position of a part of a module in the mixed reality device;

[0159] Processor 910, configured to output prompt information according to the first distance and the target object distance range, where the prompt information is used to identify a relative position between the target object distance range and the target object;

[0160] The hardware parameters include at least one of the following: aperture value, diameter of the circle of confusion, image distance, focal length and modulus transfer function value.

[0161] In an embodiment of the present application, the mixed reality device can determine the target object distance range of the mixed reality device based on the hardware parameters of the camera module, and obtain a first distance between a first position of the target object and a second position of the mixed reality device or a portion of the modules in the mixed reality device. By comparing the first distance with the target object distance range, it can be determined whether the target object at the first position is within the target object distance range, and corresponding prompt information can be output to prompt the user to adjust the relative position between the target object and the mixed reality device, so that the user can find the optimal observation distance for the object to be observed or photographed without frequent movement, thereby improving the convenience of the user in using the mixed reality device.

[0162] Further, the processor 910 is used to determine the foreground depth of field and the back depth of field of the camera module according to the aperture value, the diameter of the circle of confusion, the image distance, and the focal length;

[0163] Processor 910, for determining an optimization coefficient according to a modulus transfer function value, wherein the modulus transfer function value is associated with image clarity and image resolution of the camera module;

[0164] Processor 910 is used to determine the target object distance range according to the foreground depth of field and the product of the back field depth and the optimization coefficient.

[0165] In an embodiment of the present application, before running the augmented reality mode, the mixed reality device can calculate the foreground depth of field and back depth of field of the camera module based on the hardware parameters of the camera module, and determine the corresponding optimization coefficient based on the modulus transfer function value. The target object distance range can be calculated through the optimization coefficient, the foreground depth of field and the back depth of field, thereby improving the accuracy of the subsequent prompt information output based on the target object distance range and the actually detected first distance, so that the user can adjust the relative position between the mixed reality device and the target object according to the prompt information.

[0166] Further, the mixed reality device includes: an eye movement sensor and a range finding sensor;

[0167] Processor 910, configured to determine a gaze point position according to an eye movement signal collected by an eye movement sensor, and use the gaze point position as a first position;

[0168] The processor 910 is configured to determine a first distance between a first position and a second position by using a distance measuring sensor.

[0169] In an embodiment of the present application, an eye movement sensor and a distance measuring sensor are set in a mixed reality device, so that the first distance between the first position and the second position can be continuously monitored by the eye movement sensor and the distance measuring sensor, thereby improving the accuracy of the subsequent output of prompt information based on the target object distance range and the actually detected first distance.

[0170] Further, the processor 910 is used to determine a movement parameter and a third position of the target object according to the first distance and the target object distance range, wherein the movement parameter includes at least one of the following: a movement direction and a movement distance, and the third position includes a position of the target object after the movement, and the third position is within the target object distance range;

[0171] The processor 910 is configured to output prompt information based on the movement parameter and / or the third position.

[0172] In an embodiment of the present application, by comparing the first distance and the target object distance range, the movement parameters for moving the target object and the third position of the target object within the target area corresponding to the target object distance range after the target object moves can be determined, and corresponding prompt information is output based on the movement parameters and the third position, so that the user can move the target object accordingly according to the content of the prompt information.

[0173] Furthermore, the prompt information includes a first image identifier and a second image identifier;

[0174] A display unit 906, configured to display target display content, the target display content including a first image feature, the first image feature including an image feature of a target object;

[0175] The display unit 906 is configured to display the first icon mark in the target display content, wherein the first icon mark is surrounded by the third position; and / or

[0176] The display unit 906 is used to display a second image mark in the target reality content, one end of the second image mark is located at the first position, and the other end of the second image mark is located at the third position, and the second image mark is used to prompt the movement parameter.

[0177] In an embodiment of the present application, the prompt information includes at least one of a first image identifier and a second image identifier. The first image identifier is displayed in the target display content, and the third position recommended by the mixed reality device can be marked through the first image identifier. The second image identifier can also be displayed in the target display content, and the movement parameters of the user moving the target object are marked through the second image identifier, thereby improving the accuracy and intuitiveness of the prompt information for the user.

[0178] Furthermore, the display unit 906 is used to adjust the display parameters of the first image feature to the first parameter, and adjust the display parameters of the second image feature to the second parameter, and the second image feature is the image feature corresponding to the third position; wherein the display parameters include at least one of the following: transparency, brightness, and color.

[0179] In the embodiment of the present application, the target display content displayed by the mixed reality device includes the captured environment image, the first image feature is the image feature of the target object in the environment image, and the second image feature is the image feature of the third position in the environment image. By adjusting the display parameters of the first image feature and the second image feature, the first image feature and the second image feature correspond to different display parameters, which makes it easier for the user to distinguish the first image feature and the second image feature, thereby improving the clarity of the prompt information output by the mixed reality device to prompt the user to move the target object.

[0180] Furthermore, the mixed reality device also includes an audio playback module and an audio output unit 903, which is used to output voice prompt information through the audio output module, wherein the voice prompt information includes movement guidance information and / or target position information, the movement guidance information matches the movement parameters, and the target position information includes position information of a third position.

[0181] In the embodiment of the present application, by outputting voice prompt information, it is possible to provide prompts to users using mixed reality devices, thereby further improving the clarity and clarity of the prompts.

[0182] Further, the processor 910 is configured to obtain a third image feature in the target image when the target image is obtained;

[0183] The processor 910 is configured to, when the first gesture information in the third image feature matches the preset gesture information, execute the step of outputting prompt information according to the first distance and the target object distance range.

[0184] In the embodiment of the present application, before the mixed reality device outputs the prompt information, the target image can be acquired through the camera module, and the target image includes the user's gesture image. The first gesture information in the third image feature is extracted by the image recognition method. If the first gesture information matches the preset gesture information, it is determined that the user needs to observe or shoot the target object through the mixed reality device at this time, and the corresponding steps of outputting the prompt information are started, which improves the convenience of the user starting the shooting object prompt function of the mixed reality device.

[0185] It should be understood that in the embodiment of the present application, the input unit 904 may include a graphics processor (Graphics Processing Unit, GPU) 9041 and a microphone 9042, and the graphics processor 9041 processes the image data of the static picture or action file obtained by the image capture device (such as a camera) in the action file capture mode or the image capture mode. The display unit 906 may include a display panel 9061, and the display panel 9061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 907 includes a touch panel 9071 and at least one of other input devices 9072. The touch panel 9071 is also called a touch screen. The touch panel 9071 may include two parts: a touch detection device and a touch controller. Other input devices 9072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0186] The memory 909 can be used to store software programs and various data. The memory 909 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 909 may include a volatile memory or a non-volatile memory, or the memory 909 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 909 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0187] The processor 910 may include one or more processing units; optionally, the processor 910 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 910.

[0188] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0189] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0190] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned prompt information output method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0191] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0192] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the prompt information output method embodiment as described above, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0193] It should be noted that, in this article, the term "comprises", "includes" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, device, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, device, article or device. In the absence of further restrictions, an element defined by the statement "includes one..." does not exclude the presence of other identical elements in the process, device, article or device including the element. In addition, it should be noted that the scope of the devices and apparatuses in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described device may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0194] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment device can be implemented by means of software plus a necessary general hardware platform, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, disk, CD), including a number of instructions for a terminal (which can be a mobile phone, computer, server, or network equipment, etc.) to execute the device of each embodiment of the present application.

[0195] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A prompt information output method, characterized in that: Applied to a mixed reality device, the mixed reality device includes: a camera module and a display module, and the prompt information output method includes: Determine the target object distance range in the augmented reality mode according to the hardware parameters of the camera module; In the case of running the augmented reality mode, obtaining a first distance between a first position and a second position, wherein the first position includes a position of a target object, and the second position includes a position of the mixed reality device, or a position of a part of modules in the mixed reality device; outputting prompt information according to the first distance and the target object distance range, wherein the prompt information is used to identify a relative position between the target object distance range and the target object; The hardware parameters include at least one of the following: aperture value, diameter of the circle of confusion, image distance, focal length and modulus transfer function value.

2. The prompt information output method according to claim 1, characterized in that: Determining the target object distance range in the augmented reality mode according to the hardware parameters of the camera module includes: determining the foreground depth of field and the background depth of field of the camera module according to the aperture value, the diameter of the circle of confusion, the image distance, and the focal length; Determining an optimization coefficient according to the modulus transfer function value, wherein the modulus transfer function value is associated with image clarity and image resolution of the camera module; The target object distance range is determined according to the foreground depth of field and the product of the back depth of field and the optimization coefficient.

3. The prompt information output method according to claim 2, characterized in that: The mixed reality device includes: an eye movement sensor and a distance measurement sensor, and obtaining a first distance between a first position and a second position when the augmented reality mode is running includes: Determine a gaze point position according to the eye movement signal collected by the eye movement sensor, and use the gaze point position as the first position; A first distance between the first position and the second position is determined by the distance measuring sensor.

4. The prompt information output method according to any one of claims 1 to 3, characterized in that: The outputting prompt information according to the first distance and the target object distance range includes: Determine a movement parameter and a third position of the target object according to the first distance and the target object distance range, wherein the movement parameter includes at least one of the following: a movement direction and a movement distance, and the third position includes a position of the target object after movement, and the third position is within the target object distance range; Based on the movement parameter and / or the third position, prompt information is output.

5. The prompt information output method according to claim 4, characterized in that: The prompt information includes a first image identifier and / or a second image identifier; Outputting prompt information based on the movement parameter and / or the third position includes: displaying target display content, the target display content includes a first image feature, and the first image feature includes an image feature of the target object; Displaying the first image logo in the target display content, wherein the first image logo surrounds the third position; and / or The second image logo is displayed in the target display content, one end of the second image logo is located at the first position, the other end of the second image logo is located at the third position, and the second image logo is used to prompt the movement parameter.

6. The prompt information output method according to claim 5, characterized in that: After the display target displays the content, the prompt information output method further includes: adjusting a display parameter of the first image feature to a first parameter, and adjusting a display parameter of a second image feature to a second parameter, wherein the second image feature is an image feature corresponding to the third position; The display parameters include at least one of the following: transparency, brightness, and color.

7. The prompt information output method according to claim 4, characterized in that: The mixed reality device further includes an audio playback module, and the outputting of prompt information based on the movement parameter and / or the third position includes: The voice prompt information is outputted through the audio playback module, wherein the voice prompt information includes movement guidance information and / or target position information, the movement guidance information matches the movement parameters, and the target position information includes position information of the third position.

8. The prompt information output method according to any one of claims 1 to 3, characterized in that: Before outputting the prompt information according to the first distance and the target object distance range, the prompt information output method further includes: When a target image is acquired, acquiring a third image feature in the target image; In a case where the first gesture information in the third image feature matches the preset gesture information, the step of outputting prompt information according to the first distance and the target object distance range is performed.

9. A prompt information output device, characterized in that: Applied to a mixed reality device, the mixed reality device comprises: a display module of a camera module, and the prompt information output device comprises: A determination module, used to determine the target object distance range in the augmented reality mode according to the hardware parameters of the camera module; An acquisition module, configured to acquire a first distance between a first position and a second position when the augmented reality mode is running, wherein the first position includes a position of a target object, and the second position includes a position of the mixed reality device, or a position of some modules in the mixed reality device; an output module, configured to output prompt information according to the first distance and the target object distance range, wherein the prompt information is used to identify a relative position between the target object distance range and the target object; The hardware parameters include at least one of the following: aperture value, diameter of the circle of confusion, image distance, focal length and modulus transfer function value.

10. An electronic device, characterized in that: include: A processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the method according to any one of claims 1 to 8 are implemented.

11. A readable storage medium, characterized in that: The readable storage medium stores a program or an instruction, and when the program or the instruction is executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.

Images