Display method, device, electronic device and computer-readable storage medium

Abstract

The present application relates to a display method, device, computer equipment, storage medium and computer program product. The method comprises: displaying an augmented reality picture of the actual space inside the vehicle on the electronic device, obtaining a feature object corresponding to the device to be found in the actual space inside the vehicle from the augmented reality picture; obtaining target device information of the device to be found from the feature object; determining the target position of the device to be found in the augmented reality picture based on the target device information, and displaying the target device information at the target position. The method can quickly find the position of the device inside the vehicle.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a display method, device, electronic device and computer-readable storage medium. Background Art

[0002] As vehicle driving technology matures, cars are not just a means of transportation for people, and car manufacturers are beginning to pay more and more attention to the in-car experience. Quick and convenient use of various in-car devices, including air conditioning, charging ports, USB (Universal Serial Bus) ports or storage boxes, is also an important part of the in-car experience for passengers. Many first-time passengers do not know how to find these devices. In addition, different car manufacturers have different layouts of in-car equipment, and the experience of one car may not be smoothly transferred to another car of a different brand. For example, some cars have USB ports installed inside the front center armrest box, while some cars have USB ports installed inside the storage box under the auxiliary instrument panel.

[0003] However, traditional methods cannot quickly locate the location of components inside the vehicle. Summary of the invention

[0004] The embodiments of the present application provide a display method, device, electronic device, computer-readable storage medium and computer program product, which can quickly find the location of internal components of a vehicle.

[0005] In a first aspect, the present application provides a display method, which is applied to an electronic device with an augmented reality function; the method comprises:

[0006] Displaying an augmented reality picture of the actual space inside the vehicle on the electronic device, and acquiring a feature object corresponding to the device to be found in the actual space inside the vehicle from the augmented reality picture;

[0007] Acquire target device information of the device to be found from the feature object;

[0008] The target position of the to-be-searched device in the augmented reality picture is determined based on the target device information, and the target device information is displayed at the target position.

[0009] In a second aspect, the present application provides a display device, which is applied to an electronic device with an augmented reality function; the device comprises:

[0010] A display module is used to display an augmented reality picture of the actual space inside the vehicle on the electronic device,

[0011] an acquisition module, used to acquire, from the augmented reality picture, a feature object corresponding to the device to be found in the actual space inside the vehicle,

[0012] The acquisition module is also used to acquire the target device information of the device to be found from the feature object;

[0013] The display module is further configured to determine a target position of the to-be-searched device in the augmented reality image based on the target device information, and display the target device information at the target position.

[0014] In a third aspect, the present application provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of the display method as described above.

[0015] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the steps of the above method when executed by a processor.

[0016] In a fifth aspect, the present application provides a computer program product, including a computer program, which implements the steps of the above method when executed by a processor.

[0017] The above-mentioned display method, device, electronic device, computer-readable storage medium and computer program product are applied to an electronic device with augmented reality function, which can display an augmented reality picture of the actual space inside the vehicle, obtain the feature object corresponding to the device to be found in the actual space inside the vehicle from the augmented reality picture, and obtain the target device information of the device to be found from the feature object. Then, based on the target device information, the target position of the device to be found in the augmented reality picture can be quickly and accurately determined, and the target device information can be displayed at the target position, so that the position and information of the device to be found can be quickly found, avoiding the problem of slow search speed or even inability to find the device to be found due to manual search for the device to be found. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0019] Figure 1 A diagram showing an application environment of a method in an embodiment;

[0020] Figure 2is a flow chart showing a method in one embodiment;

[0021] Figure 3 is a schematic diagram of an augmented reality tag in one embodiment;

[0022] Figure 4 A schematic diagram of an augmented reality screen with superimposed target device information in one embodiment;

[0023] Figure 5 A flowchart of a step in an embodiment of obtaining target device information of a device to be found from a feature object;

[0024] Figure 6 is a flow chart showing a method in another embodiment;

[0025] Figure 7 is a structural block diagram of a display device in one embodiment;

[0026] Figure 8 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0027] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0028] The display method provided in the embodiment of the present application can be applied to Figure 1In the application environment shown. Taking the electronic device as a terminal as an example, the terminal 102 communicates with the server 104 through the network. The data storage system can store the data that the server 104 needs to process. The data storage system can be integrated on the server 104, or it can be placed on the cloud or other network servers. The terminal 102 has an augmented reality function, and the augmented reality picture of the actual space inside the vehicle is displayed on the terminal 102, and the feature object corresponding to the device to be found in the actual space inside the vehicle is obtained from the augmented reality picture, and the feature object is sent to the server 104 to instruct the server 104 to obtain the target device information of the device to be found from the feature object, and return the target device information to the terminal 102; the terminal 102 determines the target position of the device to be found in the augmented reality picture based on the target device information, and displays the target device information at the target position. Among them, the terminal 102 can be, but is not limited to, various personal computers, laptops, smart phones, tablets, AR (Augmented Reality, augmented reality) glasses, Internet of Things devices and portable wearable devices, and the Internet of Things devices can be smart speakers, smart TVs, smart air conditioners, smart car-mounted devices, etc. The portable wearable device may be a smart watch, a smart bracelet, a head-mounted device, etc. The server 104 may be implemented as an independent server or a server cluster consisting of multiple servers.

[0029] In another embodiment, the electronic device has an augmented reality function, and the electronic device displays an augmented reality picture of the actual space inside the vehicle, obtains the feature object corresponding to the device to be found in the actual space inside the vehicle from the augmented reality picture; obtains the target device information of the device to be found from the feature object; determines the target position of the device to be found in the augmented reality picture based on the target device information, and displays the target device information at the target position. Among them, the electronic device can be a terminal or a server, and the terminal can be but not limited to various personal computers, laptops, smart phones, tablets, AR (Augmented Reality) glasses, Internet of Things devices and portable wearable devices. The Internet of Things devices can be smart speakers, smart TVs, smart air conditioners, smart car-mounted devices, etc. Portable wearable devices can be smart watches, smart bracelets, head-mounted devices, etc. The server can be implemented as an independent server or a server cluster consisting of multiple servers.

[0030] In one embodiment, Figure 2 As shown, a display method is provided, which is applied to an electronic device with an augmented reality function; the method comprises the following steps:

[0031] Step 202 : displaying an augmented reality picture of the actual space inside the vehicle on the electronic device, and acquiring a feature object corresponding to the device to be found in the actual space inside the vehicle from the augmented reality picture.

[0032] Augmented Reality (AR), also known as augmented reality, is a relatively new technology that integrates real-world information and virtual-world information. It simulates and processes physical information that was originally difficult to experience in the real world based on scientific and technological means such as computers, and effectively applies virtual information in the real world. In the process, it can be perceived by human senses, thereby achieving a sensory experience beyond reality.

[0033] The augmented reality picture is a picture obtained by superimposing virtual information content on the real world. It is understandable that the augmented reality picture includes various devices in the actual space inside the vehicle, various organisms in the actual space inside the vehicle, and various superimposed virtual information, etc., but is not limited thereto. Among them. The virtual information may include the name of each device in the actual space inside the vehicle, the state parameters of each device, and other preset virtual information, etc., but is not limited thereto.

[0034] The device to be found is a device that the electronic device operator wants to find in the actual space inside the vehicle. The device to be found can be a device such as an air conditioner, a charging interface, a USB interface, or a storage box in the interior space of the vehicle, but is not limited thereto.

[0035] Feature objects refer to objects that contain features of the device to be found. Feature objects can be, but are not limited to, augmented reality tags, image frames containing the device to be found, or graphic codes. Augmented reality tags are a kind of reference marking system in the form of black and white rasterized images, and are mostly used in camera calibration, robot positioning, augmented reality and other scenarios. Augmented reality tags can encode certain information by changing the arrangement of the black and white squares. Figure 3 Schematic diagram of an augmented reality tag in one embodiment.

[0036] Specifically, the electronic device turns on the augmented reality function, obtains information about the actual space inside the vehicle through the augmented reality function, displays an augmented reality picture of the actual space inside the vehicle, and obtains feature objects corresponding to the device to be found in the actual space inside the vehicle from the augmented reality picture.

[0037] Step 204: Acquire target device information of the device to be found from the feature object.

[0038] The target device information is the relevant information of the device to be found. The target device information includes at least one of the identification of the device to be found and the distance between the electronic device and the device to be found. The target device information may also include at least one of the location information of the device to be found and the status parameter of the device to be found.

[0039] If the feature object is an augmented reality tag, the electronic device obtains a decoding algorithm for the augmented reality tag, uses the decoding algorithm to decode the augmented reality tag, and extracts facial device information of the device to be found.

[0040] If the feature object is an image frame containing the device to be found, the electronic device matches the image frame with each preset image, determines a matching preset image, and uses the preset device information in the preset image as the target device information of the device to be found. The preset image is an image taken in advance of the actual space inside the vehicle, and the preset device information is the information of the device contained in the preset image.

[0041] Step 206 : determining a target position of the device to be found in the augmented reality image based on the target device information, and displaying the target device information at the target position.

[0042] Specifically, the electronic device obtains the location information of the device to be found from the target device information, and can determine the target location of the device to be found in the augmented reality screen based on the location information. Then, the target device information can be displayed at the target location, and the operator of the electronic device can accurately find the device to be found from the augmented reality screen.

[0043] In one embodiment, Figure 4 As shown, the devices to be found are an air conditioner, two storage boxes, a USB port and a charging port. The electronic device determines the target position of each device to be found in the augmented reality screen and displays the target device information at the target position; wherein the target device information includes the identification of the device to be found and the distance between the electronic device and the device to be found.

[0044] For example, when the target position of the device to be found is an air conditioner, "air conditioner 1.5 meters" is displayed, indicating that the device to be found is an air conditioner, and the distance between the air conditioner and the electronic device is 1.5 meters.

[0045] For another example, "storage box 1 meter" is displayed at the target position where the device to be found is a storage box, indicating that the device to be found is a storage box, and the distance between the storage box and the electronic device is 1 meter.

[0046] For another example, "USB interface 0.75 meters" is displayed at the target position where the device to be found is a USB interface, indicating that the device to be found is a USB interface, and the distance between the USB interface and the electronic device is 0.75 meters.

[0047] For another example, "storage box 0.5 meters" is displayed at the target position where the device to be found is a storage box, indicating that the device to be found is a storage box, and the distance between the storage box and the electronic device is 0.5 meters.

[0048] For another example, "charging port 0.5 meters" is displayed at the target position where the device to be found is a charging port, indicating that the device to be found is a charging port, and the distance between the charging port and the electronic device is 0.5 meters.

[0049] The above display method is applied to an electronic device with an augmented reality function, which can display an augmented reality picture of the actual space inside the vehicle, obtain the feature object corresponding to the device to be found in the actual space inside the vehicle from the augmented reality picture, and obtain the target device information of the device to be found from the feature object. Then, based on the target device information, the target position of the device to be found in the augmented reality picture can be quickly and accurately determined, and the target device information can be displayed at the target position. The location and information of the device to be found can be quickly found, avoiding the problem of slow search speed or even failure to find the device to be found due to manual search. In addition, through the above display method, using an electronic device with an augmented reality function can clearly and intuitively locate and view all basic equipment inside the vehicle, such as air conditioning, USB interface and charging port.

[0050] Optionally, the above display method does not involve any changes to the internal structure of the car, can be applied to vehicles of any brand, and is universal; does not require additional equipment, and can quickly and easily find the in-vehicle devices through an electronic device with an augmented reality function, and is portable; through an electronic device with an augmented reality function, the purpose of the target device information displayed in the augmented reality screen can be clearly understood, that is, to help find and locate the devices in the car, avoiding cumbersome operations, and is easy to use.

[0051] Optionally, the electronic device can also be connected to the vehicle computer in the vehicle, and the status information of the device to be found can be obtained through the vehicle computer, and the status information of the device to be found can be displayed at the target position in the augmented reality screen. The status information includes information such as usage status, temperature and humidity. For example, if the device to be found is an air conditioner, the status information of the air conditioner can be the temperature of the air conditioner. For another example, if the device to be found is a charging port, the status information of the charging port can be whether the charging port is occupied.

[0052] Optionally, the electronic device can also control the device to be searched. For example, the electronic device can control the wind direction of the air conditioner in real time.

[0053] In one embodiment, an augmented reality tag is arranged within a preset range of the device inside the vehicle, and the augmented reality tag is encoded with the information of the corresponding device. If the operator of the electronic device needs to obtain the location of the device to be found, the electronic device with the augmented reality function is controlled to turn on the camera, and the augmented reality tag is scanned by the camera, and the target device information of the device to be found is extracted from the augmented reality tag using a decoding algorithm, and the target location of the device to be found is determined in the augmented reality screen displayed by the electronic device, and the target device information is displayed at the target location, so that the operator of the electronic device can quickly understand the location and information of the device to be found.

[0054] It is understandable that even if the device to be found is blocked, the electronic device can determine the target position of the device to be found and display the target device information through the augmented reality tag, thereby determining the position and information of the blocked device to be found.

[0055] If the feature object is an augmented reality tag, the target device information may also include the distance between the device to be found and the electronic device. The electronic device may use a monocular distance measurement algorithm or a binocular distance measurement algorithm to estimate the distance between the augmented reality tag and the electronic device, which is also the distance between the device to be found and the electronic device.

[0056] It is understandable that the computer vision technology used by electronic devices to identify augmented reality tags requires low computing power and is therefore suitable for direct deployment on electronic devices with augmented reality functions, which can quickly and accurately display the location and information of the device to be found.

[0057] In one embodiment, the feature object is an image frame containing the device to be found; Figure 5 As shown, the target device information of the device to be found is obtained from the feature object, including:

[0058] Step 502: Acquire target features of the image frame.

[0059] The target feature includes at least one of an image feature of the image frame and a posture feature when the image frame is taken. The image feature may include, but is not limited to, the color, texture information, and brightness of the image frame. The posture feature may include, but is not limited to, the angular velocity, acceleration, and angle when the image frame is taken.

[0060] The electronic device can obtain the image features of the image frame through the image sensor and obtain the posture features of the image frame through the inertia measurement unit (IMU).

[0061] Furthermore, the target feature may also include, but is not limited to, features such as shooting parameters of the image frame, such as aperture, exposure time, etc. The shooting parameters may include, but are not limited to, aperture, exposure time, etc.

[0062] Step 504, matching the target feature with the preset feature of the preset space inside the vehicle to determine the matching feature that matches the target feature; the preset space inside the vehicle is generated by fusing various preset images pre-taken in the actual space inside the vehicle.

[0063] The electronic device pre-shoots the actual space inside the vehicle to obtain various preset images, and fuses the various preset images to generate the preset space inside the vehicle. Furthermore, the electronic device pre-shoots various perspectives of the actual space inside the vehicle to obtain preset images of various perspectives, and fuses the preset images of various perspectives through a 3D vehicle interior model to generate the preset space inside the vehicle. The preset space inside the vehicle is a 3D image, that is, a 360-degree full-view image.

[0064] Specifically, the electronic device obtains each preset feature from each preset image of the preset space inside the vehicle, matches the target feature with each preset feature, and determines a matching feature that matches the target feature.

[0065] Step 506: Acquire target device information of the device to be found based on the matching features.

[0066] Specifically, the electronic device uses the device information corresponding to the matching feature as the target device information of the device to be found.

[0067] In this embodiment, the electronic device obtains the target features of the image frame, matches the target features with the preset features of the preset space inside the vehicle, and determines the matching features that match the target features. Based on the matching features, the target device information of the device to be found can be accurately obtained.

[0068] In one embodiment, target device information of a device to be found is obtained based on matching features, including: determining a target viewing angle that matches an image frame in a preset space inside a vehicle based on the matching features; obtaining preset device information within the target viewing angle in the preset space inside the vehicle, and using the preset device information as target device information of the device to be found.

[0069] The electronic device can determine the shooting angle of the matching feature from the position of the matching feature in the preset space inside the vehicle, and thus use the shooting angle of the matching feature as the target angle of view that matches the image frame in the preset space inside the vehicle. The preset device within the target angle of view is the device to be found that the electronic device is looking for. Therefore, by obtaining the preset device information within the target angle of view in the preset space inside the vehicle, and using the preset device information as the target device information of the device to be found, the position of the device to be found can be quickly and accurately located, and the information of the device to be found can be obtained.

[0070] In another embodiment, the electronic device determines a preset image where the matching feature is located, and uses the preset device information in the preset image as the target device information of the device to be found.

[0071] It can be understood that the target feature matches the matching feature, that is, the image frame where the target feature is located matches the preset image where the matching feature is located. The shooting angle of the preset image where the matching feature is located can be considered as the shooting angle of the image frame, so the preset device information in the preset image can be used as the target device information of the device to be found.

[0072] In one embodiment, before obtaining the preset device information within the target perspective in the preset space, it also includes: displaying the preset device information of each device in the preset space inside the vehicle; for the preset image of each perspective of the preset space inside the vehicle, if it is detected that the preset device information is blocked in the preset image, determining that the blocked preset device information is at the outermost position of the preset image, and displaying the blocked preset device information at the outermost position of the preset image.

[0073] The preset device information is information about the preset device contained in the preset space inside the vehicle. The preset device information includes at least one of the identification of the preset device and the distance between the electronic device and the preset device. The preset device information may also include at least one of the location information of the preset device and the state parameter of the preset device.

[0074] It can be understood that, for the preset images of each viewing angle of the preset space inside the vehicle, if it is detected that the preset device information is obscured in the preset image, the obscured preset device information is determined to be at the outermost position of the preset image, and the obscured preset device information is displayed at the outermost position of the preset image. This can avoid the electronic device being unable to display the complete target device information when displaying the augmented reality screen, thereby achieving a more accurate and comprehensive display of the information of the device to be found.

[0075] In one embodiment, the feature object is an image frame containing a device to be found; target device information of the device to be found is obtained from the feature object, including: sending the image frame to a server to instruct the server to obtain target features from the image frame, matching the target features with preset features of a preset space inside the vehicle, determining matching features that match the target features, and obtaining target device information of the device to be found based on the matching features; the preset space inside the vehicle is generated by fusing various preset images pre-taken in the actual space inside the vehicle; and obtaining the target device information of the device to be found sent by the server.

[0076] Alternatively, the server may be an onboard computer inside the vehicle, communicating with the electronic device via wireless LAN or Bluetooth, etc. The server may also be fixed at a certain location on the earth, communicating with the electronic device via the Internet or satellite link, etc.

[0077] The electronic device can obtain a video stream in real time through a camera and send the video stream to a server; wherein the video stream includes one or more image frames.

[0078] The server can use a feature extraction algorithm to obtain target features from the image frame, match the target features with preset features of the preset space inside the vehicle, determine matching features that match the target features, and obtain target device information of the device to be found based on the matching features; the preset space inside the vehicle is generated by fusing various preset images pre-taken in the actual space inside the vehicle; and obtain the target device information of the device to be found sent by the server. Among them, the feature extraction algorithm can be SIFT (Scale Invariant Feature Transform) or SURF (Speed ​​Up Robust Feature), etc., but is not limited to this.

[0079] Optionally, the server determines a target viewing angle that matches the image frame in a preset space inside the vehicle based on the matching features; obtains preset device information within the target viewing angle in the preset space inside the vehicle, and uses the preset device information as target device information of the device to be found.

[0080] Optionally, the server displays the preset device information of each device in the preset space inside the vehicle; for the preset image of each viewing angle of the preset space inside the vehicle, if it is detected that the preset device information is blocked in the preset image, the blocked preset device information is determined to be at the outermost position of the preset image, and the blocked preset device information is displayed at the outermost position of the preset image.

[0081] The target feature includes at least one of an image feature of the image frame and a posture feature when the image frame is taken. The image feature may include, but is not limited to, the color, texture information, and brightness of the image frame. The posture feature may include, but is not limited to, the angular velocity, acceleration, and angle when the image frame is taken.

[0082] Optionally, the target feature may also include, but is not limited to, features such as shooting parameters of the image frame, such as aperture, exposure time, etc. The shooting parameters may include, but are not limited to, aperture, exposure time, etc.

[0083] In this embodiment, the electronic device sends the image frame to the server, and the server can process the image frame to quickly obtain the target device information of the device to be found and return it to the electronic device, so that the electronic device can obtain the target device information of the device to be found more quickly and accurately.

[0084] In one embodiment, Figure 6 As shown, the electronic device obtains a video stream and sends the video stream to the server; the video stream represents the real-time viewing angle of the electronic device, and the video stream includes one or more image frames, and the image frames include the device to be found. The server extracts the target features from the image frames of the video stream, matches the target features with the preset features of the preset space inside the vehicle, and determines the matching features that best match the target features. That is, the server finds the pre-stored viewing angle with the real-time viewing angle compared with each preset feature, and finds the pre-stored viewing angle with the highest matching degree. The pre-stored viewing angle is the viewing angle of the matching feature that best matches the target feature. The server obtains the device information corresponding to the preset feature as the target device information of the device to be found, and sends the target device information to the electronic device. The electronic device receives the target device information, determines the target position of the device to be found in the augmented reality screen based on the target device information, and displays the target device information at the target position. Figure 6 If the device to be found is a USB interface, the target device information of the USB interface obtained by the electronic device is the location information of the USB interface, the identification of the USB interface and the distance between the USB interface and the electronic device. The electronic device can determine the target position of the USB interface in the augmented reality screen from the location information of the target device information, and display the identification of the USB interface and the distance between the USB interface and the electronic device "USB interface 0.75 meters" at the target position.

[0085] In one embodiment, the method further includes: obtaining a search request for a specified device; displaying device information of the specified device at the location of the specified device in the augmented reality screen, and removing device information of other devices except the specified device in the augmented display screen.

[0086] The designated device can be set as needed. For example, the designated device can be an air conditioner, a charging port, a USB port, or a storage box.

[0087] It can be understood that by displaying the device information of the specified device at the position of the specified device in the augmented reality screen and removing the device information of other devices except the specified device in the augmented display screen, the display interference of other devices can be eliminated and the required device information of the specified device can be displayed more accurately.

[0088] Optionally, the electronic device also supports obtaining a search request for a specified device by inputting voice, thereby accurately finding the location of the specified device in the voice, and displaying the device information of the specified device at the location. The operator of the electronic device can then quickly obtain the location and information of the specified device from the displayed device information.

[0089] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0090] Based on the same inventive concept, the embodiment of the present application also provides a display device for implementing the above-mentioned display method. The implementation solution provided by the device to solve the problem is similar to the implementation solution recorded in the above-mentioned method, so the specific limitations in one or more display device embodiments provided below can refer to the limitations on the display method above, and will not be repeated here.

[0091] In one embodiment, Figure 7 As shown, a display device is provided, which is applied to an electronic device with an augmented reality function; the device includes: a display module 702 and an acquisition module 704, wherein:

[0092] The display module 702 is used to display an augmented reality image of the actual space inside the vehicle on the electronic device.

[0093] The acquisition module 704 is used to acquire the feature object corresponding to the device to be found in the actual space inside the vehicle from the augmented reality picture.

[0094] The acquisition module 704 is further used to acquire target device information of the device to be found from the feature object.

[0095] The display module 702 is further configured to determine a target position of the device to be found in the augmented reality screen based on the target device information, and display the target device information at the target position.

[0096] The above-mentioned display device is applied to an electronic device with an augmented reality function, which can display an augmented reality picture of the actual space inside the vehicle, obtain the feature object corresponding to the device to be found in the actual space inside the vehicle from the augmented reality picture, and obtain the target device information of the device to be found from the feature object. Then, based on the target device information, the target position of the device to be found in the augmented reality picture can be quickly and accurately determined, and the target device information can be displayed at the target position, so that the position and information of the device to be found can be quickly found, avoiding the problem of slow search speed or even inability to find the device to be found due to manual search for the device to be found.

[0097] In one embodiment, the feature object is an image frame containing a device to be found; the acquisition module 704 is also used to obtain target features of the image frame; match the target features with preset features of a preset space inside the vehicle to determine matching features that match the target features; the preset space inside the vehicle is generated by fusion of various preset images pre-taken in the actual space inside the vehicle; and obtain target device information of the device to be found based on the matching features.

[0098] In one embodiment, the acquisition module 704 is also used to determine the target viewing angle that matches the image frame in the preset space inside the vehicle based on the matching features; obtain the preset device information within the target viewing angle in the preset space inside the vehicle, and use the preset device information as the target device information of the device to be found.

[0099] In one embodiment, the display module 702 is also used to display the preset device information of each device in the preset space inside the vehicle; for the preset image of each viewing angle of the preset space inside the vehicle, if it is detected that the preset device information is blocked in the preset image, the blocked preset device information is determined to be at the outermost position of the preset image, and the blocked preset device information is displayed at the outermost position of the preset image.

[0100] In one embodiment, the target feature includes at least one of an image feature of the image frame and a posture feature when the image frame is captured.

[0101] In one embodiment, the feature object is an image frame containing the device to be found; the above-mentioned acquisition module 704 is also used to send the image frame to the server to instruct the server to obtain the target feature from the image frame, match the target feature with the preset feature of the preset space inside the vehicle, determine the matching feature that matches the target feature, and obtain the target device information of the device to be found based on the matching feature; the preset space inside the vehicle is generated by the fusion of various preset images pre-taken in the actual space inside the vehicle; the target device information of the device to be found sent by the server is obtained.

[0102] In one embodiment, the feature object is an augmented reality tag corresponding to the device to be found, or an image frame containing the device to be found; the target device information includes at least one of an identifier of the device to be found and a distance between the electronic device and the device to be found.

[0103] In one embodiment, the acquisition module 704 is also used to obtain a search request for a specified device; the display module 702 is also used to display device information of the specified device at the location of the specified device in the augmented reality screen, and remove device information of other devices except the specified device in the augmented display screen.

[0104] Each module in the above display device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0105] In one embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as follows: Figure 8 As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, a display method is implemented. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device shell, or an external keyboard, touchpad or mouse.

[0106] Those skilled in the art will understand that Figure 8The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0107] The embodiment of the present application also provides a computer-readable storage medium, one or more non-volatile computer-readable storage media containing computer-executable instructions, when the computer-executable instructions are executed by one or more processors, the processors execute the steps of the display method.

[0108] The embodiment of the present application also provides a computer program product including instructions, which, when executed on a computer, enables the computer to execute the display method.

[0109] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0110] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0111] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0112] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A display method, characterized in that: Applied to an electronic device with an augmented reality function; the method comprises: Displaying an augmented reality picture of the actual space inside the vehicle on the electronic device, and acquiring a feature object corresponding to the device to be found in the actual space inside the vehicle from the augmented reality picture; the feature object is an image frame containing the device to be found; Acquire target features of the image frame; Matching the target feature with a preset feature of a preset space inside the vehicle to determine a matching feature that matches the target feature; the preset space inside the vehicle is generated by fusing various preset images pre-taken in the actual space inside the vehicle; Acquire target device information of the device to be found based on the matching feature; The target position of the to-be-searched device in the augmented reality picture is determined based on the target device information, and the target device information is displayed at the target position.

2. The method according to claim 1, characterized in that The step of acquiring target device information of the device to be found based on the matching feature includes: Based on the matching feature, determining a target viewing angle that matches the image frame in a preset space inside the vehicle; Preset device information within a target viewing angle in a preset space inside the vehicle is obtained, and the preset device information is used as target device information of the device to be found.

3. The method according to claim 2, characterized in that Before obtaining the preset device information within the target viewing angle in the preset space, the method further includes: Displaying preset device information of each device in a preset space inside the vehicle; For the preset image of each viewing angle of the preset space inside the vehicle, if it is detected that the preset device information is blocked in the preset image, the blocked preset device information is determined to be at the outermost position of the preset image, and the blocked preset device information is displayed at the outermost position of the preset image.

4. The method according to any one of claims 1 to 3, characterized in that The target feature includes at least one of an image feature of the image frame and a posture feature when the image frame is photographed.

5. The method according to claim 1, characterized in that The feature object is an image frame containing the device to be found; The step of acquiring target device information of the device to be found from the feature object includes: The image frame is sent to a server to instruct the server to obtain a target feature from the image frame, match the target feature with a preset feature of a preset space inside the vehicle, determine a matching feature that matches the target feature, and obtain target device information of the device to be found based on the matching feature; the preset space inside the vehicle is generated by fusing various preset images pre-taken in the actual space inside the vehicle; The target device information of the device to be found sent by the server is obtained.

6. The method according to claim 1, characterized in that The feature object is an augmented reality tag corresponding to the device to be found, or an image frame containing the device to be found; the target device information includes at least one of an identifier of the device to be found and a distance between the electronic device and the device to be found.

7. The method according to claim 1, characterized in that The method further comprises: Get the search request for the specified device; At the position of the designated device in the augmented reality screen, device information of the designated device is displayed, and device information of other devices except the designated device in the augmented reality screen is removed.

8. A display device, characterized in that: Applicable to electronic equipment with augmented reality function; the device comprises: A display module is used to display an augmented reality picture of the actual space inside the vehicle on the electronic device, An acquisition module, used to acquire a feature object corresponding to the device to be found in the actual space inside the vehicle from the augmented reality picture, wherein the feature object is an image frame containing the device to be found; The acquisition module is also used to acquire the target feature of the image frame; match the target feature with the preset feature of the preset space inside the vehicle to determine the matching feature that matches the target feature; the preset space inside the vehicle is generated by fusing various preset images pre-taken in the actual space inside the vehicle; and acquire the target device information of the device to be found based on the matching feature; The display module is further configured to determine a target position of the to-be-searched device in the augmented reality image based on the target device information, and display the target device information at the target position.

9. An electronic device comprising a memory and a processor, wherein a computer program is stored in the memory, wherein: When the computer program is executed by the processor, the processor is caused to perform the steps of the display method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

11. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images