Display method, electronic device and medium

Abstract

The present application discloses a display method, an electronic device and a medium, wherein the method comprises: obtaining at least a first projection of a first object and a second projection of a second object in at least a first direction; wherein the first direction comprises a direction from a display device to the first object and / or the second object; the first object comprises an object between the display device and the second object; based on the first projection and the second projection, determining a target display mode; and based on the target display mode, displaying the first object and the second object.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a display method, electronic device and medium. Background Art

[0002] When there are multiple objects in a space, some objects may be obscured. Summary of the invention

[0003] Embodiments of the present application provide a display method, an electronic device, and a medium.

[0004] The technical solution provided by the embodiment of the present application is as follows:

[0005] The present application embodiment first provides a display method, the method comprising:

[0006] Acquire at least a first projection of a first object and a second projection of a second object in at least a first direction; wherein the first direction includes a direction from a display device to the first object and / or the second object; and the first object includes an object between the display device and the second object;

[0007] Determining a target display mode based on the first projection and the second projection;

[0008] Based on the target display mode, the first object and the second object are displayed.

[0009] In one implementation, determining the target display mode based on the first projection and the second projection includes:

[0010] If a first condition is met, acquiring feature information of the second object; wherein the first condition includes that the second projection is a subset of the first projection;

[0011] The target display mode is determined as: displaying the first object in the first direction, and displaying characteristic information of the second object in the second direction; wherein the angle between the second direction and the first direction is greater than an angle threshold; and the angle threshold is the angle between the tangent from the display device to the first projection and the first direction.

[0012] In one implementation, the acquiring the characteristic information of the second object includes:

[0013] Acquire location information of the second object;

[0014] Based on the position information of the second object, characteristic information of the second object is acquired.

[0015] In one embodiment, the first object and the second object include virtual objects, and the display device includes a virtual reality (VR) / augmented reality (AR) device; and acquiring feature information of the second object based on the position information of the second object includes:

[0016] Determining target position information of the virtual acquisition device based on the position information of the second object;

[0017] Acquire feature information of the second object collected by the virtual collection device set based on the target position information.

[0018] In one embodiment, the feature information of the second object includes perspective projection information of the second object, and determining the target position information of the virtual acquisition device based on the position information of the second object includes:

[0019] Based on the position information of the second object, adjusting the relative position relationship between the virtual acquisition device and each of the at least one second object in a third direction; wherein the angle between the third direction and the first direction is less than 90 degrees;

[0020] The target position information is determined based on the relative position relationship and the position information of the second object.

[0021] In one embodiment, the feature information of the second object includes orthogonal projection information of the second object; and determining the target position information of the virtual acquisition device based on the position information of the second object includes:

[0022] Acquiring the field of view angle information of the virtual acquisition device;

[0023] The target position information is determined based on the position information of the second object and the field of view angle information.

[0024] In one implementation, determining the target display mode based on the first projection and the second projection includes:

[0025] If the second condition is met, the target display mode is determined to be: displaying the first object, displaying the edge of the first object in a first color, and displaying the part of the second object that is not blocked by the first object; wherein the second condition includes that the first projection is a proper subset of the second projection.

[0026] In one implementation, determining the target display mode based on the first projection and the second projection includes:

[0027] If the third condition is met, the target display mode is determined to be: displaying the first object, displaying the edge of the first object in a second color, and displaying the part of the second object that is not blocked by the first object; wherein the third condition includes that the first projection intersects the second projection, and the first projection is not a subset of the second projection, and the second projection is not a subset of the first projection.

[0028] An embodiment of the present application also provides an electronic device, which can implement any of the display methods described above.

[0029] An embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor of an electronic device, it can implement any of the display methods described above.

[0030] From the above, it can be seen that in the display method provided in the embodiment of the present application, after obtaining the first projection of the first object and the second projection of the second object, the target display mode can be determined based on the first projection and the second projection, and the first object and the second object can be displayed based on the target display mode. In this way, the display method provided in the embodiment of the present application can not only clearly display the first object and the second object, but also, due to the consistency of the first projection and the second projection with the actual object features of the first object and the second object, the target display mode determined based on the first projection and the second projection can more accurately reflect the actual characteristics of the first object and the second object, thereby solving the technical problem in the related art that multiple objects that occlude each other cannot be objectively displayed. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 A schematic diagram of a flow chart of a display method provided in an embodiment of the present application;

[0032] Figure 2 A structural schematic diagram of the relative positional relationship between a display device and a first object and a second object provided in an embodiment of the present application;

[0033] Figure 3 A structural schematic diagram of the relative positions of a first object and a second object provided in an embodiment of the present application;

[0034] Figure 4A A first principle schematic diagram of selecting a virtual object in the related art;

[0035] Figure 4B A second principle schematic diagram of selecting a virtual object in the related art;

[0036] Figure 5AA schematic diagram of a structure in the related art in which a virtual object cannot be selected due to being blocked;

[0037] Figure 5B For Figure 5A A first structural schematic diagram of a projection of a corresponding virtual object;

[0038] Figure 5C For Figure 5A A second structural schematic diagram of a projection of a corresponding virtual object;

[0039] Figure 5D A schematic diagram of the operation principle of a user selecting a completely occluded virtual object in the related art;

[0040] Figure 6 A schematic diagram of the structure of the virtual data collection device provided in the embodiment of the present application;

[0041] Fig. 7A It is a schematic diagram of the principle of perspective projection in the related art;

[0042] Figure 7B A first structural diagram of target location information provided in an embodiment of the present application;

[0043] Fig. 8A It is a schematic diagram of the principle of orthogonal projection in the related art;

[0044] Figure 8B A second structural diagram of target location information provided in an embodiment of the present application;

[0045] Figure 8C A schematic diagram of the principle of determining target location information provided in an embodiment of the present application;

[0046] Figure 8D-1 A first structural diagram of a DF provided in an embodiment of the present application;

[0047] Figure 8D-2 A second structural diagram of a DF provided in an embodiment of the present application;

[0048] Fig. 9 A schematic diagram of the structure of the display method provided in the embodiment of the present application;

[0049] Fig.10 A schematic diagram of a structure for displaying multiple virtual objects around a cursor point provided by an embodiment of the present application;

[0050] Fig.11A A first structural schematic diagram of a first projection, a second projection, and a third projection that meet the third condition provided in an embodiment of the present application;

[0051] Fig. 11BA second structural schematic diagram of the first projection, the second projection and the third projection that meet the third condition provided in an embodiment of the present application. DETAILED DESCRIPTION

[0052] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0053] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0054] In actual applications, in scenarios such as traveling, shopping, medical treatment, and dining, the user's environment may contain multiple objects that may block the user's line of sight. Due to the line of sight blocking by these objects, the user cannot understand or cannot accurately understand the status or situation of other objects.

[0055] In the related art, the status or situation of other objects usually requires the user to change his position, such as standing on a higher place, to obtain it. However, this method sometimes cannot solve the problem. For example, during traffic congestion, the vehicle driven by the user cannot switch from the current lane to other lanes, and the vehicle driven by the user cannot move from the road to a higher position. Therefore, the related art lacks a technical solution for users to obtain the status or situation of obscured objects.

[0056] Based on the above problems, embodiments of the present application provide a display method, an electronic device, and a medium.

[0057] The display method provided in the embodiment of the present application can not only display the first object and the second object, but also determine how to display the first object and the second object based on the first projection of the first object and the second projection of the second object, so that the target display method can be more in line with the actual line of sight projection characteristics for the first object and the second object, thereby solving the technical problem in the related art that multiple objects that occlude each other cannot be displayed.

[0058] It should be noted that the display method provided in the embodiment of the present application can be implemented by a processor of a display device, and the above-mentioned processor can be at least one of an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), a field programmable gate array (FPGA), a central processing unit (CPU), a controller, a microcontroller, and a microprocessor.

[0059] Figure 1 A flow chart of a display method provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, the process may include steps 101 to 103:

[0060] Step 101: Acquire at least a first projection of a first object and a second projection of a second object in at least a first direction.

[0061] The first direction includes the direction from the display device to the first object and / or the second object; the first object includes an object between the display device and the second object.

[0062] Figure 2 A structural schematic diagram of the relative position relationship between a display device and a first object and a second object provided in an embodiment of the present application.

[0063] like Figure 2 As shown, the object adjacent to the display device 201 is a first object 202, and the first object 202 is between the display device 201 and the second object 203. In addition, in the direction where the second object 203 is away from the display device 201, a third object 204 may also be included; illustratively, the third object 204 may be one of the multiple second objects 203.

[0064] from Figure 2 It can be seen that the geometric centers of the first object 202, the second object 203 and the third object 204 can be located in the same straight line. At this time, a user at the same position as the display device 201 may not be able to clearly see the second object 203 and the third object 204 blocked by the first object 202.

[0065] In one embodiment, the display device may be a device with a projection function, so that the display device can obtain a first projection and a second projection in at least a first direction; at this time, the first direction may be the direction from the display device to the first object and / or the second object.

[0066] In one embodiment, the display device itself may not have a projection function, and the first projection and the second projection may be obtained by the display device through a first device with which a communication connection is established. Exemplarily, the above-mentioned communication connection may be a wired connection or a wireless connection; Exemplarily, the above-mentioned first device may be a portable device or a device set at at least one position in the occasion where the display device is currently located; for example, when a user queues for registration, the first device may be set at a position parallel to the registration queue and higher than the height of the people in the registration queue, and the first device may have a projection function at this time; Exemplarily, the first device may also be a second device used to provide public services in public places, and the second device may be, for example, a base station device, a Bluetooth ranging device, a wireless routing device, and any one of Near Field Communication (NFC) devices.

[0067] In one implementation, the first projection and the second projection may also be acquired from other directions, and the other directions may include the direction from the first device to the first object and / or the second object, and may also include the direction from the second object to the first object and / or the second object.

[0068] In one implementation, there may be multiple second objects.

[0069] In one embodiment, the first direction may be determined based on the relative position relationship between the first object and the second object; illustratively, when the first object and multiple objects in the second object are in the same straight line, the first direction may be the direction from the display device to the first object, or the direction from the display device to the first object and the second object; when the position of the first object and the positions of multiple objects in the second object are not in a straight line, the first direction may be the direction from the display device to the second object; illustratively, at this time, the second object may be a target object.

[0070] In one embodiment, the first object and the second object may be objects of the same type, for example, the first object and the second object may both be pedestrians, or the first object and the second object may both be buildings or vehicles; illustratively, the types of the first object and the second object may be different, for example, the first object may be a vehicle and the second object may be a pedestrian.

[0071] In one embodiment, the shapes of the first projection and the second projection may be different, for example, the first projection is a triangle and the second projection is an irregular circle; exemplarily, the first projection and the second projection may be binary segmented images obtained by performing object detection and object recognition on the first image and the second image, wherein the first image may be image data including the first object, and the second image may be image data including the second object; exemplarily, the first projection and the second projection may also be shadows obtained by projecting sunlight or light onto the first object and the second object.

[0072] Step 102: Determine a target display mode based on the first projection and the second projection.

[0073] In one embodiment, the target display method may include virtually adjusting the relative position relationship between the first object and the second object in a digital manner, so that the first object and the second object are clearly visible;

[0074] Exemplarily, the target display mode may also be determined based on a user trigger. For example, the display device may load a list of information on objects to be displayed, and based on the user's selection result of at least one object to be displayed in the list of information on objects to be displayed, such as the second object, display an object in the selection result, such as the second object. Exemplarily, the user may also select or set the display mode for at least one object to be displayed selected by him.

[0075] Exemplarily, the target display mode may also include immediate display or delayed display; exemplary, the target display mode may also include whether to display through a display device or through other devices; if the target display mode is to display through other devices, the display device may send the first projection and the second projection to the other devices; exemplary, the other devices may be smart wearable devices or computer devices.

[0076] Exemplarily, the target display mode may also include a display mode of changing the relative brightness or contrast between the first object and the second object.

[0077] Exemplarily, the target display manner may further include changing the area size of the first projection and / or the second projection to highlight the object features of the first object and / or the second object.

[0078] In one implementation, the target display mode is determined based on the first projection and the second projection, which can be achieved by any of the following methods:

[0079] The target display mode is determined based on the shape fitting degree between the first projection and the second projection; illustratively, the shape fitting degree may include the similarity between the first projection and the second projection.

[0080] The target display mode is determined based on the display parameters selected or set by the user for any one of the first projection and the second projection; illustratively, the display parameters may include at least one of shape change, scaling, highlighting, and color labeling.

[0081] Step 103: Display the first object and the second object based on the target display mode.

[0082] From the above, it can be seen that in the display method provided in the embodiment of the present application, after obtaining the first projection of the first object and the second projection of the second object, the target display mode can be determined based on the first projection and the second projection, and the first object and the second object can be displayed based on the target display mode. In this way, the display method provided in the embodiment of the present application can not only clearly display the first object and the second object, but also, due to the consistency of the first projection and the second projection with the actual object features of the first object and the second object, the target display mode determined based on the first projection and the second projection can more accurately reflect the actual characteristics of the first object and the second object, thereby solving the technical problem in the related art that multiple objects that occlude each other cannot be objectively displayed.

[0083] Based on the above embodiments, in the display method provided in the embodiments of the present application, determining the target display mode based on the first projection and the second projection can be achieved through steps A1 to A2:

[0084] Step A1: If the first condition is met, obtain feature information of the second object.

[0085] The first condition includes that the second projection is a subset of the first projection.

[0086] In one embodiment, the second projection is a subset of the first projection, which may include the second projection being a true subset of the first projection. In this case, the shape of the second projection may be the same as that of the first projection, or the shape of the second projection may be different from that of the first projection; illustratively, the second projection may be the same in shape and size as the first projection. It should be noted that if the first condition is met, it may mean that the second projection is completely covered by the first projection, and in this case, the user's line of sight from the display device cannot be projected to the second object.

[0087] Figure 3 A schematic structural diagram of the relative positions of the first object 202 and the second object 203 provided in an embodiment of the present application.

[0088] like Figure 3As shown, the geometric centers of the first object 202, the second object 203 and the third object 204 are on the same straight line, and in a direction perpendicular to the first direction, the cross section of the first object 202 can cover the cross sections of the second object 203 and the third object 204 in the direction, that is, the second projection is a subset of the first projection; Figure 3 The direction indicated by the arrow in the middle is a first direction from the display device 201 to the first object 202, and the direction from Figure 3 It can be seen that in the first direction, the first object 202 completely blocks the second object 203 and the third object 204, so that the second object 203 and the third object 204 cannot be seen from the position of the display device 201.

[0089] In one implementation, the feature information of the second object may include features such as the shape, outline, whether it is three-dimensional, and whether it moves of the second object.

[0090] In one implementation, the feature information of the second object may be obtained by continuously tracking and analyzing the second projection; illustratively, based on the second projection and the method for acquiring the second projection, information such as the position and shape of the second object may be determined.

[0091] In one implementation, the feature information of the second object may be embodied in any form such as text, picture, audio, and video.

[0092] Exemplarily, the characteristic information of the second object may be acquired by the display device itself, or may be acquired by other devices such as the first device or the second device and sent to the display device; exemplary, the characteristic information of the second object may include the same or similar method of acquiring the second projection as described in the aforementioned embodiment, which will not be repeated here.

[0093] Step A2: Determine the target display mode as: displaying the first object in the first direction, and displaying feature information of the second object in the second direction.

[0094] The angle between the second direction and the first direction is greater than an angle threshold; the angle threshold is an angle between a tangent line from the display device to the first projection and the first direction.

[0095] In one implementation, the tangent line from the display device to the first projection may include a tangent line from the geometric center of the display device to the edge of the first projection.

[0096] In one embodiment, when the first projection is an irregular geometric shape, the angle threshold may be the maximum angle among all angles between a tangent line from the geometric center of the display device to the edge of the first projection and the first direction.

[0097] In one implementation, displaying the first object in the first direction and displaying the characteristic information of the second object in the second direction may be implemented in the following manner:

[0098] A first object is displayed in a first direction, and characteristic information of a second object is displayed on a plane displaying the first object and at a position adjacent to the first object. The characteristic information of the second object may include distance information between the second object and the first object and / or the display device; wherein a line connecting the characteristic information of the second object to the geometric center point of the display device may be a second direction relative to the plane displaying the first object.

[0099] As can be seen from the above, in the display method provided in the embodiment of the present application, if the second projection of the second object is a subset of the first projection of the first object, the feature information of the second object is obtained, and the first object is displayed in the first direction, and the feature information of the second object is displayed in the second direction. Since the angle between the second direction and the first direction is greater than the angle threshold, the feature information of the second object cannot be at least partially blocked or covered by the first object, thereby enabling the user at the display device to clearly obtain the feature information of the first object and the second object.

[0100] Based on the above embodiment, in the display method provided in the embodiment of the present application, obtaining the characteristic information of the second object can be achieved through steps B1 to B2:

[0101] Step B1: Obtain location information of the second object.

[0102] In one embodiment, the position information of the second object may include the position information of the second object relative to the first object; exemplarily, the position information of the second object may also include the position information of the second object relative to the display device; exemplarily, the position information of the second object may also include the position information of the second object relative to a first reference object, wherein the first reference object may include the first device and / or the second device in the aforementioned embodiments.

[0103] In one implementation, the location information of the second object may be obtained by any of the following methods:

[0104] The position information of the second object is acquired through a ranging signal of a specified frequency transmitted by the display device and an echo signal corresponding to the ranging signal received by the display device.

[0105] The location information of the second object is obtained by transmitting ranging signals from at least three ranging devices to at least one object, and echo signals corresponding to these ranging signals. Exemplarily, the at least three ranging devices may include wireless signal processing devices, such as base stations, wireless routers, and Bluetooth ranging devices. In this case, the location information of the second object obtained may include precise longitude and latitude information.

[0106] Step B2: Based on the position information of the second object, obtain feature information of the second object.

[0107] In one implementation, the feature information of the second object may be obtained by any of the following methods:

[0108] Based on the position information of the second object, the distance information of the second object relative to the display device is determined, and then based on the distance information, the influence degree information of the second object relative to the display device is determined, and then the characteristic information of the second object is obtained based on the influence degree information. For example, in a traffic congestion environment, the vehicle on which the display device is set can be a first vehicle, the first object can be a second vehicle adjacent to the first vehicle, and the second object can be a third vehicle, wherein the second vehicle is located between the first vehicle and the third vehicle; at this time, if the influence degree information of the third vehicle on the first vehicle is determined to be a first degree based on the position information of the third vehicle, image data containing the second object and more detailed information such as the volume size of the second object can be obtained at this time, and this information is determined as the characteristic information of the second object; if the influence degree information of the third vehicle on the first vehicle is determined to be a second degree based on the position information of the third vehicle, image data containing the second object can be obtained at this time, and the image data containing the second object can be determined as the characteristic information of the second object; illustratively, the first degree can be greater than the second degree, that is, the higher the influence degree information is, the more types of characteristic information of the second object can be obtained, and the fineness of the characteristic information of the second object can also be higher.

[0109] Based on the position information of the second object and the user input obtained by the display device for the user's display requirements for the second object, characteristic information of the second object is obtained; for example, based on the position information of the second object, it is determined that the distance of the second object from the display device is greater than a distance threshold, but the display requirements for the second object obtained by the display device from the user input are for a refined display. At this time, the characteristic information of the second object can be collected from multiple dimensions through the first device, the second device, and the wireless signal processing device described in the multiple aforementioned embodiments.

[0110] From the above, it can be seen that in the display method provided in the embodiment of the present application, the characteristic information of the second object can be obtained based on the position information of the second object. In this way, the characteristic information of the second object is directly associated with the position information of the second object, so that the characteristic information of the second object displayed in the target display mode can be more in line with the relative position relationship between the second object and the display device.

[0111] In an embodiment of the present application, the first object and the second object include virtual objects; and the display device includes a VR / AR device.

[0112] In one embodiment, the AR device may include AR smart glasses and AR smartphones, etc.; illustratively, the AR smart glasses may include head-mounted AR glasses.

[0113] In one embodiment, a VR device may include a device that requires the cooperation of other electronic devices to realize VR functions; exemplarily, the other electronic devices may include computer devices or portable smart terminal devices; exemplarily, the device that requires the cooperation of other electronic devices to realize VR functions may also include a controller.

[0114] In one embodiment, a VR device may include an all-in-one device provided with a VR processor and a display device; for example, a head-mounted VR display device with an independent processor, which has its own storage space and has the functions of independent calculation, data input and output, and can independently realize VR functions.

[0115] In virtual reality space, people's demands for operating virtual objects are increasing, and these operational demands often start from the virtual objects that people select. In related technologies, virtual objects are usually selected through ray or gaze interaction methods.

[0116] In actual applications, when the AR / VR device is an AR / VR glasses, if the user wears the AR / VR glasses, the AR / VR glasses can select virtual objects through the gaze point. The gaze point is located at a fixed position directly in front of the AR / VR glasses, and the gaze point moves when the user moves his head. Usually, the AR / VR glasses can process the gaze point accordingly according to the length of the user's gaze time. For example, when the user shakes his head, the gaze point can move accordingly. When the user gazes at a virtual object, if the gaze time exceeds the time threshold, the AR / VR device will trigger the selection or hit operation of the virtual object.

[0117] Figure 4A FIG. 1 is a first principle schematic diagram of selecting a virtual object in the related art. Figure 4AAs shown, the virtual object 401 is in the virtual space 402, and the first ray 403 starts from the AR / VR glasses to the virtual object 401. Figure 4A In the example, if the user wearing the AR / VR glasses stares at the virtual object 401 for a time period exceeding the time threshold, the AR / VR glasses trigger the gaze vector from the AR / VR glasses to the virtual object 401, and determine whether the virtual object 401 is selected through collision detection of the gaze vector in the virtual space 402. Figure 4A In FIG. 4 , the first ray 403 may also be a gaze vector.

[0118] Figure 4B FIG. 1 is a schematic diagram of the second principle of selecting a virtual object in the related art. Figure 4B As shown, in the AR / VR device, a controller 404 may also be provided. The controller 404 may be a handle, which is used to select and / or control the virtual object 401 through control logic. By default, when the controller 404 turns on the ray function, the second ray 405 will be emitted with the controller 404 as the origin and the direction of the controller 404 toward the virtual object 401 as the target direction. The second ray 405 can realize collision detection for the virtual object 401 in the virtual space. If a collision is detected, it can indicate that the controller 404 hits or selects the virtual object 401. Figure 4B In FIG. 4 , the second ray 405 may also be a gaze vector.

[0119] From the above, it can be seen that in the related art, whether it is the ray or gaze virtual object selection method, it is necessary to implement collision detection of rays in the virtual space. For example, if the distribution of the first object and the second object in the virtual space is as follows Figure 2 As shown, theoretically, the ray can collide with three required objects at the same time, that is, the AR / VR device can detect that there are multiple virtual objects, but it cannot display each virtual object independently for the user to select.

[0120] Figure 5A It is a schematic diagram of a structure in the related art where a virtual object cannot be selected due to being blocked.

[0121] exist Figure 5A In the embodiment, user 501 may wear an AR / VR device, and a ray or gaze vector performs collision detection in a virtual space starting from gaze point 502, and detects that first object 202, second object 203, and third object 204 are densely distributed, and second object 203 and third object 204 are completely blocked by first object 202, and AR / VR device cannot fully display second object 203 and third object 204.

[0122] Figure 5B For Figure 5A A first structural diagram of the projection of the corresponding virtual object. Figure 5B As shown, the projection of the first object 202 is the first projection 503, the projection of the second object 203 is the second projection 504, and the projection of the third object 204 is the third projection 505. In FIG. 5B , the second projection 504 and the third projection 505 are both proper subsets of the first projection 503, that is, the second object 203 and the third object 204 are completely blocked by the first object 202.

[0123] Figure 5C For Figure 5A A second structural diagram of the projection of the corresponding virtual object. Figure 5C As shown, the projection of the first object 202 is the first projection 503, the projection of the second object 203 is the second projection 504, and the projection of the third object 204 is the third projection 505. In 5B, although the first projection 503 is a proper subset of the third projection 505, that is, the third object 205 is not blocked by the first object 202, the second projection 504 is a proper subset of the first projection 503, that is, the second object 203 is completely blocked by the first object 202, and therefore, the user cannot select and operate the second object 203 through the AR / VR device.

[0124] Figure 5D FIG. 1 is a schematic diagram of the operation principle of a user selecting a completely blocked virtual object in the related art. Figure 5D As shown, in the related art, in order to select the second object 203 and the third object 204 blocked by the first object 202, the user 501 needs to adjust the head posture or change the position by walking, so as to change the direction of the ray or the direction of the gaze vector. However, the way in which the user adjusts the head posture or changes the position brings inconvenience to the user's AR / VR experience.

[0125] Therefore, although the virtual object selection method in the related art provides users with an intuitive and natural virtual object selection experience and can also reduce users' virtual object selection fatigue, the above-mentioned virtual object selection method is more effective when the distribution of virtual objects in the virtual space is sparse or uniform. When there are many virtual objects, the virtual object selection method in the related art still cannot meet the users' virtual object selection needs.

[0126] In order to solve the above problem, in the display method provided in the embodiment of the present application, based on the position information of the second object, the feature information of the second object is obtained, which can be achieved through steps C1 to C2:

[0127] Step C1: Determine target position information of the virtual data acquisition device based on the position information of the second object.

[0128] In one implementation, the position information of the second object may be determined by performing collision detection in the virtual space using rays or gaze vectors.

[0129] In one embodiment, the virtual acquisition device may be a virtual image acquisition device; illustratively, the number of virtual image acquisition devices may be multiple, for example, a virtual image acquisition device is set on the first side of the first object, the second object and the third object, and another virtual image acquisition device may be set on the second side opposite to the first side.

[0130] In one implementation, the virtual image acquisition device may acquire image data including the second object and the third object, and determine the image data as feature information of the second object and feature information of the third object.

[0131] In one embodiment, the virtual image acquisition device can perform image acquisition operations for the second object and / or the third object under the control of the AR / VR device, and send the acquired image data including the second object and / or the third object to the AR / VR device.

[0132] In one embodiment, the target position information may include the relative position information of the virtual acquisition device relative to any one of the first object to the second object; exemplarily, the target position information may include the relative position of the virtual acquisition device relative to the line connecting the geometric centers of the first object and the second object, such as the first side surface and the second side surface mentioned above; exemplarily, the target position information may also include the relative position information of the virtual acquisition device relative to the display device.

[0133] Step C2: Acquire feature information of the second object collected by the virtual collection device set based on the target position information.

[0134] In one implementation, the feature information of the second object may be obtained by analyzing image data collected by at least two virtual collection devices and extracting depth information of the second object from the image data, thereby obtaining three-dimensional structure and / or shape information of the second object.

[0135] Figure 6 This is a schematic diagram of the structure of the virtual collection device provided in the embodiment of the present application. Figure 6 As shown, the first virtual acquisition device 601 and the second virtual acquisition device 602 can both be virtual image acquisition devices; exemplarily, the virtual image acquisition device can be a virtual camera; exemplarily, the first virtual acquisition device 601 can be set on the first side of the first object 202 to the third object 204; the second virtual acquisition device 602 can be set on the second side opposite to the first side.

[0136] Exemplarily, the three-dimensional structure and / or shape information of the second object may be Figure 6 The first feature information 603 in the third object, the three-dimensional structure and / or shape information, can be Figure 6 The second characteristic information 604 in.

[0137] Exemplarily, the target display method may be to display the first object 202 and to display the first characteristic information 603 and the second characteristic information 604 at a position adjacent to the first object.

[0138] From the above, it can be seen that the display method provided in the embodiment of the present application, under the conditions that the first object and the second object are virtual objects and the display device is an AR / VR device, can still determine the target position information of the virtual acquisition device based on the position information of the second object, and then realize the display of the first object and the second object through the feature information of the second image acquired by the image acquisition device set based on the target position information.

[0139] Based on the foregoing embodiment, in the recognition method provided by the embodiment of the present application, the feature information of the second object includes perspective projection information of the second object.

[0140] Exemplarily, the perspective projection information of the second object may include a perspective projection image of the second object acquired by a virtual acquisition device.

[0141] Fig. 7A FIG. 1 is a schematic diagram of the principle of perspective projection in the related art. Fig. 7A As shown, the first image acquisition device 701 may be a perspective image acquisition device. Exemplarily, the first image acquisition device 701 may be a virtual perspective image acquisition device.

[0142] exist Fig. 7A In the embodiment, the first image acquisition device 701 acquires images of the first sphere 702 and the second sphere 703 in a perspective projection manner, and the obtained first image 704 includes a first circle 705 corresponding to the first sphere 702 and a second circle 706 corresponding to the second sphere 703. Moreover, since the distance between the first sphere 702 and the first image acquisition device 701 is greater than the distance between the second sphere 703 and the first image acquisition device 701, although the first sphere 702 and the second sphere 703 are the same size, with the help of the perspective projection operation of the first image acquisition device 701, the sizes of the first circle 705 and the second circle 706 are different, and the area of ​​the second circle 706 is greater than the area of ​​the first circle 705. That is to say, in the first image 704 obtained by the perspective projection, the area of ​​the circle decreases as the distance between the sphere and the first image acquisition device 701 increases, that is, a visual perspective effect of near large and far small is presented.

[0143] Accordingly, in the identification method provided in the embodiment of the present application, the target position information of the virtual acquisition device is determined based on the position information of the second object, which can be achieved through steps D1 to D2:

[0144] Step D1: Based on the position information of the second object, adjust the relative position relationship between the virtual acquisition device and each object in at least one second object in a third direction.

[0145] Wherein, the angle between the third direction and the first direction is less than 90 degrees.

[0146] In one embodiment, the above-mentioned relative position relationship may include whether the virtual acquisition device is located on the first side or the second side of the at least one second object, and the distance between the virtual acquisition device and each object in the at least one second object; when the number of virtual acquisition devices is at least two, it may also include whether each virtual acquisition device is symmetrically arranged relative to the at least one second object.

[0147] Exemplarily, the relative position relationship may be determined based on the position information of the second object and the field of view angle of the virtual acquisition device. In this case, the relative position relationship may enable the virtual acquisition device to obtain perspective images of all objects in at least one second object. Exemplarily, the relative position relationship may include a single position of the virtual acquisition device relative to the overall distribution of at least one second object, for example, the virtual acquisition device is fixedly set at a first position relative to at least one second object.

[0148] Exemplarily, the position of the virtual acquisition device can be flexibly adjusted according to the position of each object in the at least one second object, so that in the image data acquired by the virtual acquisition device, each object in the at least one second object will not obstruct each other. At this time, the relative position relationship can include a group of positions. For example, relative to the first object in the at least one second object, the virtual acquisition device can be set at the second position, and relative to the second object in the at least one second object, the virtual acquisition device can be set at the third position, and the second position and the third position can be different.

[0149] Exemplarily, the position of the virtual acquisition device can be adjusted so that the image data obtained by the virtual acquisition device each time the image is acquired only contains the image of one virtual object. After the image data acquisition of the first object in at least one second object is completed, the virtual acquisition device can be moved to the next position so that the virtual acquisition device can acquire image data containing the second object in at least one second object.

[0150] Exemplarily, the position of each image data collection by the virtual acquisition device can be set according to the position information of the second object. For example, the first distance information of the second object relative to the AR / VR device can be determined according to the position information of the second object, and the position of the virtual acquisition device relative to the second object can be adjusted according to the first distance information. Exemplarily, the distance between the virtual acquisition device and the second object can be proportional to the first distance information, that is, the farther the distance of the second object relative to the AR / VR device is, the farther the distance between the virtual acquisition device set relative to the second object can be. Each second object in the image data collected by the virtual acquisition devices set at the above positions can present a visual perspective effect of being larger when near and smaller when far.

[0151] Step D2: Determine target position information based on the relative position relationship and the position information of the second object.

[0152] In one implementation, the target position information may include coordinate information of a position, and in this case the virtual acquisition device may be fixedly disposed at a position corresponding to the coordinate information relative to at least one second object.

[0153] In one implementation, the target position information may include a set of position coordinate information; in this case, the virtual acquisition device may be moved and image data may be acquired according to each coordinate information in the target position information.

[0154] Figure 7B This is a first structural diagram of target location information provided in an embodiment of the present application. Figure 7B As shown, the target location information may include a first target location and a second target location.

[0155] like Figure 7BAs shown, the first virtual acquisition device 707 may be a virtual perspective projection device; the first object 202, the second object 203, and the third object 204 are distributed on the gaze vector 709; the first virtual acquisition device 707 may move in the third direction 710; wherein the first target position information may include the position of the first virtual acquisition device 707 at a second distance relative to the second object 203 and a line connecting the first virtual acquisition device 707 and the geometric center of the second object 203 being perpendicular to the gaze vector 709; the first virtual acquisition device 707 acquires the first image data 711 by acquiring the image of the second object 203; After that, the first virtual acquisition device 707' can be moved to the second target position; illustratively, the second target position can be the position where the first virtual acquisition device 707' is at a third distance relative to the third object 204 and the line connecting the geometric center of the third object 204 is perpendicular to the gaze vector 709. The first virtual acquisition device 707' performs image acquisition on the third object 204 to obtain the second image data 712; illustratively, the first image data 711 and the second image data 712 can be subjected to depth feature extraction to obtain the first stereoscopic structure 713 and the second stereoscopic structure 714. illustratively, the first stereoscopic structure 713 and the second stereoscopic structure 714 can be consistent with the stereoscopic structural features of the second object 203 and the third object 204, respectively.

[0156] Illustratively, after obtaining the first three-dimensional structure 713 and the second three-dimensional structure 714 , the first three-dimensional structure 713 and the second three-dimensional structure 714 may be sequentially displayed at positions adjacent to the first object 202 , thereby achieving intuitive display of the first object 202 , the second object 203 , and the third object 204 .

[0157] For example, Figure 7B As shown, during the process of the first virtual acquisition device 707 ′ acquiring the second image data 712 , if there is a fourth object 715 between the first virtual acquisition device 707 ′ and the third object 204 , the fourth object 715 can be removed before the first virtual acquisition device 707 ′ acquires the second image data 712 .

[0158] From the above, it can be seen that in the display method provided in the embodiment of the present application, under the condition that the first object and the second object are virtual objects and the display device is an AR / VR device, the target position information of the virtual acquisition device can be determined based on the position information of the second object, so that the perspective projection information collected by the virtual acquisition device set at the target position information can more intuitively and vividly reflect the morphological characteristics of the second object, thereby being able to display the first object and the second object more comprehensively and objectively.

[0159] Based on the foregoing embodiment, in the display method provided by the embodiment of the present application, the feature information of the second object includes orthogonal projection information of the second object.

[0160] In one implementation, the orthogonal projection information of the second object may include a projection that is collected by a virtual collection device disposed in any direction facing the second object and has the same cross-sectional area and shape as the second object in a direction perpendicular to the direction.

[0161] Fig. 8A FIG. 1 is a schematic diagram of the principle of orthogonal projection in the related art. Fig. 8A As shown, the second image acquisition device 801 may be a perspective image acquisition device. Exemplarily, the second image acquisition device 801 may be a virtual perspective image acquisition device.

[0162] exist Fig. 8A In the embodiment, the second image acquisition device 801 acquires images of the third sphere 802 and the fourth sphere 803 in a perspective projection manner, and the obtained third image 804 includes a third circle 805 corresponding to the third sphere 802 and a fourth circle 806 corresponding to the fourth sphere 803. Moreover, although the positions of the third sphere 802 and the fourth sphere 803 relative to the second image acquisition device 801 are different, due to the orthogonal projection of the second image acquisition device 801, the relative sizes of the third circle 805 and the fourth circle 806 do not change due to the distance between the third sphere 802 and the fourth sphere 803 and the second image acquisition device 801, but remain consistent with the relative sizes of the third sphere 802 and the fourth sphere 803.

[0163] Accordingly, based on the position information of the second object, determining the target position information of the virtual acquisition device can be achieved through steps E1 to E2:

[0164] Step E1, obtaining the field of view angle information of the virtual acquisition device.

[0165] In one implementation, the field of view angle information of the virtual acquisition device may include a horizontal field of view angle and a vertical field of view angle.

[0166] Step E2: determining target position information based on the position information of the second object and the field of view angle information.

[0167] In one implementation, the target location information may be determined by any of the following methods:

[0168] Based on the position information of the second object, the distribution state of the second object is determined, and then based on the distribution state of the second object and the field of view angle information, the target position information is determined. Exemplarily, the virtual acquisition device set based on the target position information can completely acquire the orthogonal projection information of each second object; Exemplarily, the distribution state of the second object can include the distribution state of the second object in at least one direction, such as the horizontal and / or vertical direction.

[0169] Figure 8B A second structural diagram of the target location information provided in the embodiment of the present application is shown as follows: Figure 8B As shown, the second virtual acquisition device 807 set based on the target position information can collect the orthogonal projection information of the second object 203 and the third object 204, and obtain the third image data 808 and the fourth image data 809 respectively; illustratively, the second virtual acquisition device 807 can be set outside the virtual object range 810; illustratively, the third image data 808 and the fourth image data 809 can also be processed respectively to obtain the third stereo structure 811 and the fourth stereo structure 812; illustratively, the third stereo structure 811 and the fourth stereo structure 812 can be displayed in sequence at the position adjacent to the first object 202. illustratively, there may be other virtual objects 813 between the second virtual acquisition device 807 and the second object 203 or the third object 204, and before the second virtual acquisition device 807 collects the third image data 808 and the fourth image data 809, the other virtual objects 813 can be removed.

[0170] Figure 8C Schematic diagram of the principle of determining target location information provided in the embodiment of the present application. Figure 8C As shown, point E can be the position of the gaze point, point C is the target position information to be determined, which can be recorded as (x, y, z), point A is the position of the first object, which can be recorded as d1 (x1, y1, z1), point B can be the position of the third object, and the coordinates of the position can be (x2, y2, z2). In actual applications, point B can be the position of the virtual object farthest from the AR / VR device in at least one second object; point D can be the geometric center position of point A and point B; DF can be the normal vector perpendicular to the plane where the AR / VR device or controller is located.

[0171] Figure 8D-1 The first structural diagram of DF provided in the embodiment of the present application. Figure 8D-1 In the example, the AR / VR device can be worn on the user's head. In this case, DF may include a vector whose starting point is the AR / VR device worn by the user and is perpendicular to the first direction 709.

[0172] Figure 8D-2The second structural diagram of DF provided in the embodiment of the present application. Figure 8D-2 In the figure, the starting points of the first direction 709 and DF can both be the controller 404 , wherein DF is perpendicular to the first direction 709 .

[0173] For example, DF can be recorded as a normalized vector (x3, y3, z3); is the field of view of the second virtual acquisition device 807. Based on the above data, the position of point D can be obtained as ((x1+x2) / 2, (y1+y2) / 2, (z1+z2) / 2). The DC vector is perpendicular to both DF and AB. Therefore, the DC vector DC' can be obtained by the vector cross product calculation shown in formula (1):

[0174] DC' = [x2 –x1, y2-y1, z2-z1] × [x3, y3, z3] (1)

[0175] For the convenience of calculation, DC' can be recorded as (x4, y4, z4). In order to normalize DC', the length len of DC' can be calculated by formula (2):

[0176] len=Sqrt(x4*x4,y4*y4,z4*z4)(2)

[0177] In formula (2), Sqrt is a square root operation. After obtaining len, DC' can be normalized to obtain the vector representation of DC: DC = (x4 / len, y4 / len, z4 / len), and the vector representation of DC is recorded as (x5, y5, z5). For example, the length of BD can be recorded as k, which is half the length of AB. k can be calculated by formula (3):

[0178] k=Sqrt( (x2-x1) * (x2-x1) + (y2 – y1) * (y2-y1) + (z2 – z1) * (z2 –z1) ) / 2 (3)

[0179] Therefore, the length r of CD can be obtained by formula (4):

[0180] r = k / tan( / 2)(4)

[0181] The coordinates of point C are obtained through equation (5):

[0182] (x, y, z) = [(x1+x2) / 2, (y1+y2) / 2, (z1+z2) / 2] + r * [x5, y5, z5] (5)

[0183] Fig. 9This is a schematic diagram of the structure of the display method provided in the embodiment of the present application. Fig. 9 As shown, the display device can sequentially unfold the characteristic information 901 of the second object and the characteristic information 902 of the third object on the side of the first object 202 and clearly present them to the user 501. Moreover, during the display process of the characteristic information 901 of the second object and the characteristic information 902 of the third object, the user 501 does not need to change the head posture or change the position by walking.

[0184] Exemplarily, after the feature information 901 of the second object and the feature information 902 of the third object are successively expanded, the user can select the second object and / or the third object to perform interactive operations through ray translation, and the user can also cancel the display of the second object and / or the third object; exemplary, when the gaze direction changes, the first projection and the second projection can also change accordingly. At this time, the feature information 901 of the second object and the feature information 902 of the third object stop being displayed, and the display device updates the feature information of the second object and the feature information of the third object based on the new projection, thereby realizing real-time tracking and display of virtual objects.

[0185] From the above, it can be seen that in the display method provided in the embodiment of the present application, under the condition that the first object takes the second object as a virtual object and the display device is an AR / VR device, the orthogonal projection information of the second object can be collected by the virtual collection device, and the feature information of the second object and the first object can be displayed, so that when the second object is blocked by the first object, the second object can still be displayed clearly and completely, thereby facilitating the user to select the virtual object through the AR / VR device.

[0186] Based on the foregoing embodiment, in the display method provided by the embodiment of the present application, determining the target display mode based on the first projection and the second projection can also be implemented in the following manner:

[0187] If the second condition is met, the target display mode is determined to be: displaying the first object, displaying the edge of the first object in the first color, and displaying the portion of the second object that is not blocked by the first object.

[0188] The second condition includes that the first projection is a proper subset of the second projection.

[0189] In one embodiment, the first projection is a true subset of the second projection, which can indicate that a partial area of ​​the second object is blocked by the first object. That is, from the perspective of the display device, another partial area of ​​the second object that is not blocked by the first object can be seen. At this time, in order to highlight the relative relationship between the first object and the second object, the edge of the first object can be displayed in the first color to distinguish the first object from the second object.

[0190] In one embodiment, the first color may be a color different from the color of the first object and the color of the second object; for example, the color of the first object may be the color of the first object that can be seen from the perspective of the display device; the color of the second object may be the color of the second object that can be seen from the perspective of the display device. For example, if the color of the first object is green and the color of the second object is red, then the first color may be yellow.

[0191] In one embodiment, the target display method can also be to display the first object, display the edge of the first object with a first pattern, and display the portion of the second object that is not blocked by the first object; exemplarily, the first pattern can be different from both the pattern of the first object and the pattern of the second image; exemplarily, the pattern of the first object can be the pattern of the first object that can be seen from the perspective of the display device; the pattern of the second object can be the pattern of the second object that can be seen from the perspective of the display device.

[0192] In one embodiment, the target display mode may also be to display the first object at a first brightness, display the second object at a second brightness, and display the nth object at an nth brightness; illustratively, the first brightness and the nth brightness may be different, wherein n is an integer greater than or equal to 1 and less than the number of virtual objects.

[0193] In one embodiment, the target display method may further include expanding the area of ​​the second object that is not blocked by the first object, and displaying the area in a highlighted form, thereby expanding the selectable and operable area of ​​the display device for the second object.

[0194] From the above, it can be seen that the display method provided in the embodiment of the present application can display the edge of the first object in the first color when the second object is not completely blocked by the first object, so as to highlight the relative position relationship between the first object and the second object, thereby facilitating the user to observe the first object and the second object.

[0195] Exemplarily, when the first object and the second object are both virtual objects and the display device is an AR / VR device, when the user changes the position of the cursor point through gaze or ray, the AR / VR device can calculate the distance between the cursor point and the virtual object. If the distance between the cursor point and the virtual object is greater than a distance threshold, the virtual object around the cursor can be displayed by highlighting or setting an outline of a first color for the virtual object.

[0196] Fig.10 A schematic diagram of a structure for displaying multiple virtual objects around a cursor point provided by an embodiment of the present application. Fig.10In the embodiment, taking the first projection 503, the second projection 504 and the third projection 505 as examples, the display effects of the first object, the second object and the third object satisfying the third condition are demonstrated.

[0197] like Fig.10 As shown, when the display device detects that there are a first object, a second object, and a third object around the cursor 1001, the first object can be displayed by setting the first projection 503 to dense oblique lines, the second object can be displayed by setting the second projection 504 to a grid, and the third object can be displayed by setting the third projection 505 to sparse oblique lines, thereby achieving a clear display of the first object to the third object; exemplarily, the display device can also set the cursor 1001 to a dot pattern that is different from the first projection 503, the second projection 504, and the third projection 505, and can also set a specified color for the cursor 1001 to remind the user of the location of the cursor 1001. When the user moves the cursor 1001 to different patterns or color areas, the selection operation of different virtual objects can be achieved. Exemplarily, the specified color can be different from the colors of the virtual objects around the cursor 1001.

[0198] In the related art, if multiple virtual objects occlude each other and the unoccluded area of ​​the virtual object is small, the user cannot accurately select the occluded virtual object. At this time, the user can only change the display effect of the virtual object by changing the head posture or moving the position to improve the user's selection efficiency of the virtual object.

[0199] In the display method provided in the embodiment of the present application, if part of the area of ​​the second object and / or the third object is blocked by the first object, the display device can still display the edge of the first object and the undisplayed part of the second object based on the first color. In this way, it can serve as a prompt for the user to select the area of ​​the second object, thereby reducing the probability of the user mistakenly selecting a virtual object and improving the user's operation efficiency on the virtual object.

[0200] Based on the above embodiments, in the display method provided in the embodiments of the present application, determining the target display mode based on the first projection and the second projection can also be implemented in the following manner:

[0201] If the third condition is met, the target display mode is determined to be: displaying the first object, displaying the edge of the first object in the second color, and displaying the portion of the second object that is not blocked by the first object.

[0202] The third condition includes that the first projection intersects the second projection, and the first projection is not a subset of the second projection, and the second projection is not a subset of the first projection.

[0203] Fig.11AA first structural diagram of a first projection 503, a second projection 504, and a third projection 505 that meet the third condition provided in an embodiment of the present application. Fig.11A It can be seen that the first projection 503 intersects with the second projection 504 and the third projection 505 , but the first projection 503 is not a subset of the second projection 504 , and the second projection 504 is not a subset of the first projection 503 , that is, the first object partially blocks the second object.

[0204] Fig. 11B A second structural diagram of a first projection 503, a second projection 504, and a third projection 505 that meet the third condition provided in an embodiment of the present application. Fig. 11B It can be seen that the first projection 503 intersects with the second projection 504 and the third projection 505, but the first projection 503 is not a subset of the second projection 504, and the second projection 504 is not a subset of the first projection 503, that is, the first object partially blocks the second object. Similarly, the third object also partially blocks the second object.

[0205] In one implementation, the method for determining the second color may be the same as or similar to the method for determining the first color, and will not be described in detail herein.

[0206] In one embodiment, the target display method can also be to display the first object, display the edge of the first object with a second pattern, and display the portion of the second object that is not blocked by the first object; exemplarily, the second pattern can be different from both the pattern of the first object and the pattern of the second image; exemplarily, the pattern of the first object can be the pattern of the first object that can be seen from the perspective of the display device; the pattern of the second object can be the pattern of the second object that can be seen from the perspective of the display device.

[0207] In the case where the first object to the third object are virtual objects, the display effect of the display device on the multiple virtual objects is as follows: Fig.10 The above display method can clearly distinguish multiple virtual objects that are close to each other, thereby reducing the probability of users mistakenly selecting virtual objects and improving the user's operation efficiency on virtual objects.

[0208] Based on the foregoing embodiments, an embodiment of the present application further provides an electronic device, which can implement the display method as described in any of the foregoing embodiments.

[0209] Exemplarily, the electronic device may be the display device described in the aforementioned embodiment; exemplary, the electronic device may be an AR / VR device; exemplary, the electronic device may be a device that requires data interaction with a controller to realize AR / VR functions, and may also be an all-in-one device that can independently realize AR / VR functions.

[0210] Based on the foregoing embodiments, an embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor of an electronic device, it can implement any of the display methods described above.

[0211] The above description of various embodiments tends to emphasize the differences between the various embodiments. The same or similar aspects can be referenced to each other, and for the sake of brevity, they will not be repeated herein.

[0212] The methods disclosed in the various method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.

[0213] The features disclosed in the various product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0214] The features disclosed in the various method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.

[0215] It should be noted that the above-mentioned computer-readable storage medium can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM) and other memories; it can also be various electronic devices including one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.

[0216] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0217] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0218] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus necessary general hardware nodes, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, disk, CD), and includes a number of instructions for a terminal device (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0219] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a heating module of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the heating module of the computer or other programmable data processing device generate instructions for implementing the steps in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0220] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0221] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0222] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A display method, the method comprising: Acquire at least a first projection of a first object and a second projection of a second object in at least a first direction; wherein the first direction includes a direction from a display device to the first object and / or the second object; and the first object includes an object between the display device and the second object; Determining a target display mode based on the first projection and the second projection; Based on the target display mode, display the first object and the second object; Wherein, determining the target display mode based on the first projection and the second projection includes: The target display mode is determined based on that the first projection and the second projection satisfy a first condition; the first condition includes that the second projection is a subset of the first projection.

2. The method according to claim 1, wherein: The determining the target display mode based on the first projection and the second projection satisfying a first condition includes: If the first condition is met, acquiring feature information of the second object; The target display mode is determined as: displaying the first object in the first direction, and displaying characteristic information of the second object in the second direction; wherein the angle between the second direction and the first direction is greater than an angle threshold; and the angle threshold is the angle between the tangent from the display device to the first projection and the first direction.

3. The method according to claim 2, wherein: The acquiring the characteristic information of the second object includes: Acquire location information of the second object; Based on the position information of the second object, characteristic information of the second object is acquired.

4. The method according to claim 3, wherein: The first object and the second object include virtual objects, and the display device includes a virtual reality VR / augmented reality AR device; and obtaining feature information of the second object based on the position information of the second object includes: Determining target position information of the virtual acquisition device based on the position information of the second object; Acquire feature information of the second object collected by the virtual collection device set based on the target position information.

5. The method according to claim 4, wherein: The feature information of the second object includes perspective projection information of the second object, and the determining the target position information of the virtual acquisition device based on the position information of the second object includes: Based on the position information of the second object, adjusting the relative position relationship between the virtual acquisition device and each of the at least one second object in a third direction; wherein the angle between the third direction and the first direction is less than 90 degrees; The target position information is determined based on the relative position relationship and the position information of the second object.

6. The method according to claim 4, wherein: The feature information of the second object includes orthogonal projection information of the second object; and determining the target position information of the virtual acquisition device based on the position information of the second object includes: Acquiring the field of view angle information of the virtual acquisition device; The target position information is determined based on the position information of the second object and the field of view angle information.

7. The method according to claim 1, wherein: The determining the target display mode based on the first projection and the second projection further includes: If the second condition is met, the target display mode is determined to be: displaying the first object, displaying the edge of the first object in a first color, and displaying the part of the second object that is not blocked by the first object; wherein the second condition includes that the first projection is a proper subset of the second projection.

8. The method according to claim 1, wherein: The determining the target display mode based on the first projection and the second projection further includes: If the third condition is met, the target display mode is determined to be: displaying the first object, displaying the edge of the first object in a second color, and displaying the part of the second object that is not blocked by the first object; wherein the third condition includes that the first projection intersects the second projection, and the first projection is not a subset of the second projection, and the second projection is not a subset of the first projection.

9. An electronic device capable of implementing the display method according to any one of claims 1 to 8.

10. A computer-readable storage medium, wherein: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor of an electronic device, the display method according to any one of claims 1 to 8 can be implemented.

Images