Screen display method and apparatus

By adjusting the virtual icons and construction point parameters displayed on the terminal, and dynamically adjusting them according to changes in the driver's perspective, the problem of mismatch between the virtual scene and the driver's perspective is solved, improving the accuracy of distance perception and the driving experience.

CN119567847BActive Publication Date: 2025-12-05HUAWEI TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202311141201.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-09-05
Publication Date
2025-12-05
Estimated Expiration
2043-09-05

AI Technical Summary

Technical Problem

In vehicle navigation, the virtual scene displayed on the terminal does not match the driver's perspective, resulting in inaccurate distance perception and affecting the driving experience.

Method used

By adjusting the virtual icons displayed on the terminal to match the driver's field of view, and dynamically adjusting the spacing and angle of the virtual icons according to changes in the driver's head height, the pitch and azimuth angles of the points are constructed to match changes in the driver's field of view.

Benefits of technology

It improves the flexibility of virtual scenes and the accuracy of distance perception, thereby enhancing the driver's driving experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119567847B_ABST
    Figure CN119567847B_ABST
Patent Text Reader

Abstract

The application provides a screen display method and device, which can make the navigation interface more matched with the driver's visual angle, improve the accuracy of the driver's distance perception of objects in the actual scene, and further improve the driving experience of the user. It comprises: at a first time, displaying a first interface, the first interface comprising a first virtual icon of a vehicle driven by a driver and a second virtual icon of a target object, in the first interface, the distance between the first virtual icon and the second virtual icon is a first length at the first time; at a second time, displaying a second interface, the second interface comprising the first virtual icon and the second virtual icon, in the second interface, the distance between the first virtual icon and the second virtual icon is a second length; wherein the second time is later than the first time, and between the first time and the second time, the vehicle and the target object are relatively static, and the second length is greater than the first length.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of terminal, and in particular, to a screen display method and device. BACKGROUND

[0002] The safety and experience of a driver is very important when the vehicle is moving. A terminal on the vehicle can acquire the position information of the vehicle and the information of the surrounding environment collected by the sensor system on the vehicle in real time, construct a virtual scene based on the position information of the vehicle and the surrounding environment information through the transformation of the view angle, and display a navigation interface for the user in combination with the constructed virtual scene, so that the user can see the environmental information around the vehicle on the navigation interface.

[0003] In the related art, when the virtual scene is constructed, the terminal constructs the virtual scene through the preset parameters of the construction point, and the view angle corresponding to the construction point is the view angle of the virtual scene (hereinafter referred to as "scene view angle"). Different drivers may have different heights, and the positions of the eyes of the corresponding drivers may be different. The position of the eyes of the same driver may also be different when the driver is in different postures, that is, the driver's view angle may have multiple changes, but the scene view angle is still the view angle corresponding to the preset parameters. In this case, when the terminal displays the virtual scene, it cannot flexibly change with the change of the driver's view angle, and the scene view angle and the driver's view angle may not match, and the distance between the objects around the vehicle and the vehicle seen by the driver on the display screen of the terminal is shorter than the distance between the objects around the vehicle and the vehicle in the actual scene. SUMMARY

[0004] The present application provides a screen display method and device, which can display pictures of different angles based on different driver's view angles, improve the flexibility of the terminal in displaying the virtual scene, make the scene view angle and the driver's view angle more matched, improve the accuracy of the driver's distance perception of the objects in the actual scene, and further improve the driving experience of the user.

[0005] In a first aspect, a screen display method is provided, applied to a device comprising a camera and a light source. The method comprises: at a first time, displaying a first interface, the first interface comprising a first virtual icon of a vehicle driven by a driver and a second virtual icon of a target object, in the first interface, a distance between the first virtual icon and the second virtual icon is a first length, at the first time, a height from a ground of a target point of the driver's head is a first height; at a second time, displaying a second interface, the second interface comprising the first virtual icon and the second virtual icon, in the second interface, the distance between the first virtual icon and the second virtual icon is a second length, at the second time, the height from the ground of the target point of the driver's head is a second height; wherein the second time is later than the first time, and between the first time and the second time, the vehicle and the target object are relatively static, the second height is greater than the first height, and the second length is greater than the first length.

[0006] The screen display method provided by the application can increase the distance between the virtual icon of the target object displayed on the terminal and the virtual icon of the vehicle driven by the driver when the height from the ground of the target point of the driver's head is increased, that is, the distance between the virtual icon of the target object displayed on the terminal and the virtual icon of the vehicle driven by the driver changes when the driver's perspective changes. In this way, the terminal can display pictures of different angles based on different driver's perspectives when displaying a virtual scene, improving the flexibility of the terminal in displaying a virtual scene, making the scene perspective (corresponding to the construction point) and the driver's perspective more matched, improving the accuracy of the driver's distance perception of objects in the actual scene, and further improving the user's driving experience.

[0007] It should be understood that the target object can be a vehicle, an obstacle, a pedestrian, or an icon on the road surface that is relatively static with the vehicle driven by the driver, and the application does not limit this.

[0008] It should also be understood that the first length can refer to the absolute distance between the first virtual icon and the second virtual icon, or can refer to the vertical distance of the first virtual icon and the second virtual icon in the driving direction in the virtual scene, and the application does not limit this.

[0009] Optionally, the target point of the driver's head can be any point of a facial key point of the driver. For example, the facial key point can be the center point of the pupil of any eye, can be the midpoint of the line connecting the two eyes, can be the point of the tip of the nose, and the like, and the application does not limit this.

[0010] Optionally, at the first time, when the upper body of the driver is in a relaxed state, the waist and the back of the driver are in a slightly curved state, the first height can be a height of the head target point of the driver from the ground in the relaxed state of the driver. At the second time, the upper body of the driver can be in an upright state. The second height can be a height of the head target point of the driver from the ground when the upper body of the driver is in the upright state.

[0011] It should be understood that the position of the head target point and the height of the head target point from the ground can be different when the driver is in different postures, i.e., the first height can be different. For example, the head position when the upper body of the driver is in a relaxed state is lower than the head position when the upper body of the driver is in an upright state, and the corresponding head target point is also lower from the ground.

[0012] Optionally, the relative static state of the target object and the vehicle driven by the driver includes the following two possible cases.

[0013] Case 1, the target object and the vehicle driven by the driver move at the same speed and in the same direction. For example, the target object is a target vehicle detected by the vehicle driven by the driver, the target vehicle travels in front of the vehicle driven by the driver, and the target vehicle and the vehicle driven by the driver move forward at a first speed, and the target vehicle also moves forward at the first speed.

[0014] Case 2, the target object and the vehicle driven by the driver are both in a static state. For example, the target object is a target vehicle detected by the vehicle driven by the driver, the target vehicle travels in front of the vehicle driven by the driver, and the target vehicle and the vehicle driven by the driver are both in a static state.

[0015] Optionally, the terminal displays the second interface in a similar manner to the manner of displaying the first interface, which will not be described here.

[0016] In combination with the first aspect, in some implementations of the first aspect, displaying the first interface includes: constructing the first virtual scene based on the first virtual icon, the second virtual icon, the position of the vehicle, the first pitch angle of the construction point of the virtual scene, the position of the construction point, the field of view angle of the construction point, and the first azimuth angle of the construction point, and displaying the first interface.

[0017] Optionally, the terminal obtains the position information of the vehicle of the driver and the road section information in which the vehicle of the driver is located by obtaining the positioning information of the vehicle of the driver, and the terminal can collect the position information of the target object in front of the vehicle of the driver through a sensor system of the vehicle of the driver. The terminal constructs a first virtual scene based on the position information of the vehicle of the driver, the road section information in which the vehicle of the driver is located, and the position information of the target object. In the virtual scene, the vehicle of the driver can be represented by a first virtual icon, and the target object can be represented by a second virtual icon. After the terminal constructs the first virtual scene, the terminal displays a first interface, and the pitch angle in the construction parameter is a first pitch angle, the field of view angle is a first field of view angle, the azimuth angle is a first azimuth angle, and the position of the construction point is a first position.

[0018] It should be understood that the construction parameter can also be referred to as a parameter of a construction point. The construction point can also be referred to as a virtual camera, and the parameter of the construction point can be understood as a parameter of the virtual camera.

[0019] It should also be understood that the terminal can display the first interface on the display screen of the terminal, or project the first interface on the windshield in front of the driver in a head-up display (HUD) manner, which is not limited in the present application.

[0020] It should be understood that the terminal displays the second interface in a similar manner to the manner in which the terminal displays the first interface, which will not be described herein again.

[0021] In combination with the first aspect, in some implementations of the first aspect, before displaying the first interface, the method further includes: determining a first distance between a first position and a second position, the first position being a vertical projection point of a target point of the head of the driver on the ground, and the second position being a gaze position prediction point of the eyes of the driver on the road surface; and determining the first pitch angle based on the first height and the first distance.

[0022] Optionally, the terminal can determine an angle between the gaze direction of the eyes of the driver and the ground based on the first height and the first distance, and determine the angle as the first pitch angle of the construction point.

[0023] For example, the height of the target point of the head of the driver from the ground (the first height) can be H1, and the distance between the vertical projection point of the target point of the head of the driver on the ground and the gaze position prediction point of the eyes of the driver on the road surface (the first distance) can be L1. The terminal determines an angle θ0 between the gaze direction of the eyes of the driver and the ground based on the first height and the first distance, and the angle θ0 is determined as the first pitch angle θ0. h = arctan (H1 / L1). The terminal determines the angle between the gaze direction of the eyes of the driver and the ground as the first pitch angle θ0 = θ h .

[0024] It should be understood that when the driver is driving the vehicle, the gaze point of the driver's eyes usually falls at a position that is a preset distance away from the vehicle, and the gaze point of the driver's eyes is different according to different speeds of the vehicle or different types of road sections where the vehicle is located, and the corresponding first distance is also different.

[0025] By determining the included angle between the gaze direction of the driver's eyes and the ground as the pitch angle (first pitch angle) of the construction point, the pitch angle of the corresponding view angle of the construction point can be matched with the pitch angle of the driver's view angle, and the accuracy of the driver's distance perception of the object in the actual scene is improved.

[0026] In combination with the first aspect, in some implementations of the first aspect, determining the first distance between the first position and the second position includes: determining a target speed range to which a current vehicle speed of the vehicle belongs from a plurality of speed ranges; and determining the first distance based on the target speed range and a first correspondence relationship, the first correspondence relationship including a correspondence relationship between the plurality of speed ranges and a plurality of distances.

[0027] It should be understood that there is no intersection between the plurality of speed ranges, that is, a speed belongs to only one speed range.

[0028] By determining the distance (i.e., the first distance) from the driver's position to the position of the driver's eye gaze point through the speed range corresponding to the speed, the determined first distance is more consistent with the visual perception of the driver when driving the vehicle at different speeds, and the accuracy of the first distance is improved.

[0029] In combination with the first aspect, in some implementations of the first aspect, determining the first distance between the first position and the second position includes: determining a target road section type of a road section where the vehicle is currently located according to a current position of the vehicle, the target road section type being a highway road section or an urban road section; and determining the first distance based on the target road section type and a second correspondence relationship, the second correspondence relationship including a correspondence relationship between a plurality of road section types and a plurality of distances.

[0030] It should be understood that the road section types described above can also include national road sections and rural road sections, and researchers can divide the road sections into various road section types according to actual conditions, which are not limited in the present application.

[0031] By determining the distance (i.e., the first distance) from the driver's position to the position of the driver's eye gaze point through the road section type, the determined first distance is more consistent with the visual perception distance of the driver when driving the vehicle on different road sections, and the accuracy of the first distance is improved.

[0032] With reference to the first aspect, in some implementations of the first aspect, before displaying the first interface, the method further includes: determining, by the detection device, the first pitch angle, determining, based on the first pitch angle and the first height, the first distance between the first position and the second position, the first position being a vertical projection point of a target point of the driver's head on the ground, and the second position being a gaze position prediction point of the driver's eyes on the road surface.

[0033] Optionally, the terminal determines the first pitch angle through the DMS configured by the vehicle.

[0034] Specifically, the terminal and the DMS can communicate through a wireless connection or a wired connection. The camera in the DMS can capture a head image of the driver in real time. The processor in the DMS analyzes and processes the head image to obtain an angle between a gaze direction of the driver's eyes and the ground, and sends the angle as the first pitch angle to the terminal.

[0035] Optionally, after determining the first pitch angle, the terminal can further determine the first distance.

[0036] Specifically, the processor in the DMS analyzes and processes the head image of the driver captured by the camera in the DMS, and can also determine a height difference between the target point of the driver's head and the installation position of the camera in the DMS. The processor in the DMS determines the sum of the height difference and the installation height of the DMS camera as the height of the target point of the driver's head from the ground (i.e., the first height), and determines the distance between the vertical projection point of the target point of the driver's head on the ground and the gaze position prediction point of the driver's eyes on the road surface (i.e., the first distance) based on the first height and the first pitch angle.

[0037] Determining the first pitch angle through the detection device and further determining the distance between the vertical projection point of the target point of the driver's head on the ground and the gaze position prediction point of the driver's eyes on the road surface (i.e., the first distance) makes the actual perception distance of the driver closer, which is beneficial to improve the accuracy of the first distance.

[0038] With reference to the first aspect, in some implementations of the first aspect, the position of the construction point includes a height of the construction point from the ground, and before displaying the first interface, the method further includes: determining the height of the construction point from the ground based on a second distance between the first position and a third position, the first distance, and the first pitch angle, the third position being a vertical projection point of the construction point on the ground.

[0039] Specifically, the height of the construction point from the ground can also be referred to as the vertical position of the construction point.

[0040] Optionally, the second distance can be a preset value. The terminal first calculates the sum of the second distance and the first distance, and calculates the height of the construction point from the ground based on the sum and the first pitch angle.

[0041] In the embodiments of the application, the pitch angle of the construction point (first pitch angle) is the same as the pitch angle of the driver's view angle (the angle between the gaze direction of the driver's eyes and the ground), and the vertical position of the construction point determined by the second distance, the first distance and the first pitch angle is on the line connecting the target point of the driver's head to the gaze position of the driver's eyes, so that the view angle of the construction point is more matched with the view angle of the driver, and the accuracy of the driver's distance perception of the objects in the actual scene is improved.

[0042] With reference to the first aspect, in some implementations of the first aspect, the position of the construction point includes a horizontal position of the construction point, and before displaying the first interface, the method further includes: determining a third distance between a fourth position and a fifth position, the fourth position being a display center point of the first interface in the vehicle, and the fifth position being determined based on the target point of the driver's head and the fourth position; determining a fourth distance between the fifth position and the target point of the driver's head; determining the first azimuth angle based on the third distance and the fourth distance; and determining the horizontal position of the construction point based on the first azimuth angle.

[0043] It should be understood that the first interface is displayed on the display screen of the terminal, and the display center point of the first interface in the vehicle can be the center point of the window corresponding to the first interface. In the case where the window corresponding to the first interface covers the display screen, the display center point of the first interface in the vehicle is not the center point of the display screen. In the case where the window corresponding to the first interface does not cover the display screen, the display center point of the first interface in the vehicle is the center point of the display screen.

[0044] The horizontal position of the construction point is determined based on the positional relationship between the target point of the driver's head and the display center point, so that the horizontal position of the construction point obtained is more matched with the horizontal position of the driver's view angle.

[0045] Optionally, the terminal can determine the first azimuth angle based on the tangent relationship between the third distance and the fourth distance.

[0046] Optionally, the azimuth angle of the initial construction point can be 0, the terminal adjusts the initial azimuth angle of the construction point to the first azimuth angle, and the terminal can determine the horizontal position of the construction point as follows: the focal point of the construction point remains unchanged, the line connecting the initial position of the construction point and the focal point of the construction point is rotated by the first azimuth angle to obtain a corrected position of the construction point, and the corrected position includes the horizontal position of the construction point.

[0047] By keeping the focal point of the construction point unchanged, adjusting the horizontal position and the azimuth angle of the construction point based on the horizontal position and the azimuth angle of the driver's perspective, the determined perspective of the construction point is the same as the driver's perspective in the horizontal position, the focal point and the azimuth angle, and the determined perspective of the construction point is more matched with the driver's perspective, which is beneficial to improving the accuracy of the driver's distance perception of the object in the actual scene.

[0048] With reference to the first aspect, in some implementations of the first aspect, the position of the construction point includes a horizontal position of the construction point, and before displaying the first interface in the vehicle, the method further includes: determining a third distance between a fourth position and a fifth position, the fourth position being a display center point of the first interface in the vehicle, and the fifth position being determined based on a target point of the driver's head and the fourth position; and determining the horizontal position of the construction point based on the third distance.

[0049] Optionally, the terminal obtains a corrected horizontal coordinate value of the construction point by adding a length of the third distance to a horizontal coordinate value of a coordinate point of the initial position of the construction point, and the corrected horizontal coordinate value of the construction point is the horizontal position of the construction point.

[0050] It should be understood that the coordinate point of the initial position of the construction point refers to the position of the construction point before the construction point parameter is corrected, and the coordinate point of the initial position of the construction point is on a plane where a center line of the vehicle is located, and the plane where the center line is located is perpendicular to the ground.

[0051] By adjusting the horizontal position of the construction point through the third distance, the adjusted construction point is more consistent with the actual perception distance of the driver in the horizontal direction, and the accuracy of the horizontal position of the construction point is improved.

[0052] With reference to the first aspect, in some implementations of the first aspect, determining the third distance between the fourth position and the fifth position includes: determining the third distance based on a vehicle model corresponding to the vehicle and a third correspondence relationship, and the third correspondence relationship includes a correspondence relationship between a plurality of vehicle models and a plurality of distances.

[0053] It should be understood that when the third distance is determined through the third correspondence, the terminal can be a center control platform on the vehicle. In different vehicle models, the distance between the center control platform and the instrument panel is different.

[0054] By determining the third distance through the correspondence relationship between the vehicle model and the third distance, the determined third distance is suitable for different vehicles, which is beneficial to improving the accuracy of the third distance.

[0055] With reference to the first aspect, in some implementations of the first aspect, determining the third distance between the fourth position and the fifth position includes: detecting the position of the target point of the driver's head by using a detection device; determining the fifth position based on the target point of the driver's head and the fourth position; and calculating the distance between the fourth position and the fifth position to obtain the third distance.

[0056] It should be understood that the terminal detects the position of the target point of the head of the driver by the detection device in the same way as the terminal detects the position of the gaze point of the eyes of the driver on the ground by the detection device, which will not be described here.

[0057] Optionally, the position of the target point of the head of the driver, the fourth position, and the fifth position can be coordinate points in the same coordinate system, and the terminal calculates the third distance according to the coordinate values of the coordinate points.

[0058] The third distance is determined by the detection device, and the determined third distance is more consistent with the actual perception distance of the driver, which is beneficial to improve the accuracy of the third distance.

[0059] In combination with the first aspect, in some implementations of the first aspect, the method further includes: displaying a third interface at a third time, the third interface including the first virtual icon and a target navigation icon displayed in a first style, the height of the target point of the head of the driver from the ground being a third height at the third time; displaying a fourth interface at a fourth time, the fourth interface including the first virtual icon and a target navigation icon displayed in a second style, the height of the target point of the head of the driver from the ground being a fourth height at the fourth time; and wherein the fourth time is later than the third time, the fourth height is different from the third height, and the second style is different from the first style.

[0060] Optionally, the terminal constructs a second virtual scene based on the first virtual icon, the target navigation icon displayed in the first style, the location of the vehicle, the second pitch angle of the construction point of the virtual scene, the position of the construction point, the field of view angle of the construction point, and the first azimuth angle of the construction point, and displays the third interface.

[0061] It should be understood that the terminal displays the third interface in a similar way to the way in which the terminal displays the first interface, which will not be described here. The difference between the terminal displaying the third interface and the terminal displaying the first interface is that the third interface further includes the target navigation icon.

[0062] Optionally, the resource library of the terminal stores a plurality of navigation icons, and the terminal obtains the target navigation icon based on the current positioning information of the vehicle. The terminal determines the second pitch angle based on the third height, determines the actual projection angle of the target navigation icon in the second virtual scene based on the second pitch angle, and obtains the first style of the target navigation icon after the target navigation icon is projected and changed at the actual projection angle; and the terminal displays the first style of the target navigation.

[0063] It should be understood that the terminal determines the second pitch angle in the same way as the terminal determines the first pitch angle, which will not be described here.

[0064] Exemplarily, the terminal determines that the vehicle is about to change lanes based on a steering indication of the vehicle, and obtains a vehicle shape frame icon displayed after the vehicle changes lanes from the resource library. The terminal can determine a display position and a projection angle of the vehicle shape frame icon in the virtual scene after the vehicle changes lanes based on current positioning information of the vehicle and a current vehicle speed of the vehicle. The terminal generates a first style of the vehicle shape frame icon based on the projection angle of the vehicle shape frame icon, and displays the first style of the vehicle shape frame icon in the virtual scene.

[0065] It should also be understood that the terminal determines the second style of the target navigation in the same way as the terminal determines the first style of the target navigation, and the terminal displays the fourth interface in the same way as the terminal displays the third interface, which will not be described here.

[0066] Optionally, the first style of the target navigation icon and the second style of the target navigation icon are both styles obtained by scaling up or down based on an original style of the target navigation icon. The first style of the target navigation icon is smaller than the second style of the target navigation icon.

[0067] By changing the style of the target navigation icon displayed on the terminal when the height of the target point of the driver's head from the ground increases, that is, by changing the style of the target navigation icon displayed on the terminal when the driver's perspective changes, the terminal can display the target navigation icon in different styles when the driver's perspective changes. In this way, when the terminal displays the virtual scene, on the one hand, the style of the navigation icon displayed by the terminal is more consistent with the actual style of the navigation icon, which is beneficial to improving the accuracy of the driver's cognition of the navigation icon; on the other hand, the terminal can display different angle pictures based on different driver's perspectives, which improves the flexibility of the terminal in displaying the virtual scene, makes the projection angle of the target navigation icon more matched with the driver's perspective, and further improves the user's driving experience.

[0068] In combination with the first aspect, in some implementations of the first aspect, before displaying the third interface, the method further includes: determining a projection correction angle of the target navigation icon in the second virtual scene; determining an actual projection angle of the target navigation icon in the second virtual scene based on the second pitch angle and the correction angle; and projecting the target navigation icon at the actual projection angle to obtain the target navigation icon displayed in the first style.

[0069] Optionally, the terminal determines the sum of the second pitch angle and the correction angle as the actual projection angle of the target navigation icon in the second virtual scene.

[0070] In combination with the first aspect, in some implementations of the first aspect, determining the projection correction angle of the target navigation icon in the second virtual scene includes: determining the projection correction angle based on the second pitch angle and a fourth correspondence relationship, the fourth correspondence relationship including a correspondence relationship between a plurality of pitch angles and a plurality of angles.

[0071] Optionally, the pitch angle and the correction angle are inversely proportional, that is, the greater the pitch angle, the smaller the correction angle.

[0072] With reference to the first aspect, in some implementations of the first aspect, determining the projection correction angle of the target navigation icon in the second virtual scene comprises: determining the projection correction angle based on the target distance and a first preset threshold, the target distance being a distance between a position of the target navigation icon in the second virtual scene and a position of the vehicle in the second virtual scene.

[0073] With reference to the first aspect, in some implementations of the first aspect, the projection correction angle is a negative value when the target distance is greater than or equal to the first preset threshold; and the correction angle is a positive value when the target distance is less than the first preset threshold.

[0074] For example, the projection correction angle is -2° when the target distance is greater than or equal to 25 m, and the projection correction angle is +2° when the target distance is less than 25 m.

[0075] By setting the first preset threshold, it is determined whether the correction angle is a positive angle correction or a negative angle correction according to the size relationship between the target distance and the first preset threshold, so that the accuracy of the projection correction angle is improved.

[0076] With reference to the first aspect, in some implementations of the first aspect, the projection correction angle is a preset angle.

[0077] For example, the projection correction angle can be 5°.

[0078] In the second aspect, the application further provides another screen display method, which is executed by the terminal and comprises: at a first time, the terminal displays a first interface, the first interface comprising a first virtual icon and a target navigation icon displayed in a first style, at the first time, a target point of the driver's head is at a first height from the ground; at a second time, the terminal displays a second interface, the second interface comprising the first virtual icon and the target navigation icon displayed in a second style, at the second time, the target point of the driver's head is at a second height from the ground; wherein the second time is later than the first time, the second height is different from the first height, and the second style is different from the first style.

[0079] With reference to the second aspect, in some implementations of the second aspect, displaying the first interface comprises: constructing a third virtual scene based on the first virtual icon, the target navigation icon displayed in the first style, a position of the vehicle, a third pitch angle of a construction point of the third virtual scene, a position of the construction point, a field of view angle of the construction point, and a second azimuth angle of the construction point, and displaying the first interface.

[0080] It should be understood that the terminal displays the second interface in the same way as the terminal displays the first interface, and details are not repeated here.

[0081] With reference to the second aspect, in some implementations of the second aspect, before displaying the first interface, the method further includes: determining a projection correction angle of the target navigation icon in the second virtual scene; determining an actual projection angle of the target navigation icon in the second virtual scene based on the second pitch angle and the correction angle; and projecting the target navigation icon at the actual projection angle to obtain the target navigation icon displayed in the first style.

[0082] With reference to the second aspect, in some implementations of the second aspect, the terminal determines the sum of the second pitch angle and the correction angle as the actual projection angle of the target navigation icon in the second virtual scene.

[0083] It should be understood that the terminal determines the projection correction angle in the same way as the terminal determines the projection correction angle at the third time, and details are not repeated here.

[0084] In a third aspect, a screen display apparatus is provided for performing the method in any possible implementation of the first aspect or the second aspect. Specifically, the apparatus includes modules for performing the method in any possible implementation of the first aspect or the second aspect.

[0085] In one design, the apparatus can include modules corresponding one-to-one to the methods / operations / steps / actions described in the first aspect or the second aspect. The modules can be hardware circuits, software, or a combination of hardware circuits and software.

[0086] In a fourth aspect, a screen display apparatus is provided, including a processor and a memory. The processor is configured to read instructions stored in the memory to perform the method in any possible implementation of the first aspect or the second aspect.

[0087] Optionally, the processor is one or more, and the memory is one or more.

[0088] Optionally, the memory can be integrated with the processor, or the memory and the processor are separately arranged.

[0089] In a specific implementation process, the memory can be a non-transitory memory, such as a read only memory (ROM), which can be integrated on the same chip as the processor, or arranged separately on different chips. The type of memory and the arrangement of the memory and the processor are not limited in the embodiments of the present application.

[0090] The device in the fourth aspect can be a chip, and the processor can be implemented by hardware or software. When implemented by hardware, the processor can be a logic circuit, an integrated circuit, or the like. When implemented by software, the processor can be a general-purpose processor, which is configured to read software codes stored in a memory to implement the processor. The memory can be integrated in the processor or exist independently of the processor.

[0091] In a fifth aspect, a computer program product is provided, which includes a computer program (also referred to as code or instructions), which, when executed by a computer, causes the computer to perform the method in any possible implementation manner of the first aspect or the second aspect.

[0092] In a sixth aspect, a computer-readable storage medium is provided, which stores a computer program (also referred to as code or instructions), which, when executed by a computer, causes the computer to perform the method in any possible implementation manner of the first aspect or the second aspect. BRIEF DESCRIPTION OF DRAWINGS

[0093] Figure 1 FIG. 1 is a structural schematic diagram of a terminal according to an embodiment of the present application;

[0094] Figure 2 FIG. 2 is a diagram of parameters of a build point in a virtual scene;

[0095] Figure 3 FIG. 3 is a schematic diagram of an application scenario according to an embodiment of the present application;

[0096] Figure 4 FIG. 4 is a schematic flowchart of a screen display method according to an embodiment of the present application;

[0097] Figure 5 FIG. 5 is a schematic diagram of a display interface change of a terminal according to an embodiment of the present application;

[0098] Figure 6 FIG. 6 is a diagram of calculating a first distance according to an embodiment of the present application;

[0099] Figure 7 FIG. 7 is a diagram of calculating a height of a build point from the ground according to an embodiment of the present application;

[0100] Figure 8 FIG. 8 is a diagram of calculating a first azimuth according to an embodiment of the present application;

[0101] Figure 9 FIG. 9 is a top view of the device of FIG. 8; Figure 8

[0102] Figure 10 ​is a schematic diagram for determining the horizontal position of a construction point provided by an embodiment of the present application;

[0103] Figure 11 is another schematic diagram for determining the horizontal position of a construction point provided by an embodiment of the present application;

[0104] Figure 12 is another schematic diagram for changing the display interface of a terminal provided by an embodiment of the present application;

[0105] Figure 13 is a schematic diagram for displaying different correction projection angles in different scene perspectives provided by an embodiment of the present application;

[0106] Figure 14 is a schematic block diagram of a screen display device provided by an embodiment of the present application;

[0107] Figure 15 is another schematic block diagram of a screen display device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0108] The technical solutions in the present application will be described below with reference to the accompanying drawings.

[0109] In order to clearly describe the technical solutions of the embodiments of the present application, in the embodiments of the present application, the same items or similar items with basically the same functions and effects are distinguished by using "first", "second", etc. The skilled in the art can understand that "first", "second", etc. do not limit the quantity and execution order, and "first", "second", etc. also do not necessarily mean different.

[0110] It should be noted that in the present application, the words "exemplarily" or "for example" are used to represent as an example, illustration or explanation. Any embodiment or design scheme described as "exemplarily" or "for example" in the present application should not be interpreted as more preferred or more advantageous than other embodiments or design schemes. Rather, the words "exemplarily" or "for example" are intended to present the relevant concept in a specific manner.

[0111] Furthermore, "at least one" refers to one or more, while "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can mean: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, and c can mean: a, or b, or c, or a and b, or a and c, or b and c, or a, b, and c, where a, b, and c can be single or multiple.

[0112] In the embodiments of this application, descriptions such as "when," "under the circumstances," "if," and "if" all refer to the device making corresponding processing under certain objective circumstances, and are not limited to a specific time. They do not require the device to make a judgment action during implementation, nor do they imply any other limitations.

[0113] To better understand the terminal in the embodiments of this application, the following will be combined with... Figure 1 The hardware structure of the terminal in the embodiments of this application will be described in detail.

[0114] Figure 1 This is a schematic diagram of the structure of the terminal 100 provided in an embodiment of this application. Figure 1 As shown, terminal 100 may include processor 110, external memory interface 120, internal memory 121, universal serial bus (USB) interface 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, voice module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, and display screen 194, etc.

[0115] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the terminal 100. In other embodiments of this application, the terminal 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0116] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices or integrated in one or more processors.

[0117] The controller can generate operation control signals according to the instruction operation code and the timing signal, complete the control of fetching and executing instructions.

[0118] The processor 110 can also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can save instructions or data that have just been used or are recycled by the processor 110. If the processor 110 needs to use the instructions or data again, it can be directly called from the memory. This avoids repeated access and reduces the waiting time of the processor 110, thus improving the efficiency of the system.

[0119] In some embodiments, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, and / or a universal serial bus (USB) interface, etc.

[0120] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 can include multiple sets of I2C bus. The processor 110 can be coupled to the touch sensor 180K, the charger, etc. through different I2C bus interfaces. For example, the processor 110 can be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface, and the touch function of the terminal 100 is realized.

[0121] The I2S interface can be used for voice communication. In some embodiments, the processor 110 can include multiple sets of I2S bus. The processor 110 can be coupled to the voice module 170 through the I2S bus, and communication between the processor 110 and the voice module 170 is realized. In some embodiments, the voice module 170 can transmit voice signals to the wireless communication module 160 through the I2S interface, and the function of answering the phone through the Bluetooth earphone is realized.

[0122] The PCM interface can also be used for voice communication, sampling, quantizing and encoding analog signals. In some embodiments, the voice module 170 and the wireless communication module 160 can be coupled through the PCM bus interface. In some embodiments, the voice module 170 can also transmit voice signals to the wireless communication module 160 through the PCM interface, and the function of playing music through the Bluetooth earphone is realized. Both the I2S interface and the PCM interface can be used for voice communication.

[0123] The UART interface is a universal serial data bus, which is used for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is usually used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface, and the Bluetooth function is realized. In some embodiments, the voice module 170 can transmit voice signals to the wireless communication module 160 through the UART interface, and the function of playing music through the Bluetooth earphone is realized.

[0124] The MIPI interface can be used to connect the processor 110 and peripheral devices such as the display screen 194. The MIPI interface includes the display serial interface (DSI). In some embodiments, the processor 110 and the display screen 194 communicate through the DSI interface, and the display function of the terminal 100 is realized.

[0125] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the display screen 194, the wireless communication module 160, the voice module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, an MIPI interface, etc.

[0126] The USB interface 130 is an interface that complies with the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the terminal 100, or to transmit data between the terminal 100 and a peripheral device. It can also be used to connect a headset to play voice through the headset. The interface can also be used to connect to other terminals, such as AR devices, etc.

[0127] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a structural limitation of the terminal 100. In other embodiments of the present application, the terminal 100 can also use different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0128] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input through the wireless charging coil of the terminal 100. The charging management module 140 can charge the battery 142 while also providing power to the terminal through the power management module 141.

[0129] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to provide power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160, etc. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), etc. In other embodiments, the power management module 141 can also be provided in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be provided in the same device.

[0130] The wireless communication function of the terminal 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, etc.

[0131] The antenna 1 and the antenna 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the terminal 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In some other embodiments, the antennas can be used in combination with a tuning switch.

[0132] The mobile communication module 150 can provide a solution including 2G / 3G / 4G / 5G wireless communication applied to the terminal 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert the signals into electromagnetic waves radiated by the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 150 can be arranged in the processor 110. In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 can be arranged in the same device.

[0133] The modem processor can include a modulator and a demodulator. The modulator is used to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal processed by the baseband processor is transmitted to the application processor. The application processor outputs a sound signal through a voice device (not limited to the loudspeaker 170A, the microphone 170B, etc.), or displays an image or a video through the display screen 194. In some embodiments, the modem processor can be an independent device. In some other embodiments, the modem processor can be independent of the processor 110, and arranged in the same device as the mobile communication module 150 or other functional modules.

[0134] The wireless communication module 160 can provide a solution for wireless communication including wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. applied to the terminal 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency-modulates and filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 can also receive signals to be transmitted from the processor 110, frequency-modulate them, amplify them, and radiate them as electromagnetic waves via the antenna 2.

[0135] In some embodiments, antenna 1 and mobile communication module 150 of terminal 100 are coupled, and antenna 2 and wireless communication module 160 are coupled, so that terminal 100 can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include global positioning system (GPS), global navigation satellite system (GLONASS), beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).

[0136] Terminal 100 implements a display function through a GPU, display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, connected to display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations, for graphics rendering. Processor 110 can include one or more GPUs that execute program instructions to generate or change display information.

[0137] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a Micro Led, a Micro-oLed, a quantum dot light emitting diodes (QLED), etc. In some embodiments, the terminal 100 can include one or N display screens 194, and N is a positive integer greater than 1.

[0138] The digital signal processor is used to process digital signals, which can process digital image signals and other digital signals. For example, when the terminal 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0139] The video codec is used to compress or decompress digital videos. The terminal 100 can support one or more video codecs. In this way, the terminal 100 can play or record videos in multiple encoding formats, such as moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0140] The NPU is a neural-network (NN) calculation processor, which can quickly process input information by referring to the structure of a biological neural network, such as the transmission mode between human brain neurons, and can also constantly self-learn. Through the NPU, intelligent cognitive applications of the terminal 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0141] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize data storage functions. For example, music, video, etc. files are saved in the external memory card.

[0142] The internal memory 121 can be used to store computer executable program codes including instructions. The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.), and the like. The data storage area can store data created during use of the terminal 100 (such as voice data, a phone book, etc.), and the like. In addition, the internal memory 121 can include a high-speed random access memory, and can further include a non-volatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like. The processor 110 executes various function applications and data processing of the terminal 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory disposed in the processor.

[0143] The terminal 100 can implement a voice function through a voice module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, an application processor, and the like. For example, music playing, voice recording, and the like.

[0144] The voice module 170 is used to convert digital voice information into an analog voice signal output, and is also used to convert an analog voice input into a digital voice signal. The voice module 170 can also be used to encode and decode voice signals. In some embodiments, the voice module 170 can be disposed in the processor 110, or part of the voice module 170 can be disposed in the processor 110.

[0145] The speaker 170A, also referred to as a "loudspeaker", is used to convert a voice electrical signal into a sound signal. The terminal 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0146] The receiver 170B, also referred to as an "earpiece", is used to convert a voice electrical signal into a sound signal. When the terminal 100 answers a call or a voice message, the voice can be heard by placing the receiver 170B close to the ear.

[0147] The microphone 170C, also referred to as a "microphone", "sound transducer", is used to convert a sound signal into an electrical signal. When making a call or sending a voice message, the user can make a sound by placing the mouth close to the microphone 170C, and input the sound signal into the microphone 170C. The terminal 100 can be provided with at least one microphone 170C. In other embodiments, the terminal 100 can be provided with two microphones 170C, in addition to collecting sound signals, noise reduction functions can also be achieved. In other embodiments, the terminal 100 can also be provided with three, four or more microphones 170C, to achieve the functions of collecting sound signals, noise reduction, and identifying the source of the sound, and implementing directional recording functions, etc.

[0148] The earphone interface 170D is used to connect a wired earphone. The earphone interface 170D can be a USB interface 130, or a 3.5 mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0149] The keys 190 include a power-on key, a volume key, and the like. The keys 190 can be mechanical keys. Alternatively, the keys 190 can be touch keys. The terminal 100 can receive key input, and generate key signal input related to user settings and function control of the terminal 100.

[0150] The indicator 192 can be an indicator light, and can be used to indicate a charging state, a power change, or a message, a missed call, a notification, and the like.

[0151] Before introducing the present application, the terms related to the present application are first explained.

[0152] 1, driver monitoring system (DMS)

[0153] The driver monitoring system is a system for monitoring the state of a driver in a vehicle based on image processing technology, voice processing technology, and the like, and includes a DMS camera installed in a cabin of the vehicle and a DMS processor. The DMS camera can capture an image including a face and a head of the driver, and the DMS processor processes the captured image of the face or the head to obtain a height difference between a target point of the head of the driver and a mounting position of the DMS camera, and can also obtain an included angle (which can also be referred to as a "pitch angle of the eyes of the driver") between a gaze direction of the eyes of the driver and the ground.

[0154] 2, parameters of the build point (pitch angle, azimuth angle, field of view, horizontal position of the build point, and vertical position of the build point, and the like)

[0155] In the related art, a terminal constructs a virtual scene with a build point, which can also be referred to as a "virtual camera" (which can be simply referred to as a "camera"), and the build point can also be referred to as a "virtual camera" (which can be simply referred to as a "camera").

[0156] Figure 2 A schematic diagram of various parameters of a camera in a virtual scene is shown. In the related art, a terminal constructs a virtual scene with a build point, which can also be referred to as a "virtual camera" (which can be simply referred to as a "camera"), and the build point can also be referred to as a "virtual camera" (which can be simply referred to as a "camera"). Figure 2In the coordinate system, the center point of the vehicle is taken as the origin O, the left direction of the vehicle is taken as the X axis, the opposite direction of the driving direction of the vehicle is taken as the Y axis, and the vertical direction of the road surface is taken as the Z axis. In the coordinate system, the XOY plane is the ground, and the focal point of the virtual camera is the vehicle. As shown in FIG. 1, the pitch angle of the virtual camera refers to the included angle between the line connecting the virtual camera and the vehicle and the ground (XOY plane). The azimuth angle of the virtual camera refers to the included angle between the vertical projection point of the virtual camera on the ground and the line connecting the vehicle and the ZOY plane. The vertical position of the virtual camera can be obtained by the height of the virtual camera from the ground, and the horizontal position of the virtual camera can be obtained by the length of the vertical projection point of the virtual camera on the ground from the ZOY plane. The field of view angle refers to the range of the field of view that can be covered by the virtual camera when constructing the virtual scene. Figure 2

[0157] In order to facilitate understanding of the present application, the application scenarios 300 related to the embodiments of the present application are introduced as follows. Figure 3 The application scenarios 300 related to the embodiments of the present application are introduced as follows.

[0158] Figure 3 A schematic diagram of the application scenario 300 of the embodiments of the present application is shown. The application scenario includes a target vehicle 301, a vehicle driven by a driver (hereinafter can be referred to as "self-driving vehicle") 302, and a terminal 303 located in the self-driving vehicle 302. The terminal 303 displays a virtual scene interface, which includes a virtual icon 304 of the target vehicle and a virtual icon 305 of the self-driving vehicle.

[0159] Optionally, the terminal 303 can obtain the position information of the self-driving vehicle 302 and the road section information in which the self-driving vehicle 302 is located by acquiring the positioning information of the self-driving vehicle 302, and the terminal 303 can collect the position information of the target vehicle 301 in front of the self-driving vehicle 302 through the sensor system of the self-driving vehicle 302. The terminal 303 constructs a virtual scene based on the position information of the self-driving vehicle 302, the road section information in which the self-driving vehicle 302 is located, and the position information of the target vehicle 301 with preset construction parameters, and displays the virtual scene interface as shown in the terminal 303, and the construction parameters include the pitch angle of the construction point, the azimuth angle of the construction point, the field of view of the construction point, and the position of the construction point.

[0160] It should be understood that the terminal 303 described above can be the vehicle itself, or a central control platform installed in the self-driving vehicle 302, or other terminals capable of transmitting data with the sensor system and the positioning system in the self-driving vehicle 302 and having the functions of constructing and displaying a virtual scene, for example, a mobile phone or a tablet computer, which is not limited in the present application.

[0161] ​In the related art, when constructing a virtual scene, the terminal constructs the virtual scene through preset values of various parameters of a construction point, and a view angle corresponding to the construction point is a view angle of the virtual scene (hereinafter referred to as "scene view angle"). Different drivers may have different heights, and the positions of the eyes of the drivers may be different. The position of the eyes of the same driver may also be different when the driver is in different postures, that is, the driver view angle may have multiple changes, but the scene view angle is still the view angle corresponding to the preset parameters. In this case, the terminal cannot flexibly change along with the change of the driver view angle when displaying the virtual scene, and the scene view angle and the driver view angle may not match, and the driver sees the distance between the objects around the vehicle and the vehicle on the display screen of the terminal to be shorter than the actual distance between the objects around the vehicle and the vehicle in the actual scene.

[0162] Exemplarily, when the driver is in a first view angle (the height of the head target point of the driver from the ground is 130 cm) or a second view angle (the height of the head target point of the driver from the ground is 140 cm), the display interface of the terminal is as shown in the display interface of the terminal 303, and the visual distance between the virtual icon 304 of the target vehicle and the virtual icon 305 of the self-driving vehicle always remains unchanged. Figure 3

[0163] Therefore, the present application provides a screen display method and device. When the driver view angle changes, the distance between the virtual icon of the target object displayed on the terminal and the virtual icon of the self-driving vehicle also changes, wherein when the height of the target point of the head of the driver from the ground increases, the distance between the target object and the self-driving vehicle displayed on the terminal becomes longer, and vice versa. In this way, when displaying the virtual scene, the terminal can display pictures of different angles based on different driver view angles, improve the flexibility of the terminal in displaying the virtual scene, make the scene view angle and the driver view angle more matched, improve the accuracy of the driver's perception of the distance of the objects in the actual scene, and further improve the driving experience of the user.

[0164] The technical solutions of the present application and how the technical solutions of the present application solve the above technical problems will be described in detail below with specific embodiments. The following specific embodiments can be implemented independently or in combination. For the same or similar concepts or processes, some embodiments may not be described again.

[0165] Figure 4 FIG. 4 is a schematic flowchart of a screen display method 400 provided by an embodiment of the present application. The method 400 can be executed by a terminal.

[0166] The method 400 can include the following steps:

[0167] ​S401, at the first time, the terminal displays a first interface, the first interface comprising a first virtual icon of a vehicle driven by the driver and a second virtual icon of a target object, in the first interface, the distance between the first virtual icon and the second virtual icon is a first length, at the first time, the height of the target point of the head of the driver from the ground is a first height.

[0168] It should be understood that the target object can be a vehicle, an obstacle, a pedestrian, or an icon on the road surface that remains relatively stationary with the vehicle driven by the driver, which is not limited in the present application.

[0169] It should also be understood that the first length can refer to the absolute distance of the first virtual icon and the second virtual icon, or the vertical distance of the first virtual icon and the second virtual icon in the driving direction in the virtual scene, which is not limited in the present application.

[0170] Optionally, the target point of the head of the driver can be any point of the facial key point of the driver. For example, the facial key point can be the center point of the pupil of any eye, the midpoint of the line connecting the two eyes, the point of the tip of the nose, etc., which is not limited in the present application.

[0171] Optionally, at the first time, when the upper body of the driver is in a relaxed state, the waist and back of the driver are in a slightly curved state, and the first height can be the height of the target point of the head of the driver from the ground in the relaxed state of the driver.

[0172] It should be understood that when the driver is in different postures, the position of the target point of the head can be different, and the height of the target point of the head from the ground can also be different, i.e. the first height can be different. For example, the head position when the upper body of the driver is in a relaxed state is lower than the head position when the upper body of the driver is in a straight state, and the position of the target point of the head from the ground is also lower.

[0173] Optionally, the terminal obtains the position information of the vehicle of the driver and the road section information in which the vehicle of the driver is located by obtaining the positioning information of the vehicle of the driver. The terminal can collect the position information of the target object in front of the vehicle of the driver through the sensor system of the vehicle of the driver. The terminal constructs a first virtual scene based on the position information of the vehicle of the driver, the road section information in which the vehicle of the driver is located, and the position information of the target object. Among them, the vehicle of the driver in the virtual scene can be represented by the first virtual icon, and the target object in the virtual scene can be represented by the second virtual icon. After the terminal constructs the first virtual scene, the first interface is displayed, the pitch angle in the construction parameter is a first pitch angle, the field of view angle is a first field of view angle, the azimuth angle is a first azimuth angle, and the position of the construction point is a first position.

[0174] It should be understood that the construction parameter can also be referred to as a parameter of the construction point.

[0175] It should also be understood that the terminal displaying the first interface can be displayed on the display screen of the terminal, or projected on the windshield in front of the driver in the form of a head-up display (HUD), and the present application does not limit this.

[0176] S402, at the second time, the terminal displays a second interface, the second interface includes a first virtual icon and a second virtual icon, and the distance between the first virtual icon and the second virtual icon in the second interface is a second length, and at the second time, the height of the target point of the head of the driver from the ground is a second height.

[0177] Specifically, the second time is later than the first time, and between the first time and the second time, the vehicle and the target object are relatively static, the second height is greater than the first height, and the second length is greater than the first length.

[0178] It should be understood that the second length refers to the absolute distance between the first virtual icon and the second virtual icon, or can refer to the vertical distance of the first virtual icon and the second virtual icon in the driving direction in the virtual scene, and the present application does not limit this.

[0179] Optionally, at the second time, the upper body of the driver can be in an upright state. The second height can be the height of the target point of the head of the driver from the ground when the upper body of the driver is in the upright state.

[0180] Optionally, the target object and the vehicle driven by the driver remain relatively static, including the following two possible cases.

[0181] Case 1, the target object and the vehicle driven by the driver move at the same speed and in the same direction. For example, the target object is a target vehicle detected by the vehicle driven by the driver, the target vehicle travels in front of the vehicle driven by the driver, and the target vehicle and the vehicle driven by the driver move forward at a first speed, and the target vehicle also moves forward at the first speed.

[0182] Case 2, the target object and the vehicle driven by the driver are both in a static state. For example, the target object is a target vehicle detected by the vehicle driven by the driver, the target vehicle travels in front of the vehicle driven by the driver, and the target vehicle and the vehicle driven by the driver are both in a static state.

[0183] It should be understood that the terminal displays the second interface in a similar manner to the above-mentioned display of the first interface, which will not be described here.

[0184] The screen display method provided in the application can increase the distance between the virtual icon of the target object displayed on the terminal and the virtual icon of the vehicle driven by the driver when the height of the target point of the head of the driver from the ground is increased, that is, the distance between the virtual icon of the target object displayed on the terminal and the virtual icon of the vehicle driven by the driver changes when the driver's perspective changes. In this way, the terminal can display pictures of different angles based on different driver perspectives when displaying a virtual scene, improve the flexibility of the terminal in displaying a virtual scene, make the scene perspective (the perspective corresponding to the construction point) more matched with the driver's perspective, improve the accuracy of the driver's distance perception of objects in the actual scene, and further improve the driving experience of the user.

[0185] Figure 5 The interface change schematic diagram of the terminal display interface changing with the driver's perspective is shown. In Figure 5 , the target object is a front vehicle (i.e., a target vehicle) detected by a self-driving vehicle. At a first time, the upper body of the driver is in a relaxed state, and the waist and back of the driver are in a slightly curved state. In this relaxed state, the height of the target point of the head of the driver from the ground is a first height (i.e., the driver is in a first perspective). At this time, the terminal displays Figure 5 the interface a shown in the interface a. In Figure 5 , the absolute distance between the virtual icon 304 of the target vehicle and the virtual icon 305 of the self-driving vehicle is a first distance. At a second time, the upper body of the driver is in an upright state, and the waist and back of the driver are in a straight state. In this upright state, the height of the target point of the head of the driver from the ground is a second height (i.e., the driver is in a second perspective). At this time, the terminal displays Figure 5 the interface b shown in the interface b. In Figure 5 , the absolute distance between the virtual icon 304 of the target vehicle and the virtual icon 305 of the self-driving vehicle is a second distance, and the second distance is greater than the first distance.

[0186] As an optional embodiment, before S401, the terminal needs to determine the angle between the gaze direction of the eyes of the driver and the ground, and then determine the first pitch angle.

[0187] In the embodiment of the application, the terminal can determine the first pitch angle through a plurality of possible implementation manners.

[0188] In a possible implementation manner, the terminal determines a first distance between a first position and a second position, the first position being the vertical projection point of the target point of the head of the driver on the ground, and the second position being the gaze position prediction point of the eyes of the driver on the road surface; and determines the first pitch angle based on the first height and the first distance.

[0189] Optionally, the terminal can determine the angle between the gaze direction of the driver's eyes and the ground based on the first height and the first distance, and determine the angle as the first pitch angle of the construction point.

[0190] Illustratively, the height (first height) of the target point of the driver's head from the ground can be H1, and the distance (first distance) from the vertical projection point of the target point of the driver's head on the ground to the gaze position prediction point of the driver's eyes on the road surface can be L1. The terminal determines the angle θ between the gaze direction of the driver's eyes and the ground based on the first height and the first distance, and determines the angle as the first pitch angle θ0 of the construction point. h h .

[0191] By determining the angle between the gaze direction of the driver's eyes and the ground as the pitch angle (first pitch angle) of the construction point, the pitch angle of the corresponding view angle of the construction point can be made to match the pitch angle of the driver's view angle more closely, thereby improving the accuracy of the driver's distance perception of objects in the actual scene.

[0192] It should be understood that when the driver is driving the vehicle, the gaze point of the driver's eyes will usually fall at a position that is a predetermined distance away from the vehicle. Depending on the speed of the vehicle or the type of road segment on which the vehicle is located, the gaze point of the driver's eyes will be different, and the corresponding first distance will also be different.

[0193] Optionally, the terminal can determine the first distance (i.e., the distance from the vertical projection point of the target point of the driver's head on the ground to the gaze position prediction point of the driver's eyes on the road surface) in the following two ways.

[0194] Method 1: The terminal determines a target speed range to which the current speed of the vehicle belongs from a plurality of speed ranges; and determines the first distance based on the target speed range and a first correspondence relationship, the first correspondence relationship including a correspondence relationship between a plurality of speed ranges and a plurality of distances.

[0195] It should be understood that there is no intersection between the plurality of speed ranges, i.e., a speed belongs to only one speed range.

[0196] Illustratively, the first correspondence relationship can be as shown in Table 1. When the current speed is 60 km / h, the terminal obtains the first distance as 15 m by looking up the table.

[0197] Table 1

[0198] Vehicle speed range (km / h) Distance (m) [0~60) 10 [60~100) 15 [100~180) 25

[0199] ​The first distance is determined by the vehicle speed range corresponding to the vehicle speed, and the determined first distance is more in line with the visual perception of the driver at different vehicle speeds when driving the vehicle, thereby improving the accuracy of the first distance.

[0200] In mode 2, the terminal determines a target road section type of a road section currently passed through by the vehicle according to the current position of the vehicle, the target road section type being a highway road section or an urban road section; and determines the first distance based on the target road section type and a second correspondence relationship, the second correspondence relationship including a correspondence relationship between a plurality of road section types and a plurality of distances.

[0201] For example, the second correspondence relationship can be as shown in Table 2. The terminal first acquires the position information of the vehicle, determines the road section type of the road section currently passed through by the vehicle according to the position information of the vehicle, and obtains the first distance as 25 m by table lookup in a case where the current road section type is a highway road section.

[0202] Table 2

[0203] Road segment type Distance (m) Urban road segment 10 Highway road segment 25

[0204] It should be understood that the road section types described above can also include national road sections and rural road sections, and the developer can divide the road sections into various road section types according to actual conditions, which is not limited in the present application.

[0205] The first distance is determined by the road section type, and the determined first distance is more in line with the visual perception distance of the driver when driving the vehicle on different road sections, thereby improving the accuracy of the first distance.

[0206] In another possible implementation, the terminal determines the first pitch angle by a detection device.

[0207] Optionally, the terminal determines the first pitch angle by a DMS configured for the vehicle.

[0208] Specifically, the terminal and the DMS can communicate through wireless connection or wired connection, the camera in the DMS can capture the head image of the driver in real time, the processor in the DMS can analyze and process the head image to obtain the angle between the gaze direction of the eyes of the driver and the ground, and send the angle as the first pitch angle to the terminal.

[0209] Optionally, the terminal can further determine the first distance after determining the first pitch angle.

[0210] Specifically, the processor in the DMS analyzes the head image of the driver taken by the camera in the DMS, and can also determine the height difference between the head target point of the driver and the installation position of the camera in the DMS. The processor in the DMS determines the sum of the height difference and the installation height of the DMS camera as the height of the head target point of the driver from the ground (i.e., the first height). According to the first height and the first pitch angle, the distance (i.e., the first distance) from the vertical projection point of the head target point of the driver on the ground to the predicted gaze position point of the driver's eyes on the road surface is determined.

[0211] Exemplarily, Figure 6 A schematic diagram for calculating the first distance is shown. In Figure 6 , the plane where the line connecting the vertical projection point E' of the head target point of the driver (i.e., the first position) and the gaze point Z of the driver (i.e., the second position) is located is the ground, and the line segment E'Z is the first distance. The detection device is the camera S in the DMS, the installation height (the height of the installation position from the ground) of the camera S is h1, the height difference between the head target point E of the driver and the camera S is h2, and the included angle between the gaze direction of the driver's eyes and the ground is θ h . The terminal adds the installation height h1 of the camera in the DMS and the height difference h2 to obtain the height of the head target point of the driver from the ground (i.e., the first height) H1 = h1 + h2. The terminal calculates the length L1 = H1 / tan(θ h ) of the first distance.

[0212] By determining the first pitch angle through the detection device, the distance (i.e., the first distance) from the vertical projection point of the head target point of the driver on the ground to the predicted gaze position point of the driver's eyes on the road surface is further determined, which is closer to the actual perception distance of the driver, and is beneficial to improve the accuracy of the first distance.

[0213] As an optional embodiment, the above method further comprises: constructing the height of the point from the ground, and the terminal determines the height of the point from the ground based on the second distance between the first position and the third position, the first distance, and the first pitch angle, the third position being the vertical projection point of the point on the ground.

[0214] Specifically, the height of the point from the ground can also be referred to as the vertical position of the point.

[0215] Optionally, the second distance can be a preset value. The terminal first calculates the sum of the second distance and the first distance, and calculates the height of the point from the ground based on the sum value and the first pitch angle.

[0216] Exemplarily, Figure 7 A schematic diagram for calculating the height of the point from the ground is shown. As Figure 7As shown, the plane where the line connecting the vertical projection point E' of the driver head target point E on the ground and the driver gaze point Z is located is the ground. The distance (i.e., the first distance) between the vertical projection point E' of the driver head target point on the ground and the driver gaze point Z is L1, and the distance (i.e., the second distance) between the vertical projection point E' of the driver head target point on the ground and the vertical projection point G2 of the construction point on the ground is L2. The terminal calculates the angle θ between the gaze direction of the driver's eyes and the ground h Then, the angle between the gaze direction of the driver's eyes and the ground is taken as the first pitch angle θ0 of the construction point, i.e., θ0 = θ h The terminal calculates the height H2 of the construction point from the ground based on the first distance, the second distance, and the first pitch angle, i.e., H2 = (L1 + L2) tan(θ0).

[0217] Optionally, the dashed circle is an initial position point G0 of the construction point. After the terminal determines the height H2 of the construction point from the ground, the terminal adjusts the height of the corrected construction point from the ground to H2, and the corrected position of the construction point is as shown in Figure 7 the corrected position point G1 of the construction point.

[0218] In the embodiments of the present application, the pitch angle (the first pitch angle) of the construction point is the same as the pitch angle of the driver's visual angle (the angle between the gaze direction of the driver's eyes and the ground), and the vertical position of the construction point determined based on the second distance, the first distance, and the first pitch angle is on the line connecting the target point of the driver's head to the gaze position of the driver's eyes, so that the visual angle of the construction point is more matched with the visual angle of the driver, and the accuracy of the driver's distance perception of objects in the actual scene is improved.

[0219] As an optional embodiment, the terminal determining the horizontal position of the construction point includes the following multiple implementation manners.

[0220] In a possible implementation manner, the position of the construction point is the horizontal position of the construction point, and the method further includes: the terminal determining a third distance between a fourth position and a fifth position, the fourth position being a display center point of the first interface in the vehicle, and the fifth position being determined based on the target point of the driver's head and the fourth position; the terminal determining a fourth distance between the fifth position and the target point of the driver's head; the terminal determining a first azimuth angle based on the third distance and the fourth distance; and the terminal determining the horizontal position of the construction point based on the first azimuth angle.

[0221] The horizontal position of the construction point is determined based on the positional relationship between the target point of the driver's head and the display center point, and the horizontal position of the construction point obtained is more matched with the horizontal position of the driver's visual angle, and the accuracy of the driver's distance perception of objects in the actual scene is improved.

[0222] It should be understood that the first interface is displayed on the display screen of the terminal, and the display center point of the first interface in the vehicle can be the center point of the window corresponding to the first interface. In the case where the window corresponding to the first interface covers the display screen, the display center point of the first interface in the vehicle is not the center point of the display screen. In the case where the window corresponding to the first interface does not cover the display screen, the display center point of the first interface in the vehicle is the center point of the display screen.

[0223] Optionally, the terminal can determine the first azimuth angle based on the tangent relationship between the third distance and the fourth distance.

[0224] Exemplarily, Figure 8 A schematic diagram for calculating the first azimuth angle is shown. In Figure 8 In the coordinate system, the driving direction of the vehicle is taken as the Y axis, the right direction of the driving direction of the vehicle is taken as the X axis, and the vertical direction of the road surface is taken as the Z axis. The vertical projection point of the driver's head target point E on the XOY plane is taken as the origin O of the coordinate system. The display center point A is the display position of the display screen (i.e., the fourth position described above, which can be the midpoint of the display screen of the center control platform, for example). This position can be represented by the coordinates A(x1, y1, 0). The driver's head target point E can be represented by E(0, 0, z2). The fifth position (which can be a point of the dashboard in front of the driver, for example) determined by the driver's head target point E and the display center point A is F(0, y1, 0). The plane on which the line connecting the fifth position F and the display center point A is located is a horizontal plane parallel to the ground. The line connecting the fifth position F and the driver's head target point E is perpendicular to the line connecting the fifth position F and the display center point A (i.e., EF is perpendicular to FA). The distance between the fifth position F and the display center point A (i.e., the third distance) is L3, and the distance between the fifth position F and the driver's head target point E (i.e., the fourth distance) is L4. The terminal calculates the first azimuth angle a based on the third distance and the fourth distance. h = arctan(L3 / L4).

[0225] For ease of observation, Figure 9 A top view of Figure 8 is shown. As shown in Figure 9 the line connecting the fifth position F and the driver's head target point E is perpendicular to the line connecting the fifth position F and the display center point A (i.e., EF is perpendicular to FA). The distance between the fifth position F and the display center point A (i.e., the third distance) is L3, and the distance between the fifth position F and the driver's head target point E (i.e., the fourth distance) is L4. The terminal calculates the first azimuth angle a based on the third distance and the fourth distance. h = arctan(L3 / L4).

[0226] Optionally, the initial azimuth angle of the construction point can be 0. The terminal adjusts the initial azimuth angle of the construction point to the first azimuth angle. The terminal determines the horizontal position of the construction point by: keeping the focus of the construction point unchanged, rotating the line connecting the initial position of the construction point and the focus of the construction point by the first azimuth angle to obtain the corrected position of the construction point, which includes the horizontal position of the construction point.

[0227] Figure 10 A schematic diagram illustrating how to determine the horizontal position of a construction point is shown. For example... Figure 10 As shown, the driver's seat of the vehicle is on the left. The initial position G of the construction point and the focus C of the construction point are on the centerline of the vehicle. When the construction point is at the initial position G, the azimuth angle of the construction point is 0. The center of the dashed circle is the focus C, and the radius is CG. The terminal can determine the horizontal position of the construction point by rotating the line connecting the construction point G and the focus C around the focus C by a first azimuth angle α. h The corrected position G' of the construction point is obtained, and the azimuth angle of the corrected construction point is α. h .

[0228] By keeping the focal point of the construction point unchanged, and adjusting the horizontal position and azimuth angle based on the driver's perspective, the determined perspective of the construction point is the same as the driver's perspective in terms of horizontal position, focal point, and azimuth angle. The determined perspective of the construction point is more in line with the driver's perspective, which helps to improve the accuracy of the driver's perception of the distance of objects in the actual scene.

[0229] Alternatively, the terminal may determine the third distance in the following two ways.

[0230] Method 1: The terminal determines the third distance based on the vehicle model and the third correspondence relationship. The third correspondence relationship includes the correspondence relationship between multiple vehicle models and multiple distances.

[0231] For example, the third correspondence can be as shown in Table 3. When the current vehicle model is XXX1, the terminal obtains the third distance as 30cm by looking up the table.

[0232] Table 3

[0233] Vehicle speed range (km / h) Distance (cm) XXX1 30 XXX2 28 XXX3 45

[0234] It should be understood that, in method 1, the terminal can be the vehicle's central control platform. The distance between the central control platform and the instrument panel varies depending on the vehicle model.

[0235] The third distance is determined by the correspondence between vehicle model and third distance. The determined third distance is suitable for different vehicles, which helps to improve the accuracy of the third distance.

[0236] In the second mode, the terminal detects the position of the target point of the driver's head through the detection device, determines a fifth position based on the target point of the driver's head and the fourth position, and calculates the third distance between the fourth position and the fifth position.

[0237] It should be understood that the terminal detects the position of the target point of the driver's head through the detection device in the same way as the terminal detects the position of the gaze point of the driver's eyes on the ground through the detection device, which will not be described here.

[0238] Optionally, the position of the target point of the driver's head, the fourth position, and the fifth position can be coordinate points in the same coordinate system, and the terminal calculates the third distance according to the coordinate values of the coordinate points.

[0239] For example, the position of the target point of the driver's head can be a coordinate point E(0, 0, z2), the position of the fourth position (the display center point) can be A(x1, y1, 0), the terminal determines the coordinate point of the fifth position as F(0, y1, 0) based on E(0, 0, z2) and A(x1, y1, 0), and the third distance L 3= x1-0=x1.

[0240] The third distance determined by the detection device is more consistent with the actual perception distance of the driver, which is beneficial to improve the accuracy of the first distance.

[0241] In another possible implementation, the position of the construction point is the horizontal position of the construction point, and the method further includes: the terminal determines a third distance between the fourth position and the fifth position, the fourth position being a display center point of the first interface in the vehicle, and the fifth position being determined based on the target point of the driver's head and the fourth position; and the terminal determines the horizontal position of the construction point based on the third distance.

[0242] Optionally, the terminal obtains the corrected horizontal coordinate value of the construction point by adding the length of the third distance to the horizontal coordinate value of the coordinate point of the initial position of the construction point, and the corrected horizontal coordinate value of the construction point is the horizontal position of the construction point.

[0243] It should be understood that the coordinate point of the initial position of the construction point refers to the position of the construction point before the correction of the construction point parameter, and the coordinate point of the initial position of the construction point is on a plane where a center line of the vehicle is located, and the plane where the center line is located is perpendicular to the ground.

[0244] For example, Figure 11 Another schematic diagram for determining the horizontal position of the construction point is shown. As Figure 11As shown, the driving position of the vehicle is on the left side, the initial position G of the construction point and the focal point C of the construction point are on the center line of the vehicle, and the azimuth angle of the construction point is 0 when the construction point is at the initial position G. The method for the terminal to determine the horizontal position of the construction point can be: moving the construction point from the initial position G to the left by a length of L3 to obtain a corrected position G' of the construction point. The focal point of the corrected construction point is the focal point C', and the azimuth angle is still 0.

[0245] The horizontal position of the construction point is adjusted by the third distance, and the adjusted construction point is more consistent with the actual perception distance of the driver in the horizontal direction, thereby improving the accuracy of the horizontal position of the construction point.

[0246] As an optional embodiment, the above method further includes: at a third time, the terminal displays a third interface, the third interface includes the first virtual icon and a target navigation icon displayed in a first style, at the third time, the target point of the head of the driver is at a third height from the ground; at a fourth time, the terminal displays a fourth interface, the fourth interface includes the first virtual icon and a target navigation icon displayed in a second style, at the fourth time, the target point of the head of the driver is at a fourth height from the ground; wherein the fourth time is later than the third time, the fourth height is different from the third height, and the second style is different from the first style.

[0247] Optionally, the terminal constructs the second virtual scene based on the first virtual icon, the target navigation icon displayed in the first style, the position of the vehicle, the second pitch angle of the construction point of the second virtual scene, the position of the construction point, the field of view angle of the construction point, and the first azimuth angle of the construction point, and displays the third interface.

[0248] It should be understood that the terminal displays the third interface in a similar manner to the terminal displaying the first interface, which will not be described here. The difference between the terminal displaying the third interface and the terminal displaying the first interface is that the third interface further includes the target navigation icon.

[0249] Optionally, the resource library of the terminal stores a plurality of navigation icons, and the terminal obtains the target navigation icon based on the current positioning information of the vehicle. The terminal determines the second pitch angle based on the third height, determines the actual projection angle of the target navigation icon in the second virtual scene based on the second pitch angle, and obtains the first style of the target navigation icon after the terminal projects the target navigation icon at the actual projection angle; the terminal displays the first style of the target navigation.

[0250] It should be understood that the terminal determines the second pitch angle in the same manner as the terminal determines the first pitch angle described above, which will not be described here.

[0251] Exemplarily, the terminal determines that the vehicle is about to change lanes based on the steering indication of the vehicle, and obtains a vehicle shape frame icon displayed after the vehicle changes lanes from the resource library. The terminal can determine the display position and projection angle of the vehicle shape frame icon in the virtual scene after the vehicle changes lanes based on the current positioning information of the vehicle and the current speed of the vehicle. The terminal generates a first style of the vehicle shape frame icon based on the projection angle of the vehicle shape frame icon, and displays the first style of the vehicle shape frame icon in the virtual scene.

[0252] It should also be understood that the terminal determines the second style of the target navigation in the same way as the terminal determines the first style of the target navigation, and the terminal displays the fourth interface in the same way as the terminal displays the third interface, which will not be described here.

[0253] Optionally, the first style of the target navigation icon and the second style of the target navigation icon are both styles obtained by scaling up or down based on the original style of the target navigation icon. The first style of the target navigation icon is smaller than the second style of the target navigation icon.

[0254] Exemplarily, Figure 12 An interface change schematic diagram showing changes of the navigation icon with the driver's visual angle is shown. At the third time, the upper body of the driver is in a relaxed state, the waist and back of the driver are slightly bent, in the relaxed state, the height of the head target point of the driver from the ground is a third height, at this time, the terminal displays Figure 12 the interface a shown in the figure. In the interface a shown in the figure Figure 12 , the visual distance between the target navigation icon and the virtual icon of the driver's vehicle is a third distance. At the fourth time, the upper body of the driver can be in a straight state. In the straight state, the height of the head target point of the driver from the ground becomes a fourth height. At this time, the terminal displays Figure 12 the interface b shown in the figure, and in the interface b shown in the figure Figure 12 , the visual distance between the target navigation icon and the virtual icon of the driver's vehicle is a fourth distance, which is greater than the third distance.

[0255] By changing the style of the target navigation icon displayed on the terminal when the height of the head target point of the driver from the ground is high, that is, by changing the style of the target navigation icon displayed on the terminal when the visual angle of the driver changes, the terminal can display the target navigation icon in different styles according to different visual angles of the driver. In this way, when the terminal displays the virtual scene, on the one hand, the style of the navigation icon displayed by the terminal is more consistent with the actual style of the navigation icon, which is conducive to improving the accuracy of the driver's cognition of the navigation icon; on the other hand, the terminal can display pictures in different angles based on different visual angles of the driver, which improves the flexibility of the terminal in displaying the virtual scene, makes the projection angle of the target navigation icon more matched with the visual angle of the driver, and further improves the driving experience of the user.

[0256] As an optional embodiment, the method further comprises: determining, by the terminal, a projection correction angle of the target navigation icon in the second virtual scene; determining, by the terminal, an actual projection angle of the target navigation icon in the second virtual scene based on the second pitch angle and the correction angle; and projecting, by the terminal, the target navigation icon at the actual projection angle to obtain the target navigation icon displayed in the first style.

[0257] Optionally, the terminal determines a sum of the second pitch angle and the correction angle as the actual projection angle of the target navigation icon in the second virtual scene.

[0258] Optionally, the terminal determines the projection correction angle in the following multiple implementation manners.

[0259] In a possible implementation manner, the terminal determines the projection correction angle based on the second pitch angle and a fourth correspondence relationship, the fourth correspondence relationship comprising a correspondence relationship between multiple pitch angles and multiple angles.

[0260] Optionally, the pitch angle and the correction angle are in an inverse proportional relationship, that is, the greater the pitch angle, the smaller the correction angle.

[0261] Exemplarily, the fourth correspondence relationship can be as shown in Table Four. When the pitch angle is 15°, the terminal obtains the correction angle of 1° by looking up the table.

[0262] Table Four

[0263] Pitch angle Correction angle 5° 4° 10° 2° 15° 1°

[0264] In another possible implementation manner, the terminal determines the projection correction angle based on a target distance and a first preset threshold value, the target distance being a distance between a position of the target navigation icon in the second virtual scene and a position of the vehicle in the second virtual scene.

[0265] Optionally, in a case where the target distance is greater than or equal to the first preset threshold value, the projection correction angle is a negative value; and in a case where the target distance is less than the first preset threshold value, the correction angle is a positive value.

[0266] Exemplarily, in a case where the target distance is greater than or equal to 25 m, the projection correction angle is –2°; and in a case where the target distance is less than 25 m, the projection correction angle is +2°.

[0267] By setting the first preset threshold value, it is determined whether the correction angle is a positive angle correction or a negative angle correction according to a size relationship between the target distance and the first preset threshold value, thereby improving the accuracy of the projection correction angle.

[0268] In yet another possible implementation manner, the projection correction angle is a preset angle. For example, the projection correction angle can be 5°.

[0269] Figure 13The diagram shows the projection effects of navigation icons under different scene perspectives and projection correction angles. For example... Figure 13 As shown, Figure 13 The interface shows the display effect of navigation icons when the projection correction angles are -2°, 0°, and +2°, respectively, with the scene view angles a, d, and g being 5°. Figure 13 The interface b, e, and h represent the scene's viewpoint with a tilt angle of 10°. The display effect of the navigation icons is shown when the projection correction angles are -2°, 0°, and +2°, respectively. Figure 13 The interface, where c, f, and i represent the scene's viewpoint with a tilt angle of 15°, shows the display effect of the navigation icons when the projection correction angles are -2°, 0°, and +2°, respectively. Figure 13 In the interface shown (a), the target navigation icon is a car-shaped frame icon. The position of this car-shaped frame icon indicates the location the driver's vehicle will arrive at at a future time. In this virtual scene, the target navigation icon in the left lane is 15m away from the driver's vehicle icon (target distance), and the target navigation icon displays the first style. The target navigation icon in the middle lane is 20m away from the driver's vehicle icon (target distance), and the target navigation icon displays the second style. The target navigation icon in the right lane is 25m away from the driver's vehicle icon (target distance), and the target navigation icon displays the third style. Figure 13 The display of interfaces b to i shown is... Figure 13 The display styles of interface a shown are similar and will not be elaborated upon here. The only differences lie in the pitch angle of the scene view corresponding to the different interfaces or the projection correction angle corresponding to the display style of the target navigation icon. By comparing the display interfaces under different projection correction angles at the same pitch angle (e.g., comparing interfaces a, d, and g), it can be seen that when the distance between the target navigation icon and the driver's vehicle icon (target distance) is 15m, the display style of the target navigation icon with a projection correction angle of +2° is significantly better for the driver's distance perception than when the projection correction angle is 0°. The display style of the target navigation icon with a projection correction angle of 0° is significantly better for the driver's distance perception than when the projection correction angle is -2°. When the distance between the target navigation icon and the driver's vehicle icon (target distance) is 20m, the display style of the target navigation icon with a projection correction angle of -2° is significantly better for the driver's distance perception than when the projection correction angle is +2°.

[0270] Therefore, it can be concluded that when the distance between the target navigation icon and the driver's vehicle icon (target distance) is greater than or equal to 25 m, the target navigation icon pattern obtained by the projection transformation with the projection correction angle of -2° is closer to the actual perception, and when the distance between the target navigation icon and the driver's vehicle icon (target distance) is less than 25 m, the target navigation icon pattern obtained by the projection transformation with the projection correction angle of +2° is closer to the actual perception.

[0271] In some virtual scenes, the terminal usually acquires the target navigation icon from the resource library according to the positioning information of the current vehicle, constructs the target navigation icon in the virtual scene through projection transformation, and displays the target navigation icon on the display screen of the terminal. In the related art, the projection angle of the target navigation icon is the same as the pitch angle of the scene view angle, which causes the shape of the target navigation icon to be compressed. The target navigation icon stored in the resource library is a fixed icon designed based on the related design standard, and the target navigation icon displayed by the terminal does not change when the scene view angle changes. In this case, the style of the navigation icon displayed by the terminal does not conform to the actual style of the navigation icon, which makes the driver inaccurate in recognizing the navigation icon, and when the terminal displays the virtual scene, the navigation icon in the virtual scene cannot flexibly change with the change of the driver's view angle, which aggravates the driver's perception barrier of the navigation icon.

[0272] Therefore, the present application also provides a screen display method, which is executed by the terminal, and the method comprises:

[0273] Step one, at the first time, the terminal displays a first interface, and the first interface comprises a first virtual icon and a target navigation icon displayed in a first style. At the first time, the height of the target point of the head of the driver from the ground is a first height.

[0274] Step two, at the second time, the terminal displays a second interface, and the second interface comprises the first virtual icon and the target navigation icon displayed in a second style. At the second time, the height of the target point of the head of the driver from the ground is a second height. The second time is later than the first time, the second height is different from the first height, and the second style is different from the first style.

[0275] Optionally, the terminal constructs a third virtual scene based on the first virtual icon, the target navigation icon displayed in the first style, the position of the vehicle, a third pitch angle of a construction point of the third virtual scene, the position of the construction point, the field angle of the construction point, and the second azimuth angle of the construction point, and displays the first interface.

[0276] It should be understood that the terminal displays the second interface in the same way as the terminal displays the first interface, which will not be described here.

[0277] Optionally, the terminal determines the projection correction angle of the target navigation icon in the second virtual scene; based on the second pitch angle and the correction angle, it determines the actual projection angle of the target navigation icon in the second virtual scene; the terminal projects the target navigation icon at the actual projection angle to obtain the target navigation icon displayed in the first style.

[0278] Optionally, the terminal determines the sum of the second pitch angle and the correction angle as the actual projection angle of the target navigation icon in the second virtual scene.

[0279] Optionally, the terminal determines the projection correction angle in the same way as the terminal determines the projection correction angle at the third moment mentioned above, and will not be repeated here.

[0280] The above text combines Figures 1 to 13 The present application describes in detail the screen display method according to the embodiments of this application. The following will be combined with... Figures 14 to 15 This application provides a detailed description of the screen display device according to embodiments thereof.

[0281] Figure 14 An embodiment of this application shows a screen display device 1400, which includes a display unit 1410.

[0282] The display unit 1410 is configured to: display a first interface at a first moment, the first interface including a first virtual icon of the vehicle driven by the driver and a second virtual icon of the target object, wherein the distance between the first virtual icon and the second virtual icon in the first interface is a first length, and the height of the target point of the driver's head from the ground at the first moment is a first height. The display unit 1410 is also configured to: display a second interface at a second moment, the second interface including the first virtual icon and the second virtual icon, wherein the distance between the first virtual icon and the second virtual icon in the second interface is a second length, and the height of the target point of the driver's head from the ground at the second moment is a second height; wherein the second moment is later than the first moment, and between the first moment and the second moment, the vehicle and the target object are relatively stationary, the second height is greater than the first height, and the second length is greater than the first length.

[0283] Optionally, the device 1400 further includes a processing unit 1420, which is configured to: construct a first virtual scene based on a first virtual icon, a second virtual icon, the vehicle's location, a first pitch angle of the construction point of the virtual scene, the location of the construction point, the field of view of the construction point, and a first azimuth angle of the construction point. The display unit 1410 is further configured to: display a first interface at a first moment.

[0284] Optionally, the processing unit 1420 is further configured to: determine a first distance between a first position and a second position, the first position being a vertical projection point of a target point of the head of the driver on the ground, the second position being a gaze position prediction point of the eyes of the driver on the road surface; determine the first pitch angle based on the first height and the first distance.

[0285] Optionally, the processing unit 1420 is further configured to: determine a target speed range to which a current vehicle speed of the vehicle belongs from a plurality of speed ranges; determine the first distance based on the target speed range and a first correspondence relationship, the first correspondence relationship including a correspondence relationship between the plurality of speed ranges and a plurality of distances.

[0286] Optionally, the processing unit 1420 is further configured to: determine a target road section type of a road section currently passed through by the vehicle according to a current position of the vehicle, the target road section type being a highway road section or an urban road section; determine the first distance based on the target road section type and a second correspondence relationship, the second correspondence relationship including a correspondence relationship between a plurality of road section types and a plurality of distances.

[0287] Optionally, the processing unit 1420 is further configured to: determine the first pitch angle by a detection device; and determine the first distance between the first position and the second position based on the first pitch angle and the first height, the first position being a vertical projection point of a target point of the head of the driver on the ground, the second position being a gaze position prediction point of the eyes of the driver on the road surface.

[0288] Optionally, the position of the construction point includes a height of the construction point from the ground, and the processing unit 1420 is further configured to: determine the height of the construction point from the ground based on a second distance between the first position and a third position, the first distance, and the first pitch angle, the third position being a vertical projection point of the construction point on the ground.

[0289] Optionally, the position of the construction point includes a horizontal position of the construction point, and the processing unit 1420 is further configured to: determine a third distance between a fourth position and a fifth position, the fourth position being a display center point of the first interface in the vehicle, the fifth position being determined based on the target point of the head of the driver and the fourth position; determine a fourth distance between the fifth position and the target point of the head of the driver; determine a first azimuth angle based on the third distance and the fourth distance; and determine the horizontal position of the construction point based on the first azimuth angle.

[0290] Optionally, the position of the construction point includes a horizontal position of the construction point, and the processing unit 1420 is further configured to: determine a third distance between a fourth position and a fifth position, the fourth position being a display center point of the first interface in the vehicle, the fifth position being determined based on the target point of the head of the driver and the fourth position; and determine the horizontal position of the construction point based on the third distance.

[0291] Optionally, the processing unit 1420 is further configured to determine the third distance between the fourth position and the fifth position by determining the third distance based on the vehicle corresponding vehicle model and a third correspondence relationship, the third correspondence relationship comprising a correspondence relationship between a plurality of vehicle models and a plurality of distances.

[0292] Optionally, the processing unit 1420 is further configured to determine the fifth position based on the target point of the driver's head and the fourth position, and calculate the distance between the fourth position and the fifth position to obtain the third distance by detecting the position of the target point of the driver's head through the detection device.

[0293] Optionally, the display unit 1410 is further configured to display a third interface at the third time, the third interface comprising the first virtual icon and the target navigation icon displayed in the first style, and the target point of the driver's head is at a third height from the ground at the third time; and the display unit 1410 is further configured to display a fourth interface at a fourth time, the fourth interface comprising the first virtual icon and the target navigation icon displayed in a second style, and the target point of the driver's head is at a fourth height from the ground at the fourth time; wherein the fourth time is later than the third time, the fourth height is different from the third height, and the second style is different from the first style.

[0294] Optionally, the processing unit 1420 is further configured to construct the second virtual scene based on the first virtual icon, the target navigation icon displayed in the first style, the position of the vehicle, the second pitch angle of the construction point of the virtual scene, the position of the construction point, the field of view angle of the construction point, and the first azimuth angle of the construction point, and display the third interface.

[0295] Optionally, the processing unit 1420 is further configured to determine a projection correction angle of the target navigation icon in the second virtual scene, determine an actual projection angle of the target navigation icon in the second virtual scene based on the second pitch angle and the correction angle, and project the target navigation icon at the actual projection angle to obtain the target navigation icon displayed in the first style.

[0296] Optionally, the processing unit 1420 is further configured to determine the projection correction angle based on the second pitch angle and a fourth correspondence relationship, the fourth correspondence relationship comprising a correspondence relationship between a plurality of pitch angles and a plurality of angles.

[0297] Optionally, the processing unit 1420 is further configured to determine the projection correction angle based on a target distance and a first preset threshold, the target distance being a distance between the position of the target navigation icon in the second virtual scene and the position of the vehicle in the second virtual scene.

[0298] Optionally, in a case where the target distance is greater than or equal to the first preset threshold, the projection correction angle is a negative value; and in a case where the target distance is less than the first preset threshold, the correction angle is a positive value.

[0299] It should be understood that the apparatus 1400 herein is embodied in the form of functional modules. The term "module" herein can refer to an application specific integrated circuit (ASIC), an electronic circuit, a processor (shared, dedicated or group) and memory that execute one or more software or firmware programs, a combinational logic circuit, and / or other suitable components that provide the described functionality. In one optional example, those skilled in the art can understand that the apparatus 1400 can be embodied in the terminal in the above-described embodiments, and the apparatus 1400 can be used to execute the respective processes and / or steps corresponding to the terminal in the above-described method embodiments. To avoid repetition, details are not described herein.

[0300] The apparatus 1400 described above has the functions of performing the respective steps of the terminal in the above-described methods; the above-described functions can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above-described functions. For example, the processing module 1420 described above can be used to implement the respective steps and / or processes corresponding to the processing module for performing processing actions.

[0301] In the embodiments of the present application, Figure 14 The apparatus 1400 in the above-described embodiments can also be a chip or a chip system, for example, a system on chip (SOC). Correspondingly, the processing module 1420 can be a processing circuit of the chip, which is not limited herein.

[0302] Figure 15 Another screen display apparatus 1500 provided by the embodiments of the present application is shown. The apparatus 1500 includes a processor 1510, a communication interface 1520 and a memory 1530. The processor 1510, the communication interface 1520 and the memory 1530 communicate with each other through an internal connection path. The memory 1530 is used to store instructions, the processor 1510 is used to execute the instructions stored in the memory 1530, and the communication interface 1520 can be used to receive signals from other modules (for example, the memory 1530), and the communication interface 1520 can also be used to send signals to other modules.

[0303] It should be understood that the apparatus 1500 can be embodied as a terminal in the above-described embodiments, and can be used to perform each step and / or procedure in the above-described method embodiments corresponding to the terminal. Optionally, the memory 1530 can include a read-only memory and a random access memory, and provide instructions and data for the processor. A part of the memory can also include a non-volatile random access memory. For example, the memory can also store device type information. The processor 1510 can be used to execute the instructions stored in the memory, and when the processor 1510 executes the instructions stored in the memory, the processor 1510 is used to perform each step and / or procedure of the above-described method embodiments corresponding to the apparatus. Illustratively, the communication interface 1520 can read the instructions stored in the memory 1530 and send the instructions to the processor 1510. When the instructions are executed by the processor 1510, the apparatus can be caused to perform each step performed by the terminal in the above-described embodiments.

[0304] It should be understood that in the embodiments of the present application, the processor can be a central processing unit (CPU), and the processor can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor.

[0305] In the implementation process, each step of the above-described method can be completed by the integrated logic circuit of hardware in the processor or the instructions in the form of software. The steps of the method disclosed in the embodiments of the present application can be directly embodied as hardware processor execution completion, or executed by a combination of hardware and software modules in the processor. The software module can be located in a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is in the memory, and the processor executes the instructions in the memory, and combines the hardware to complete the steps of the above-described method. To avoid repetition, it will not be described in detail here.

[0306] The present application also provides a computer readable storage medium for storing a computer program for implementing the method corresponding to the terminal in the above-described embodiments.

[0307] The present application also provides a computer program product including a computer program (also referred to as code or instructions), which can execute the method corresponding to the terminal shown in the above-described embodiments when the computer program runs on a computer.

[0308] Those skilled in the art can clearly understand that the modules and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0309] Those skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working processes of the above-described system, device and module can refer to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

[0310] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the above-described device embodiments are merely schematic, for example, the division of the modules is only a logical function division, and actual implementation can have another division manner, for example, multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed each other can be indirect coupling or communication connection through some interfaces, devices or modules, which can be electrical, mechanical or other forms.

[0311] The modules described as separate components can or can not be physically separated, and the components displayed as modules can or can not be physical modules, that is, they can be located in one place, or can be distributed on multiple network modules. According to actual needs, part or all of the modules can be selected to achieve the purpose of the embodiment.

[0312] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically, or two or more modules can be integrated into one module.

[0313] If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application or the parts of the technical solutions that essentially contribute to the prior art or the parts of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0314] The above is only a specific implementation of the present application, but the protection scope of the embodiments of the present application is not limited to this. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the embodiments of the present application, which should be covered within the protection scope of the embodiments of the present application. Therefore, the protection scope of the embodiments of the present application should be subject to the protection scope of the claims.

Claims

1. A screen display method, characterized in that, include: At the first moment, a first interface is displayed, which includes a first virtual icon of the vehicle driven by the driver and a second virtual icon of the target object. In the first interface, the distance between the first virtual icon and the second virtual icon is a first length, and at the first moment, the height of the target point of the driver's head from the ground is a first height. At the second moment, a second interface is displayed, which includes the first virtual icon and the second virtual icon. In the second interface, the distance between the first virtual icon and the second virtual icon is a second length, and at the second moment, the height of the target point of the driver's head from the ground is a second height. Wherein, the second moment is later than the first moment, and between the first moment and the second moment, the vehicle and the target object are relatively stationary, the second height is greater than the first height, and the second length is greater than the first length.

2. The method according to claim 1, characterized in that, The first display interface includes: Based on the first virtual icon, the second virtual icon, the vehicle's location, the first pitch angle of the virtual scene's construction point, the location of the construction point, the field of view of the construction point, and the first azimuth angle of the construction point, a first virtual scene is constructed, and the first interface is displayed.

3. The method according to claim 2, characterized in that, Before displaying the first interface, the method further includes: Determine a first distance between a first position and a second position, wherein the first position is the vertical projection of the target point of the driver's head onto the ground, and the second position is the predicted gaze position of the driver's eyes on the road surface; The first pitch angle is determined based on the first altitude and the first distance.

4. The method according to claim 3, characterized in that, Determining the first distance between the first position and the second position includes: Determine the target speed range to which the vehicle's current speed belongs from multiple speed ranges; Based on the target vehicle speed range and the first correspondence, the first distance is determined, wherein the first correspondence includes the correspondence between the plurality of vehicle speed ranges and the plurality of distances.

5. The method according to claim 3, characterized in that, Determining the first distance between the first position and the second position includes: Based on the vehicle's current location, determine the target road segment type of the road segment where the vehicle is currently located, which is either a highway segment or an urban road segment; Based on the target road segment type and the second correspondence, the first distance is determined, and the second correspondence includes the correspondence between multiple road segment types and multiple distances.

6. The method according to claim 2, characterized in that, Before displaying the first interface, the method further includes: The first pitch angle is determined using detection equipment; Based on the first pitch angle and the first height, a first distance is determined between the first position and the second position, wherein the first position is the vertical projection point of the target point of the driver's head on the ground, and the second position is the predicted point of the driver's gaze position on the road surface.

7. The method according to any one of claims 3 to 6, characterized in that, The location of the construction point includes the height of the construction point from the ground. Before displaying the first interface, the method further includes: Based on the second distance between the first position and the third position, the first distance, and the first pitch angle, the height of the construction point above the ground is determined, and the third position is the vertical projection point of the construction point on the ground.

8. The method according to any one of claims 2 to 6, characterized in that, The location of the construction point includes its horizontal position. Before displaying the first interface, the method further includes: A third distance is determined between the fourth position and the fifth position, wherein the fourth position is the display center point of the first interface in the vehicle, and the fifth position is determined based on the target point of the driver's head and the fourth position; Determine the fourth distance between the fifth position and the target point of the driver's head; The first azimuth angle is determined based on the third distance and the fourth distance; The horizontal position of the construction point is determined based on the first azimuth angle.

9. The method according to any one of claims 2 to 6, characterized in that, The location of the construction point includes its horizontal position. Before displaying the first interface, the method further includes: A third distance is determined between the fourth position and the fifth position, wherein the fourth position is the display center point of the first interface in the vehicle, and the fifth position is determined based on the target point of the driver's head and the fourth position; Based on the third distance, the horizontal position of the construction point is determined.

10. The method according to claim 8, characterized in that, Determining the third distance between the fourth and fifth positions includes: Based on the vehicle model and the third correspondence, the third distance is determined, and the third correspondence includes the correspondence between multiple vehicle models and multiple distances.

11. The method according to claim 9, characterized in that, Determining the third distance between the fourth and fifth positions includes: Based on the vehicle model and the third correspondence, the third distance is determined, and the third correspondence includes the correspondence between multiple vehicle models and multiple distances.

12. The method according to claim 8, characterized in that, Determining the third distance between the fourth and fifth positions includes: The position of the target point of the driver's head is detected by the detection equipment; The fifth position is determined based on the target point of the driver's head and the fourth position; The distance between the fourth position and the fifth position is calculated to obtain the third distance.

13. The method according to claim 9, characterized in that, Determining the third distance between the fourth and fifth positions includes: The position of the target point of the driver's head is detected by the detection equipment; The fifth position is determined based on the target point of the driver's head and the fourth position; The distance between the fourth position and the fifth position is calculated to obtain the third distance.

14. The method according to claim 1, characterized in that, The method further includes: At the third moment, a third interface is displayed, which includes the first virtual icon and a target navigation icon displayed in the first style. At the third moment, the target point of the driver's head is at a third height above the ground. At the fourth moment, a fourth interface is displayed, which includes the first virtual icon and the target navigation icon displayed in a second style. At the fourth moment, the target point of the driver's head is at a fourth height above the ground. Wherein, the fourth moment is later than the third moment, the fourth height is different from the third height, and the second style is different from the first style.

15. The method according to claim 14, characterized in that, The third interface for display includes: Based on the first virtual icon, the target navigation icon displayed in the first style, the vehicle's location, the second pitch angle of the virtual scene's construction point, the location of the construction point, the field of view of the construction point, and the first azimuth angle of the construction point, a second virtual scene is constructed, and the third interface is displayed.

16. The method according to claim 15, characterized in that, Before displaying the third interface, the method further includes: Determine the projection correction angle of the target navigation icon in the second virtual scene; Based on the second pitch angle and the projection correction angle, determine the actual projection angle of the target navigation icon in the second virtual scene; The target navigation icon is projected at the actual projection angle to obtain the target navigation icon displayed in the first style.

17. The method according to claim 16, characterized in that, Determining the projection correction angle of the target navigation icon in the second virtual scene includes: Based on the second pitch angle and the fourth correspondence, the projection correction angle is determined, wherein the fourth correspondence includes the correspondence between multiple pitch angles and multiple angles.

18. The method according to claim 16, characterized in that, Determining the projection correction angle of the target navigation icon in the second virtual scene includes: Based on the target distance and a first preset threshold, the projection correction angle is determined, wherein the target distance is the distance between the position of the target navigation icon in the second virtual scene and the position of the vehicle in the second virtual scene.

19. The method according to claim 18, characterized in that, When the target distance is greater than or equal to the first preset threshold, the projection correction angle is negative; When the target distance is less than the first preset threshold, the projection correction angle is a positive value.

20. A screen display device, characterized in that, Includes modules for implementing the method of any one of claims 1 to 19.

21. A screen display device, characterized in that, include: A processor coupled to a memory for storing a computer program, wherein when the processor invokes the computer program, the device performs the method as described in any one of claims 1 to 19.

22. A computer-readable storage medium, characterized in that, Used to store a computer program, the computer program including instructions for implementing the method as described in any one of claims 1 to 19.

23. A computer program product, said computer program product comprising computer program code, characterized in that, When the computer program code is run on a computer, it causes the computer to implement the method as described in any one of claims 1 to 19.

Citation Information

Patent Citations

  • Driving aid system and method based on augmented reality

    CN109649275A

  • Display device for vehicle

    CN115943101A