A display method, a wearable device and a storage medium

Abstract

Embodiments of the present application provide a display method, a wearable device and a storage medium. The method comprises: acquiring vehicle seat posture data of a wearer of a wearable device when the wearer is located at a vehicle driving seat; determining an interface initial height and an interface initial sight distance of display content of the wearable device according to the vehicle seat posture data, wherein the interface initial height represents a line of sight height of the wearer when the wearer is located at the vehicle driving seat; the interface initial sight distance is used to represent a horizontal distance from an eye of the wearer to the display content when the wearer is located at the vehicle driving seat; determining a space calibration value of the display content through the interface initial height and the interface initial sight distance; and adjusting the display content based on the acquired first posture of the wearable device, a second posture of the vehicle and the space calibration value.

Description

Technical Field

[0001] This application relates to the field of display technology, and in particular to a display method, wearable device and storage medium. Background Technology

[0002] Augmented Reality (AR) technology, which merges virtual information with the real world, is being applied in an increasing number of fields. In scenarios where AR wearable devices (e.g., AR glasses) are combined with in-vehicle infotainment systems, it is necessary to display navigation information from the vehicle's central control system onto the AR glasses. For example, if a navigation application is pre-installed on the side of the AR glasses, the virtual information in the AR glasses will drift as the user's head and the vehicle move, causing significant obstruction to the user's view or resulting in inaccurate display. Summary of the Invention

[0003] In a first aspect, embodiments of this application provide a display method, including:

[0004] Acquire vehicle seat posture data when the wearer of the wearable device is in the driver's seat;

[0005] Based on the vehicle seat posture data, the initial height of the interface and the initial viewing distance of the wearable device display content are determined, wherein the initial height of the interface represents the eye level of the wearer when the wearer is in the driver's seat of the vehicle; and the initial viewing distance represents the horizontal distance from the wearer's eyes to the displayed content when the wearer is in the driver's seat of the vehicle.

[0006] The spatial calibration value of the displayed content is determined by the initial height of the interface and the initial viewing distance of the interface.

[0007] The display content is adjusted based on the first posture of the wearable device, the second posture of the vehicle, and the spatial calibration value.

[0008] In some embodiments, determining the initial height and initial viewing distance of the displayed content in the wearable device based on the vehicle seat posture data includes:

[0009] Based on the vehicle seat posture data, obtain the wearer's height information, first torso information, and first head height information;

[0010] Based on the vehicle seat posture data, the first torso information, and the first head height information, the second torso information and the second head height information of the wearer when located in the vehicle driver's seat are obtained. Based on the second torso information, the second head height information, and the vehicle chassis height information, the initial height of the interface is obtained.

[0011] Based on the height information, the wearer's leg length information is determined. Based on the vehicle seat posture data and the leg length information, the leg distance information is obtained. Based on the leg distance information and the preset viewing distance compensation distance, the initial viewing distance of the interface is obtained. The leg distance information is the horizontal distance between the wearer's knee and the vehicle pedal when the wearer is in the driver's seat of the vehicle. The preset viewing distance compensation distance is determined based on the vehicle seat posture data.

[0012] In some embodiments, the method further includes:

[0013] Based on the mapping relationship between vehicle seat posture samples and human body information samples, a pre-set human body size information database is constructed;

[0014] The step of obtaining the wearer's height information, first torso information, and first head height information based on the vehicle seat posture data includes:

[0015] Based on the vehicle seat posture data, the corresponding wearer's human body information is obtained from the preset human body size information database, wherein the wearer's human body information includes the height information, the first torso information, and the first head height information.

[0016] In some embodiments, adjusting the display content based on the acquired first posture of the wearable device, the second posture of the vehicle, and the spatial calibration value includes:

[0017] Determine the corresponding adjustment angle based on the first posture and the second posture;

[0018] The display content is adjusted by adjusting the angle so that the display direction of the adjusted display content is consistent with the driving direction of the vehicle. The display content is navigation content, and the display direction is the navigation direction.

[0019] In some embodiments, the method further includes:

[0020] If the head tilt angle of the wearer in the first posture is determined to be greater than or equal to a preset tilt angle, the displayed content is turned off.

[0021] The head tilt angle of the wearer is continuously monitored until it is less than the preset tilt angle. The display content is then turned on, and the direction of the display content is consistent with the direction of travel of the vehicle.

[0022] In some embodiments, it also includes:

[0023] The display content is adjusted based on the opposite direction of the first posture movement direction, and / or based on the same direction as the second posture movement direction.

[0024] In some embodiments, acquiring vehicle seat posture data when the wearer of the wearable device is in the driver's seat includes:

[0025] The vehicle seat posture data is determined based on the seat height, seat back angle, distance from the seat to the pedals, and seat load-bearing weight data of the vehicle driver's seat.

[0026] In some embodiments, the method further includes:

[0027] Receive a first input, which indicates that the spatial calibration value should be adjusted;

[0028] In response to the first input, the spatial calibration value is adjusted to obtain an adjusted spatial calibration value, and the display position of the displayed content is determined based on the adjusted spatial calibration value.

[0029] Secondly, embodiments of this application also provide a wearable device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the display method as described in any of the first aspects above.

[0030] In some embodiments, it also includes:

[0031] A first inertial measurement unit is configured to acquire the attitude of the wearable device.

[0032] Thirdly, embodiments of this application also provide a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the display method as described in any of the first aspects above. Attached Figure Description

[0033] To more clearly illustrate the technical solutions in this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0034] Figure 1 A schematic flowchart illustrating a display method provided in one embodiment of this application;

[0035] Figure 2 This is a schematic diagram illustrating human body size information provided in one embodiment of this application;

[0036] Figure 3This is one of the schematic diagrams illustrating the relationship between the vehicle's driving direction and the head's rotation direction, provided in one embodiment of this application.

[0037] Figure 4 This is a second schematic diagram illustrating the relationship between the vehicle's driving direction and the head's turning direction, provided as an embodiment of this application.

[0038] Figure 5 Schematic diagram three illustrating the relationship between the vehicle's driving direction and the head's turning direction, provided as an embodiment of this application.

[0039] Figure 6 Fourth of a series of schematic diagrams illustrating the relationship between the vehicle's driving direction and the head's turning direction, provided as an embodiment of this application;

[0040] Figure 7 Fifth of a series of schematic diagrams illustrating the relationship between the vehicle's driving direction and the head's turning direction, provided as an embodiment of this application;

[0041] Figure 8 This is a schematic diagram of the structure of a wearable device provided in one embodiment of this application. Detailed Implementation

[0042] The technical solutions of this application will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0043] In some embodiments, smart wearable devices are a general term for devices that utilize wearable technology to intelligently design and develop everyday wearables, such as AR (Augmented Reality) glasses, VR (Virtual Reality) glasses, and MR (Mixed Reality) glasses. With technological advancements and evolving user needs, the form and application trends of smart wearable devices are constantly changing.

[0044] In this embodiment, augmented reality glasses are used as an example to illustrate the display method provided in this application. It should be noted that the aforementioned execution subject does not constitute a limitation on this application.

[0045] Figure 1 This is a flowchart illustrating a display method provided in one embodiment of this application, as shown below. Figure 1 As shown, this application provides a display method, and the method steps are merely one possible implementation of this application, including:

[0046] Step 101: Obtain vehicle seat posture data when the wearer of the wearable device is in the driver's seat of the vehicle.

[0047] In this embodiment, the augmented reality glasses are connected to the vehicle system via wireless communication, such as Wi-Fi, Bluetooth, 4G, or 5G. Real-time data, such as navigation data and vehicle fuel level information, is obtained from the vehicle system and displayed on the augmented reality glasses.

[0048] Furthermore, after the wearer of the augmented reality glasses (i.e., the driver / passenger in this application) enters the vehicle and adjusts their seat posture and position, specific vehicle seat posture data is obtained through the vehicle's infotainment system. In some embodiments, obtaining the vehicle seat posture data when the wearer of the wearable device is in the driver's seat includes:

[0049] The vehicle seat posture data is determined based on the seat height, seat back angle, distance from the seat to the pedals, and seat load-bearing weight data of the vehicle driver's seat.

[0050] In this embodiment, drivers and passengers wearing augmented reality glasses will adjust the vehicle seat according to their own sitting posture habits. Therefore, based on the adjusted seat, seat posture data of the driver and passengers after sitting in the driver's seat can be obtained. This seat posture data corresponds to information such as the driver's and passengers' height, torso, and head height, thereby quickly determining the relevant information of the driver and passengers.

[0051] Step 102: Based on the vehicle seat posture data, determine the initial height of the interface and the initial viewing distance of the content displayed in the wearable device, wherein the initial height of the interface represents the eye level of the wearer when the wearer is in the driver's seat of the vehicle; and the initial viewing distance represents the horizontal distance from the wearer's eyes to the displayed content when the wearer is in the driver's seat of the vehicle.

[0052] In this embodiment, for example, vehicle seat posture data can be sent to a server via the vehicle infotainment system. Based on the mapping relationship between vehicle seat posture data and human body size information stored on the server, the height and torso of the current driver / passenger can be obtained. Alternatively, human body size information can be stored in the vehicle or augmented reality glasses, and the corresponding human body size information can be directly obtained from the vehicle or augmented reality glasses. Further, based on the obtained human body size information, the initial interface positioning position of the displayed content is determined, i.e., the initial interface height and the initial viewing distance.

[0053] Having determined the initial height and initial viewing distance of the displayed content, it is necessary to ensure that the displayed content in the augmented reality glasses remains stationary relative to the vehicle, so that the display position of the content in the augmented reality glasses at the current moment is the same as its display position at the previous moment relative to the vehicle. In this embodiment, the displayed content is always displayed at a fixed position corresponding to the area of ​​the vehicle's windshield, and this fixed position is determined based on the initial height and initial viewing distance of the interface. The initial viewing distance is the horizontal distance from the wearer's eyes to the displayed content when the wearer is in the driver's seat, or it can be the horizontal distance from the wearable device to the displayed content when the wearer is in the driver's seat.

[0054] Optionally, in some embodiments, the vehicle system can also send vehicle seat posture data to augmented reality glasses, and directly obtain the corresponding initial interface height and initial viewing distance based on the preset driver and passenger information already stored in the augmented reality glasses.

[0055] Step 103: Obtain the spatial calibration value of the displayed content using the initial height of the interface and the initial viewing distance of the interface.

[0056] In this embodiment, based on the body dimensions of each different driver and passenger, the corresponding initial interface height and initial viewing distance are obtained. Then, based on the initial interface height and initial viewing distance, spatial calibration of the augmented reality glasses is completed, obtaining the spatial calibration value of the augmented reality interface's display position in the real world. In this embodiment, through spatial calibration, the fixed display position of the displayed content relative to the vehicle can be determined, for example, always near the vehicle's windshield area. As the driver and passenger's head moves and the vehicle's driving state (such as turning left or going uphill), the display position of the displayed content is adjusted to maintain the content always displayed in a fixed position within the vehicle's windshield area.

[0057] Step 104: Adjust the display content based on the first posture of the wearable device, the second posture of the vehicle, and the spatial calibration value.

[0058] For example, as the driver's head moves and the vehicle's direction changes during driving, the display direction of the content in existing augmented reality glasses usually changes accordingly, leading to inaccurate application positioning (e.g., deviation in directional guidance after the virtual navigation content changes position) and obstruction of the driver's view. Therefore, when the driver needs to observe the surrounding environment of the driving route or when the vehicle turns, this embodiment obtains the current deflection angle of the augmented reality glasses by observing the movement of the glasses, such as the driver's head turning, and / or obtains the current turning data of the vehicle by observing the vehicle's state during driving, such as when the vehicle turns. The display direction of the content is then adjusted. Taking navigation content as an example, the display direction in the augmented reality glasses is used to provide navigation content to the driver. When the vehicle is traveling straight, if the driver's head turns to the right, the navigation content needs to be adjusted so that it remains aligned with the vehicle's straight-ahead direction and does not incorrectly navigate to a right turn as the driver's head turns to the right. It should be noted that, in the embodiments of this application, the first attitude of the augmented reality glasses can be calculated based on the inertial measurement unit of the augmented reality glasses and the deflection angle of the augmented reality glasses; or the second attitude of the vehicle can be calculated based on the inertial measurement unit of the vehicle and the state of the vehicle during driving. The above methods of determining the attitude of the augmented reality glasses and the vehicle are not limited to this application.

[0059] The display in augmented reality glasses is a transparent interface that allows you to see objects in the real world. This transparent interface can show only part of the navigation space information, such as navigation direction icons and speed, or it can display all the navigation space information around the perimeter of the transparent interface to prevent obstructing the user's view. In some examples, such as when a vehicle is parked, or when other vehicles are approaching or reversing behind it, other information, such as video streams from the vehicle's 360-degree camera, can be displayed on the remaining transparent interface.

[0060] The display method provided in this application generates a suitable display interface for drivers and passengers wearing augmented reality wearable devices based on vehicle seat posture information, and adjusts the display direction of the display content in real time based on the motion data of the augmented reality wearable devices and the vehicle, thereby avoiding the display content from obstructing the driver's and passengers' view and providing more accurate virtual display content for different augmented reality applications.

[0061] It should be noted that each implementation method of this application can be freely combined, rearranged, or executed individually, and does not need to rely on or depend on a fixed execution order.

[0062] In some embodiments, determining the initial height and initial viewing distance of the real-world interface in the wearable device based on the vehicle seat posture data includes:

[0063] Based on the vehicle seat posture data, obtain the wearer's height information, first torso information, and first head height information;

[0064] Based on the vehicle seat posture data, the first torso information, and the first head height information, the second torso information and the second head height information of the wearer when located in the vehicle driver's seat are obtained. Based on the second torso information, the second head height information, and the vehicle chassis height information, the initial height of the interface is obtained.

[0065] Based on the height information, the wearer's leg length information is determined. Based on the vehicle seat posture data and the leg length information, the leg distance information is obtained. Based on the leg distance information and the preset viewing distance compensation distance, the initial viewing distance of the interface is obtained. The leg distance information is the horizontal distance between the wearer's knee and the vehicle pedal when the wearer is in the driver's seat of the vehicle. The preset viewing distance compensation distance is determined based on the vehicle seat posture data.

[0066] Figure 2 This is a schematic diagram illustrating human body size information provided in one embodiment of this application, which may be referred to. Figure 2 As shown, after the driver and passengers adjust their seats, the occupants' body dimensions can be obtained based on the collected vehicle seat posture data. Optionally, in some embodiments, before obtaining the wearer's height information, first torso information, and first head height information based on the vehicle seat posture data, the method further includes:

[0067] Based on the mapping relationship between vehicle seat posture samples and human body information samples, a pre-set human body size information database is constructed;

[0068] The step of obtaining the wearer's height information, first torso information, and first head height information based on the vehicle seat posture data includes:

[0069] Based on the vehicle seat posture data, the corresponding wearer's human body information is obtained from the preset human body size information database, wherein the wearer's human body information includes the height information, the first torso information, and the first head height information.

[0070] In this embodiment, after the vehicle system obtains the seat height, backrest angle, distance from the seat to the pedals, and seat load-bearing weight of the driver's seat, it can directly obtain the corresponding wearer's human body information stored on the vehicle system using the aforementioned vehicle seat posture data. Alternatively, the vehicle system can send the vehicle seat posture data to a server, which will then determine the wearer's human body information corresponding to the vehicle seat posture data. Or, the vehicle system can send the vehicle seat posture data to augmented reality glasses, which can then determine the corresponding wearer's human body information based on the vehicle seat posture data, either directly on the glasses themselves or by sending the data to the server. For example, the corresponding wearer's human body information can be obtained through a preset human body size information database. In this embodiment, the human body information samples in the preset human body size information database include the height information, first torso information, and first head height information of the sample driver / passenger when standing. Furthermore, in this embodiment, since drivers / passengers adjust the driver's seat according to their own sitting posture habits while driving, different vehicle seat posture data are generated. When the occupant is in the driver's seat of the vehicle, their torso and head information will change to some extent when they are standing. For example, their back may be bent or their head may be raised appropriately. Therefore, the first torso information and the first head height information need to be converted. That is, the first torso information and the first head height information are adjusted according to the vehicle seat posture data to obtain torso information (i.e., second torso information) and head height information (i.e., second head height information) that are more consistent with the occupant's position in the driver's seat.

[0071] Further references can be made. Figure 2 As shown, based on the second torso information 201, the second head height information 202, and the vehicle chassis height information ( Figure 2 (Not shown in the image), the initial height 203 of the interface is obtained. In this embodiment, when the driver or passenger is seated, the second torso information 201 and the seat height data can be considered as a whole, that is, the distance from the human neck to the vehicle chassis is the torso height, i.e., the second torso information 201 (refer to the image). Figure 2 As shown, in order to obtain a more accurate initial interface height, the chassis height of different vehicles is taken into account. Therefore, when generating the initial interface height 203, vehicle chassis height information can also be added to determine the initial interface height for different types of vehicles.

[0072] In some embodiments, the second torso information 201 and seat height data are described as a whole. That is, the initial interface height 203 is obtained based on the torso height of the driver / passenger sitting behind the seat, combined with the second head height information 202. In this embodiment, a range of values ​​for the initial interface height 203 can be generated based on the second head height information 202. That is, based on the height of the head position and the driver / passenger's driving visual habits, display content can be generated within a certain height range. For example, the initial interface height is generated by adding the second torso information 201 to the second head height information 202, which is suitable for drivers / passengers who are accustomed to looking up to view augmented reality interfaces. Preferably, in some embodiments, the optimal head observation position (the distance from the eyes to the neck, usually half the head height) is obtained based on the second head height information 202. The initial interface height 203 is obtained by adding the torso height to the optimal head observation position, so that the driver / passenger can view the display content in a head-on state.

[0073] Taking the determination of the wearer's anatomy information through a pre-set human body size database on the server as an example, the system can estimate in real time the height, torso information, and head height of a current driver or passenger in the driver's seat. Based on the acquired anatomy data and the distance to the seat position, it can also estimate the average head height range in a seated position. Figure 2 As shown, torso height + partial head height (e.g., height from the top of the torso to the eyes) + vehicle chassis height = initial height of the navigation interface, i.e., initial interface height 203; initial viewing distance 204 = preset viewing distance compensation distance 25cm + leg distance, where the preset viewing distance compensation distance is generally the horizontal distance between the vehicle steering wheel and the driver's / passenger's chest, adjusted according to the seat back angle; leg distance is the horizontal distance between the knee and the foot, or can be determined based on the distance between the seat and the pedals. In some embodiments, to improve the comfort of the driver / passenger, a leg range of motion value is generally added to the initial viewing distance 204 (e.g., ...). Figure 2 Regarding the 10cm mentioned in this application embodiment, it should be noted that after obtaining the height information of the driver and passenger when they are standing by pre-setting the human body size information database, the leg length information of the driver and passenger can be estimated. Then, combined with the current vehicle seat posture data, the leg length information is further estimated to obtain the leg distance information of the driver and passenger when they are in the vehicle seat. Finally, using the initial height and initial viewing distance of the navigation interface, a navigation interface positioning position is initialized so that the virtual navigation interface in the augmented reality glasses always remains in the same position relative to the vehicle in the real world.

[0074] Obviously, the aforementioned preset viewing distance compensation distance of 25cm and leg range of motion value of 10cm are exemplary and do not constitute a limitation of this application.

[0075] In this embodiment, after the augmented reality glasses connect to the vehicle's wireless network, they acquire vehicle GPS, inertial measurement unit (IMU) data, and vehicle movement data (e.g., speed, battery / fuel level, temperature, humidity) via the wireless network. Simultaneously, the augmented reality glasses' own sensors, such as the built-in IMU, collect real-time data on the head rotation of the driver and passengers, i.e., the deflection angle. It should be noted that in this embodiment, the vehicle's straight-line direction is used as the reference direction. When the vehicle's direction or the driver's / passenger's head deviates from the straight-line direction, the respective IMUs collect three-axis attitude angles (or angular rates) and acceleration, thereby obtaining the deflection angle of the augmented reality wearable device and the vehicle's driving status data. In this embodiment, the driver / passenger turns on the vehicle navigation (or the mobile phone navigation connects to the wireless network), and the navigation application acquires vehicle navigation data through the device (or the wireless network). With the navigation application open, the navigation interface is initialized based on the spatially calibrated display content, thus displaying graphics in the augmented reality glasses.

[0076] In some embodiments, adjusting the display content based on the acquired first posture of the wearable device, the second posture of the vehicle, and the spatial calibration value includes:

[0077] Determine the corresponding adjustment angle based on the first posture and the second posture;

[0078] The display content is adjusted by adjusting the angle so that the display direction of the adjusted display content is consistent with the driving direction of the vehicle. The display content is navigation content, and the display direction is the navigation direction.

[0079] In this embodiment, a navigation scenario is used as an example. After wearing augmented reality glasses, the vehicle's occupants first initialize navigation information in the navigation application and display it using spatially calibrated content. Simultaneously, they acquire the vehicle's GPS data and begin calculating the route and locating the current position. Further, the augmented reality glasses obtain navigation information via a wireless network and begin displaying navigation-related status bars at the pre-calibrated location. After navigation route planning, the vehicle's heading direction is calculated based on the vehicle's GPS and displayed on the augmented reality glasses.

[0080] In some embodiments, the vehicle's driving direction is determined based on its GPS positioning and initial travel path; the vehicle's driving status data is captured based on the vehicle's IMU data, indicating whether it is in a state of merging left or right, turning, or making a U-turn. Simultaneously, the augmented reality glasses determine the vehicle's driving direction using the vehicle's GPS data and ensure that the navigation information displayed on the augmented reality glasses always aligns with the vehicle's driving direction. This means that the navigation information in the augmented reality interface will not deviate from a real-world position relative to the vehicle (such as the windshield area) as the vehicle turns or the head rotates, avoiding abnormal navigation direction due to head tilting or body movement.

[0081] In this embodiment, when the head of the augmented reality glasses wearer is moving, the augmented reality glasses will move in the opposite direction of the head turning direction according to the position of the vehicle's front and the IMU data of the augmented reality glasses, so that the display direction of the displayed content is consistent with the vehicle's driving direction.

[0082] When the vehicle moves left or right (turning left and right), the augmented reality glasses acquire data from the vehicle's IMU via a wireless network. The displayed content moves synchronously with the vehicle's front, thus achieving a fixed display position relative to the vehicle. When the vehicle is traveling straight and uphill or downhill, if the wearer's head does not turn, the display position remains stationary relative to the vehicle. In some embodiments, if the wearer's head turns up or downhill while the vehicle is going uphill—for example, when the wearer looks up at the rearview mirror while going uphill—the display position is adjusted according to the angle of head movement, ensuring the adjusted position remains the same relative to the vehicle.

[0083] In some embodiments, the displayed content is described as navigation content. Figure 3 This is one of the schematic diagrams illustrating the relationship between the vehicle's driving direction and the head's rotation direction provided in one embodiment of this application. (See also...) Figure 3As shown, in scenarios where the vehicle is not turning and the occupants' heads are not turned, the vehicle infotainment system uses the vehicle's IMU or Global Navigation Satellite System (GNSS) to identify the vehicle's straight-line direction and sends the identification result to the augmented reality glasses (the vehicle infotainment system can also directly send vehicle IMU data or vehicle GPS data to the augmented reality glasses, which then identify the vehicle's direction of travel). This allows the augmented reality glasses to fix the displayed content in the same position relative to the vehicle based on the straight-line direction. For example, after spatial calibration, the displayed content is displayed in a fixed area on the windshield. When the vehicle is moving, the augmented reality glasses, based on the onboard IMU data and their own IMU data, ensure that the navigation interface is always displayed in the same position within the vehicle. In some embodiments, it also includes:

[0084] The display content is adjusted based on the opposite direction of the first posture movement direction, and / or based on the same direction as the second posture movement direction.

[0085] Figure 4 This is a second schematic diagram illustrating the relationship between the vehicle's driving direction and the head's turning direction, provided in one embodiment of this application. (See also...) Figure 4 As shown, in scenarios where the vehicle is not turning and the driver's or passengers' heads are turned, the vehicle's infotainment system uses vehicle IMU data or GPS data to identify that the vehicle is traveling in a straight direction. When the driver's or passengers' heads shift (e.g., turning to the right), the augmented reality glasses adjust the displayed content according to the direction and angle of head shift, moving the head offset angle in the opposite direction to ensure that the displayed content remains in a fixed position relative to the vehicle. For example, when the wearer looks in the right rearview mirror, the field of vision begins to shift with the head. At this time, the augmented reality glasses determine that the vehicle is traveling in a straight direction based on the vehicle's IMU data and calculate the offset angle based on the augmented reality glasses' own IMU data, ensuring that the navigation direction always matches the vehicle's direction of travel.

[0086] Correspondingly, Figure 5 This is the third schematic diagram illustrating the relationship between the vehicle's driving direction and the head's turning direction, provided in one embodiment of this application. (See also...) Figure 5 As shown, in a scenario where the vehicle is turning (turning right) and the head is not turning, the augmented reality glasses worn on the head capture a head deflection angle of 0. At this time, the vehicle's deflection angle is calculated by the onboard IMU, so that the navigation content moves synchronously in the direction of the vehicle's turning. At this time, the displayed content always maintains a fixed position relative to the vehicle.

[0087] Figure 6 This is the fourth schematic diagram illustrating the relationship between the vehicle's driving direction and the head's turning direction, provided in one embodiment of this application. (See also...) Figure 6 As shown, in a scenario where the vehicle is turning and the head is also turning, the vehicle's infotainment system captures the vehicle's IMU deflection angle, while the augmented reality glasses' IMU captures the head deflection angle. When the head's rotation direction is the same as the vehicle's deflection direction, the augmented reality glasses adjust the display direction of the content according to the vehicle's deflection angle minus the head deflection angle in the opposite direction; when the head's rotation direction is opposite to the vehicle's deflection direction, the augmented reality glasses adjust the display direction of the content according to the vehicle's deflection angle plus the head deflection angle in the opposite direction.

[0088] When the vehicle is going uphill or downhill, the augmented reality glasses calculate the uphill and downhill movement speed based on the vehicle's IMU movement data. The navigation interface is then moved in the opposite direction to the vehicle's movement. For example, when going uphill, the navigation interface is moved downhill; when going downhill, the navigation interface is moved uphill, thus ensuring that the navigation interface is always in the same position relative to the vehicle. Figure 7 This is the fifth schematic diagram illustrating the relationship between the vehicle's driving direction and the head's turning direction, provided in one embodiment of this application. The navigation interface adjustment when the vehicle is going uphill or downhill can be referred to... Figure 7 As shown. This application embodiment combines augmented reality glasses with GPS and IMU data from a vehicle (mobile phone) device to achieve the effect of accurately presenting the displayed content in the virtual space of the augmented reality glasses. Since the displayed content always remains in a fixed position in the real world relative to the vehicle (such as the windshield of the vehicle), the interface avoids obstructing the wearer's view when the wearer turns their head, thereby providing a better user experience for the wearer during vehicle driving.

[0089] In some embodiments, the method further includes:

[0090] If the head tilt angle of the wearer in the first posture is determined to be greater than or equal to a preset tilt angle, the displayed content is turned off.

[0091] The head tilt angle of the wearer is continuously monitored until it is less than the preset tilt angle. The display content is then turned on, and the direction of the display content is consistent with the direction of travel of the vehicle.

[0092] In this embodiment of the application, when the driver's head is turned to a certain angle (e.g., 60 degrees), the driver's visual range is removed from the fixed display position of the displayed content in the real world. At this time, the navigation interface in the augmented reality glasses can be turned off until the head turning angle (i.e., the third posture) is less than the preset turning angle, and then it is turned on again in the augmented reality glasses.

[0093] In some embodiments, when it is necessary to display electronic video rearview mirror data of the vehicle's surrounding environment, the data stream is sent to augmented reality glasses via a wireless network, and the augmented reality glasses display the video stream in a preset display area without obstructing the user's view.

[0094] In some embodiments, the method further includes:

[0095] Receive a first input, which indicates that the spatial calibration value should be adjusted;

[0096] In response to the first input, the spatial calibration value is adjusted to obtain an adjusted spatial calibration value, and the display position of the displayed content is determined based on the adjusted spatial calibration value.

[0097] In this embodiment, the wearer can also manually adjust the display position of the content to adjust the spatial calibration value, thereby better conforming to the wearer's visual habits.

[0098] Figure 8 This is a schematic diagram of the structure of a wearable device provided in one embodiment of this application, as shown below. Figure 8 As shown, the electronic device may include: a processor 801, a communications interface 802, a memory 803, and a communication bus 804, wherein the processor 801, the communications interface 802, and the memory 803 communicate with each other via the communication bus 804. The processor 801 can call logical instructions in the memory 803 to execute a display method, which includes: acquiring vehicle seat posture data when the wearer of the wearable device is in the driver's seat of a vehicle; determining the initial interface height and initial viewing distance of the display content of the wearable device based on the vehicle seat posture data, wherein the initial interface height represents the wearer's line of sight height when in the driver's seat of the vehicle; the initial viewing distance represents the horizontal distance from the wearer's eyes to the display content when in the driver's seat of the vehicle; determining the spatial calibration value of the display content based on the initial interface height and the initial viewing distance; and adjusting the display content based on the acquired first posture of the wearable device, the second posture of the vehicle, and the spatial calibration value.

[0099] Furthermore, the logical instructions in the aforementioned memory 803 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0100] On the other hand, this application also provides a computer program product, which includes a computer program stored on a non-transitory computer-readable storage medium. The computer program includes program instructions, and when the program instructions are executed by a computer, the computer is able to execute the display method provided by the above methods. The method includes: acquiring vehicle seat posture data when a wearer of a wearable device is located in the driver's seat of a vehicle; determining an initial interface height and an initial viewing distance of the display content of the wearable device based on the vehicle seat posture data, wherein the initial interface height represents the eye level of the wearer when located in the driver's seat of the vehicle; the initial viewing distance represents the horizontal distance from the wearer's eyes to the display content when located in the driver's seat of the vehicle; determining a spatial calibration value of the display content based on the initial interface height and the initial viewing distance; and adjusting the display content based on the acquired first posture of the wearable device, the second posture of the vehicle, and the spatial calibration value.

[0101] In another aspect, this application also provides a non-transitory computer-readable storage medium storing a computer program thereon, which, when executed by a processor, is implemented to perform the display methods provided in the above embodiments. The method includes: acquiring vehicle seat posture data when a wearer of a wearable device is located in the driver's seat of a vehicle; determining an initial interface height and an initial viewing distance of the display content of the wearable device based on the vehicle seat posture data, wherein the initial interface height represents the eye level of the wearer when located in the driver's seat of the vehicle; the initial viewing distance represents the horizontal distance from the wearer's eyes to the display content when located in the driver's seat of the vehicle; determining a spatial calibration value of the display content based on the initial interface height and the initial interface viewing distance; and adjusting the display content based on the acquired first posture of the wearable device, a second posture of the vehicle, and the spatial calibration value.

[0102] In some embodiments, the wearable device further includes a first inertial measurement unit configured to acquire the attitude of the wearable device.

[0103] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0104] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0105] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A display method, characterized in that, include: Acquire vehicle seat posture data when the wearer of the wearable device is in the driver's seat; Based on the vehicle seat posture data, the initial height of the interface and the initial viewing distance of the wearable device display content are determined, wherein the initial height of the interface represents the eye level of the wearer when the wearer is in the driver's seat of the vehicle; and the initial viewing distance represents the horizontal distance from the wearer's eyes to the display content when the wearer is in the driver's seat of the vehicle. The spatial calibration value of the displayed content is determined by the initial height of the interface and the initial viewing distance of the interface. The display content is adjusted based on the first posture of the wearable device, the second posture of the vehicle, and the spatial calibration value. The step of determining the initial height and initial viewing distance of the interface displayed on the wearable device based on the vehicle seat posture data includes: Based on the vehicle seat posture data, obtain the wearer's height information, first torso information, and first head height information; Based on the vehicle seat posture data, the first torso information, and the first head height information, the second torso information and the second head height information of the wearer when located in the vehicle driver's seat are obtained. Based on the second torso information, the second head height information, and the vehicle chassis height information, the initial height of the interface is obtained. Based on the height information, the wearer's leg length information is determined. Based on the vehicle seat posture data and the leg length information, the leg distance information is obtained. Based on the leg distance information and the preset viewing distance compensation distance, the initial viewing distance of the interface is obtained. The leg distance information is the horizontal distance between the wearer's knee and the vehicle pedal when the wearer is in the driver's seat of the vehicle. The preset viewing distance compensation distance is determined based on the vehicle seat posture data.

2. The display method according to claim 1, characterized in that, The method further includes: Based on the mapping relationship between vehicle seat posture samples and human body information samples, a pre-set human body size information database is constructed; The step of obtaining the wearer's height information, first torso information, and first head height information based on the vehicle seat posture data includes: Based on the vehicle seat posture data, the corresponding wearer's human body information is obtained from the preset human body size information database, wherein the wearer's human body information includes the height information, the first torso information, and the first head height information.

3. The display method according to claim 1, characterized in that, The step of adjusting the display content based on the acquired first pose of the wearable device, the second pose of the vehicle, and the spatial calibration value includes: Determine the corresponding adjustment angle based on the first posture and the second posture; By adjusting the angle, the displayed content is adjusted so that the display direction of the adjusted content is consistent with the driving direction of the vehicle, wherein the displayed content is navigation content and the display direction is the navigation direction.

4. The display method according to claim 3, characterized in that, The method further includes: If the head tilt angle of the wearer in the first posture is determined to be greater than or equal to a preset tilt angle, the displayed content is turned off. The head tilt angle of the wearer is continuously monitored until it is less than the preset tilt angle. The display content is then turned on, and the direction of the display content is consistent with the direction of travel of the vehicle.

5. The display method according to claim 3, characterized in that, Also includes: The display content is adjusted based on the opposite direction of the first posture movement direction, and / or based on the same direction as the second posture movement direction.

6. The display method according to claim 1, characterized in that, The acquisition of vehicle seat posture data when the wearer of the wearable device is in the driver's seat includes: The vehicle seat posture data are determined based on the seat height, seat back angle, distance from the seat to the vehicle pedals, and the weight the seat bears.

7. The display method according to any one of claims 1 to 6, characterized in that, The method further includes: Receive a first input, which indicates that the spatial calibration value should be adjusted; In response to the first input, the spatial calibration value is adjusted to obtain an adjusted spatial calibration value, and the display position of the displayed content is determined based on the adjusted spatial calibration value.

8. A wearable device, characterized in that, It includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the computer program, implements the display method as described in any one of claims 1 to 7.

9. The wearable device according to claim 8, characterized in that, Also includes: A first inertial measurement unit is configured to acquire the attitude of the wearable device.

10. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the display method as described in any one of claims 1 to 7.

Images