Vehicle-mounted screen control method and device, equipment, medium and vehicle

By obtaining the seat posture and human eye vision model, calculating the occupant's central vision and automatically adjusting the angle of the vehicle screen, the problem of camera occupancy and increasing costs in the existing technology is solved, and the automatic angle adjustment of the vehicle screen is realized, which improves the The occupants' viewing angle and comfort experience.

CN119078673APending Publication Date: 2024-12-06SHANGHAI LIXIANG AUTOMOBILE CO LTD
View PDF 0 Cites 3 Cited by

Patent Information

Application Number
CN202310640849.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-31
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

The existing automatic adjustment technology of on-board screens requires the installation of a camera in the cockpit, occupying space and increasing costs, and cannot effectively meet the needs of occupants' different seat angles.

Method used

By obtaining the seat posture and human eye vision model of the occupant, the central line of sight of the occupant is calculated, and the angle of the on-board screen is adjusted to be in line with the line of sight, the automatic angle adjustment of the on-board screen is realized and the cabin space is reduced.

Benefits of technology

Automatic angle adjustment of the on-board screen can be achieved without a camera, which reduces the use of cockpit space and saves costs, meets the needs of different seat angles of the passengers, and improves the viewing angle and comfortable experience of the passengers.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119078673A_ABST
    Figure CN119078673A_ABST
Patent Text Reader

Abstract

The invention relates to a vehicle-mounted screen control method, device and equipment, a medium and a vehicle. The method comprises the steps that the seat posture of an in-vehicle seat where a passenger is located is obtained; calculating the central sight line of the passenger in combination with the seat posture and a human eye view model; and adjusting the angle of a vehicle-mounted screen to an angle adaptive to the central sight line, so that the vehicle-mounted screen is displayed at the view center of the passenger. Linkage of angle adjustment of the vehicle-mounted screen and the posture of the seat can be achieved, so that angle adjustment of the vehicle-mounted screen does not need to recognize the sight line of a user through a camera, occupied cabin space is reduced, and cost is saved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of vehicle control technology, and in particular to a vehicle-mounted screen control method, device, equipment, medium and vehicle. Background Art

[0002] With the development of automobile intelligence and the continuous maturity of autonomous driving technology, in order to meet the various needs of passengers, the configuration of electronic equipment in the car is getting higher and higher, such as the co-pilot entertainment screen and the second-row roof entertainment screen, which are very popular. When passengers use the in-car electronic screen, they often adjust the seat to a more relaxed and comfortable lying position, and different passengers prefer different seat angles. In order to allow passengers to get a better viewing angle and a more comfortable experience when using the in-car electronic screen, the existing solution automatically adjusts the angle of the in-car electronic screen by capturing the user's image through a camera to identify the user's line of sight. This method requires additional cameras to be arranged in the cockpit, which takes up cabin space and increases costs. Summary of the invention

[0003] In order to solve the above technical problems, the present disclosure provides a vehicle-mounted screen control method, device, equipment, medium and vehicle.

[0004] In a first aspect, the present disclosure provides a vehicle-mounted screen control method, comprising:

[0005] Obtaining the seat posture of the seat in the vehicle where the occupant is located;

[0006] Calculating the occupant's central line of sight by combining the seat posture and the human eye field model;

[0007] The angle of the vehicle-mounted screen is adjusted to an angle that is compatible with the central line of sight, so that the vehicle-mounted screen is displayed in the center of the passenger's field of vision.

[0008] Optionally, obtaining the seat posture of the seat in the vehicle includes:

[0009] Acquiring a Hall signal of a motor of the seat, wherein the motor is used to adjust the posture of the seat;

[0010] A first posture and a first position of the seat in a cabin coordinate system are determined according to the Hall signal.

[0011] Optionally, the calculating the occupant's central line of sight by combining the seat posture and the human eye field model includes:

[0012] Generating a seat model in the seat position in a cabin coordinate system based on the parameters of the seat;

[0013] Simulating binocular features of the occupant when sitting on the seat model according to preset human body parameters;

[0014] The central sight line of the occupant is calculated by combining the binocular features with the human eye field model.

[0015] Optionally, simulating binocular features of the occupant when sitting on the seat model according to preset human body parameters includes:

[0016] Simulating a second posture and a second position of the occupant in a vehicle cabin coordinate system when the occupant sits on the seat model;

[0017] Determining the eye height corresponding to the preset human body parameters in the second posture according to the corresponding relationship between the human body posture and the eye height;

[0018] Determining a third position of the occupant's eyes in the cabin coordinate system according to the second position and the eye height corresponding to the preset human body parameter;

[0019] Determining a first angle of the occupant's eyes in the cabin coordinate system when the occupant is in the second posture according to a correspondence between a human body posture and an eye angle;

[0020] The third position and the first angle are used as the binocular features.

[0021] Optionally, the calculating the occupant's central line of sight by combining the binocular feature with the human eye field model includes:

[0022] Using the human eye visual field model to simulate a first visual field of both eyes at the first position and the first angle;

[0023] The center line of the first field of view is used as the center line of sight of the occupant.

[0024] Optionally, after adjusting the angle of the vehicle-mounted screen to an angle that is compatible with the central line of sight, the method further includes:

[0025] If the passenger manually adjusts the angle of the vehicle-mounted screen, then recording a second angle of the vehicle-mounted screen after the manual adjustment;

[0026] Entering the second angle, the Hall signal and preset human body parameters into a first training set;

[0027] The first machine learning model is trained using the first training set to optimize the angle of the in-vehicle screen corresponding to different Hall signals of the seat motor.

[0028] In a second aspect, the present disclosure provides a vehicle-mounted screen control device, comprising:

[0029] An acquisition module, used to acquire the seat posture of the seat in the vehicle where the occupant is located;

[0030] A calculation module, used for calculating the central sight line of the occupant by combining the seat posture and the human eye field model;

[0031] The adjustment module is used to adjust the angle of the vehicle-mounted screen to an angle that is compatible with the central line of sight, so that the vehicle-mounted screen is displayed in the center of the passenger's field of vision.

[0032] Optionally, when acquiring the seat posture of the seat in the vehicle, the acquisition module is specifically used to acquire a Hall signal of a motor of the seat, and the motor is used to adjust the posture of the seat; and determine a first posture and a first position of the seat in the cabin coordinate system according to the Hall signal.

[0033] Optionally, when the calculation module calculates the central line of sight of the occupant in combination with the seat posture and the human eye field of vision model, it is specifically used to generate a seat model in the seat posture in the cabin coordinate system based on the parameters of the seat; simulate the binocular features of the occupant when sitting on the seat model according to preset human body parameters; and calculate the central line of sight of the occupant in combination with the binocular features and the human eye field of vision model.

[0034] Optionally, when the calculation module simulates the binocular features of the occupant when sitting on the seat model according to preset human body parameters, the calculation module is specifically used to simulate the second posture and the second position of the occupant in the cabin coordinate system when the occupant sits on the seat model; determine the height of the eyes corresponding to the preset human body parameters in the second posture according to the correspondence between the human body posture and the height of the eyes; determine the third position of the occupant's eyes in the cabin coordinate system according to the second position and the height of the eyes corresponding to the preset human body parameters; determine the first angle of the occupant's eyes in the cabin coordinate system in the second posture according to the correspondence between the human body posture and the angle of the eyes; and use the third position and the first angle as the binocular features.

[0035] Optionally, when the calculation module combines the binocular features with the human eye field of view model to calculate the central line of sight of the occupant, it is specifically used to use the human eye field of view model to simulate the first field of view of both eyes at the first position and the first angle; and use the center line of the first field of view as the central line of sight of the occupant.

[0036] Optionally, the device also includes a training module for recording a second angle of the vehicle screen after the manual adjustment if the occupant manually adjusts the angle of the vehicle screen after adjusting the angle of the vehicle screen to an angle consistent with the central line of sight; entering the second angle, the Hall signal and preset human body parameters into a first training set; and using the first training set to train a first machine learning model to optimize the angle of the vehicle screen corresponding to different Hall signals of the seat motor.

[0037] In a third aspect, the present disclosure provides a computer device, comprising:

[0038] Memory;

[0039] Processor; and

[0040] Computer programs;

[0041] The computer program is stored in the memory and is configured to be executed by the processor to implement the method as described in any one of the first aspects.

[0042] In a fourth aspect, the present disclosure provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method as described in any one of the first aspects.

[0043] In a fifth aspect, the present disclosure provides a vehicle, comprising the vehicle-mounted screen control device as described in the second aspect and / or the computer device as described in the third aspect.

[0044] The present disclosure provides a method for controlling a vehicle screen, including obtaining the seat posture of the seat in the vehicle where the occupant is located, calculating the central line of sight of the occupant in combination with the seat posture and the human eye field of view model, and adjusting the angle of the vehicle screen to an angle adapted to the central line of sight, so that the vehicle screen is displayed at the center of the occupant's field of view. In this way, after obtaining the seat posture of the seat in the vehicle, the central line of sight of the occupant is calculated by combining the posture of the seat in the vehicle where the occupant is located and the human eye field of view model, and the angle of the vehicle screen is adapted to the central line of sight according to the central line of sight of the occupant, so that the vehicle screen is displayed at the center of the occupant's field of view, realizing the linkage between the angle adjustment of the vehicle screen and the seat posture. The vehicle screen control method provided by the present application does not need to identify the user's line of sight by setting a camera in the cabin, which reduces the occupation of the cabin space and saves costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0046] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0047] Figure 1 A flow chart of a vehicle screen control method provided by an embodiment of the present disclosure;

[0048] Figure 2A schematic diagram of an application scenario provided by an embodiment of the present disclosure;

[0049] Figure 3 A schematic diagram of a human eye visual field model provided in an embodiment of the present disclosure;

[0050] Figure 4 A schematic diagram of the structure of a vehicle-mounted screen control device provided by an embodiment of the present disclosure;

[0051] Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0052] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0053] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0054] Figure 1 This is a flow chart of a vehicle screen control method provided by an embodiment of the present disclosure. The method can be executed by a vehicle screen control device. The vehicle screen control device can be implemented in software and / or hardware. The vehicle screen control device can be configured in an electronic device, such as a server or a terminal, wherein the terminal includes a computer device with specific data processing capabilities such as a vehicle computer or a vehicle computer. The method includes the following steps:

[0055] S101. Obtain the seat posture of the seat in which the occupant is seated.

[0056] For example, Figure 2 A schematic diagram of an application scenario provided by an embodiment of the present disclosure. The scenario includes a vehicle 200, a vehicle screen 210, a seat 230, an occupant 240, and a vehicle computer 250. The vehicle screen control method can be executed by the vehicle computer 250. The seat 230 includes a backrest motor 231 and a seat height adjustment motor 232. The backrest motor 231 is used to adjust the inclination angle of the backrest of the seat 230, and the seat height adjustment motor 232 is used to adjust the height of the seat 230. The field of view 241 represents the field of view of the occupant's eyes in the current state, and the central line of sight 242 represents the center line of the field of view 241.

[0057] When the passenger 240 adjusts the seat 230 through the control button in the vehicle, the rotor of the backrest motor 231 and / or the seat height adjustment motor 232 rotates accordingly according to the height and / or backrest angle of the seat 230 that the passenger 240 wants to adjust, thereby adjusting the seat 230 to the posture that the passenger 240 wants. At the same time, the vehicle computer 250 detects the signal that the seat 230 is adjusted, and obtains the seat posture and position of the seat 230, so as to subsequently infer the posture and position of the passenger 240 sitting on the seat 230 through the seat posture and position of the seat 230, and then infer the line of sight of the passenger 240.

[0058] In one embodiment, obtaining a seat posture of a seat in a vehicle includes: obtaining a Hall signal of a motor of the seat, the motor being used to adjust the posture of the seat; and determining a first posture and a first position of the seat in a vehicle cabin coordinate system according to the Hall signal.

[0059] In the disclosed embodiment, the Hall signal of the motor refers to the rotor position signal of the motor. The Hall sensor used in the motor can detect the magnetic field generated by the permanent magnet. According to the change of the magnetic field detected by the Hall sensor, the magnetic direction of the electrode where the motor rotor is located can be identified, and compared with the phase difference between the sector slots of the motor stator, the angle and position of the motor rotor can be determined. In other words, the rotation angle of the motor rotor can be determined by the Hall signal of the motor.

[0060] For example, the vehicle computer 250 can determine the inclination angle of the backrest of the seat 230 through the Hall signal of the backrest motor 231, and the vehicle computer 250 can determine the height of the seat 230 through the Hall signal of the seat height adjustment motor 232. The first posture of the seat 230 in the cabin coordinate system can be determined by combining the Hall signal of the seat motor. At present, the motors of the seats in the car may also include slide motors, front lifting motors, etc. The slide motors can be used to slide the seats in the car to change the position of the seats in the car. Therefore, the Hall signal of the slide motor can be used to determine the first position of the sliding seat 230 in the cabin coordinate system. If the position of the seat 230 is fixed, the first position of the seat 230 in the cabin coordinate system can be directly obtained from the parameters of the seat in the cabin.

[0061] The disclosed embodiment determines the position of the seat in the vehicle in the cabin coordinate system by acquiring the Hall signal of the seat motor to support subsequent steps.

[0062] S102, calculating the central sight line of the occupant by combining the seat posture and the human eye field model.

[0063] Exemplarily, when occupant 240 sits on seat 230, the position of seat 230 can be regarded as the position of occupant 240. The posture of occupant 240 when sitting on seat 230 can be inferred through the inclination angle of the seat back and the height of seat 230. The position and angle of the eyes of occupant 240 can be inferred through the position of the posture of occupant 240. Finally, the field of vision and central line of sight of occupant 240 can be inferred based on the position and angle of the eyes of occupant 240 combined with the human eye field of vision model.

[0064] The human eye visual field model refers to a theoretical model used to describe the human eye visual field. It usually expresses the range of objects that the human visual system can perceive and its corresponding resolution in a certain quantitative way. It has been widely used in scientific research, image processing, virtual reality, medical diagnosis and other fields. The human eye visual field model can be divided into two types according to distance: near field of view and far field of view; it can also be divided into different types of fields of view such as central field of view and peripheral field of view according to angle. Among them, the central field of view refers to the part where people see objects most clearly, with a diameter of about 1.5°, including the retinal macula and nearby parts; the peripheral field of view refers to the other field of view range except the central field of view, and the specific range depends on human cognition and environmental conditions.

[0065] The human eye field of view model in the embodiment of the present disclosure is specifically a theoretical model that reflects the human eye field of view range according to angle. Figure 3 A schematic diagram of a human eye visual field model provided in an embodiment of the present disclosure, Figure 3 The human eye visual field model shown shows the visual field range of the human eye in the vertical plane and different types of visual field areas divided by angle. Among them, the center line 304 of the visual field is the 0° boundary, the upper boundary line 301 and the lower boundary line 307 represent the upper and lower boundaries of the dynamic visual field range of the human eye, respectively, the angle between the two sides is 120°, the upper visual field range is 50°, and the lower visual field range is 70°. The upper boundary line 302 and the lower boundary line 306 represent the upper and lower boundaries of the color discrimination limit of the human eye, respectively, the angle between the two sides is 60°, and the upper and lower ranges are both 30°. The upper boundary line 303 and the lower boundary line 305 represent the central area boundary of the human eye visual field, the angle between the two sides is 30°, and the upper and lower ranges are both 15°. The central area of ​​the human eye visual field is the clear area when the human eye observes, and the center line 304 of the visual field is also the center line of the central area. The central area of ​​the human eye visual field is the central field of view of the human eye, and the center line of the central area is the central line of sight.

[0066] In one embodiment, the central line of sight of the occupant is calculated by combining the seat posture and the human eye field model, including: generating a seat model in the seat posture in the cabin coordinate system based on the seat parameters; simulating the binocular features of the occupant when sitting on the seat model according to preset human body parameters; and calculating the central line of sight of the occupant by combining the binocular features and the human eye field model.

[0067] Because the occupant is sitting on a seat in the car, the posture of the seat determines the posture of the occupant, and the position of the seat determines the position of the occupant. Therefore, the posture and position of the seat can be used to infer the posture of the occupant. The disclosed embodiment generates a seat model of the seat 230 in the seat posture in S101 through the shape parameters of the seat, and the seat model can represent the seat posture of the seat 230 in the cabin coordinate system. Then, the binocular features of the occupant when sitting on the seat model are simulated according to the preset human body parameters.

[0068] In some embodiments, the binocular features of an occupant when sitting on a seat model are simulated according to preset human body parameters, including: simulating a second posture and a second position of the occupant in a cabin coordinate system when the occupant sits on the seat model; determining the height of both eyes corresponding to the preset human body parameters in the second posture according to the correspondence between the human body posture and the height of both eyes; determining the third position of the occupant's eyes in the cabin coordinate system according to the second position and the height of both eyes corresponding to the preset human body parameters; determining the first angle of the occupant's eyes in the cabin coordinate system in the second posture according to the correspondence between the human body posture and the angle of both eyes; and using the third position and the first angle as binocular features.

[0069] When the occupant sits on the seat, the occupant's posture is in contact with the seat, so that the preset human body parameters can be used to simulate the occupant's second posture and second position in the cabin coordinate system when the occupant sits on the seat model. In the disclosed embodiment, the human body parameters generally include parameters such as height and eye height, and the eye height refers to the vertical distance from the pupil point to the ground. In some real-time examples, the height in the preset human body parameters can be the average height of the area. In some embodiments, the occupant can set his or her height by himself or herself. In the case where the occupant sets his or her height by himself or herself, the standard eye height parameter of the human body under the occupant's height can be determined based on the corresponding relationship between the human body height and the standard eye height, and the eye height parameter can be used as the eye height of the occupant.

[0070] When simulating the posture of the occupant when sitting on the seat model, a standard human body model of the height can be generated according to the height parameter in the human body parameters, and then the posture of the human body model when sitting on the seat model is simulated, and the posture of the human body model is used as the second posture of the occupant in the cabin coordinate system. The position of the seat model is the second position of the occupant in the cabin coordinate system, that is, the position of the seat where the occupant sits.

[0071] A person's perspective is mainly determined by the position and angle of the eyes. Relative to the human body, the position and angle of the eyes are related to the parameters and posture of the human body. For example, when standing, the taller the person, the higher the position of the eyes. Although the position of the eyes of different people of the same height is different, the difference is small, and the difference in eye position in different postures is greater. For example, the position of the eyes is higher when a person is standing than when sitting, and the position of the eyes is higher when sitting than when squatting. The angle of the eyes changes with the angle of the head. The angle of the head of a person is different in different postures. For example, the angle of the head is different when lying down compared to when sitting, and the angle of the eyes is also different when the head is lowered compared to when the head is raised. For example Figure 2 In the scene shown, the passenger 240 is sitting on the seat 230, and the back of the passenger 240 is in contact with the backrest of the seat 230. Therefore, the inclination angle of the backrest of the seat 230 determines the inclination angle of the upper body of the passenger 240, and also determines the inclination angle of the head of the passenger 240. The inclination angle of the eyes in the cabin coordinate system can be determined by the inclination angle of the head of the passenger 240.

[0072] The vehicle computer 250 stores the correspondence between the human body posture and the eye height in advance. According to the correspondence, the eye height corresponding to the human body with preset human body parameters in the second posture can be determined. According to the height of the eye of the passenger 240 and the position of the passenger 240, the third position of the eye of the passenger 240 in the cabin coordinate system can be determined. For example, the passenger 240 sits on the seat 230, and the third position of the eye of the passenger 240 in the cabin coordinate system is (x1, y1, z1). The height of the eye of the passenger in the second posture determines the value of z1. According to the correspondence between the human body posture and the eye height, the eye height z2 corresponding to the human body with preset human body parameters in the second posture is determined. In addition, the position of the passenger 240 determines the values ​​of x1 and y1. In the above embodiment, the position of the passenger has been calculated. For example, the position coordinates of the passenger 240 are (x, y, z), then x1=x, y1=y can be obtained.

[0073] The first angle of the occupant's eyes in the cabin coordinate system is mainly determined by the inclination angle of the head of the occupant 240 when sitting, and the inclination angle of the head of the occupant 240 when sitting is determined by the posture of the occupant 240 when sitting. Therefore, through the pre-set correspondence between the human body posture and the eye angle, the angle of the eyes corresponding to the current posture of the occupant 240 can be determined, and then the angle of the eyes in the human body coordinate system is converted into the angle of the eyes in the cabin coordinate system, thereby determining the first angle of the eyes of the occupant 240 in the cabin coordinate system.

[0074] The third position and the first angle of the eyes of the occupant 240 in the cabin coordinate system calculated in this way are the binocular features of the occupant 240 .

[0075] The disclosed embodiment calculates the posture of the occupant in the cabin coordinate system through the posture and position of the seat, and then calculates the first position and the first angle of the occupant's eyes in the cabin coordinate system according to the posture of the occupant and preset human body parameters to obtain the occupant's binocular posture, and roughly calculates the occupant's binocular features through the Hall signal of the seat motor. There is no need to install other additional shooting devices to extract the occupant's binocular features by capturing the occupant's image, thereby reducing the occupancy of the cabin space and saving costs.

[0076] In some embodiments, binocular features are combined with a human eye field model to infer the occupant's central line of sight, including: using the human eye field model to simulate a first field of view of both eyes at a first position and a first angle; and using the center line of the first field of view as the occupant's central line of sight.

[0077] For example, the vehicle computer 250 can use the human eye field model to simulate the field of view formed by the eyes of the occupant 240 at the current position and angle. When the vehicle computer 250 infers the binocular features of the occupant 240 through the motor signal of the seat 230, the vehicle computer 250 uses the human eye field model to simulate the first field of view of the eyes at the third position and the first angle. In this case, the center line of the first field of view is the center line of the occupant. Figure 2 In the example scenario, the field of view 241 is a field of view obtained by simulating the position and angle of the eyes of the occupant 240 by the vehicle computer 250 using the human eye field model, wherein the central line of sight 242 is the center line of the field of view 241 .

[0078] The disclosed embodiment uses a human eye field model to simulate the field of view of the occupant's eyes at the current position and angle, and determines the center line of the field of view as the occupant's current central line of sight, so that the angle of the vehicle screen can be adjusted according to the central line of sight in subsequent steps.

[0079] S103, adjusting the angle of the vehicle-mounted screen to an angle that is compatible with the central line of sight, so that the vehicle-mounted screen is displayed in the center of the passenger's field of vision.

[0080] Exemplarily, after the vehicle computer 250 determines the current central line of sight 242 of the occupant 240, the vehicle computer 250 adjusts the angle of the vehicle screen 210 to an angle that is compatible with the central line of sight 242, so that the vehicle screen 210 is displayed in the center of the field of vision of the occupant 240. As described in the above embodiment, the central area of ​​the human eye field of vision is a clear area when the human eye observes, and the central area is a field of vision area with the central line of sight 242 as the center line and the angle between the upper and lower boundary lines is 30°. Therefore, in order to allow the occupant 240 to clearly observe the vehicle screen 210, the vehicle computer 250 can adjust the angle of the vehicle screen 210 to an angle that makes the vehicle screen 210 perpendicular to the central line of sight 242. In addition, some occupants may be more adapted to the angle of the screen being relatively tilted from the central line of sight rather than the angle of the screen being perpendicular to the central line of sight. Therefore, the angle that is more in line with the needs of the occupant and compatible with the central line of sight can also be determined by collecting the screen angle manually adjusted by the occupant.

[0081] The disclosed embodiment calculates the occupant's central line of sight by combining the posture of the occupant's seat in the car and the human eye field of vision model, and finally adjusts the angle of the vehicle screen to an angle suitable for the central line of sight, so that the vehicle screen is displayed in the center of the occupant's field of vision, realizing the linkage between the angle adjustment of the vehicle screen and the seat posture, so that the angle adjustment of the vehicle screen does not need to use a camera to identify the user's line of sight, thereby reducing the occupancy of the cabin space and saving costs.

[0082] In some embodiments, after adjusting the angle of the vehicle screen to an angle that is consistent with the center line of sight, it also includes: if the occupant manually adjusts the angle of the vehicle screen, recording a second angle of the vehicle screen after the manual adjustment; entering the second angle, the Hall signal and preset human body parameters into a first training set; and using the first training set to train a first machine learning model to optimize the angle of the vehicle screen corresponding to different Hall signals of the seat motor.

[0083] Because some passengers have their own preferred screen angles when viewing the in-vehicle screen, the automatically adjusted in-vehicle screen angle may not meet the passenger's needs. In this case, the passenger may manually adjust the in-vehicle screen angle. In order to make the in-vehicle screen angle automatically adjusted by the machine closer to the passenger's needs, the embodiment of the present disclosure trains the machine learning model by recording the in-vehicle screen angle manually adjusted by the passenger as training data, so as to continuously optimize and update the control logic of the linkage between the passenger characteristics and the in-vehicle screen adjustment angle through machine self-learning.

[0084] Exemplarily, because there are two schemes for determining the binocular features of the occupants in the disclosed embodiment, one is to infer the binocular features of the occupants through the Hall signal of the seat motor, and the other is to extract the binocular features from the facial image of the occupants, so the disclosed embodiment relatively proposes two machine self-learning optimization schemes. The scheme of inferring the binocular features of the occupants through the Hall signal of the seat motor and then determining the screen adjustment angle, the actual task is to obtain the screen angle that makes the occupants watch comfortably through the Hall signal of the seat motor, so the Hall signal of the seat motor is the input value of the machine learning model, and the screen angle is the output value of the occupants, then the first angle of the vehicle screen after the occupants manually adjust, the Hall signal of the seat motor and the preset human body parameters are the training data. When enough data is collected, the Hall signal of the seat motor and the preset human body parameters are used as the input of the first machine learning model in the training data, and the first angle is used as the true value to train the first machine learning model, and the first angle as the true value is used to continuously iteratively optimize the screen adjustment angle output by the first machine learning model, and optimize the angle of the vehicle screen corresponding to different Hall signals of the seat motor, and the optimized value is the output value of the first machine learning model.

[0085] By extracting binocular features from the passenger's facial image and then determining the screen adjustment angle, the actual task is to obtain a screen angle that is comfortable for the passenger to watch through the facial image. Similar to the above self-learning solution, the first angle of the vehicle screen after the passenger manually adjusts it and the facial image are the training data. When enough data is collected, the facial image is used as the input of the second machine learning model in the training data, and the first angle is used as the true value. The second machine learning model is trained, and the screen adjustment angle output by the second machine learning model is continuously iteratively optimized with the first angle as the true value. The angle of the vehicle screen corresponding to different facial images is optimized, and the optimized value is the output value of the second machine learning model.

[0086] The disclosed embodiment collects the first angle of the vehicle screen after manual adjustment by the occupant, the Hall signal of the seat motor and preset human body parameters as training data for the first machine learning model, and uses the training data to train the first machine learning model, or collects the first angle of the vehicle screen after manual adjustment by the occupant and the facial image of the occupant as training data for the second machine learning model, and uses the training data to train the second machine learning model, thereby continuously optimizing and updating the control logic of the linkage between occupant characteristics and the vehicle screen adjustment angle through machine self-learning.

[0087] Figure 4The structure diagram of the vehicle screen control device provided in the embodiment of the present disclosure. The vehicle screen control device may be a component or assembly in the terminal of the above embodiment. The vehicle screen control device provided in the embodiment of the present disclosure may execute the processing flow provided in the vehicle screen control method embodiment, such as Figure 4 As shown, the vehicle-mounted screen control device 400 includes: an acquisition module 401, which is used to acquire the seat posture of the seat in the vehicle where the occupant is located;

[0088] A calculation module 402, used to calculate the central sight line of the occupant by combining the seat posture and the human eye field model;

[0089] The adjustment module 403 is used to adjust the angle of the vehicle screen to an angle that is compatible with the central line of sight, so that the vehicle screen is displayed in the center of the passenger's field of vision.

[0090] In some embodiments, when acquiring the seat posture of the seat in the vehicle, the acquisition module 401 is specifically used to acquire the Hall signal of the seat motor, and the motor is used to adjust the posture of the seat; and determine the first posture and first position of the seat in the cabin coordinate system according to the Hall signal.

[0091] In some embodiments, when the calculation module 402 calculates the central line of sight of the occupant in combination with the seat posture and the human eye field of view model, it is specifically used to generate a seat model in a seat posture in a cabin coordinate system based on the parameters of the seat; simulate the binocular features of the occupant when sitting on the seat model according to preset human body parameters; and calculate the central line of sight of the occupant in combination with the binocular features and the human eye field of view model.

[0092] In some embodiments, when the calculation module 402 simulates the binocular features of the occupant when sitting on the seat model according to the preset human body parameters, it is specifically used to simulate the second posture and the second position of the occupant in the cabin coordinate system when the occupant sits on the seat model; determine the eye height corresponding to the preset human body parameters in the second posture according to the correspondence between the human body posture and the eye height; determine the third position of the occupant's eyes in the cabin coordinate system according to the second position and the eye height corresponding to the preset human body parameters; determine the first angle of the occupant's eyes in the cabin coordinate system in the second posture according to the correspondence between the human body posture and the eye angle; and use the third position and the first angle as binocular features.

[0093] In some embodiments, when the calculation module 402 combines binocular features with the human eye field model to calculate the occupant's central line of sight, it is specifically used to use the human eye field model to simulate the first field of view of both eyes at a first position and a first angle; and use the center line of the first field of view as the occupant's central line of sight.

[0094] In some embodiments, the device also includes a training module 404, which is used to record a second angle of the vehicle screen after the manual adjustment if the occupant manually adjusts the angle of the vehicle screen after adjusting the angle of the vehicle screen to an angle suitable for the center line of sight; enter the second angle, the Hall signal and the preset human body parameters into a first training set; and use the first training set to train the first machine learning model to optimize the angle of the vehicle screen corresponding to different Hall signals of the seat motor.

[0095] Figure 4 The vehicle-mounted screen control device of the illustrated embodiment can be used to execute the technical solution of the above-mentioned method embodiment. Its implementation principle and technical effects are similar and will not be repeated here.

[0096] Figure 5 Schematic diagram of the structure of an electronic device in the embodiment of the present disclosure. Figure 5 , which shows a structural schematic diagram of an electronic device 500 suitable for implementing the embodiments of the present disclosure. Figure 5 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0097] like Figure 5 As shown, the electronic device 500 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 to a random access memory (RAM) 503 to implement the vehicle screen control method of the embodiment of the present disclosure. In the RAM 503, various programs and data required for the operation of the electronic device 500 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0098] Typically, the following devices may be connected to the I / O interface 505: an input device 506 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509. The communication device 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 5 The electronic device 500 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0099] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains a program code for executing the method shown in the flowchart, thereby implementing the above-mentioned vehicle screen control method. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 509, or installed from the storage device 508, or installed from the ROM 502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0100] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0101] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0102] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0103] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device:

[0104] Obtaining the seat posture of the seat in the vehicle where the occupant is located;

[0105] Calculate the occupant's central line of sight by combining the seat posture and human eye field model;

[0106] Adjust the angle of the vehicle screen to an angle that matches the central line of sight so that the vehicle screen is displayed in the center of the passenger's field of vision.

[0107] Optionally, when the above one or more programs are executed by the electronic device, the electronic device may also execute other steps described in the above embodiments.

[0108] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the crew computer, partially on the crew computer, as a separate software package, partially on the crew computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the crew computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0109] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0110] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the name of a unit does not, in some cases, limit the unit itself.

[0111] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0112] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0113] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0114] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0115] Although the subject matter has been described in language specific to structural features and / or method logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims. In addition, the embodiments of the present disclosure also provide a computer-readable storage medium on which a computer program is stored, and the computer program is executed by a processor to implement the vehicle screen control method described in the above embodiments.

[0116] The present disclosure also provides a vehicle, including: Figure 3 The in-vehicle screen controls shown and / or Figure 4 Computer equipment shown.

[0117] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the term "comprises" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

Claims

1. A vehicle screen control method, It is characterized in that include: Obtaining the seat posture of the seat in the vehicle where the occupant is located; Calculating the occupant's central line of sight by combining the seat posture and the human eye field model; The angle of the vehicle-mounted screen is adjusted to an angle that is compatible with the central line of sight, so that the vehicle-mounted screen is displayed in the center of the passenger's field of vision.

2. The method according to claim 1, It is characterized in that The obtaining of the seat posture of the seat in the vehicle comprises: Acquiring a Hall signal of a motor of the seat, wherein the motor is used to adjust the posture of the seat; A first posture and a first position of the seat in a cabin coordinate system are determined according to the Hall signal.

3. The method according to claim 1, It is characterized in that The calculating the central sight line of the occupant by combining the seat posture and the human eye field model comprises: Generating a seat model in the seat position in a cabin coordinate system based on the parameters of the seat; Simulating binocular features of the occupant when sitting on the seat model according to preset human body parameters; The central sight line of the occupant is calculated by combining the binocular features with the human eye field model.

4. The method according to claim 3, It is characterized in that The simulating the binocular features of the occupant when sitting on the seat model according to preset human body parameters includes: Simulating a second posture and a second position of the occupant in a vehicle cabin coordinate system when the occupant sits on the seat model; Determining the eye height corresponding to the preset human body parameters in the second posture according to the corresponding relationship between the human body posture and the eye height; Determining a third position of the occupant's eyes in the cabin coordinate system according to the second position and the eye height corresponding to the preset human body parameter; Determining a first angle of the occupant's eyes in the cabin coordinate system when the occupant is in the second posture according to a correspondence between a human body posture and an eye angle; The third position and the first angle are used as the binocular features.

5. The method according to claim 4, It is characterized in that The calculating the central sight line of the occupant by combining the binocular feature with the human eye field model includes: Using the human eye visual field model to simulate a first visual field of both eyes at the first position and the first angle; The center line of the first field of view is used as the center line of sight of the occupant.

6. The method according to claim 2, It is characterized in that After the angle of the vehicle-mounted screen is adjusted to an angle that is compatible with the central sight line, the method further includes: If the passenger manually adjusts the angle of the vehicle-mounted screen, then recording a second angle of the vehicle-mounted screen after the manual adjustment; Entering the second angle, the Hall signal and preset human body parameters into a first training set; The first machine learning model is trained using the first training set to optimize the angle of the in-vehicle screen corresponding to different Hall signals of the seat motor.

7. A vehicle-mounted screen control device, It is characterized in that include: an acquisition module, for acquiring binocular features of an occupant in response to an adjustment operation on a seat in the vehicle, the occupant being on the seat; A calculation module, used for calculating the central sight line of the occupant based on the binocular features and a human eye field model; The adjustment module is used to adjust the angle of the vehicle-mounted screen to an angle that is compatible with the central line of sight, so that the vehicle-mounted screen is displayed in the center of the passenger's field of vision.

8. A computer device, include: Memory; processor; as well as Computer programs; The computer program is stored in the memory and is configured to be executed by the processor to implement the method according to any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program stored thereon, It is characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

10. A vehicle, It is characterized in that It comprises the vehicle-mounted screen control device as claimed in claim 7 and / or the computer device as claimed in claim 8.

Citation Information

Cited By

  • Control method and control system of vehicle-mounted screen and vehicle

    CN121106031A

  • Control method and control system of vehicle-mounted screen and vehicle

    CN121106031B

  • Pickup method based on microphone group, electronic equipment, medium and product

    CN121126176A