Picture display method and device, electronic equipment and vehicle

Abstract

The invention relates to a picture display method and device, electronic equipment and a vehicle, and relates to the technical field of vehicle-mounted display methods, and the method comprises the steps: obtaining image information of a target user in a riding space; performing feature recognition on the image information to obtain eye feature information of the target user; performing feature processing on the eye feature information to obtain a sight line moving direction and a sight line moving speed of the target user; the display position of the display device is adjusted, so that the moving direction of the display position is matched with the sight line moving direction, and the change speed of the display position is matched with the sight line moving speed, and by the adoption of the technical scheme, the moving direction of the display position of the display device can be matched with the sight line moving direction; and the change speed of the display position of the display picture of the display equipment is matched with the sight line moving speed, so that passengers in the vehicle do not need to watch the display equipment along one sight line direction, and the riding experience of the passengers in the vehicle is improved.

Description

Technical Field

[0001] The present application relates to the technical field of vehicle-mounted display methods, and in particular to a screen display method. Background Art

[0002] In smart cars, as more and more display devices are used, the interaction between people and display devices is becoming more and more diverse. The current display methods can be divided into two categories: fixed display methods and mobile display methods.

[0003] Among them, taking the display method as a fixed display method as an example, the problems existing in the existing display method are explained. Among them, the fixed display method can include display devices such as instrument screen, head-up display, central control screen, and liftable display screen, among which the liftable display screen is a display device that can be unfolded or retracted. All methods in the fixed display method are to fix the position of the display device. When the passengers in the car interact with the display device, the display screen of the display device cannot be synchronized with the line of sight of the passengers in the car, so that the passengers in the car can only look at the display device in one line of sight, which reduces the riding experience of the passengers in the car. Summary of the invention

[0004] In view of this, the present disclosure provides a screen display method, device, electronic device and vehicle, the main purpose of which is to solve the problem that the display screen of the current display device cannot be synchronized with the line of sight of the passengers in the vehicle, so that the passengers in the vehicle can only look at the display device in one line of sight, thereby reducing the riding experience of the passengers in the vehicle.

[0005] In a first aspect, the present disclosure provides a screen display method, comprising: acquiring image information of a target user in a seating space;

[0006] Performing feature recognition on the image information to obtain eye feature information of the target user;

[0007] Performing feature processing on the eye feature information to obtain the sight line moving direction and sight line moving speed of the target user;

[0008] The display position of the display device is adjusted so that the moving direction of the display position matches the moving direction of the sight line, and the changing speed of the display position matches the moving speed of the sight line.

[0009] In a second aspect, the present disclosure provides a screen display device, comprising:

[0010] An acquisition module is used to acquire image information of a target user in the riding space;

[0011] A recognition module, used to perform feature recognition on the image information to obtain eye feature information of the target user;

[0012] A processing module, used for performing feature processing on the eye feature information to obtain the sight line moving direction and sight line moving speed of the target user;

[0013] The first adjustment module is used to adjust the display position of the display device so that the moving direction of the display position matches the moving direction of the sight line, and the changing speed of the display position matches the moving speed of the sight line.

[0014] In a third aspect, the present disclosure provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the screen display method described in the first aspect.

[0015] In a fourth aspect, the present disclosure provides an electronic device, including a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor, wherein the processor implements the screen display method described in the first aspect when executing the computer program.

[0016] By means of the above technical scheme, the present disclosure provides a screen display method, device, electronic device and vehicle. Compared with the current existing technology, the present disclosure can realize that the display position change speed of the display screen of the display device is synchronized with the line of sight movement speed of the passengers in the vehicle. Specifically, the image information of the target user in the riding space can be first obtained; the image information is feature recognized to obtain the eye feature information of the target user; the eye feature information is feature processed to obtain the line of sight movement direction and line of sight movement speed of the target user; the display position of the display device is adjusted so that the movement direction of the display position matches the line of sight movement direction, and the change speed of the display position matches the line of sight movement speed. The technical scheme of the present disclosure, by synchronously adjusting the display position of the display device based on the line of sight movement direction and line of sight movement speed of the target user, can realize that the screen display content of the display device and the line of sight focus area of ​​the target user are kept relatively still, so that the target user does not need to continuously look at the display device along a line of sight direction, and the user can accurately view the display screen in any line of sight direction, thereby improving the riding experience of the passengers in the vehicle.

[0017] The above description is only an overview of the technical solution of the present disclosure. In order to more clearly understand the technical means of the present disclosure, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present disclosure more obvious and easy to understand, the specific implementation methods of the present disclosure are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0019] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0020] Figure 1 A schematic diagram showing a flow chart of a screen display method provided by an embodiment of the present disclosure is shown;

[0021] Figure 2 A schematic diagram showing a flow chart of another screen display method provided by an embodiment of the present disclosure;

[0022] Figure 3 A schematic structural diagram of a picture display device provided by an embodiment of the present disclosure is shown.

[0023] Figure 4 A schematic structural diagram of another image display device provided by an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0024] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.

[0025] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0026] In the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be an indirect connection through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0027] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0028] In order to improve the problem in the current existing screen display method that when the passengers in the car interact with the display device, the display screen of the display device cannot be synchronized with the line of sight of the passengers in the car, so that the passengers in the car can only look at the display device in one line of sight, which reduces the riding experience of the passengers in the car. The embodiment of the present disclosure provides a screen display method, the execution subject can be a vehicle-mounted tracking display system or a control module in the vehicle-mounted tracking display system, which is used to control the display screen of the vehicle-mounted screen to move synchronously with the line of sight of the passengers in the car (that is, the display screen and the head remain relatively still), so that the passengers in the car do not need to look at the vehicle-mounted screen in one line of sight, thereby improving the riding experience of the passengers in the car.

[0029] Step 101: Obtain image information of a target user in a seating space.

[0030] Among them, the riding space may be the riding space inside the vehicle; the target user refers to a user with specific permissions, such as a driver, a co-pilot, etc., and there is no specific limitation on this; as a possible implementation method, the target users may be prioritized, such as setting the target users from high to low as the first priority, the second priority, etc., the driver may be set to the first priority, and the co-pilot may be set to the second priority, and the display device may sort according to the identified priority levels, and adjust the display position of the target user with the highest level first; the image information may include multiple frames of head images captured while the target user's head is moving, or multiple frames of eye images captured while the target user's eyes are moving.

[0031] For the embodiments of the present disclosure, as a possible implementation method, a sensor module or an image acquisition device such as a camera can be used to obtain image information of a target user in the riding space, wherein the image acquisition device can capture an image of the target user's head during movement, or an image of the eyes during movement, and the sensors in the sensor module can include but are not limited to posture sensors, motion sensors, etc.

[0032] For the embodiments of the present disclosure, the execution subject may be a control module. As a possible implementation method, the control module may receive the image information of the target user acquired by the image acquisition device, and determine the eye feature information of the target user based on the image information. By performing feature processing on the eye feature information, the line of sight movement direction and line of sight movement speed of the target user may be obtained, and the display position of the display device may be adjusted, so that the moving direction of the display position of the display device matches the line of sight movement direction, and the changing speed of the display position of the display screen of the display device matches the line of sight movement speed, so that the passengers in the car do not need to look at the display device along a line of sight direction, thereby improving the riding experience of the passengers in the car. For the specific implementation process, please refer to steps 102, 103 and 104 of the embodiment.

[0033] Step 102: Perform feature recognition on the image information to obtain eye feature information of the target user.

[0034] Among them, the eye feature information may be features such as pupil point coordinates, pupil connection points, etc., and there is no specific limitation on this.

[0035] For the disclosed embodiment, before performing feature recognition on the image information, since the image information acquired by the image acquisition device may produce geometric distortion, the image information of the target user may be corrected first, so that the eye feature information of the target user can be more accurately recognized. There are many methods for image correction, such as Fourier transform, affine geometric transform, etc., which are not specifically limited.

[0036] In the embodiments of the present disclosure, there may be multiple methods for feature recognition, such as feature recognition models, corner detection algorithms, etc., which are not specifically limited. In the following embodiment steps of the present disclosure, feature recognition based on feature recognition models is taken as an example to illustrate the technical solution in the present disclosure, but it does not constitute a specific limitation.

[0037] Step 103: perform feature processing on the eye feature information to obtain the sight line movement direction and sight line movement speed of the target user.

[0038] For the embodiments of the present disclosure, the line of sight movement direction and line of sight movement speed of the target user can be obtained by performing feature processing on the eye feature information. The line of sight movement direction is used to determine the movement direction of the display device, and the line of sight movement speed is used to determine the movement speed of the display device. The feature processing method may include but is not limited to data preprocessing, feature selection, dimensionality reduction, etc., which are not limited to.

[0039] Step 104: adjust the display position of the display device so that the moving direction of the display position matches the moving direction of the sight line, and the changing speed of the display position matches the moving speed of the sight line.

[0040] For the disclosed embodiment, the control module can control the execution module so that the execution module adjusts the display position of the display device. The display device may include but is not limited to a flat panel display, smart glasses and other displays; the execution module may include a motor and a mechanical arm, and the motor is used to drive the mechanical arm to drive the display device to move, so that the moving direction of the display position of the display device matches the moving direction of the line of sight, and the changing speed of the display position of the display screen of the display device matches the moving speed of the line of sight, so that the passengers in the car do not need to look at the display device in one line of sight, thereby improving the riding experience of the passengers in the car.

[0041] In summary, according to the screen display method provided by the present disclosure, compared with the current existing technology, the present disclosure can achieve that the display position change speed of the display screen of the display device is synchronized with the line of sight movement speed of the passengers in the car. Specifically, the image information of the target user in the riding space can be first obtained; feature recognition is performed on the image information to obtain the eye feature information of the target user; feature processing is performed on the eye feature information to obtain the line of sight movement direction and line of sight movement speed of the target user; the display position of the display device is adjusted so that the movement direction of the display position matches the line of sight movement direction, and the change speed of the display position matches the line of sight movement speed. The technical solution of the present disclosure, by synchronously adjusting the display position of the display device based on the line of sight movement direction and line of sight movement speed of the target user, can achieve that the screen display content of the display device and the line of sight focus area of ​​the target user are kept relatively still, so that the target user does not need to continuously look at the display device along one line of sight direction, and the user can accurately view the display screen in any line of sight direction, thereby improving the riding experience of the passengers in the car.

[0042] Further, as a refinement and extension of the above embodiment, in order to fully illustrate the specific implementation process of the method of the embodiment of the present disclosure, the embodiment of the present disclosure provides the following Figure 2 The specific method shown includes:

[0043] Step 201: Obtain image information of a target user in a seating space.

[0044] For the implementation process of the embodiment of the present disclosure, please refer to the relevant description in step 101 of the embodiment, which will not be repeated here.

[0045] Step 202: input the image information into a preset key point detection model to obtain the eye key point coordinates of the target user; determine the eye key point coordinates and the connecting lines between adjacent eye key point coordinates as the eye feature information of the target user.

[0046] The preset key point detection model is a key point of the eye that can be preset according to the actual situation for detecting image information, and there can be multiple preset key point detection models. For example, a multimedia machine learning (MediaPipe) model can be used to complete real-time detection and tracking of eye key points, wherein the MediaPipe model can complete face recognition, iris detection, body tracking, etc.

[0047] For the disclosed embodiment, the image information can be input into the MediaPipe model, the eye key point coordinates and the connecting lines between the adjacent eye key point coordinates can be obtained, and the eye key point coordinates and the connecting lines are determined as eye feature information, wherein the eye key point coordinates can be pupil coordinates, and the connecting lines can be pupil connection points, which are not specifically limited. Through the eye feature information, the display device can more accurately track the line of sight movement direction and line of sight movement speed of the target user.

[0048] Step 203: perform feature processing on the eye feature information to obtain the sight line movement direction and sight line movement speed of the target user.

[0049] For the disclosed embodiment, as a possible implementation method, eye feature information can be input into a convolutional neural network, and the convolutional neural network is used to determine the first eye feature position in the eye feature information, and the convolutional neural network is used to determine the second eye feature position in the eye feature information, the first eye feature position is the eye pupil position of the first frame image captured in the image information, and the second eye feature position is the eye pupil position of the second frame image captured in the image information, wherein the second frame image and the first frame image are adjacent frame images to each other, such as the second frame image is the next frame image of the first frame image; by comparing the first eye feature position and the second eye feature position, the pupil position change information of the target user is obtained; based on the pupil position change information, the line of sight movement direction and line of sight movement speed of the target user are determined. Among them, convolutional neural networks (CNN) are a type of feedforward neural network that includes convolution calculation and has a deep structure. Due to the difference in hierarchical structure and filter size, convolutional neural networks can capture high-level, intermediate and even low-level features. The process of determining the feature position may include feature extraction, fusion, classification and other steps, which are not specifically limited.

[0050] For the embodiments of the present disclosure, the pupil position change information includes the pupil movement position and the pupil movement speed. Based on the pupil position change information, the line of sight movement direction and the line of sight movement speed of the target user are determined. The specific implementation method can be described as: the position movement direction corresponding to the pupil movement position is determined as the line of sight movement direction of the target user; the pupil movement speed is determined as the line of sight movement speed of the target user.

[0051] For the embodiments of the present disclosure, when a convolutional neural network performs feature extraction on eye feature information, as a possible implementation method, a deep network convolutional layer of the convolutional neural network can be used to extract deep eye features of multiple eye images generated during eye movement in the eye feature information, which can include a first deep eye feature and a second deep eye feature, the first deep eye feature being all feature points of an eye pupil region of a first frame image captured in the image information obtained by the convolutional neural network; the second deep eye feature being all feature points of an eye pupil region of a second frame image captured in the image information obtained by the convolutional neural network; since the receptive field of the deep network convolutional layer increases and the overlapping area between the receptive fields increases, the eye image can be compressed, so that the first deep eye feature and the second deep eye feature obtained are all feature points of the eye pupil region during eye movement.

[0052] As a possible implementation method, the shallow network convolution layer of the convolutional neural network can be used to extract shallow eye features of multiple eye images generated during eye movement in the eye feature information, which can include a first shallow eye feature and a second shallow eye feature. The first shallow eye feature is the texture edge of the eye pupil area of ​​the first frame image captured in the image information obtained by the convolutional neural network; the second shallow eye feature is the texture edge of the eye pupil area of ​​the second frame image captured in the image information obtained by the convolutional neural network; because the receptive field of the shallow network convolution layer is small and the overlapping area of ​​the receptive field is also small, the captured shallow eye features can contain more detailed information, such as pupil color, texture, edge and other information, and there is no specific limitation on this.

[0053] In the embodiments of the present disclosure, when the convolutional neural network performs feature fusion on eye feature information, there may be multiple methods of feature fusion, such as early fusion, late fusion, etc., which are not specifically limited. Feature fusion may be performed on the first deep eye feature and the first shallow eye feature, as well as on the second deep eye feature and the second shallow eye feature, and feature classification may be performed on the result of the feature fusion, wherein there may be multiple methods of feature classification, such as classifying and outputting features using a cross entropy loss function, which is not specifically limited. The first eye feature position and the second eye feature position of the target user are extracted from the feature classification result, wherein the feature classification result may include the first eye feature position coordinates and the second eye feature position coordinates of the target user.

[0054] As a possible implementation method, the eye feature information may also include the corresponding change time that follows the pupil changes during eye movement. By comparing the first eye feature position and the second eye feature position, the pupil position change information between the pupil point coordinates of the target user can be determined. The pupil position change information is the position deviation between the first eye feature position and the second eye feature position. Based on the pupil position change information and the corresponding change time generated by the pupil position change, the pupil movement speed can be determined, and the pupil movement speed is used as the line of sight movement speed; the pupil movement direction is detected, and the pupil movement direction is used as the line of sight movement direction, wherein there can be many methods for detecting the pupil movement direction, which are not limited to.

[0055] Step 204: adjust the display position of the display device so that the moving direction of the display position matches the moving direction of the sight line, and the changing speed of the display position matches the moving speed of the sight line.

[0056] For the embodiment of the present disclosure, before adjusting the display position of the display device, the specific implementation method can be described as: determining the working state of the display device, which may include but is not limited to the power-on state, the running state, the standby state and the power-off state, and when determining that the working state of the display device is the running state, adjusting the display position of the display device. Among them, the power-on state is the state in which the display device is powered on; the running state is the state in which the moving direction of the display position of the display device matches the moving direction of the line of sight, and the changing speed of the display position matches the moving speed of the line of sight; the standby state is the state in which the display device is turned on but does not track the eyes of the occupants in the vehicle; the power-off state is the state in which the tracking of the eyes of the occupants in the vehicle is stopped.

[0057] In an embodiment of the present disclosure, before determining that the working state of the display device is the running state and adjusting the display position of the display device, the display position of the display device can be determined first. As a possible implementation method, eye tracking technology can be used to determine the line of sight movement position based on the line of sight movement direction and line of sight movement speed; the control module can calculate the relative distance between the display position and the line of sight movement position in real time, and determine whether the relative distance is equal to a preset distance threshold, wherein the preset distance threshold is a preset line of sight distance between the target user and the display position; if the relative distance is not equal to the preset distance threshold, the display position of the display device is adjusted.

[0058] In a specific application scenario, as a possible implementation method, the target user can manually adjust the display device to the position required by the user. At this time, the display position of the display device is a fixed position, and there is a first distance between the target user and the display device (the first distance can be used as a preset line of sight distance). After the display device enters the operating state, the display device can track the target user's line of sight moving position. When the target user's line of sight moving position changes, the control module can solve the second distance between the display position and the line of sight moving position in real time (the second distance can be used as a relative distance), and compare it with the first distance. If the first distance is inconsistent with the second distance, the control module can calculate the distance difference between the first distance and the second distance, and generate a control instruction for eliminating the distance difference. Based on the control instruction, the display position is controlled to be adjusted so that the moving direction of the display position is consistent with the line of sight moving direction of the target user, and the changing speed of the display position is equal to the line of sight moving speed of the target user, so that the target user does not need to continue to look at the display device in one line of sight direction. In any line of sight direction, the user can accurately view the display screen, thereby improving the riding experience of the passengers in the vehicle.

[0059] As a possible implementation method, when determining that the working state of the display device is the running state and adjusting the display position of the display device, it is possible to determine whether the display position of the display device is within the sight range of the target user based on the display position and the direction of sight movement; if the display position of the display device is not within the sight range of the target user, the display position of the display device is adjusted. By determining whether the display position of the display device is within the sight range of the target user, the waste of resources caused by the display device monitoring the eye position of the occupant in the vehicle in real time and adjusting the display position of the display device in real time can be reduced.

[0060] In summary, according to the screen display method provided by the present disclosure, compared with the current existing technology, the present disclosure can achieve that the display position change speed of the display screen of the display device is synchronized with the line of sight movement speed of the passengers in the car. Specifically, the image information of the target user in the riding space can be first obtained; feature recognition is performed on the image information to obtain the eye feature information of the target user; feature processing is performed on the eye feature information to obtain the line of sight movement direction and line of sight movement speed of the target user; the display position of the display device is adjusted so that the movement direction of the display position matches the line of sight movement direction, and the change speed of the display position matches the line of sight movement speed. The technical solution of the present disclosure, by synchronously adjusting the display position of the display device based on the line of sight movement direction and line of sight movement speed of the target user, can achieve that the screen display content of the display device and the line of sight focus area of ​​the target user are kept relatively still, so that the target user does not need to continuously look at the display device along one line of sight direction, and the user can accurately view the display screen in any line of sight direction, thereby improving the riding experience of the passengers in the car.

[0061] Based on the above Figure 1 and Figure 2 The specific implementation of the method shown in the embodiment provides a picture display device, such as Figure 3 As shown, the device includes: an acquisition module 31, an identification module 32, a processing module 33, and a first adjustment module 34;

[0062] An acquisition module 31 is used to acquire image information of a target user in the seating space;

[0063] The recognition module 32 is used to perform feature recognition on the image information to obtain eye feature information of the target user;

[0064] A processing module 33 is used to perform feature processing on the eye feature information to obtain the sight line moving direction and sight line moving speed of the target user;

[0065] The first adjustment module 34 is used to adjust the display position of the display device so that the moving direction of the display position matches the moving direction of the sight line, and the changing speed of the display position matches the moving speed of the sight line.

[0066] In a specific application scenario, the recognition module 32 can be used to input image information into a preset key point detection model to obtain the eye key point coordinates of the target user; the eye key point coordinates and the connecting lines between adjacent eye key point coordinates are determined as the eye feature information of the target user.

[0067] In a specific application scenario, the processing module 33 can be used to input eye feature information into a convolutional neural network, determine a first eye feature position in the eye feature information using the convolutional neural network, and determine a second eye feature position in the eye feature information using the convolutional neural network, the first eye feature position being the pupil position of a first eye pupil region, and the second eye feature position being the pupil position of a second eye pupil region; obtain pupil position change information of the target user by comparing the first eye feature position and the second eye feature position; and determine the line of sight movement direction and line of sight movement speed of the target user based on the pupil position change information.

[0068] In a specific application scenario, the pupil position change information includes the pupil movement position and the pupil movement speed. The processing module 33 can be used to determine the position movement direction corresponding to the pupil movement position as the line of sight movement direction of the target user; and determine the pupil movement speed as the line of sight movement speed of the target user.

[0069] In specific application scenarios, such as Figure 4 As shown, the device further includes: a first determination module 35, a calculation module 36, a judgment module 37, and a second adjustment module 38;

[0070] A first determination module 35 is used to determine a display position of a display device, and determine a sight line moving position based on a sight line moving direction and a sight line moving speed;

[0071] A calculation module 36, used for calculating the relative distance between the display position and the sight moving position;

[0072] A determination module 37, configured to determine whether the relative distance is equal to a preset distance threshold, wherein the preset distance threshold is a preset sight distance between the target user and the display position;

[0073] The second adjustment module 38 is configured to adjust the display position of the display device if the relative distance is not equal to a preset distance threshold.

[0074] In a specific application scenario, the first adjustment module 34 can be used to calculate the distance difference between the relative distance and a preset distance threshold; generate a control instruction for eliminating the distance difference; and adjust the display position based on the control instruction so that the moving direction of the display position is consistent with the moving direction of the target user's line of sight, and the changing speed of the display position is equal to the moving speed of the target user's line of sight.

[0075] In specific application scenarios, such as Figure 4 As shown, the device further includes: a second determination module 39;

[0076] A second determination module 39, used to determine the working state of the display device;

[0077] In a specific application scenario, the judgment module 37 can be used to adjust the display position of the display device when it is determined that the working state of the display device is the running state.

[0078] It should be noted that for other corresponding descriptions of the functional units involved in the information processing device provided in this embodiment, please refer to Figure 1 and Figure 2 The corresponding description in will not be repeated here.

[0079] Based on the above Figure 1 and Figure 2 The method shown in the embodiment also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the above-mentioned Figure 1 and Figure 2 The method shown.

[0080] Based on this understanding, the technical solution of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, USB flash drive, mobile hard disk, etc.), including a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods of various implementation scenarios of the present application.

[0081] Based on the above Figure 1 and Figure 2 The method shown, and Figure 3 and Figure 4 In order to achieve the above-mentioned purpose, the embodiment of the present application also provides an electronic device that can be configured on the vehicle (such as an electric vehicle) side, and the device includes a storage medium and a processor; the storage medium is used to store a computer program; the processor is used to execute the computer program to achieve the above-mentioned Figure 1 and Figure 2 The method shown.

[0082] Optionally, the above-mentioned physical device may also include a user interface, a network interface, a camera, a radio frequency (RF) circuit, a sensor, an audio circuit, a WI-FI module, etc. The user interface may include a display, an input unit such as a keyboard, etc., and the optional user interface may also include a USB interface, a card reader interface, etc. The network interface may optionally include a standard wired interface, a wireless interface (such as a WI-FI interface), etc.

[0083] Those skilled in the art will appreciate that the above-mentioned physical device structure provided in this embodiment does not constitute a limitation on the physical device, and may include more or fewer components, or a combination of certain components, or different arrangements of components.

[0084] The storage medium may also include an operating system and a network communication module. The operating system is a program that manages the hardware and software resources of the above-mentioned physical device, and supports the operation of the information processing program and other software and / or programs. The network communication module is used to realize the communication between the components inside the storage medium, and the communication with other hardware and software in the information processing physical device.

[0085] Through the description of the above implementation methods, those skilled in the art can clearly understand that the present application can be implemented by means of software plus necessary general hardware platforms, or by hardware. By applying the solution of this embodiment, compared with the current prior art, the present disclosure can realize that the display position change speed of the display screen of the display device is synchronized with the line of sight movement speed of the occupants in the vehicle. Specifically, the image information of the target user in the riding space can be first obtained; the image information is feature recognized to obtain the eye feature information of the target user; the eye feature information is feature processed to obtain the line of sight movement direction and line of sight movement speed of the target user; the display position of the display device is adjusted so that the moving direction of the display position matches the line of sight movement direction, and the changing speed of the display position matches the line of sight movement speed. The technical solution disclosed in the present disclosure, by synchronously adjusting the display position of the display device based on the line of sight movement direction and line of sight movement speed of the target user, can realize that the screen display content of the display device and the line of sight focus area of ​​the target user are kept relatively still, so that the target user does not need to continuously look at the display device along a line of sight direction, and the user can accurately view the display screen in any line of sight direction, thereby improving the riding experience of the occupants in the vehicle.

[0086] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the term "comprising" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprising a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0087] The above is only a specific implementation of the present application, so that those skilled in the art can understand or implement the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to these embodiments herein, but will conform to the widest scope consistent with the principles and novel features applied for herein.

Claims

1. A screen display method, characterized in that: The method comprises: Obtain image information of target users in the riding space; Performing feature recognition on the image information to obtain eye feature information of the target user; Performing feature processing on the eye feature information to obtain the sight line moving direction and sight line moving speed of the target user; The display position of the display device is adjusted so that the moving direction of the display position matches the moving direction of the sight line, and the changing speed of the display position matches the moving speed of the sight line.

2. The method according to claim 1, characterized in that The performing feature recognition on the image information to obtain eye feature information of the target user includes: Inputting the image information into a preset key point detection model to obtain eye key point coordinates of the target user; The eye key point coordinates and the connecting lines between adjacent eye key point coordinates are determined as the eye feature information of the target user.

3. The method according to claim 2, characterized in that The performing feature processing on the eye feature information to obtain the sight line moving direction and sight line moving speed of the target user includes: Inputting the eye feature information into a convolutional neural network, determining a first eye feature position in the eye feature information using the convolutional neural network, and determining a second eye feature position in the eye feature information using the convolutional neural network, wherein the first eye feature position is a pupil position of a first eye pupil region, and the second eye feature position is a pupil position of a second eye pupil region; Obtaining pupil position change information of the target user by comparing the first eye feature position and the second eye feature position; Based on the pupil position change information, the sight line movement direction and sight line movement speed of the target user are determined.

4. The method according to claim 3, characterized in that The pupil position change information includes the pupil movement position and the pupil movement speed, and determining the sight line movement direction and the sight line movement speed of the target user based on the pupil position change information includes: Determining the position movement direction corresponding to the pupil movement position as the sight line movement direction of the target user; The pupil movement speed is determined as the sight line movement speed of the target user.

5. The method according to claim 1, characterized in that Before adjusting the display position of the display device, the method further includes: Determining the display position of the display device, and determining the sight line moving position based on the sight line moving direction and the sight line moving speed; Calculating the relative distance between the display position and the sight line moving position; Determining whether the relative distance is equal to a preset distance threshold, wherein the preset distance threshold is a preset line of sight distance between the target user and the display position; If the relative distance is not equal to the preset distance threshold, the display position of the display device is adjusted.

6. The method according to claim 5, characterized in that The adjusting the display position of the display device so that the moving direction of the display position matches the moving direction of the sight line, and the changing speed of the display position matches the moving speed of the sight line, includes: Calculating a distance difference between the relative distance and the preset distance threshold; generating a control instruction for eliminating the distance difference; The display position is adjusted based on the control instruction so that a moving direction of the display position is consistent with a moving direction of a sight line of the target user, and a changing speed of the display position is equal to a moving speed of a sight line of the target user.

7. The method according to any one of claims 1 to 6, characterized in that Before adjusting the display position of the display device, the method further includes: Determining the operating status of the display device; The adjusting the display position of the display device includes: When it is determined that the working state of the display device is the running state, the display position of the display device is adjusted.

8. A screen display device, characterized in that: include: An acquisition module is used to acquire image information of a target user in the riding space; A recognition module, used to perform feature recognition on the image information to obtain eye feature information of the target user; A processing module, used for performing feature processing on the eye feature information to obtain the sight line moving direction and sight line moving speed of the target user; The first adjustment module is used to adjust the display position of the display device so that the moving direction of the display position matches the moving direction of the sight line, and the changing speed of the display position matches the moving speed of the sight line.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

10. An electronic device comprising a storage medium, a processor, and a computer program stored in the storage medium and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 7 is implemented.

Images