Vehicle display control method, controller and vehicle

Abstract

The invention relates to a vehicle display control method, a controller and a vehicle, and the method comprises the steps: responding to a first gesture operation of a vehicle user on a vehicle-mounted display screen, and recognizing a first finger form corresponding to the first gesture operation; and controlling the display content of the vehicle-mounted display screen according to the first finger form. According to the technical scheme, the display content on the vehicle-mounted display screen can be controlled in the air through the finger form in the gesture operation, compared with the prior art that the vehicle-mounted display screen is controlled through a remote controller, additional equipment does not need to be added, the convenience of controlling the vehicle-mounted display screen can be improved, and meanwhile the control efficiency of the vehicle-mounted display screen can be improved.

Description

Technical Field

[0001] The present disclosure relates to the field of control technologies, and in particular, to a vehicle display control method, a controller, and a vehicle. Background Art

[0002] In-vehicle displays are mainly used to display relevant parameter information, entertainment navigation information in the vehicle, and control the vehicle. In related technologies, the in-vehicle display in the vehicle is controlled by a remote controller. However, when controlling the in-vehicle display by the remote controller, the convenience of controlling the in-vehicle display is relatively low. Summary of the Invention

[0003] The purpose of the present disclosure is to provide a vehicle display control method, a controller, and a vehicle to solve the technical problems existing in related technologies.

[0004] To achieve the above purpose, in a first aspect, the present disclosure provides a vehicle display control method, including: Responding to a first gesture operation of a vehicle user on an in-vehicle display, and identifying a first finger form corresponding to the first gesture operation; Controlling the display content of the in-vehicle display according to the first finger form.

[0005] Optionally, the identifying the finger form corresponding to the first gesture operation includes: For each finger corresponding to the first gesture operation, identifying the straight or curved form of the finger; The controlling the display content of the in-vehicle display according to the first finger form includes: Controlling the display content of the in-vehicle display according to the straight or curved form of each finger.

[0006] Optionally, the identifying the straight or curved form of the finger for each finger corresponding to the first gesture operation includes: For each finger corresponding to the first gesture operation, determining the straight or curved form of the finger according to a first position point on the palm corresponding to the first gesture operation and a second position point on the finger joint.

[0007] Optionally, the determining the straight or curved form of the finger according to the first position point on the palm corresponding to the first gesture operation and the second position point on the finger joint includes: Determining the straight or curved form of the finger according to a first distance and a second distance, where the first distance is the sum of the distances between the first position point and all adjacent position points among all the second position points, and the second distance is the distance between the first position point and the second position point on the finger that is farthest from the first position point.

[0008] Optionally, determining the straight or curved state of the finger according to the first distance and the second distance includes: When the ratio of the first distance to the second distance is less than or equal to a preset ratio, determining the straight or curved state as a straight state; or, When the ratio of the first distance to the second distance is greater than the preset ratio, determining the straight or curved state as a curved state.

[0009] Optionally, controlling the display content of the in-vehicle display according to the first finger state includes: When the first finger state indicates that a preset finger is in a straight state, controlling the content in the in-vehicle display to change following the first gesture operation.

[0010] Optionally, controlling the content in the in-vehicle display to change following the first gesture operation includes: Controlling a first manipulation pointer displayed in the in-vehicle display to move following the first gesture operation, where the first manipulation pointer is used to select a target function module from the function modules displayed in the in-vehicle display.

[0011] Optionally, the preset finger includes at least two preset fingers, and controlling the content in the in-vehicle display to change following the first gesture operation includes: Controlling the content in the in-vehicle display to scale following the opening and closing state of the at least two fingers corresponding to the first gesture operation, or, Controlling the content in the in-vehicle display to rotate following the rotation state of the at least two fingers corresponding to the first gesture operation.

[0012] Optionally, controlling the content in the in-vehicle display to scale following the opening and closing state of the at least two fingers corresponding to the first gesture operation includes: Displaying a second manipulation pointer and a third manipulation pointer in the in-vehicle display; Controlling the content in the in-vehicle display to scale following the opening and closing state of the at least two fingers corresponding to the first gesture operation according to the second manipulation pointer and the third manipulation pointer.

[0013] Optionally, the reference point for scaling is determined based on the display positions of the second manipulation pointer and the third manipulation pointer in the in-vehicle display.

[0014] Optionally, controlling the content in the in-vehicle display to rotate following the rotation state of the at least two fingers corresponding to the first gesture operation includes: Display a second manipulation pointer and a third manipulation pointer on the in-vehicle display screen; According to the second manipulation pointer and the third manipulation pointer, control the content in the in-vehicle display screen to rotate following the rotation state of the at least two fingers corresponding to the first gesture operation.

[0015] Optionally, the reference point of the rotation is determined based on the display positions of the second manipulation pointer and the third manipulation pointer on the in-vehicle display screen.

[0016] Optionally, the method further includes: In response to a change of the gesture operation of the vehicle user on the in-vehicle display screen from a single-finger gesture operation to a multi-finger gesture operation, display a second manipulation pointer and a third manipulation pointer on the in-vehicle display screen; When the distance between the second manipulation pointer and the third manipulation pointer is greater than a preset distance, control the in-vehicle display screen to enter a multi-finger control mode, where the multi-finger gesture operation is to control the in-vehicle display screen with at least two fingers.

[0017] Optionally, the method further includes: In response to a second gesture operation of the vehicle user on the in-vehicle display screen, identify the second finger form of the second gesture operation; In the case where the second finger form is a preset finger form, control the in-vehicle display screen to exit the multi-finger control mode, or, When the distance between the second manipulation pointer and the third manipulation pointer is less than or equal to the preset distance, control the in-vehicle display screen to exit the multi-finger control mode.

[0018] Optionally, the controlling the display content of the in-vehicle display screen according to the first finger form includes: In the case where the first finger form represents that a preset finger changes from a straight form to a bent form and the target function module in the in-vehicle display screen is in a selected state, display the module content corresponding to the target function module on the in-vehicle display screen, or, In the case where the first finger form represents a bent form and the target function module in the in-vehicle display screen is in a selected state, control the content in the in-vehicle display screen to move following the first gesture operation.

[0019] Optionally, the case where the first finger form represents that a preset finger changes from a straight form to a bent form and the target function module in the in-vehicle display screen is in a selected state includes: When the target function module in the in-vehicle display screen is in a selected state, in response to the preset finger of the first finger form changing from a straightened form to a bent form, control the first manipulation pointer displayed on the in-vehicle display screen to change to a fourth manipulation pointer; Displaying the module content corresponding to the target function module on the in-vehicle display screen includes: According to the fourth manipulation pointer, control the in-vehicle display screen to display the module content corresponding to the target function module.

[0020] Optionally, controlling the content in the in-vehicle display screen to move following the first gesture operation includes: Control the fourth manipulation pointer displayed in the in-vehicle display screen to move following the first gesture operation, and the fourth manipulation pointer is used to move a target function module in the function modules displayed on the in-vehicle display screen.

[0021] Optionally, the method further includes: In response to the triggering operation of the vehicle user on the gesture control control displayed on the in-vehicle display screen, control the in-vehicle display screen to enter the gesture control mode, and display the display content for the vehicle user to perform gesture control on the in-vehicle display screen.

[0022] Optionally, the recognizing the first finger form corresponding to the first gesture operation in response to the first gesture operation of the vehicle user on the in-vehicle display screen includes: In response to the first gesture operation of the vehicle user on the in-vehicle display screen within the preset area, recognize the first finger form corresponding to the first gesture operation, where the preset area is a gesture activity area capable of controlling the display content of the in-vehicle display screen.

[0023] Optionally, the recognizing the first finger form corresponding to the first gesture operation in response to the first gesture operation of the vehicle user on the in-vehicle display screen within the preset area includes: In response to the first gesture operation of the vehicle user on the in-vehicle display screen within the preset area, convert the first gesture operation into a spatial coordinate, and recognize the first finger form according to the spatial coordinate.

[0024] Optionally, the method further includes: Obtain the first gesture operation of the vehicle user on the in-vehicle display screen through the image acquisition module on the in-vehicle display screen; Recognize the first gesture operation through the data processing layer in the in-vehicle display screen of the vehicle to obtain the first finger form corresponding to the first gesture operation, and control the display content of the in-vehicle display screen according to the first finger form.

[0025] Optionally, the first gesture operation is recognized by a data processing layer in an in-vehicle display screen of a vehicle to obtain a first finger form corresponding to the first gesture operation, and the display content of the in-vehicle display screen is controlled according to the first finger form, including: The first gesture operation is recognized by a source data common processing layer in the data processing layer to obtain an initial finger form; The initial finger form is rendered by a source data special effect processing layer in the data processing layer to obtain a first finger form; The first finger form is displayed by a display layer in the data processing layer, and the display content of the in-vehicle display screen is controlled according to the first finger form.

[0026] In a second aspect, the present disclosure also provides a controller, including: A memory on which a computer program is stored; A processor configured to execute the computer program in the memory to implement the steps of any of the methods provided in the first aspect of the present disclosure.

[0027] In a third aspect, the present disclosure also provides a vehicle, where the vehicle includes the controller provided in the second aspect of the present disclosure Through the above technical solutions, in response to a first gesture operation of a vehicle user on an in-vehicle display screen, the first finger form corresponding to the first gesture operation is recognized, and then the display content of the in-vehicle display screen is controlled according to the first finger form. It is possible to realize remotely controlling the display content on the in-vehicle display screen through the finger form in the gesture operation. Compared with the related art of controlling the in-vehicle display screen by a remote controller, no additional device needs to be added, thereby improving the convenience of controlling the in-vehicle display screen and also improving the control efficiency of the in-vehicle display screen.

[0028] Other features and advantages of the present disclosure will be described in detail in the subsequent specific implementation part. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The drawings are used to provide a further understanding of the present disclosure and constitute a part of the specification. They are used together with the following specific implementation to explain the present disclosure, but do not constitute a limitation to the present disclosure. In the drawings: Figure 1 FIG. is a schematic diagram showing a vehicle display control method according to an exemplary embodiment of the present disclosure.

[0030] Figure 2 FIG. is a schematic diagram showing controlling the display content of an in-vehicle display screen by a first finger form according to an exemplary embodiment of the present disclosure.

[0031] Figure 3It is a schematic diagram showing the control of the display content of an in-vehicle display screen by a first finger in a bent form according to an exemplary embodiment of the present disclosure.

[0032] Figure 4 It is a schematic diagram showing the control of the display content of an in-vehicle display screen by a first finger according to an exemplary embodiment of the present disclosure.

[0033] Figure 5 It is a schematic diagram showing the control of the display content of an in-vehicle display screen by a first finger in a multi-finger form according to an exemplary embodiment of the present disclosure.

[0034] Figure 6 It is a schematic diagram showing the initial page of an in-vehicle display screen according to an exemplary embodiment of the present disclosure.

[0035] Figure 7 It is a schematic diagram showing the gesture activity area of gesture operations according to an exemplary embodiment of the present disclosure.

[0036] Figure 8 It is a schematic diagram showing the data flow of a vehicle display control method according to an exemplary embodiment of the present disclosure.

[0037] Figure 9 It is a schematic diagram showing a vehicle display control device according to an exemplary embodiment of the present disclosure.

[0038] Figure 10 It is a block diagram of a vehicle shown according to an exemplary embodiment. Detailed implementation manners

[0039] The following will describe in detail the specific implementation manners of the present disclosure with reference to the accompanying drawings. It should be understood that the specific implementation manners described herein are only for explaining and illustrating the present disclosure, and are not used to limit the present disclosure.

[0040] With the development of travel electrification and intelligence, the demand for large-space intelligent rear seats in commercial and household vehicles has become a standard configuration. Among them, the configuration of in-vehicle display screens in the rear seats adds a touch of luxury and intelligence to this standard configuration. However, due to limitations in the flexibility and safety of travel, there may be some limitations in the spatial association between the seat and the in-vehicle display screen, resulting in less comfortable operation of the in-vehicle display screen by vehicle users on the seat.

[0041] In related technologies, the in-vehicle display screen is controlled by equipping a remote controller. However, the inventor found that when controlling the in-vehicle display screen with a remote controller, unexpected situations such as forgetting to replace the battery of the remote controller, losing the remote controller, or not knowing where the remote controller is hidden and having to search the entire vehicle back and forth often occur during the use of the remote controller, resulting in the inability to control the in-vehicle display screen in a timely manner and reducing the control convenience of the in-vehicle display screen.

[0042] In view of this, the present disclosure provides a vehicle display control method, a controller, and a vehicle to solve the technical problems existing in the related art.

[0043] As Figure 1 shown, Figure 1 is a schematic diagram showing a vehicle display control method according to an exemplary embodiment of the present disclosure. Referring to Figure 1 , the method includes: S101: In response to a first gesture operation of a vehicle user on an in-vehicle display screen, identify a first finger form corresponding to the first gesture operation; S102: Control the display content of the in-vehicle display screen according to the first finger form.

[0044] Through the above technical solution, in response to a first gesture operation of a vehicle user on an in-vehicle display screen, identify a first finger form corresponding to the first gesture operation, and then control the display content of the in-vehicle display screen according to the first finger form. It is possible to realize remotely controlling the display content on the in-vehicle display screen through the finger form in the gesture operation. Compared with controlling the in-vehicle display screen by a remote controller in the related art, it is not necessary to add additional devices, thereby improving the convenience of controlling the in-vehicle display screen and also improving the control efficiency of the in-vehicle display screen.

[0045] To enable those skilled in the art to better understand the vehicle display control method provided by the present disclosure, the above steps will be described in detail with examples below.

[0046] Exemplarily, the in-vehicle display screen can be used to display relevant parameters during vehicle driving, can also be used to display relevant entertainment information, navigation, or can be used to control vehicle-related devices. The first gesture operation can be a relevant change gesture for controlling the display content on the in-vehicle display screen. Among them, the first gesture operation can be a gesture of the user's left hand or a gesture of the user's right hand. The first finger form can be the form of fingers such as the thumb, index finger, ring finger in the fingers. This finger form can be a single-finger form or a multi-finger form. The vehicle user can be a user sitting in the rear cabin of the vehicle. In this regard, the embodiments of the present disclosure do not make specific limitations.

[0047] In the embodiments of the present disclosure, when a vehicle user makes a first gesture operation on the in-vehicle display screen, the first gesture operation of the vehicle user can be recognized by an image acquisition module on the in-vehicle display screen, and the first finger form in the first gesture operation can be recognized. Then, the display content on the in-vehicle display screen can be remotely controlled according to the first finger form. Among them, the display content such as Figure 2As shown, it may include multiple functional modules 2, and the image acquisition module 3 may be a camera. Compared with the related art where the display content of the in-vehicle display is controlled by a remote control, it is possible to control the display content of the in-vehicle display in the vehicle without adding additional devices, thereby improving the convenience of controlling the in-vehicle display and also improving the control efficiency of the in-vehicle display.

[0048] In a possible way, the recognizing the finger shape corresponding to the first gesture operation includes: For each finger corresponding to the first gesture operation, recognize the straight or curved shape of the finger; The controlling the display content of the in-vehicle display according to the first finger shape includes: Control the display content of the in-vehicle display according to the straight or curved shape of each finger.

[0049] It should be understood that when recognizing the first gesture operation, each finger in the first gesture operation can be recognized to determine the straight or curved shape of the finger, and the display content of the in-vehicle display is controlled according to this straight or curved shape. Among them, the straight or curved shape can be a straight shape, a curved shape, or a change from a straight shape to a curved shape. In this regard, the embodiments of the present disclosure do not make specific limitations. For example, Figure 3 the first finger shape 5 in Figure 2 can be a single-finger curved shape, and through this single-finger curved shape, the corresponding functional module can be controlled to change. For example,

[0050] In a possible way, the recognizing the straight or curved shape of each finger corresponding to the first gesture operation includes: For each finger corresponding to the first gesture operation, determine the straight or curved shape of the finger according to the first position point on the palm corresponding to the first gesture operation and the second position point on the finger joint.

[0051] It should be understood that when recognizing the straight or curved shape of the finger, it can be recognized according to the corresponding position points in the gesture. The position points can include the first position point on the palm and the second position point on the finger joint. Among them, the first position point can be any position point on the palm, and the second position point can be the position point on the finger joint and the position point on the finger tip. In this regard, the embodiments of the present disclosure do not make specific limitations.

[0052] In a possible way, the determining the straight or curved shape of the finger according to the first position point on the palm corresponding to the first gesture operation and the second position point on the finger joint includes: Determine the straight or curved shape of the finger according to the first distance and the second distance, where the first distance is the sum of the distances between the first position point and all adjacent position points among all the second position points, and the second distance is the distance between the first position point and the second position point that is farthest from the first position point in the finger.

[0053] It should be understood that when the finger is bent or straightened, the distance between the second position point farthest from the palm and the first position point on each finger is different. Therefore, when determining the straight or curved shape of the finger according to the first position point and the second position point, the straight or curved shape of the finger can be determined according to the second distance between the second position point on the fingertip and the first position point, and for each finger, the sum of the distances between all adjacent two position points among all the second position points and the first position point. In this regard, the embodiments of the present disclosure do not make specific limitations.

[0054] In a possible way, the determining the straight or curved shape of the finger according to the first distance and the second distance includes: When the ratio of the first distance to the second distance is less than or equal to a preset ratio, determine the straight or curved shape as a straight shape; or, When the ratio of the first distance to the second distance is greater than the preset ratio, determine the straight or curved shape as a curved shape.

[0055] It should be understood that when determining what specific shape the straight or curved shape of the finger is, it can be calculated by the ratio between the first distance and the second distance. When the ratio of the first distance to the second distance is less than or equal to the preset ratio, it can represent that the finger is straight at this time, and the corresponding straight or curved shape of the finger can be a straight shape; when the ratio of the first distance to the second distance is greater than the preset ratio, it can represent that the finger is bent at this time, and the corresponding straight or curved shape of the finger can be a curved shape. In this regard, the embodiments of the present disclosure do not make specific limitations.

[0056] In another possible way, the second distance can be directly compared with a preset distance threshold. When the second distance is greater than the preset distance threshold, it can represent that the straight or curved shape is a straight shape. When the second distance is less than or equal to the preset distance threshold, it can represent that the straight or curved shape is a curved shape, where the preset distance threshold can represent the critical value between the straight shape and the curved shape of the finger.

[0057] Judging whether the straight or curved shape of the finger is a curved shape or a straight shape through different distances can achieve precise control of the display content in the in-vehicle display screen.

[0058] In a possible way, the controlling the display content of the in-vehicle display screen according to the first finger shape includes: When the first finger gesture represents that the preset finger is in a straight state, control the content in the in-vehicle display screen to change following the first gesture operation.

[0059] It should be understood that when controlling the display content of the in-vehicle display screen according to the first finger gesture, it can be controlled when the finger is in a straight state or in a bent state. When the first finger gesture is in a straight state, the display content of the in-vehicle display screen can be controlled by the straight state of a single finger or by the straight state of multiple fingers. In the embodiments of the present disclosure, when the preset finger is in a straight state, when the preset finger moves left and right, the content in the in-vehicle display screen can change according to the left and right movement of the preset finger.

[0060] For example, when there are multiple images in the in-vehicle display screen, when the preset finger first moves left and then right, the images can be flipped to view the next image; as Figure 2 shown, when there are multiple function modules 2 in the in-vehicle display screen 1, when the first finger gesture 5 moves left and right, a target function module among the multiple function modules 2 can be selected.

[0061] By moving the preset finger, the content of the in-vehicle display screen can be controlled to change following the preset finger, and the display content of the in-vehicle display screen can be controlled remotely, thereby improving the convenience of controlling the in-vehicle display screen.

[0062] In a possible way, the control that the content in the in-vehicle display screen changes following the first gesture operation includes: Control the first manipulation pointer displayed in the in-vehicle display screen to move following the first gesture operation, and the first manipulation pointer is used to select a target function module among the function modules displayed in the in-vehicle display screen.

[0063] It should be understood that when the preset finger is in a straight state, a first manipulation pointer can be displayed in the in-vehicle display screen, and the first manipulation pointer can be as Figure 4 shown. When controlling the content in the in-vehicle display screen 1 to change following the first gesture operation, the first manipulation pointer 7 will move according to the movement of the first gesture operation, and thus a target function module can be selected among the function modules 2 displayed in the in-vehicle display screen 1. For example, as Figure 4 shown, the first function module 2 indicated by the first manipulation pointer 7 can represent that the first function module 2 is the target function module selected by the first gesture operation.

[0064] In a possible way, the preset finger includes at least two preset fingers, and the control that the content in the in-vehicle display screen changes following the first gesture operation includes: Control the content in the vehicle-mounted display screen to scale according to the opening and closing state of the at least two fingers corresponding to the first gesture operation, or, Control the content in the vehicle-mounted display screen to rotate according to the rotation state of the at least two fingers corresponding to the first gesture operation.

[0065] It should be understood that when the finger form is a straight form, the display content of the vehicle-mounted display screen can be controlled by the finger form of a single finger as shown in Figures 2 to 4 shown, or the display content of the vehicle-mounted display screen 1 can be controlled by the finger form of at least two fingers as shown in Figure 5 shown. When controlling by at least two fingers, the at least two fingers can be divided into a first finger and a second finger. The first finger and the second finger include at least one finger, and the number of the first finger and the second finger can be the same or different.

[0066] In the embodiment of the present disclosure, taking the finger form corresponding to two fingers as an example, the two fingers are divided into a first finger and a second finger. When the first finger and the second finger open towards the vehicle-mounted display screen 1, it can represent enlarging the display content in the vehicle-mounted display screen. When the first finger and the second finger change from opening to closing, it can represent reducing the display content in the vehicle-mounted display screen 1; when the first finger rotates around the second finger or the second finger rotates around the first finger, it can represent rotating the display content in the vehicle-mounted display screen 1. In this regard, the embodiment of the present disclosure does not make specific limitations.

[0067] In a possible way, the control of the content in the vehicle-mounted display screen to scale according to the opening and closing state of the at least two fingers corresponding to the first gesture operation includes: Display a second manipulation pointer and a third manipulation pointer on the vehicle-mounted display screen; According to the second manipulation pointer and the third manipulation pointer, control the content in the vehicle-mounted display screen to scale according to the opening and closing state of the at least two fingers corresponding to the first gesture operation.

[0068] It should be understood that when scaling the display content in the vehicle-mounted display screen by the first finger and the second finger, when the finger form changes to the form of controlling by at least two fingers, such as Figure 5As shown, a second manipulation pointer 8 and a third manipulation pointer 9 are displayed on the in-vehicle display screen. The second manipulation pointer 8 may correspond to the first finger, and the third manipulation pointer 9 may correspond to the second finger. In this regard, the embodiments of the present disclosure do not make specific limitations. Subsequently, the display content in the in-vehicle display screen 1 can be scaled according to the second manipulation pointer 8 and the third manipulation pointer 9. For example, when the first finger and the second finger change from being closed to being open, it can represent that the distance between the second manipulation pointer 8 and the third manipulation pointer 9 increases at this time. At this time, the display content in the in-vehicle display screen 1 can be enlarged. When the first finger and the second finger change from being open to being closed, it can represent that the distance between the second manipulation pointer 8 and the third manipulation pointer 9 decreases at this time. At this time, the display content in the in-vehicle display screen 1 can be reduced.

[0069] In a possible manner, the reference point for the scaling is determined based on the display positions of the second manipulation pointer and the third manipulation pointer in the in-vehicle display screen.

[0070] It should be understood that when reducing or enlarging the display content in the in-vehicle display screen according to the second manipulation pointer 8 and the third manipulation pointer 9, any point on the line connecting the second manipulation pointer 8 and the third manipulation pointer 9 can be used as a reference point in the in-vehicle display screen 1, and the display content of the in-vehicle display screen 1 is scaled based on this reference point. Among them, this reference point can be the midpoint between the second manipulation pointer 8 and the third manipulation pointer 9. In this regard, the embodiments of the present disclosure do not make specific limitations.

[0071] In a possible manner, controlling the content in the in-vehicle display screen to rotate following the rotation state of the at least two fingers corresponding to the first gesture operation includes: Displaying a second manipulation pointer and a third manipulation pointer in the in-vehicle display screen; Controlling the content in the in-vehicle display screen to rotate following the rotation state of the at least two fingers corresponding to the first gesture operation according to the second manipulation pointer and the third manipulation pointer.

[0072] It should be understood that when rotating the display content in the in-vehicle display screen by the first finger and the second finger, when the finger form changes to a form controlled by at least two fingers, such as Figure 5As shown, the second control pointer 8 and the third control pointer 9 are displayed on the vehicle display screen. The second control pointer 8 may correspond to the first finger, and the third control pointer 9 may correspond to the second finger. The embodiment of the present disclosure does not specifically limit this. Then, the display content in the vehicle display screen can be rotated according to the second control pointer 8 and the third control pointer 9. For example, when the first finger rotates around the second finger, it can represent that the second control pointer 8 rotates around the third control pointer 9 at this time. At this time, the display content in the vehicle display screen 1 can be rotated. The embodiment of the present disclosure does not specifically limit this.

[0073] In a possible manner, the reference point of the rotation is determined based on display positions of the second manipulation pointer and the third manipulation pointer in the vehicle-mounted display screen.

[0074] It should be understood that when the display content on the vehicle display screen 1 is rotated according to the second control pointer 8 and the third control pointer 9, any point on the line between the second control pointer 8 and the third control pointer 9 can be used as a reference point in the vehicle display screen 1, and the display content of the vehicle display screen 1 is rotated based on the reference point. The reference point can be the midpoint between the second control pointer 8 and the third control pointer 9, and the embodiment of the present disclosure does not specifically limit this.

[0075] By converting at least two fingers into two control pointers displayed on the vehicle display screen, the display content on the vehicle display screen can be controlled remotely. Compared with controlling the display content of the vehicle display screen by a remote control in the related art, the convenience of controlling the display content of the vehicle display screen can be improved, and the control efficiency of the vehicle display screen can also be improved.

[0076] In a possible embodiment, the method further comprises: In response to the vehicle user's gesture operation on the vehicle display screen changing from a single-finger gesture operation to a multi-finger gesture operation, displaying a second control pointer and a third control pointer on the vehicle display screen; When the distance between the second control pointer and the third control pointer is greater than a preset distance, the vehicle display screen is controlled to enter a multi-finger control mode, wherein the multi-finger gesture operation is to control the vehicle display screen by at least two fingers.

[0077] It should be understood that when controlling the display content in the in-vehicle display screen through the gesture mode, the single-finger control mode can be entered first. When it is necessary to zoom in, zoom out, or rotate the displayed content, the multi-finger gesture operation mode can be entered, and the display content in the in-vehicle display screen can be continuously controlled through the multi-finger operation mode. Specifically, when the gesture operation on the in-vehicle display screen changes from a single-finger gesture operation to a multi-finger gesture operation, a second manipulation pointer and a third manipulation pointer can be displayed in the in-vehicle display screen. Then, it can be determined whether the gesture operation enters the multi-finger operation mode by judging the distance between the second manipulation pointer and the third manipulation pointer. When the distance between the second manipulation pointer and the third manipulation pointer is greater than the preset distance, it can represent that zooming in or out of the display content of the in-vehicle display screen by the second manipulation pointer and the third manipulation pointer is within the controllable range. Thus, the in-vehicle display screen can be controlled to enter the multi-finger control mode.

[0078] In a possible way, the method further includes: In response to a second gesture operation of the vehicle user on the in-vehicle display screen, identifying the second finger shape of the second gesture operation; In the case where the second finger shape is a preset finger shape, controlling the in-vehicle display screen to exit the multi-finger control mode, or, When the distance between the second manipulation pointer and the third manipulation pointer is less than or equal to the preset distance, controlling the in-vehicle display screen to exit the multi-finger control mode.

[0079] It should be understood that after the in-vehicle display screen enters the multi-finger control mode, the in-vehicle display screen can be continuously controlled through the multi-finger control mode. When the in-vehicle display screen does not need to be controlled by the multi-finger control mode, the multi-finger control mode can be exited. At this time, the second gesture operation of the vehicle user can be monitored in real time, and the second finger shape of the second gesture operation can be identified. When the second finger shape is a preset finger shape, it can represent exiting the multi-finger control mode in the in-vehicle display screen. Among them, the preset finger shape can be a fist finger shape or a shape with only the little finger straightened. In this regard, the embodiments of the present disclosure do not make specific limitations.

[0080] When controlling to exit the multi-finger control mode in the in-vehicle display screen, it can also be judged by the distance between the second manipulation pointer and the third manipulation pointer. When the distance between the second manipulation pointer and the third manipulation pointer is too small, the display content on the in-vehicle display screen is in an uncontrolled state. Thus, when the distance between the second manipulation pointer and the third manipulation pointer is less than or equal to the preset distance, it can represent that the in-vehicle display screen exits the multi-finger control mode.

[0081] By exiting the multi-finger control mode in the vehicle display screen by measuring the distance between the second control pointer and the third control pointer or determining whether the second finger shape is the preset finger shape, the accuracy of controlling the vehicle display screen can be improved, and the vehicle display screen can be controlled remotely through finger operation without the need for additional equipment, thereby improving the convenience of controlling the vehicle display screen.

[0082] In a possible manner, controlling the display content of the vehicle-mounted display screen according to the first finger shape includes: When the first finger shape representation presets that the finger changes from a straight shape to a bent shape and the target function module in the vehicle display screen is in a selected state, the module content corresponding to the target function module is displayed on the vehicle display screen, or, When the first finger shape is characterized as a bent shape and the target function module in the vehicle-mounted display screen is in a selected state, the content in the vehicle-mounted display screen is controlled to move following the first gesture operation.

[0083] It should be understood that when the display content of the vehicle display screen is controlled by gesture operation, the gesture control can be changed. At this time, the display content of the vehicle display screen can be controlled according to the change of the finger shape in the gesture operation. Figure 3 and Figure 4 As shown, when the first finger shape 5 is transformed from the straight shape to the bent shape, the display content on the vehicle-mounted display screen 1 can be changed from Figure 4 The content in changes to Figure 3 When the content in the vehicle display screen 1 is displayed, it may represent that the target function module in the selected state needs to be clicked, and then the module content corresponding to the target function module may be displayed in the vehicle display screen 1. Among them, the target function module may be selected by the first finger shape 5 in the straight shape.

[0084] like Figure 3 As shown, when the target function module in the vehicle display screen 1 is in a selected state, and the first finger shape 5 continues to be in a bent shape and moves, it may represent that the target function module needs to be moved in the vehicle display screen 1. At this time, the target function module may move along with the movement of the finger in the bent shape. This embodiment of the present disclosure does not make any specific limitation on this.

[0085] In a possible manner, when the first finger shape representation presets that the finger changes from a straight shape to a bent shape and the target function module in the vehicle-mounted display screen is in a selected state, the method includes: When the target function module in the in-vehicle display screen is in a selected state, in response to the preset finger of the first finger form changing from a straight form to a bent form, control the first manipulation pointer displayed on the in-vehicle display screen to change to a fourth manipulation pointer; Displaying the module content corresponding to the target function module on the in-vehicle display screen includes: According to the fourth manipulation pointer, control the in-vehicle display screen to display the module content corresponding to the target function module.

[0086] It should be understood that when the first finger form changes from a straight form to a bent form, it can indicate that it is necessary to enter the selected target function module in the in-vehicle display screen. At this time, the first manipulation pointer displayed in the in-vehicle display screen can change to a fourth manipulation pointer, where the fourth manipulation pointer can be, for example Figure 3 the manipulation pointer shown. In this regard, the embodiments of the present disclosure do not make specific limitations. After the first manipulation pointer 7 changes to the fourth manipulation pointer 6, the display content in the in-vehicle display screen 1 can change following the fourth manipulation pointer 6. For example, when the first finger form 5 changes from a straight form to a bent form and then to a straight form, it can correspondingly display the module content selected by the fourth manipulation pointer 6. When the first finger form 5 is continuously in a bent form and moves, the target function module in the in-vehicle display screen 1 can move following the movement of the fourth manipulation pointer 6.

[0087] In a possible way, controlling the content in the in-vehicle display screen to move following the first gesture operation includes: Control the fourth manipulation pointer displayed in the in-vehicle display screen to move following the first gesture operation, and the fourth manipulation pointer is used to move a target function module in the function module displayed on the in-vehicle display screen.

[0088] It should be understood that when the fourth manipulation pointer is displayed in the in-vehicle display screen, the fourth manipulation pointer can move correspondingly according to the movement of the first gesture operation, and thus it can be realized to remotely control the display content in the in-vehicle display screen through gesture operations, which can improve the convenience of controlling the in-vehicle display screen.

[0089] In a possible way, the method further includes: In response to the triggering operation of the vehicle user on the gesture control control displayed on the in-vehicle display screen, control the in-vehicle display screen to enter the gesture control mode, and display the display content for the vehicle user to perform gesture control on the in-vehicle display screen.

[0090] It should be understood that when the in-vehicle display screen of the vehicle is in use, it may not directly enter the page of the gesture control mode. When it is necessary to enter the gesture control mode, such asFigure 6 As shown, a triggering operation can be performed on the gesture control control 10 in the initial page of the in-vehicle display screen 1, and then the display content as shown in Figure 2 can be entered, which can represent that the in-vehicle display screen 1 has entered the gesture control mode. In this regard, the embodiments of the present disclosure do not make specific limitations.

[0091] In a possible manner, the recognizing the first finger form corresponding to the first gesture operation in response to a first gesture operation of a vehicle user on the in-vehicle display screen includes: Recognizing the first finger form corresponding to the first gesture operation in response to a first gesture operation of a vehicle user on the in-vehicle display screen within a preset area, where the preset area is a gesture activity area capable of controlling the display content of the in-vehicle display screen.

[0092] It should be understood that when the in-vehicle display screen enters the gesture control mode, the display content in the in-vehicle display screen can be controlled through relevant gesture operations, but this gesture operation needs to be performed within the moving activity area to control the in-vehicle display screen effectively. When exceeding this activity area, the corresponding control pointer cannot be displayed on the in-vehicle display screen, and the display content of the in-vehicle display screen cannot be controlled through relevant gestures. In the embodiments of the present disclosure, as shown in Figure 7 , when the first gesture operation is active within the preset area 11, the image acquisition module 3 in the in-vehicle display screen 1 can recognize the first gesture operation, and then the display content in the in-vehicle display screen 1 can be controlled remotely through the gesture operation. Among them, the preset area 11 can be a gesture activity area framed by proportionally reducing the preview screen of the image acquisition module 3 in the in-vehicle display screen 1. There is a certain threshold distance between the gesture activity area and the periphery of the actual screen of the image acquisition module 3, and when a gesture operation behavior is recognized, it can be converted into spatial coordinates.

[0093] In a possible manner, the recognizing the first finger form corresponding to the first gesture operation in response to a first gesture operation of a vehicle user on the in-vehicle display screen within a preset area includes: Converting the first gesture operation into spatial coordinates in response to a first gesture operation of a vehicle user on the in-vehicle display screen within the preset area, and recognizing the first finger form according to the spatial coordinates.

[0094] It should be understood that when a vehicle user performs a first gesture operation within the preset area, as shown in Figure 7 , through the area framing of the preview screen of the image acquisition module 3, the spatial coordinates of the first gesture operation are mapped to the in-vehicle display screen 1 according to the framing ratio, so that the control pointer corresponding to the gesture operation is within the framed edge of the in-vehicle display screen 1, and then the edge points of the in-vehicle display screen 1 can be controlled.

[0095] By setting a preset area and controlling the display content of the in-vehicle display when the gesture operation is within the range of the preset area, the accuracy of controlling the in-vehicle display can be improved.

[0096] In a possible way, the method further includes: Obtaining, by an image acquisition module on the in-vehicle display, a first gesture operation of a vehicle user on the in-vehicle display; Identifying, by a data processing layer in the in-vehicle display in the vehicle, the first gesture operation to obtain a first finger form corresponding to the first gesture operation, and controlling the display content of the in-vehicle display according to the first finger form.

[0097] It should be understood that in the in-vehicle display, since the image acquisition module in the in-vehicle display can be used for different purposes, the image acquisition module cannot be used in the same application. Therefore, different hierarchical structures can be set up to store and process corresponding data to achieve resource sharing of the image acquisition module between different applications.

[0098] Specifically, as Figure 8 shown, a data processing layer can be set in the corresponding system. The image acquisition module 12 on the in-vehicle display 1 can directly obtain the first gesture operation of the vehicle user, and then the first gesture operation can be transmitted to the data processing layer. In the data processing layer, the first gesture operation can be identified to obtain the first finger form, and the display content in the in-vehicle display can be controlled according to the first finger form.

[0099] In a possible way, the identifying, by a data processing layer in the in-vehicle display in the vehicle, the first gesture operation to obtain a first finger form corresponding to the first gesture operation, and controlling the display content of the in-vehicle display according to the first finger form includes: Identifying, by a source data common processing layer in the data processing layer, the first gesture operation to obtain an initial finger form; Rendering, by a source data special effect processing layer in the data processing layer, the initial finger form to obtain the first finger form; Displaying, by a display layer in the data processing layer, the first finger form and controlling the display content of the in-vehicle display according to the first finger form.

[0100] It should be understood that, as Figure 8 shown, in the source data common processing layer 13, the first gesture operation can be received, the first gesture operation can be identified to obtain the initial finger form. And in the source data common processing layer 13, a trigger switch of the gesture control control can also be stored, and by default, this layer will not process when the in-vehicle display does not enter the gesture control mode.

[0101] In the source data special effect processing layer 14, the special effect operations required by the user and the preview pixel processing can be completed based on the original data collected by the image acquisition module 3. For example, the data directly collected by the image acquisition module 3 can be operated on or processed, or the initial finger form can be rendered to obtain the first finger form. The processing result of the source data special effect processing layer 14 on the data can determine the display effect on the in-vehicle display screen.

[0102] In the display layer 17, different contents can be displayed. It can include the first finger form and other image data collected by the image acquisition module 3. When the corresponding content is displayed in the display layer 17, the display layer can be dynamically configured through different application layers, which can be the source data common processing layer 13 or the source data special effect processing layer 14. In this regard, the embodiments of the present disclosure do not make specific limitations. By displaying different contents in the display layer 17, the on-off consumption of the image acquisition module caused by the switching of different application scenario services can be reduced, and thus the utilization rate of the image acquisition module 3 in multiple scenarios can be improved.

[0103] In addition, as Figure 8 shown, a fixed preview layer 15 and a local storage encoding layer 16 are also provided. Among them, the fixed preview layer 15 can be used to display the data processed by the source data special effect processing layer 14, or to display the preview effect of the gesture control control of the first gesture operation. The local storage encoding layer 16 can be used to store the encoding and saving of the images or videos of the content collected by the image acquisition module.

[0104] Through the above technical solution, taking the first gesture operation collected by the image acquisition module in the in-vehicle display screen as the input, the first finger form in the first gesture operation is recognized. Furthermore, the display content in the in-vehicle display screen can be controlled through the single-finger form and multi-finger form in the first finger form, and different scenarios such as moving, clicking, long pressing, and two-finger zooming can be realized, which has a wider and richer coverage than the remote control button operation.

[0105] Specifically, as Figures 2 to 8 shown, the specific process in the actual use process is as follows.

[0106] The image acquisition module 12 acquires the first gesture operation: The image acquisition module 12 in the in-vehicle display screen 1 acquires the first gesture operation of the user in the rear cockpit of the vehicle, captures it at a certain frame rate, and then converts it into the first finger form 5 that can be rendered by the system-related encoding module. In this in-vehicle display screen 1, an application for viewing the screen of the image acquisition module 12 can be set. For example, the image acquisition module 12 can be a device such as a camera or a mirror. When the corresponding device is started, the image acquisition module 12 can be enabled, and a preview screen can be requested to display the content of the preview screen of the image acquisition module 12 in the in-vehicle display screen 1.

[0107] Triggering the gesture control control can cause Figure 6 The content displayed in to change to Figure 2 The content displayed in. After the vehicle user starts the image acquisition module 12 and previews the screen, by triggering the gesture control control 10, the in-vehicle display screen 1 can enter the gesture control mode. After the in-vehicle display screen 1 enters the gesture control mode, the display area of the entire in-vehicle display screen 1 can be controlled, and during the process of controlling the in-vehicle display screen 1, the first gesture operation of the vehicle user can be continuously acquired. Thus, in, for example, Figures 2 to 5 And Figure 7 As shown in, the content corresponding to the first gesture operation of the vehicle user is displayed on the right side of the in-vehicle display screen to increase the transparency of the control. When the gesture control control is turned off, it can represent exiting the gesture control mode.

[0108] When the first finger form 5 is a single-finger gesture operation, the specific process of controlling the in-vehicle display screen 1 is as follows.

[0109] The first gesture operation of the single-finger gesture operation acquired by the image acquisition module 12 is displayed in the in-vehicle display screen 1 in a mirror display manner. The in-vehicle display screen 1 recognizes the first gesture operation, and when the first finger form 5 is recognized, a first control pointer 7 can be displayed on the in-vehicle display screen. The first control pointer 7 can indicate that the vehicle user moves and selects the corresponding content on the in-vehicle display screen 1, and the displayed content is as Figure 4 Shown.

[0110] Showing the control effect through the first finger form 5: The first finger form 5 in the first gesture operation can be recognized through the node curve straightness algorithm. Specifically, the first finger form 5 recognized for one finger can be represented by the following calculation formula.

[0111] ∑Pn / f(1,n)≤Kn Among them, Pn can be the spacing between adjacent position points, f(1,n) is the distance between the first position point and the second position point, which is the farthest from the first position point among one of the fingers. Kn is a preset ratio, which can be obtained from the position of the second position point on the finger joint. When the above calculation formula holds exactly, it can represent that the straightness and curvature state of the corresponding finger is the straight state, otherwise it is the bent state.

[0112] When the first finger state 5 changes from the straight state to the bent state, it can represent a pressing action in the in-vehicle display screen 1, and the first control pointer 7 in the in-vehicle display screen 1 can be changed to the fourth control pointer 6. And through the fourth control pointer 6, the display content of the selected target function module can be displayed in the in-vehicle display screen 1, such as Figure 4 the content displayed in Figure 3 the content displayed in. Among them, the change of the first control pointer 7 to the fourth control pointer 6 can be made according to the change of the first finger state 5. During the change of the first finger state 5 of the vehicle user, the current behavior intention of the vehicle user can be displayed in real time, and the control pointer will continue to be maintained to complete the long-time control scenario of a single intention before the new behavior triggers a change.

[0113] When the first finger state 5 is a single-finger state, control operations such as moving, pressing, pressing and moving, and bouncing can be performed on the display content in the in-vehicle display screen 1 by recognizing the single-finger state.

[0114] When the first finger state 5 is a multi-finger gesture operation, the specific process of controlling the in-vehicle display screen is as follows.

[0115] In the case where the first finger state 5 is a two-finger gesture operation in the multi-finger gesture operation, the display content of the in-vehicle display screen 1 can be moved, zoomed or rotated. When the first gesture operation is recognized as a two-finger gesture operation, the entire indication and response in the in-vehicle display screen 1 will maintain this state. The start and end of the two-finger gesture operation can be determined by the distance between the preset finger or the second control pointer 8 and the third control pointer 9 mapped to the in-vehicle display screen 1. Among them, the preset finger can be a clenched fist or a finger with the little finger straightened, etc.

[0116] During the specific control process, if the distance between the second control pointer 8 and the third control pointer 9 does not change, it can represent moving the selection point. When the distance between the second control pointer 8 and the third control pointer 9 changes, it can represent behaviors such as pressing and moving.

[0117] During the two-finger gesture operation, whether it is zooming or rotating the display content on the in-vehicle display screen, there is generally a reference point, which can be located between the second manipulation pointer 8 and the third manipulation pointer 9. To ensure the rationality of the reference point, the two-finger gesture operation process will combine the first position point in the palm as a preset distance, and when the requirement of the preset distance is met, the two-finger gesture operation mode can be entered.

[0118] During the two-finger gesture operation, when the two-finger gesture operation changes to gestures such as making a fist or extending the little finger, it can represent that the in-vehicle display screen 1 exits the two-finger gesture operation.

[0119] Through the above technical solution, based on the image acquisition module equipped on the in-vehicle display screen as the control source, enter the gesture control mode on the built-in camera, mirror and other APPs (Application, application programs) of the in-vehicle display screen, and complete the basic function operations of the in-vehicle display screen in combination with the gesture operations of the vehicle user. Compared with the method of controlling the in-vehicle display screen by a remote control in the related art, there is no need to configure additional equipment and no need to increase additional costs, which can improve the control effect of the in-vehicle display screen, and the in-vehicle display screen can be controlled remotely through gesture operations, which can improve the convenience and intuitiveness of control. Based on the same concept, this embodiment also discloses a vehicle display control method, referring to Figure 9 , Figure 9 is a schematic diagram showing a vehicle display control device 900 according to an exemplary embodiment of the present disclosure, as Figure 9 shown, including: A first recognition module 901, configured to recognize a first finger form corresponding to the first gesture operation in response to a first gesture operation of a vehicle user on the in-vehicle display screen; A first control module 902, configured to control the display content of the in-vehicle display screen according to the first finger form.

[0120] Optionally, the first recognition module 901 is used for: For each finger corresponding to the first gesture operation, recognize the straight or curved form of the finger; The first control module 902 is used for: Control the display content of the in-vehicle display screen according to the straight or curved form of each finger.

[0121] Optionally, the first recognition module 901 is further used for: For each finger corresponding to the first gesture operation, determine the straight or curved form of the finger according to the first position point on the palm corresponding to the first gesture operation and the second position point on the finger joint.

[0122] Optionally, the first recognition module 901 is further used for: Determine the straight or curved shape of the finger according to the first distance and the second distance, where the first distance is the sum of the distances between the first position point and all adjacent position points among all the second position points, and the second distance is the distance between the first position point and the second position point farthest from the first position point in the finger.

[0123] Optionally, the first recognition module 901 is further configured to: When the ratio of the first distance to the second distance is less than or equal to a preset ratio, determine the straight or curved shape as a straight shape; or, When the ratio of the first distance to the second distance is greater than the preset ratio, determine the straight or curved shape as a curved shape.

[0124] Optionally, the first control module 902 is configured to: When the first finger shape represents that the preset finger is in a straight shape, control the content in the vehicle-mounted display screen to change following the first gesture operation.

[0125] Optionally, the first control module 902 is configured to: Control the first manipulation pointer displayed in the vehicle-mounted display screen to move following the first gesture operation, where the first manipulation pointer is used to select a target function module from the function modules displayed in the vehicle-mounted display screen.

[0126] Optionally, the preset finger includes at least two preset fingers, and the first control module 902 is configured to: Control the content in the vehicle-mounted display screen to be scaled following the opening and closing state of the at least two fingers corresponding to the first gesture operation, or, Control the content in the vehicle-mounted display screen to rotate following the rotation state of the at least two fingers corresponding to the first gesture operation.

[0127] Optionally, the first control module 902 includes: A first display module, configured to display a second manipulation pointer and a third manipulation pointer in the vehicle-mounted display screen; A second control module, configured to control the content in the vehicle-mounted display screen to be scaled following the opening and closing state of the at least two fingers corresponding to the first gesture operation according to the second manipulation pointer and the third manipulation pointer.

[0128] Optionally, the reference point for the scaling is determined based on the display positions of the second manipulation pointer and the third manipulation pointer in the vehicle-mounted display screen.

[0129] Optionally, the first control module 902 includes: A second display module, configured to display a second manipulation pointer and a third manipulation pointer on the vehicle-mounted display screen; A third control module, configured to control the content on the vehicle-mounted display screen to rotate following the rotation state of the at least two fingers corresponding to the first gesture operation according to the second manipulation pointer and the third manipulation pointer.

[0130] Optionally, the reference point of the rotation is determined based on the display positions of the second manipulation pointer and the third manipulation pointer on the vehicle-mounted display screen.

[0131] Optionally, the vehicle display control device 900 further includes: A third display module, configured to display a second manipulation pointer and a third manipulation pointer on the vehicle-mounted display screen in response to a change of the gesture operation of the vehicle user on the vehicle-mounted display screen from a single-finger gesture operation to a multi-finger gesture operation; A first judgment module, configured to control the vehicle-mounted display screen to enter a multi-finger control mode when the distance between the second manipulation pointer and the third manipulation pointer is greater than a preset distance, where the multi-finger gesture operation is to control the vehicle-mounted display screen with at least two fingers.

[0132] Optionally, the vehicle display control device 900 further includes: A second recognition module, configured to recognize the second finger form of the second gesture operation in response to the second gesture operation of the vehicle user on the vehicle-mounted display screen; A second judgment module, configured to control the vehicle-mounted display screen to exit the multi-finger control mode when the second finger form is a preset finger form, or control the vehicle-mounted display screen to exit the multi-finger control mode when the distance between the second manipulation pointer and the third manipulation pointer is less than or equal to the preset distance.

[0133] Optionally, the first control module 902 is configured to: When the first finger form represents that a preset finger changes from a straight form to a bent form and the target function module on the vehicle-mounted display screen is in a selected state, display the module content corresponding to the target function module on the vehicle-mounted display screen, or When the first finger form represents a bent form and the target function module on the vehicle-mounted display screen is in a selected state, control the content on the vehicle-mounted display screen to move following the first gesture operation.

[0134] Optionally, the first control module 902 includes: A third display module, configured to, when a target function module in the vehicle-mounted display screen is in a selected state, in response to a preset finger of the first finger form changing from a straightened form to a bent form, control a first manipulation pointer displayed on the vehicle-mounted display screen to change to a fourth manipulation pointer; A fourth control module, configured to control the vehicle-mounted display screen to display module content corresponding to the target function module according to the fourth manipulation pointer.

[0135] Optionally, the fourth control module is configured to: Control the fourth manipulation pointer displayed on the vehicle-mounted display screen to move following the first gesture operation, where the fourth manipulation pointer is used to move a target function module in the function modules displayed on the vehicle-mounted display screen.

[0136] Optionally, the vehicle display control device 900 further includes: A fifth control module, configured to, in response to a trigger operation of a vehicle user on a gesture control control displayed on the vehicle-mounted display screen, control the vehicle-mounted display screen to enter a gesture control mode, and display display content for the vehicle user to perform gesture control on the vehicle-mounted display screen.

[0137] Optionally, the first recognition module 901 is configured to: In response to a first gesture operation of a vehicle user on the vehicle-mounted display screen within a preset area, recognize a first finger form corresponding to the first gesture operation, where the preset area is a gesture activity area capable of controlling the display content of the vehicle-mounted display screen.

[0138] Optionally, the first recognition module 901 is configured to: In response to a first gesture operation of a vehicle user on the vehicle-mounted display screen within the preset area, convert the first gesture operation into spatial coordinates, and recognize the first finger form according to the spatial coordinates.

[0139] Optionally, the vehicle display control device 900 is configured to: Obtain a first gesture operation of a vehicle user on the vehicle-mounted display screen through an image acquisition module on the vehicle-mounted display screen; Recognize the first gesture operation through a data processing layer in the vehicle-mounted display screen in the vehicle to obtain a first finger form corresponding to the first gesture operation, and control the display content of the vehicle-mounted display screen according to the first finger form.

[0140] Optionally, the vehicle display control device 900 is configured to: Recognize the first gesture operation through a source data common processing layer in the data processing layer to obtain an initial finger form; The source data special effect processing layer in the data processing layer renders the initial finger form to obtain a first finger form. The display layer in the data processing layer displays the first finger form and controls the display content of the vehicle-mounted display screen according to the first finger form.

[0141] Based on the same concept, this embodiment also provides a controller, including: A memory storing a computer program thereon; A processor for executing the computer program in the memory to implement the steps of the vehicle display control method disclosed in this embodiment.

[0142] Based on the same concept, this embodiment also discloses a vehicle, and the vehicle includes the controller disclosed in this embodiment.

[0143] Figure 10 FIG. 16 is a block diagram of a vehicle 1000 shown according to an exemplary embodiment. For example, the vehicle 1000 may be a hybrid vehicle, a non-hybrid vehicle, an electric vehicle, a fuel cell vehicle, or other types of vehicles. The vehicle 1000 may be an autonomous vehicle or a semi-autonomous vehicle.

[0144] Refer to Figure 10 , the vehicle 1000 may include various subsystems. For example, the infotainment system 1010, the perception system 1020, the decision control system 1030, the drive system 1040, and the computing platform 1050. Among them, the vehicle 1000 may also include more or fewer subsystems, and each subsystem may include multiple components. In addition, each subsystem and each component of the vehicle 1000 may be interconnected by wired or wireless means.

[0145] In some embodiments, the infotainment system 1010 may include a communication system, an entertainment system, and a navigation system, etc.

[0146] The perception system 1020 may include several sensors for sensing information about the environment around the vehicle 1000. For example, the perception system 1020 may include a global positioning system (the global positioning system may be a GPS system, a Beidou system, or other positioning systems), an inertial measurement unit (IMU), a lidar, a millimeter wave radar, an ultrasonic radar, and a camera device.

[0147] The decision control system 1030 may include a computing system, a vehicle controller, a steering system, an accelerator, and a braking system.

[0148] The drive system 1040 may include components that provide motive power for the vehicle 1000. In one embodiment, the drive system 1040 may include an engine, an energy source, a transmission system, and wheels. The engine may be one or a combination of an internal combustion engine, an electric motor, and an air compression engine. The engine is capable of converting the energy provided by the energy source into mechanical energy.

[0149] Some or all of the functions of the vehicle 1000 are controlled by the computing platform 1050. The computing platform 1050 may include at least one processor 1051 and a memory 1052, and the processor 1051 may execute instructions 1053 stored in the memory 1052.

[0150] The processor 1051 may be any conventional processor, such as a commercially available CPU. The processor may also include, for example, a Graphic Process Unit (GPU), a Field Programmable Gate Array (FPGA), a System on Chip (SOC), an Application Specific Integrated Circuit (ASIC), or a combination thereof.

[0151] The memory 1052 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), magnetic memory, flash memory, a magnetic disk, or an optical disk.

[0152] In addition to the instructions 1053, the memory 1052 may also store data, such as road maps, route information, data such as the position, direction, and speed of the vehicle. The data stored in the memory 1052 can be used by the computing platform 1050.

[0153] In an embodiment of the present disclosure, the processor 1051 may execute the instructions 1053 to complete all or part of the steps of the above vehicle display control method.

[0154] In another exemplary embodiment, a computer-readable storage medium including program instructions is also provided, and when the program instructions are executed by a processor, the steps of the above vehicle display control method are implemented. For example, the computer-readable storage medium may be the above memory 1052 including program instructions, and the above program instructions may be executed by the processor 1051 of the vehicle 1000 to complete the above vehicle display control method.

[0155] In another exemplary embodiment, a computer program product is also provided. The computer program product includes a computer program executable by a programmable device, and the computer program has a code portion for performing the above-described in-vehicle image display method when executed by the programmable device.

[0156] The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings. However, the present disclosure is not limited to the specific details in the above embodiments. Within the scope of the technical concept of the present disclosure, various simple modifications can be made to the technical solutions of the present disclosure, and these simple modifications all fall within the protection scope of the present disclosure.

[0157] In addition, it should be noted that, among the various specific technical features described in the above specific embodiments, they can be combined in any suitable manner without contradiction. To avoid unnecessary repetition, the present disclosure will not separately describe various possible combination manners.

[0158] Furthermore, any combination can be made among various different embodiments of the present disclosure as long as it does not violate the idea of the present disclosure, and it should also be regarded as the content disclosed by the present disclosure.

Claims

1. A vehicle display control method, characterized in that, Including: In response to a first gesture operation of a vehicle user on an in-vehicle display screen, identifying a first finger form corresponding to the first gesture operation; Controlling the display content of the in-vehicle display screen according to the first finger form.

2. The vehicle display control method according to claim 1, wherein The identifying the finger form corresponding to the first gesture operation includes: For each finger corresponding to the first gesture operation, identifying the straight or curved form of the finger; The controlling the display content of the in-vehicle display screen according to the first finger form includes: Controlling the display content of the in-vehicle display screen according to the straight or curved form of each finger.

3. The vehicle display control method according to claim 2, characterized in that, The identifying the straight or curved form of the finger for each finger corresponding to the first gesture operation includes: For each finger corresponding to the first gesture operation, determining the straight or curved form of the finger according to a first position point on the palm corresponding to the first gesture operation and a second position point on the finger joint.

4. The vehicle display control method according to claim 3, wherein, The determining the straight or curved form of the finger according to the first position point on the palm and the second position point on the finger joint corresponding to the first gesture operation includes: Determining the straight or curved form of the finger according to a first distance and a second distance, where the first distance is the sum of the distances between the first position point and all adjacent position points among all the second position points, and the second distance is the distance between the first position point and the second position point on the finger that is farthest from the first position point.

5. The vehicle display control method according to claim 4, characterized in that, The determining the straight or curved form of the finger according to the first distance and the second distance includes: When the ratio of the first distance to the second distance is less than or equal to a preset ratio, determining the straight or curved form as a straight form; or, When the ratio of the first distance to the second distance is greater than the preset ratio, determining the straight or curved form as a curved form.

6. The vehicle display control method according to any one of claims 1-5, characterized in that, The controlling the display content of the in-vehicle display screen according to the first finger form includes: When the first finger form indicates that a preset finger is in a straight form, controlling the content in the in-vehicle display screen to change following the first gesture operation.

7. The vehicle display control method according to claim 6, wherein The controlling the content in the in-vehicle display screen to change following the first gesture operation includes: Controlling a first manipulation pointer displayed in the in-vehicle display screen to move following the first gesture operation, where the first manipulation pointer is used to select a target function module in the function modules displayed on the in-vehicle display screen.

8. The vehicle display control method according to claim 6, wherein The preset finger includes at least two preset fingers, and the controlling the content in the in-vehicle display screen to change following the first gesture operation includes: Controlling the content in the in-vehicle display screen to scale following the opening and closing state of the at least two fingers corresponding to the first gesture operation, or, Controlling the content in the in-vehicle display screen to rotate following the rotation state of the at least two fingers corresponding to the first gesture operation.

9. The vehicle display control method according to claim 8, wherein The controlling the content in the in-vehicle display screen to scale following the opening and closing state of the at least two fingers corresponding to the first gesture operation includes: Displaying a second manipulation pointer and a third manipulation pointer in the in-vehicle display screen; Control the content in the vehicle-mounted display screen to scale according to the opening and closing state of the at least two fingers corresponding to the first gesture operation based on the second control pointer and the third control pointer.

10. The vehicle display control method according to claim 9, characterized in that, The reference point for the scaling is determined based on the display positions of the second control pointer and the third control pointer in the vehicle-mounted display screen.

11. The vehicle display control method according to claim 8, wherein The control for the content in the vehicle-mounted display screen to rotate according to the rotation state of the at least two fingers corresponding to the first gesture operation includes: Display a second control pointer and a third control pointer in the vehicle-mounted display screen; Control the content in the vehicle-mounted display screen to rotate according to the rotation state of the at least two fingers corresponding to the first gesture operation based on the second control pointer and the third control pointer.

12. The vehicle display control method according to claim 11, wherein The reference point for the rotation is determined based on the display positions of the second control pointer and the third control pointer in the vehicle-mounted display screen.

13. The vehicle display control method according to claim 8, wherein The method further includes: In response to the gesture operation of the vehicle user on the vehicle-mounted display screen changing from a single-finger gesture operation to a multi-finger gesture operation, display a second control pointer and a third control pointer in the vehicle-mounted display screen; When the distance between the second control pointer and the third control pointer is greater than a preset distance, control the vehicle-mounted display screen to enter a multi-finger control mode, where the multi-finger gesture operation is to control the vehicle-mounted display screen with at least two fingers.

14. The vehicle display control method according to claim 13, wherein The method further includes: In response to the second gesture operation of the vehicle user on the vehicle-mounted display screen, identify the second finger form of the second gesture operation; In the case where the second finger form is a preset finger form, control the vehicle-mounted display screen to exit the multi-finger control mode, or When the distance between the second control pointer and the third control pointer is less than or equal to the preset distance, control the vehicle-mounted display screen to exit the multi-finger control mode.

15. The vehicle display control method according to any one of claims 1-5, characterized in that The control of the display content of the vehicle-mounted display screen according to the first finger form includes: In the case where the first finger form represents that a preset finger changes from a straight form to a bent form and the target function module in the vehicle-mounted display screen is in a selected state, display the module content corresponding to the target function module on the vehicle-mounted display screen, or In the case where the first finger form represents a bent form and the target function module in the vehicle-mounted display screen is in a selected state, control the content in the vehicle-mounted display screen to move according to the first gesture operation.

16. The vehicle display control method according to claim 15, wherein The case where the first finger form represents that a preset finger changes from a straight form to a bent form and the target function module in the vehicle-mounted display screen is in a selected state includes: In the case where the target function module in the vehicle-mounted display screen is in a selected state, in response to the preset finger of the first finger form changing from a straight form to a bent form, control the first control pointer displayed on the vehicle-mounted display screen to change to a fourth control pointer; The display of the module content corresponding to the target function module on the vehicle-mounted display screen includes: Control the vehicle-mounted display screen to display the module content corresponding to the target function module according to the fourth control pointer.

17. The vehicle display control method according to claim 16, characterized in that, Controlling the content in the vehicle-mounted display screen to move following the first gesture operation includes: Controlling a fourth manipulation pointer displayed in the vehicle-mounted display screen to move following the first gesture operation, where the fourth manipulation pointer is used to move a target function module in the function modules displayed on the vehicle-mounted display screen.

18. The vehicle display control method according to any one of claims 1-5, characterized in that The method further includes: In response to a triggering operation by the vehicle user on a gesture control control displayed on the vehicle-mounted display screen, controlling the vehicle-mounted display screen to enter a gesture control mode, and displaying display content for the vehicle user to perform gesture control on the vehicle-mounted display screen.

19. The vehicle display control method according to any one of claims 1-5, characterized in that, Responding to a first gesture operation by the vehicle user on the vehicle-mounted display screen, and identifying a first finger form corresponding to the first gesture operation, includes: Responding to a first gesture operation by the vehicle user on the vehicle-mounted display screen within a preset area, and identifying a first finger form corresponding to the first gesture operation, where the preset area is a gesture activity area capable of controlling the display content of the vehicle-mounted display screen.

20. The vehicle display control method according to claim 19, wherein Responding to a first gesture operation by the vehicle user on the vehicle-mounted display screen within a preset area, and identifying a first finger form corresponding to the first gesture operation, includes: Responding to a first gesture operation by the vehicle user on the vehicle-mounted display screen within the preset area, converting the first gesture operation into spatial coordinates, and identifying the first finger form according to the spatial coordinates.

21. The vehicle display control method according to any one of claims 1-5, characterized in that, The method further includes: Obtaining a first gesture operation by the vehicle user on the vehicle-mounted display screen through an image acquisition module on the vehicle-mounted display screen; Identifying the first gesture operation through a data processing layer in the vehicle-mounted display screen in the vehicle to obtain a first finger form corresponding to the first gesture operation, and controlling the display content of the vehicle-mounted display screen according to the first finger form.

22. The vehicle display control method according to claim 21, wherein The identifying the first gesture operation through a data processing layer in the vehicle-mounted display screen in the vehicle to obtain a first finger form corresponding to the first gesture operation, and controlling the display content of the vehicle-mounted display screen according to the first finger form includes: Identifying the first gesture operation through a source data common processing layer in the data processing layer to obtain an initial finger form; Rendering the initial finger form through a source data special effect processing layer in the data processing layer to obtain a first finger form; Displaying the first finger form through a display layer in the data processing layer, and controlling the display content of the vehicle-mounted display screen according to the first finger form.

23. A controller, characterized in that, Includes: A memory, on which a computer program is stored; A processor, configured to execute the computer program in the memory to implement the steps of the method according to any one of claims 1-22.

24. A vehicle, characterized in that, The vehicle includes the controller according to claim 23.

Images