Digital cockpit system and operation method of digital rearview mirror

Abstract

A digital cockpit system and a method of operating a digital rearview mirror, the digital cockpit system including an eyeball tracking lens, a rearview mirror lens, a rearview mirror display screen, and a control circuit, the eyeball tracking lens providing sight information, the rearview mirror lens providing an environmental image, the control circuit coupled to the eyeball tracking lens, the rearview mirror lens, and the rearview mirror display screen, the control circuit determines a viewing angle of eyeballs of the passenger based on the line-of-sight information, and determines a viewing field of view of a rearview mirror screen displayed based on the environment image in the rearview mirror display screen based on the determined viewing angle.

Description

Technical Field

[0001] The present invention relates to a circuit system for a cockpit, and more particularly to a digital cockpit system and an operating method of a digital rearview mirror. Background Art

[0002] In recent years, with the advancement of touch technology, vehicle buttons have gradually been digitized and integrated into the in-vehicle screen. Furthermore, in addition to digitizing traditional operations, the new generation of cockpits also places greater emphasis on connected services and enhanced system scalability to create a digital cockpit that keeps pace with the times.

[0003] The digital cockpit features a digital rearview mirror, which the driver can select to assist with driving and reduce blind spots. However, the digital rearview mirror's field of view and angle are determined by the lens and display mode, significantly different from traditional rearview mirrors, where the image changes with the driver's line of sight, thus affecting the driver's visual experience. Summary of the Invention

[0004] The present invention provides a digital cockpit system and an operating method for a digital rearview mirror, so that the rearview mirror image displayed on the rearview mirror display screen can be adjusted as the driver's line of sight changes, thereby obtaining a more intuitive simulation experience similar to that obtained when the driver moves the body to change the viewing angle.

[0005] The digital cockpit system for a vehicle of the present invention includes an eye-tracking lens, a rearview lens, a rearview mirror display screen, and a control circuit. The eye-tracking lens provides line of sight information, the rearview lens provides an environmental image, and the control circuit couples the eye-tracking lens, the rearview lens, and the rearview mirror display screen. The control circuit determines the viewing angle of the passenger's eyes based on the line of sight information, and determines the viewing field of the rearview mirror image displayed on the rearview mirror display screen based on the environmental image based on the determined viewing angle.

[0006] In one embodiment of the digital cockpit system, the control circuit further determines, based on the line of sight information, whether the passenger's eyeball is directed toward the rearview mirror display screen.

[0007] In response to the viewing angle being toward the rearview mirror display screen, the control circuit determines a viewing angle of the eyeball to the rearview mirror display screen, and determines the viewing field based on the viewing angle, and

[0008] In response to the viewing angle not being directed toward the rearview mirror display screen, the control circuit determines that the viewing field of view is a preset field of view.

[0009] In an embodiment of the digital cockpit system, when the viewing angle changes, the control circuit changes the viewing field of view.

[0010] In an embodiment of the digital cockpit system, the rearview lens is a movable angle lens, and the control circuit provides a control signal to the rearview lens based on the determined viewing field to control the rearview lens to turn.

[0011] In an embodiment of the digital cockpit system, the rearview lens is a fixed-angle lens, and the control circuit determines a captured portion of the ambient image displayed on the rearview mirror display screen based on the determined viewing field of view.

[0012] In an embodiment of the digital cockpit system, the eye tracking lens further provides gesture information, and the control circuit further determines a gesture of the passenger based on the gesture information to set the viewing field based on the gesture.

[0013] In one embodiment of the digital cockpit system, the control circuit further sets the viewing field of view relative to the rearview camera, zooms the viewing field of view, quickly takes photos or videos, or sets the viewing field of view to be fixed or variable based on the gesture.

[0014] In an embodiment of the digital cockpit system, the system further includes a second rearview mirror that provides a second environmental image, and the control circuit further determines, based on the gesture, whether the rearview mirror image is based on the environmental image or the second environmental image.

[0015] The operating method of the digital rearview mirror of the present invention is used in a digital cockpit system of a vehicle. The operating method includes the following steps: determining the viewing angle of a passenger's eyes based on line of sight information provided by an eye tracking lens via a control circuit; receiving an environmental image provided by the rearview lens via the control circuit; and determining the viewing field of the rearview mirror image displayed on the rearview mirror display screen based on the environmental image based on the determined viewing angle via the control circuit.

[0016] In one embodiment of the above operating method, determining the viewing field based on the determined viewing angle includes:

[0017] determining, by the control circuit based on the sight line information, whether a viewing angle of the passenger's eyeball is directed toward the rearview mirror display screen;

[0018] In response to the viewing angle being toward the rearview mirror display screen, the control circuit determines a viewing angle of the eyeball to the rearview mirror display screen, and determines the viewing field based on the viewing angle; and

[0019] In response to the viewing angle not being directed toward the rearview mirror display screen, the control circuit determines that the viewing field of view is a preset field of view.

[0020] In one embodiment of the above operating method, determining the viewing field based on the determined viewing angle includes:

[0021] When the viewing angle changes, the viewing field of view is changed via the control circuit.

[0022] In one embodiment of the above operating method, the rearview lens is a movable angle lens, and the operating method includes:

[0023] The control circuit provides a control signal to the rearview lens based on the determined viewing field of view, so as to control the rearview lens to turn.

[0024] In one embodiment of the above operating method, the rearview lens is a fixed-angle lens, and the operating method includes:

[0025] A captured portion of the environmental image displayed on the rearview mirror display screen is determined by the control circuit based on the determined viewing field of view.

[0026] In one embodiment of the above operating method, the eye tracking lens further provides gesture information, and the operating method includes:

[0027] The control circuit determines a gesture of the passenger based on the gesture information, so as to set the viewing field based on the gesture.

[0028] In one embodiment of the above operating method, setting the viewing field based on the gesture includes:

[0029] The control circuit sets a viewing angle of the viewing field relative to the rearview camera based on the gesture, zooms the viewing field, quickly takes photos or videos, or sets the viewing field to be fixed or variable.

[0030] In one embodiment of the above operating method, the method further includes:

[0031] The control circuit further determines based on the gesture that the rearview mirror image is based on one of the environmental image and a second environmental image provided by a second rearview lens.

[0032] Based on the above, in the digital cockpit system and digital rearview mirror operating method of the embodiments of the present invention, the control circuit determines the viewing field of the rearview mirror image displayed on the rearview mirror display screen based on the passenger's perspective. This, through image recognition and eye tracking technology, enables a more realistic digital rearview mirror feedback experience, allowing the driver and passengers to further reduce blind spots by adjusting their line of sight and posture, thereby creating a more user-friendly smart cockpit.

[0033] In order to make the above features and advantages of the present invention more clearly understood, embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1AFIG2 is a schematic diagram illustrating the component configuration of a digital rearview mirror of a digital cockpit system according to an embodiment of the present invention.

[0035] Figure 1B FIG. 4 is a system diagram of a digital cockpit system according to an embodiment of the present invention.

[0036] Figure 2A and 2B Schematic diagram of the operating environment of a digital rearview mirror and a passenger's field of view in a digital cockpit system according to an embodiment of the present invention.

[0037] Figure 3 FIG. 1 is a schematic diagram illustrating a captured rearview mirror image of a rearview mirror display screen of a digital cockpit system according to an embodiment of the present invention.

[0038] Figure 4 FIG. 4 is a system diagram of a digital cockpit system according to another embodiment of the present invention.

[0039] Figure 5 The figure is a flowchart of a method for operating a digital rearview mirror of a digital cockpit system according to an embodiment of the present invention.

[0040] Figure 6 The figure is a flowchart of a method for operating a digital rearview mirror of a digital cockpit system according to another embodiment of the present invention.

[0041] Wherein, the reference numerals:

[0042] 10: Passenger

[0043] 11: Eyeball

[0044] 12: Hands

[0045] 20: Vehicle

[0046] 100, 100a: Digital cockpit system

[0047] 110: Eye tracking shot

[0048] 120, 120a: Car interior rear view camera

[0049] 130: In-car rearview mirror display screen

[0050] 140, 140a: Rear view of the car

[0051] 150, 150a: Left side rear view camera

[0052] 160: Left side rearview mirror display screen

[0053] 170, 170a: Right side rear view camera

[0054] 180: Right side rearview mirror display screen

[0055] 190: Control circuit

[0056] A1, A2, A3, A4, Vpse, Vpse1, Vpse2: viewing angle

[0057] FRrem_L, FRrem_C, FRrem_R: rearview mirror image

[0058] IFg: Gesture information

[0059] IFv: Line of sight information

[0060] IMef, IMeb, IMel, IMer, IMev: Environmental images

[0061] PTcap: Captured part

[0062] SCRrem: rearview mirror display screen

[0063] SCxf, SCxb, SCxl, SCxr: control signals

[0064] vf1, vf2, vf3, vf4: viewing field

[0065] θve: viewing angle

[0066] S110, S120, S130, S210, S220, S230, S240, S250, S260: Steps DETAILED DESCRIPTION

[0067] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the invention belongs. It will be further understood that terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant art and the present invention, and will not be interpreted as idealized or overly formal unless explicitly defined as such herein.

[0068] It should be understood that although the terms "first," "second," "third," etc. may be used herein to describe various components, parts, regions, layers, and / or portions, these components, parts, regions, and / or portions should not be limited by these terms. These terms are only used to distinguish one component, part, region, layer, or portion from another component, part, region, layer, or portion. Thus, a "first component," "part," "region," "layer," or "portion" discussed below could be referred to as a second component, part, region, layer, or portion without departing from the teachings herein.

[0069] The terms used herein are for the purpose of describing specific embodiments only and are not intended to be limiting. As used herein, unless the context clearly indicates otherwise, the singular forms "a", "an", and "the" are intended to include the plural forms, including "at least one". "" or "represents" and / or. As used herein, the term "and / or" includes any and all combinations of one or more of the relevant listed items. It should also be understood that when used in this specification, the terms "include" and / or "including" specify the presence and / or parts of the features, regions, entireties, steps, operations, components, and / or parts, but do not exclude the presence or addition of one or more other features, regions, entireties, steps, operations, components, parts, and / or combinations thereof.

[0070] Figure 1A FIG2 is a schematic diagram illustrating the component configuration of a digital rearview mirror of a digital cockpit system according to an embodiment of the present invention. Figure 1B This is a system diagram of a digital cockpit system according to an embodiment of the present invention. Figure 1A and Figure 1B In this embodiment, a digital cockpit system 100 is provided for a vehicle 20, wherein the vehicle 20 is, for example, a bus, a car, a truck, a truck, or a tractor, but the embodiment of the present invention is not limited thereto.

[0071] In this embodiment, the digital cockpit system 100 includes, for example, an eye-tracking camera 110, a rearview camera 120, an interior rearview mirror display 130, a rearview camera 140, a left rearview camera 150, a left rearview mirror display 160, a right rearview camera 170, a right rearview mirror display 180, and a control circuit 190. The control circuit 190 is coupled to the eye-tracking camera 110, the rearview camera 120, the interior rearview mirror display 130, the rearview camera 140, the left rearview camera 150, the left rearview mirror display 160, the right rearview camera 170, and the right rearview mirror display 180.

[0072] The eye-tracking camera 110 can track (or measure) the eye 11 or gaze position of the passenger 10 to provide line of sight information IFv. The rearview camera 120 captures images from an angle (e.g., angle A1) that is substantially opposite to the viewing angle Vpse of the passenger 10's eye 11 to provide an image IMef of the vehicle interior. The rearview camera 140 captures images from an angle (e.g., angle A2) that is substantially opposite to the viewing angle Vpse of the passenger 10's eye 11 to provide an image IMeb of the environment behind the vehicle 20.

[0073] The left rearview camera 150 shoots at an angle (e.g., angle A3) that is substantially opposite to the viewing angle Vpse of the eyeball 11 of the passenger 10, thereby providing an environmental image IMel on the left side of the vehicle 20. The right rearview camera 170 shoots at an angle (e.g., angle A4) that is substantially opposite to the viewing angle Vpse of the eyeball 11 of the passenger 10, thereby providing an environmental image IMer on the right side of the vehicle 20.

[0074] In this embodiment, the control circuit 190 determines the viewing angle Vpse of the eyeball 11 of the passenger 10 based on the line of sight information IFv. Then, based on the determined viewing angle Vpse, the control circuit 190 determines the viewing field vf1 or vf2 of the rearview mirror image FRrem_C displayed on the interior rearview mirror display screen 130 based on the environmental image IMef or IMeb relative to the interior rearview lens 120 or the rearview lens 140; determines the viewing field vf3 of the rearview mirror image FRrem_L displayed on the left side rearview mirror display screen 160 based on the environmental image IMel relative to the left side rearview lens 150; and determines the viewing field vf4 of the rearview mirror image FRrem_R displayed on the right side rearview mirror display screen 180 based on the environmental image IMer relative to the right side rearview lens 170.

[0075] As described above, the control circuit 190 determines the viewing field vf1 or vf2 of the rearview mirror image FRrem_C displayed on the interior rearview mirror display screen 130, the viewing field vf3 of the rearview mirror image FRrem_L displayed on the left side rearview mirror display screen 160, and the viewing field vf4 of the rearview mirror image FRrem_R displayed on the right side rearview mirror display screen 180 based on the viewing angle Vpse of the passenger 10. This allows the rearview mirror images FRrem_L, FRrem_C, and FRrem_R to adjust as the driver's line of sight changes, providing a more intuitive and realistic experience similar to that obtained when the driver (i.e., the passenger 10) moves their body to change the viewing angle Vpse.

[0076] In this embodiment, the control circuit 190 includes, for example, a microcontroller unit (MCU), but the embodiment of the present invention is not limited thereto.

[0077] In this embodiment, the eye-tracking camera 110 can further analyze the motion of the passenger 10's hand 12 to provide gesture information IFg. Furthermore, the control circuit 190 can determine the passenger 10's gesture based on the gesture information and set viewing fields vf1, vf2, vf3, and vf4 based on the determined gesture. For example, based on the gesture, the control circuit 190 can set the viewing angle of each of the viewing fields vf1, vf2, vf3, and vf4 relative to a corresponding one of the rearview camera 120, the rearview camera 140, the left rearview camera 150, and the right rearview camera 170 (i.e., vertically or horizontally adjust the viewing angles A1-A4), zoom in or out of the corresponding one of the viewing fields vf1, vf2, vf3, and vf4, quickly take a photo or video, or set the viewing fields vf1, vf2, vf3, and vf4 to be fixed or variable (i.e., enable / disable the eye tracking function).

[0078] In this embodiment, the rearview mirror image FRrem_C displayed on the interior rearview mirror display screen 130 is based on the environmental image IMef (corresponding environmental image) provided by the interior rearview lens 120 (corresponding rearview lens) or the environmental image IMeb (corresponding second environmental image) provided by the rearview lens 140 (corresponding second rearview lens). Therefore, the control circuit 190 further determines based on gestures whether the rearview mirror image FRrem_C is based on one of the environmental images IMef and IMeb.

[0079] In this embodiment, the rearview mirror image FRrem_C can be a single image, but in other embodiments, the rearview mirror image FRrem_C can be a split image, that is, the rearview mirror image FRrem_C can be displayed based on the environmental images IMef and IMeb at the same time, but the embodiment of the present invention is not limited to this.

[0080] Figure 2A and 2B 1, 2 and 3. This is a schematic diagram of the operating environment of the digital rearview mirror and passenger vision of the digital cockpit system according to an embodiment of the present invention. Figure 2A and Figure 2B In this embodiment, the control circuit 190 further determines the viewing field (such as vf1, vf2, vf3, vf4) by determining whether the viewing angle Vpse of the eyeball 11 of the passenger 10 is facing the rearview mirror display screen SCRrem based on the line of sight information IFv, where the rearview mirror display screen SCRrem can be one of the interior rearview mirror display screen 130, the left side rearview mirror display screen 160 and the right side rearview mirror display screen 180.

[0081] like Figure 2AAs shown, the viewing angle Vpse1 of the passenger 10's eyeball 11 is not directed toward the rearview mirror display screen SCRrem. In response to the fact that the viewing angle Vpse1 is not directed toward the rearview mirror display screen SCRrem, the control circuit 190 determines that the viewing fields vf1, vf2, vf3, and vf4 are preset fields of view. For example, the viewing fields vf1, vf2, vf3, and vf4 are restored to their original values ​​and remain fixed.

[0082] On the other hand, Figure 2B As shown, the viewing angle Vpse2 of the eyeball 11 of the passenger 10 is directed toward the rearview mirror display screen SCRrem. In response to the viewing angle Vpse2 being directed toward the rearview mirror display screen SCRrem, the control circuit 190 determines the viewing angle θve of the eyeball 11 toward the rearview mirror display screen SCRrem relative to the display plane of the rearview mirror display screen SCRrem, and determines the viewing field of view (e.g., vf1, vf2, vf3, vf4) based on the viewing angle θve. Specifically, when the control circuit 190 determines that the viewing angle Vpse2 is directed toward the rearview mirror display screen SCRrem, the control circuit 190 determines the viewing angle θve of the eyeball 11 toward the rearview mirror display screen SCRrem based on the line of sight information IFv. This determination of the viewing angle θve is performed periodically (e.g., 10 times per second). When the difference between two consecutive viewing angles θve exceeds a threshold (i.e., the viewing angle θve changes), the control circuit 190 may change the viewing field of view (e.g., vf1, vf2, vf3, vf4).

[0083] For example, with respect to the normal of the display plane of the rearview mirror display screen SCRrem, when the relative position of the eyeball 11 of the passenger 10 is raised, that is, the viewing angle (such as Vpse2) of the eyeball 11 of the passenger 10 is moved downward, the viewing field (such as vf1, vf2, vf3, vf4) can be changed to be slightly downward; when the relative position of the eyeball 11 of the passenger 10 is lowered, that is, the viewing angle (such as Vpse2) of the eyeball 11 of the passenger 10 is moved upward, the viewing field (such as vf1, vf2, vf3, vf4) can be changed to be slightly downward. Slightly upward; when the relative position of the passenger 10's eyeball 11 is shifted to the left, that is, the viewing angle of the passenger 10's eyeball 11 (such as Vpse2) is shifted to the right, the viewing field (such as vf1, vf2, vf3, vf4) can be changed to be slightly to the right; when the relative position of the passenger 10's eyeball 11 is shifted to the right, that is, the viewing angle of the passenger 10's eyeball 11 (such as Vpse2) is shifted to the left, the viewing field (such as vf1, vf2, vf3, vf4) can be changed to be slightly to the left. The above is an example for illustration, but the embodiments of the present invention are not limited thereto.

[0084] Figure 31, 2 and 3. Figure 2A 、 Figure 2B as well as Figure 3 In this embodiment, the interior rearview camera 120, the rearview camera 140, the left side rearview camera 150, and the right side rearview camera 170 are, for example, fixed-angle wide-angle lenses. The control circuit 190 can determine the captured portion PTcap of the environmental image IMe to be displayed on the rearview mirror display screen SCRrem based on the determined viewing fields (e.g., vf1, vf2, vf3, and vf4). The environmental image IMev can be one of the environmental images IMel, IMer, IMef, and IMeb, but the present invention is not limited thereto.

[0085] Furthermore, when the control circuit 190 determines that the viewing field of view needs to be changed (such as vf1, vf2, vf3, vf4), the control circuit 190 can adjust the captured portion PTcap to adjust the viewing field of view (such as vf1, vf2, vf3, vf4) corresponding to the rearview mirror image displayed on the rearview mirror display screen SCRrem. For example, when the viewing field of view (such as vf1, vf2, vf3, vf4) needs to be adjusted upward, the captured portion of the PTcap can be moved upward; when the viewing field of view (such as vf1, vf2, vf3, vf4) needs to be adjusted downward, the captured portion of the PTcap can be moved downward; when the viewing field of view (such as vf1, vf2, vf3, vf4) needs to be adjusted to the left, the captured portion of the PTcap can be moved to the left; when the viewing field of view (such as vf1, vf2, vf3, vf4) needs to be adjusted to the right, the captured portion of the PTcap can be moved to the right. The above are examples for illustration, but the embodiments of the present invention are not limited to this.

[0086] Figure 4 This is a system diagram of a digital cockpit system according to another embodiment of the present invention. Figure 2A 、 Figure 2B as well as Figure 4 , wherein the digital cockpit system 100a is substantially the same as the digital cockpit system 100, but in this embodiment, the interior rearview lens 120a, the rear view lens 140a, the left side rearview lens 150a, and the right side rearview lens 170a are, for example, lenses with movable angles, that is, the interior rearview lens 120a, the rear view lens 140a, the left side rearview lens 150a, and the right side rearview lens 170a can be configured with motors to control the steering of the interior rearview lens 120a, the rear view lens 140a, the left side rearview lens 150a, and the right side rearview lens 170a.

[0087] That is, the control circuit 190 can provide a control signal SCxf to the interior rearview camera 120 to adjust the viewing field vf1, can provide a control signal SCxb to the rear rearview camera 140 to adjust the viewing field vf2, can provide a control signal SCxl to the left side rearview camera 150 to adjust the viewing field vf3, and can provide a control signal SCxr to the right side rearview camera 170 to adjust the viewing field vf4.

[0088] Furthermore, when the viewing field of view vf1 is the default field of view, the control circuit 190 can provide a control signal SCxf to the interior rearview camera 120 to set the viewing angle A1 of the interior rearview camera 120 to determine the viewing field of view vf1; when the viewing field of view vf1 needs to be changed, the control circuit 190 can further provide a control signal SCxf to the interior rearview camera 120 to control the interior rearview camera 120 to turn (i.e., change the viewing angle A1).

[0089] When the viewing field vf2 is the default field of view, the control circuit 190 may provide a control signal SCxb to the rearview camera 140 to set the viewing angle A2 of the rearview camera 140 to determine the viewing field vf2. When the viewing field vf2 needs to be changed, the control circuit 190 may further provide a control signal SCxb to the rearview camera 140 to control the rearview camera 140 to turn (i.e., change the viewing angle A2).

[0090] When the viewing field vf3 is the default field of view, the control circuit 190 may provide a control signal SCx1 to the left rearview camera 150 to set the viewing angle A3 of the left rearview camera 150 to determine the viewing field vf3. When the viewing field vf3 needs to be changed, the control circuit 190 may further provide a control signal SCx1 to the left rearview camera 150 to control the left rearview camera 150 to turn (i.e., change the viewing angle A3).

[0091] When the viewing field vf4 is the default field of view, the control circuit 190 may provide a control signal SCxr to the right side rearview lens 170 to set the viewing angle A4 of the right side rearview lens 170 to determine the viewing field vf4; when the viewing field vf4 needs to be changed, the control circuit 190 may further provide a control signal SCxr to the right side rearview lens 170 to control the right side rearview lens 170 to turn (i.e., change the viewing angle A4).

[0092] Figure 5 This is a flow chart of a method for operating a digital rearview mirror in a digital cockpit system according to an embodiment of the present invention. Figure 5In this embodiment, a method for operating a digital rearview mirror is used in a vehicle's digital cockpit system and includes the following steps. In step S110, a control circuit determines the passenger's eye viewing angle based on line-of-sight information provided by an eye-tracking lens. In step S120, the control circuit receives an ambient image provided by the rearview lens. In step S130, the control circuit determines the viewing field of the rearview mirror image displayed on the rearview mirror display screen based on the ambient image based on the determined viewing angle.

[0093] Figure 6 This is a flow chart of an operating method of a digital rearview mirror in a digital cockpit system according to another embodiment of the present invention. Figure 5 and Figure 6 ,in Figure 6 The flowchart shown further illustrates the operation method of a digital rearview mirror. In this embodiment, the operation method includes the following steps. In step S210, the control circuit analyzes the passenger's line of sight data. In step S220, it is determined whether the passenger's eyes are looking directly at the rearview mirror display screen. If the passenger's eyes are not looking directly at the rearview mirror display screen, that is, the judgment result is "no", step S240 is executed; if the passenger's eyes are looking directly at the rearview mirror display screen, that is, the judgment result is "yes", step S240 is executed.

[0094] In step S230, the rearview mirror image of the user's initially set monitoring field of view is maintained. In step S240, the control circuit calculates the angle between the eyeball and the rearview mirror display screen. In step S250, the calculated result is used to change the rearview lens' viewing field of view via a motor or digital control. In step S260, the revised image is displayed on the rearview mirror display screen.

[0095] The order of steps S110, S120, S130, S210, S220, S230, S240, S250, and S260 is for illustration only, and the present invention is not limited thereto. Figures 1A to 4 The embodiments are shown and will not be described again here.

[0096] As shown in the above embodiments, the present invention essentially utilizes the image from the eye-tracking camera inside the vehicle. Through eye-tracking technology, the driver / passenger's gaze direction is transmitted to the vehicle's central processing unit (CPU). This simultaneously controls the interior and exterior cameras, allowing the image in the digital rearview mirror to change with the driver / passenger's gaze, creating a more intuitive and realistic experience, similar to the way the lens changes perspective with the body's movement.

[0097] The technical features of this invention are broadly summarized as follows: 1. Utilizing one or more eye-tracking cameras, the system captures the driver / passenger's gaze or gesture information and transmits this information to a control circuit. 2. The control circuit converts the driver / passenger's gaze and gesture information into control commands, driving the servo motor that controls the lens angle to adjust the lens or digitally alter the image field of view. 3. The control circuit transmits the images captured by the surveillance camera back to the interior rearview mirror display and the side digital rearview mirror display. Therefore, the combination of image recognition and eye-tracking technology enables a more realistic feedback experience in the digital rearview mirror, allowing the driver / passenger to further reduce blind spots by adjusting their gaze and posture, thereby creating a more user-friendly smart cockpit.

[0098] In summary, in the digital cockpit system and digital rearview mirror operating method of the embodiments of the present invention, the control circuit determines the viewing field of the rearview mirror image displayed on the rearview mirror display screen based on the passenger's perspective. This, through image recognition and eye-tracking technology, enables a more realistic digital rearview mirror feedback experience, allowing the driver and passengers to further reduce blind spots by adjusting their line of sight and posture, thereby creating a more user-friendly smart cockpit.

[0099] Although the present invention has been disclosed above with reference to the embodiments, they are not intended to limit the present invention. Anyone with ordinary skill in the art may make slight changes and modifications without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention shall be determined by the scope of the appended patent applications.

Claims

1. A digital cockpit system for a vehicle, characterized in that: include: One eye tracking lens provides line of sight information; a rearview camera, providing an image of the surroundings; a rearview mirror display screen; as well as A control circuit is coupled to the eye-tracking lens, the rearview lens, and the rearview mirror display screen, wherein the control circuit determines a viewing angle of one eye of a passenger based on the line of sight information, and determines a viewing field of a rearview mirror image displayed on the rearview mirror display screen based on the environmental image based on the determined viewing angle.

2. The digital cockpit system according to claim 1, characterized in that: The control circuit further determines whether the passenger's eyeball is directed toward the rearview mirror display screen based on the sight line information. In response to the viewing angle being toward the rearview mirror display screen, the control circuit determines a viewing angle of the eyeball to the rearview mirror display screen, and determines the viewing field based on the viewing angle, and In response to the viewing angle not being directed toward the rearview mirror display screen, the control circuit determines that the viewing field of view is a preset field of view.

3. The digital cockpit system according to claim 2, characterized in that: When the viewing angle changes, the control circuit changes the viewing field of view.

4. The digital cockpit system according to claim 2, wherein: The rearview lens is a movable angle lens. The control circuit provides a control signal to the rearview lens based on the determined viewing field to control the rearview lens to turn.

5. The digital cockpit system according to claim 2, wherein: The rearview lens is a fixed-angle lens. The control circuit determines a captured portion of the environmental image displayed on the rearview mirror display screen based on the determined viewing field.

6. The digital cockpit system according to claim 1, wherein: The eye tracking lens further provides gesture information, and the control circuit further determines a gesture of the passenger based on the gesture information to set the viewing field based on the gesture.

7. The digital cockpit system according to claim 6, characterized in that: The control circuit further sets an angle of view of the viewing field relative to the rearview camera based on the gesture, zooms the viewing field, quickly takes photos or videos, or sets the viewing field to be fixed or variable.

8. The digital cockpit system according to claim 6, wherein: The invention also includes a second rearview mirror that provides a second environmental image, and the control circuit further determines, based on the gesture, whether the rearview mirror image is based on the environmental image and the second environmental image.

9. A method for operating a digital rearview mirror, used in a digital cockpit system of a vehicle, characterized in that: include: Determining a viewing angle of one eye of a passenger based on line of sight information provided by an eye tracking lens via a control circuit; receiving an environmental image provided by a rearview camera via the control circuit; and A viewing field of a rearview mirror image displayed based on the environmental image on a rearview mirror display screen is determined by the control circuit based on the determined viewing angle.

10. The operating method according to claim 9, characterized in that: Determining the viewing field based on the determined viewing angle includes: determining, by the control circuit based on the sight line information, whether a viewing angle of the passenger's eyeball is directed toward the rearview mirror display screen; In response to the viewing angle being toward the rearview mirror display screen, the control circuit determines a viewing angle of the eyeball to the rearview mirror display screen, and determines the viewing field based on the viewing angle; and In response to the viewing angle not being directed toward the rearview mirror display screen, the control circuit determines that the viewing field of view is a preset field of view.

11. The operating method according to claim 10, wherein: Determining the viewing field based on the determined viewing angle includes: When the viewing angle changes, the viewing field of view is changed via the control circuit.

12. The operating method according to claim 10, wherein: The rearview lens is a movable angle lens, and the operation method includes: The control circuit provides a control signal to the rearview lens based on the determined viewing field of view, so as to control the rearview lens to turn.

13. The operating method according to claim 10, wherein: The rearview lens is a fixed-angle lens, and the operating method includes: A captured portion of the environmental image displayed on the rearview mirror display screen is determined by the control circuit based on the determined viewing field of view.

14. The operating method according to claim 9, wherein: The eye tracking lens further provides gesture information, and the operation method includes: The control circuit determines a gesture of the passenger based on the gesture information, so as to set the viewing field based on the gesture.

15. The operating method according to claim 14, characterized in that: Setting the viewing field based on the gesture includes: The control circuit sets a viewing angle of the viewing field relative to the rearview camera based on the gesture, zooms the viewing field, quickly takes photos or videos, or sets the viewing field to be fixed or variable.

16. The operating method according to claim 14, characterized in that: Also includes: The control circuit further determines based on the gesture that the rearview mirror image is based on one of the environmental image and a second environmental image provided by a second rearview lens.

Images