An image display method, device, vehicle-mounted display screen, and apparatus

Abstract

This invention discloses an image display method, apparatus, vehicle-mounted display screen, and device, relating to the field of display technology. The method includes: acquiring user interaction commands generated on the vehicle-mounted display screen; generating display information for each first pixel based on the interaction commands; parsing the display information to obtain projection parameters for each projection beam; projecting the corresponding projection beam onto the vehicle-mounted display screen according to the projection parameters to obtain each second pixel; and forming an interactive interface based on all the second pixels. The vehicle-mounted display screen includes a hemispherical or super-hemispherical display carrier, a touch electrode layer covering the outer surface of the display carrier, and a diffraction film layer covering the inner surface of the display carrier. User interaction commands are obtained based on the touch electrode layer, and the diffraction film layer is used to diffract the projection beam to form second pixels. The interactive interface display method of this invention can present the user in a more intuitive, vivid, and private way.

Description

Technical Field

[0001] This invention relates to the field of display technology, and more specifically to an image display method, apparatus, vehicle display screen, and device. Background Technology

[0002] With the rapid development of intelligent and connected vehicles, the importance of in-vehicle infotainment systems and in-vehicle interactive interfaces is becoming increasingly prominent. Traditional in-vehicle interactive interfaces mainly rely on flat or curved displays, combined with physical buttons, knobs, or flat touch controls to enable user interaction.

[0003] Accurately projecting two-dimensional planar images onto spherical or quasi-spherical screens is crucial for achieving immersive visual experiences. However, due to the fundamental difference between the geometry of a sphere and the projection plane, directly using conventional planar projection techniques can lead to severe image distortion. Specifically, when a projection beam is emitted from a point light source and projects an ideal planar image onto a spherical receiving screen, the curvature of the sphere causes pixels in the image's edge regions to be non-uniformly compressed or stretched, resulting in a distorted image perceived by the observer.

[0004] Therefore, there is an urgent need for a new in-vehicle interaction solution that can break through the limitations of two-dimensional planes, so as to bring users a way of information interaction with a three-dimensional visual sense. Summary of the Invention

[0005] In view of this, embodiments of the present invention provide an image display method, apparatus, vehicle display screen, and device to solve the problem that existing vehicle interaction solutions cannot provide users with a three-dimensional visual sense of information interaction.

[0006] According to a first aspect, embodiments of the present invention provide an image display method, the method comprising:

[0007] Obtain the interaction commands generated by the user on the in-vehicle display screen, and generate the display information of each first pixel based on the interaction commands;

[0008] The displayed information is analyzed to obtain the projection parameters of each projection beam;

[0009] The corresponding projection beam is projected onto the vehicle display screen according to the projection parameters to obtain each second pixel, and an interactive interface is formed based on all the second pixels.

[0010] The vehicle-mounted display screen includes a hemispherical or super-hemispherical display carrier, a touch electrode layer covering the outer surface of the display carrier, and a diffraction film layer covering the inner surface of the display carrier. The user's interaction commands are obtained based on the touch electrode layer, and the diffraction film layer is used to diffract the projection beam and form a second pixel.

[0011] In conjunction with the first aspect, in the first embodiment of the first aspect, the step of projecting the corresponding projection beam onto the vehicle display screen according to the projection parameters to obtain each second pixel, and forming an interactive interface based on all the second pixels, specifically includes:

[0012] Determine the virtual projection point formed by each projection beam projected onto the original projection surface and the real projection point formed by projecting onto the projection receiving surface, and establish the mapping relationship between the virtual projection point and the real projection point corresponding to the projection beam to obtain the first mapping relationship;

[0013] Determine the projection length formed by each projection beam projected onto the original projection surface, and establish a mapping relationship between the projection length and the first deflection component to obtain the second mapping relationship;

[0014] The mapping relationship between the vector from the first pixel point corresponding to each projection beam to the center of the sphere of the display carrier and the second deflection component is determined to obtain the third mapping relationship;

[0015] The display information is analyzed based on the first, second, and third mapping relationships to obtain the projection parameters of each projection beam;

[0016] The original projection surface is the largest cross section passing through the center of the display carrier sphere, the projection receiving surface is the inner surface of the display carrier, the display information includes the display intensity and the display color, the projection parameters include the projection intensity corresponding to the display intensity, the projection color corresponding to the display color, the deflection angle of the projection beam and the deflection speed, and the deflection angle is obtained from the first and second deflection components.

[0017] In conjunction with the first aspect, in the second embodiment of the first aspect, the step of acquiring the user's interaction commands on the in-vehicle display screen and generating display information for each first pixel based on the interaction commands specifically includes:

[0018] Acquire touch events generated by the user on the in-vehicle display screen, and determine at least one touch point corresponding to the touch event on the in-vehicle display screen;

[0019] The user's interaction commands are generated based on the touch points, and the display image and the display information of each first pixel in the display image are determined based on the interaction commands.

[0020] In conjunction with the second embodiment of the first aspect, in the third embodiment of the first aspect, the interactive instructions are obtained through the following steps:

[0021] Acquire at least one touch event generated by the user on the current interactive interface;

[0022] Determine the first interactive area on the current interactive interface corresponding to the current touch event based on the touch point of the current touch event;

[0023] The second interactive area corresponding to the previous touch event on the current interactive interface is determined based on the touch point of the previous touch event;

[0024] Based on the first and second interaction areas, determine the touch buttons and / or interaction trajectories of the user's interaction on the current interaction interface, and generate the user's interaction commands based on the touch buttons and / or interaction trajectories.

[0025] In conjunction with the second embodiment of the first aspect, in the fourth embodiment of the first aspect, the outer surface of the touch electrode layer is provided with a plurality of driving electrodes and a plurality of sensing electrodes, each driving electrode having an intersection point with a sensing electrode, and the intersection of the driving electrode and the sensing electrode forming a capacitor node of the vehicle display screen.

[0026] In conjunction with the fourth embodiment of the first aspect, in the fifth embodiment of the first aspect, the step of acquiring the touch event generated by the user on the vehicle display screen and determining at least one touch point corresponding to the touch event on the vehicle display screen specifically includes:

[0027] Obtain the capacitance value of each capacitor node in the current frame, compare the capacitance value of the current frame with the reference capacitance value of each capacitor node, and determine the amount of change in capacitance value of each capacitor node in the current frame.

[0028] Determine whether a user touch event occurred in the current frame based on the change in capacitance value;

[0029] If a user touch event is determined to have occurred, the capacitor node whose capacitance value changes by more than a preset threshold is considered a valid node.

[0030] Determine the driving electrode and sensing electrode corresponding to each effective node;

[0031] Based on the change in driving electrode, sensing electrode, and capacitance value corresponding to the effective node, the calculation weight of each effective node is determined. Based on the position information and calculation weight of all effective nodes on the vehicle display screen, at least one touch point is determined.

[0032] In conjunction with the fifth embodiment of the first aspect, in the sixth embodiment of the first aspect, the step of determining the calculation weight of each effective node based on the change in the driving electrode, sensing electrode, and capacitance value corresponding to the effective node, and determining at least one set of longitude and latitude coordinates based on the position information and calculation weights of all effective nodes on the vehicle display screen, specifically includes:

[0033] The initial weights of each effective node are determined based on the change in capacitance value.

[0034] Based on the driving electrode and sensing electrode corresponding to the effective node, the position information of each effective node on the vehicle display screen is determined, and the first compensation factor of each effective node is determined based on the position information; the larger the latitude coordinate corresponding to the sensing electrode, the larger the first compensation factor of the corresponding effective node; the smaller the latitude coordinate corresponding to the sensing electrode, the smaller the first compensation factor of the corresponding effective node.

[0035] The second compensation factor for each valid node is determined based on the location information; the larger the latitude coordinate corresponding to the sensing electrode, the larger the second compensation factor of the corresponding valid node; the smaller the latitude coordinate corresponding to the sensing electrode, the smaller the second compensation factor of the corresponding valid node and the closer it is to 1.

[0036] The calculated weight of each valid node is determined by multiplying the basic weight of the valid node, the first compensation factor, and the second compensation factor.

[0037] Based on the spherical distance of the valid nodes on the vehicle display screen, the valid nodes are spatially clustered and grouped to obtain at least one group of valid nodes.

[0038] The touch points for each group are obtained by calculating the weighted centroid based on the location information and weight of each group of valid nodes.

[0039] According to a second aspect, embodiments of the present invention also provide an image display device, the device comprising:

[0040] The display generation module is used to acquire the interaction commands generated by the user on the vehicle display screen and generate the display information of each first pixel according to the interaction commands.

[0041] The parameter generation module is used to parse the display information and obtain the projection parameters of each projection beam.

[0042] The projection diffraction module is used to project the corresponding projection beam onto the vehicle display screen according to the projection parameters, to obtain each second pixel, and to form an interactive interface based on all the second pixels.

[0043] The vehicle-mounted display screen includes a hemispherical or super-hemispherical display carrier, a touch electrode layer covering the outer surface of the display carrier, and a diffraction film layer covering the inner surface of the display carrier. The user's interaction commands are obtained based on the touch electrode layer, and the diffraction film layer is used to diffract the projection beam and form a second pixel.

[0044] According to a third aspect, embodiments of the present invention also provide an in-vehicle display screen, comprising a hemispherical or super-hemispherical display carrier, a touch electrode layer covering the outer surface of the display carrier, and a diffraction film layer covering the inner surface of the display carrier. Based on the touch electrode layer, user interaction commands are obtained. The diffraction film layer is used to diffract the projection beam and form a second pixel. The in-vehicle display screen performs the steps of the image display method described in any of the above claims to generate the projection beam.

[0045] According to a fourth aspect, embodiments of the present invention also provide an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the steps of any of the above-described image display methods.

[0046] The image display method, apparatus, vehicle display screen, and device of the present invention, when a user generates a touch event on the vehicle display screen, the user generates an interaction command on the vehicle display screen, which in turn generates an interaction command that conforms to the user's intention, and can further execute corresponding interactive operations according to the interaction command. Simultaneously, the user can perform touch operations on the entire visible surface of the hemispherical or super-hemispherical vehicle display screen, extending the user's interactive behavior from a two-dimensional plane to a three-dimensional curved surface, thus improving the user's interactive experience. The hemispherical display carrier shell structure is simple, easy to install and manufacture, and can meet general vehicle space requirements. The super-hemispherical display carrier structure can provide users with a larger display area and a wider viewing angle, suitable for vehicles with high display effect requirements. By generating display information for each first pixel point according to the interaction command, and then... The displayed information is analyzed to obtain the projection parameters of each projection beam. Finally, based on the projection parameters, the corresponding projection beam is projected onto the vehicle display screen to obtain each second pixel. An interactive interface is formed based on all the second pixels, realizing imaging on a three-dimensional sphere. This breaks through the limitations of traditional two-dimensional planar displays. Through diffraction imaging of the diffraction film layer on the vehicle display screen, the main direction of the projection beam is oriented towards the outer surface of the sphere, i.e., the direction of the user's observation, thus forming an interactive interface with a sense of three-dimensionality and space. The interactive interface has a strong sense of three-dimensionality and spatial depth. At the same time, due to the directionality of diffraction, the interactive interface is brightest in the direction of observation directly facing the sphere. This helps to provide users with privacy. The interactive interface can be presented to users in a more intuitive, vivid, and private way, improving the efficiency, fun, and confidentiality of information transmission. Attached Figure Description

[0047] The features and advantages of the invention will be more clearly understood by referring to the accompanying drawings, which are schematic and should not be construed as limiting the invention in any way. In the drawings:

[0048] Figure 1A flowchart illustrating the image display method provided by the present invention is shown;

[0049] Figure 2 A front view of the projection path of the projection beam in the image display method provided by the present invention is shown;

[0050] Figure 3 A top view of the projection path of the projection beam in the image display method provided by the present invention is shown;

[0051] Figure 4 A schematic diagram of the structure of the image display device provided by the present invention is shown;

[0052] Figure 5 This is a schematic diagram of the hardware structure of the electronic device provided in the embodiments of this application. Detailed Implementation

[0053] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0054] With the rapid development of intelligent and connected vehicles, the importance of in-vehicle infotainment systems and in-vehicle interactive interfaces is becoming increasingly prominent. Traditional in-vehicle interactive interfaces mainly rely on flat or curved displays, combined with physical buttons, knobs, or flat touch controls to enable user interaction.

[0055] Among them, flat-panel displays are the most widely used solution in the field of in-vehicle interaction, but their display form is simple, lacks a sense of three-dimensional visual hierarchy, and the way information is presented is monotonous. Moreover, the interaction is limited to a two-dimensional plane, lacking a sense of three-dimensionality, and cannot provide users with a novel and intuitive operating experience. Curved displays, by bending the screen to fit the curvature of the user's field of vision, can improve the visual immersion and experience to a certain extent. However, they are still essentially a deformation of a two-dimensional display plane and have not broken through the scope of a flat display plane. The user interaction methods are also limited to flat touch, such as clicking and swiping, resulting in insufficient user operating experience.

[0056] Accurately projecting two-dimensional planar images onto spherical or quasi-spherical screens is crucial for achieving immersive visual experiences. However, due to the fundamental difference between the geometry of a sphere and the projection plane, directly using conventional planar projection techniques can lead to severe image distortion. Specifically, when a projection beam is emitted from a point light source and projects an ideal planar image onto a spherical receiving screen, the curvature of the sphere causes pixels in the image's edge regions to be non-uniformly compressed or stretched, resulting in a distorted image perceived by the observer.

[0057] In conclusion, there is an urgent need for a new in-vehicle interaction solution that can break through the limitations of two-dimensional planes, thereby bringing users a way of information interaction with a three-dimensional visual sense of hierarchy.

[0058] To address the aforementioned issues, this specification provides an image display method designed to present the interactive interface to the user in a more intuitive, vivid, and private manner, thereby improving the efficiency, engagement, and confidentiality of information delivery. The image display method provided in this specification can be applied to electronic devices, including laptops, desktop computers, smartphones, smart wearable devices, and tablets. Furthermore, the image display method provided in this specification can also be applied to applications running on the aforementioned electronic devices. Figure 1 This is a flowchart illustrating an image display method according to an embodiment of the present invention, such as... Figure 1 As shown, the method may include the following steps:

[0059] S101. Obtain the interaction commands generated by the user on the vehicle display screen, and generate display information for each first pixel based on the interaction commands. The display information includes the display intensity, i.e., the display brightness value, and the display (RGB) color.

[0060] In this embodiment of the invention, the vehicle display screen includes a hemispherical or super-hemispherical display carrier, a touch electrode layer covering the outer surface of the display carrier, a diffraction film layer covering the inner surface of the display carrier, a light source, a touch sensor, a signal processing circuit, and a touch controller. The touch electrode layer corresponds to the shape of the display carrier and is also hemispherical or super-hemispherical.

[0061] In this embodiment of the invention, a nanoscale diffraction film is deposited on the inner surface of the display carrier, thereby forming an optical path coverage area. This diffraction film is prepared using precision processes such as magnetron sputtering, and its thickness is typically 50-200 nanometers. The material used to prepare the diffraction film can be titanium dioxide, silicon dioxide, or a multilayer composite structure thereof.

[0062] In this embodiment of the invention, the touch electrode layer determines the touch point on the vehicle display screen for each user touch event based on capacitive or piezoresistive detection methods, and generates the user's interaction command based on the touch point.

[0063] The principle of capacitive touch point detection is as follows: when a user's finger presses the touch electrode layer, the touch electrode layer will produce an extremely small deformation that is imperceptible to the naked eye. This deformation will cause the capacitance value of the capacitor node at the corresponding position on the touch electrode layer to change, and the specific touch point is determined based on the amount of capacitance change.

[0064] The principle of piezoresistive touch point detection is as follows: The touch electrode layer has several insulating spacers, and a piezoresistive material is coated or printed around each insulating spacer. When the user does not press the touch electrode layer, the touch electrode layer is separated into upper and lower layers by the insulating spacers, and the circuit is in an open or high-resistance state. When the user presses the touch electrode layer with their finger, the upper touch electrode layer deforms and contacts the lower touch electrode layer at the user's touch point, squeezing the piezoresistive material in the middle. The squeezing causes the resistance value of the piezoresistive material to decrease, and the greater the pressure, the greater the decrease in resistance. By measuring the change in current or voltage in the circuit, the pressure value at that point and the position of the press, i.e., the position of the touch point, can be accurately calculated.

[0065] In this embodiment of the invention, the vehicle display screen uses a capacitive detection method to determine the touch point. The outer surface of the touch electrode layer is provided with a plurality of driving electrodes and sensing electrodes. The driving electrodes and sensing electrodes are arranged perpendicularly to each other, and the intersection of the driving electrodes and sensing electrodes forms a capacitive node of the vehicle display screen.

[0066] In this embodiment of the invention, the display carrier is made of a high-strength, high-transmittance transparent material, which gives the display carrier excellent impact resistance, scratch resistance, and weather resistance. For example, transparent tempered glass or sapphire glass can be used to make the display carrier, and the display carrier is hemispherical or super-hemispherical. The hemispherical structure of the display carrier shell is simple, easy to install and manufacture, and can meet the general vehicle space requirements. The super-hemispherical structure of the display carrier can provide users with a larger display area and a wider viewing angle, which is suitable for vehicles with high requirements for display effect. The touch electrode layer uses transparent conductive materials such as indium tin oxide (ITO) and is plated on the outer surface of the display carrier, so that the user can interact using the capacitive touch principle. Electrode patterns are set on the outer surface of the touch electrode layer through micro-nano processing technology such as photolithography and etching, thus forming driving electrodes and sensing electrodes on the touch electrode layer. A capacitor node can be formed at the intersection of the driving electrodes and sensing electrodes.

[0067] It is understandable that each driving electrode can form a capacitor node with each sensing electrode. Since there are several driving electrodes and sensing electrodes on the outer surface of the touch electrode layer, several capacitor nodes are formed on the vehicle display screen. The vehicle display screen also includes a touch sensor, which is used to obtain the capacitance value of the capacitor node and transmit the capacitance value to the signal processing circuit. The signal processing circuit amplifies and filters the received capacitance value, and then sends the processed signal to the touch controller. The touch controller uses an application-specific integrated circuit (ASIC). The touch sensor sequentially sends a specific frequency excitation signal to each driving electrode. When the user's finger is not touching the vehicle display screen, the signal received by each sensing electrode has a stable baseline value. When the user's finger touches a point on the vehicle display screen, which has a spherical outer surface, it disturbs the electric field of one or more capacitor nodes in a local area near the touch point, causing a decrease in the mutual capacitance value at these nodes. In this case, the touch sensor is used to obtain the capacitance value of the capacitor node. Therefore, by setting each touch sensor, the amount of change in capacitance value can be captured. The touch sensor transmits the change to the touch controller through the signal processing circuit. Based on the change after processing by the signal processing circuit, the touch controller can detect which capacitor nodes have significantly changed capacitance values, and then calculate the position of the touch point on the vehicle display screen.

[0068] When a user makes a touch event on the in-vehicle display screen, that is, when a specific touch point is generated on the in-vehicle display screen, various interactive commands can be generated based on the touch point, thereby realizing various interactive operations of the user. For example, the user can switch the displayed content by sliding on the surface of the in-vehicle display screen, or click on a specific area of ​​the in-vehicle display screen to select functions. This three-dimensional interaction method brings users a brand-new operating experience and enriches the forms and possibilities of interaction.

[0069] It should be noted that the touch sensors are set in several and evenly distributed on the outer surface of the display carrier. For example, a touch sensor is set at the position corresponding to each capacitor node.

[0070] For example, the driving electrodes are longitudinal electrodes disposed on the touch electrode layer, and the sensing electrodes are transverse electrodes disposed on the touch electrode layer. Specifically, the driving electrodes are a series of arc-shaped electrodes converging from the poles of the display carrier to the edge of the display carrier, and the sensing electrodes are a series of circular electrodes parallel to the original projection plane. The plane passing through the driving electrodes and the central axis is perpendicular to the original projection plane; that is, the plane formed by the driving electrodes and the central axis is perpendicular to the original projection plane, and the plane passing through the sensing electrodes is parallel to the original projection plane. Each longitudinal line formed on the touch electrode layer corresponds to one driving electrode, and similarly, each transverse line formed on the touch electrode layer corresponds to one sensing electrode.

[0071] The in-vehicle infotainment system also includes a projection imaging unit, which employs a picture generation unit (PGU) based on laser beam scanning. Specifically, the projection imaging unit includes:

[0072] Laser diode array: emits red (R), green (G), and blue (B) laser light;

[0073] Beam combining optical system: combines three-color lasers into a single colored projection beam;

[0074] Projection beam deflector: It is usually composed of two micro-electro-mechanical system (MEMS) scanning mirrors. One mirror is responsible for high-speed horizontal (X-axis) scanning and the other is responsible for low-speed vertical (Y-axis) scanning. By precisely controlling the angle of the scanning mirrors, the projection beam can perform grating scanning on a two-dimensional plane.

[0075] Synchronization and control circuit: The color and brightness of the laser diode are strictly synchronized with the position of the scanning mirror. At each moment of scanning, the system knows the target position of the beam and gives the RGB brightness value that should be given at that position. The laser then emits light of the corresponding intensity.

[0076] In this embodiment of the invention, the projection imaging unit based on LBS PGU utilizes the collimation characteristics of lasers, eliminating the need for focusing when the output laser dot matrix is ​​imaged on the vehicle-mounted display screen, thus effectively solving the focusing problem of displaying stereoscopic spheres. When the projection beam emitted by the projection imaging unit illuminates the diffraction film layer, diffraction occurs, resulting in a clear interactive interface formed on the outer surface of the vehicle-mounted display screen. This imaging method, based on the principle of diffraction combined with laser projection, fully utilizes the curved surface characteristics of the sphere to present a picture with a sense of three-dimensionality and space. For example, it can display AI styling of sphere shapes, enabling a more vivid interactive experience with users.

[0077] Please see Figure 2 After the display carrier is manufactured, the center point of its poles and the center of the entire display carrier can be determined. Based on the poles and center of the sphere of the solid object... The central axis of the display carrier and the original projection surface can be determined. Original projection plane The maximum cross-section passing through the center of the sphere is also the maximum cross-section passing through the display carrier. For a hemispherical display carrier, the original projection surface... It is also a plane obtained based on its edge, with its central axis being a straight line passing through the pole and the center of the sphere O and intersecting with the original projection plane. Perpendicular to each other, according to the center of the ball Central axis and original projection plane A spherical polar coordinate system can be established for the display carrier, with the origin of the system being the center of the sphere. The positive Z-axis of the spherical polar coordinate system is the axis passing through the center of the sphere. The coordinate axes to the poles, the XY plane of the spherical polar coordinate system is the original projection plane. The projection bearing surface of the inner surface of the display carrier is The inner diameter of the display carrier is .

[0078] More specifically, the output end of the beam combining optical system that serves as the light source in the projection imaging unit. Set at an off-center position on the display carrier, at the ejection end , center of the ball The three points are collinear with the pole, and the exit end The poles are located at the center of the sphere. Both sides, thus from the ejection end The emitted projection beam can be projected onto a designated diffraction film layer, that is, onto the inner surface of the display carrier.

[0079] S102. Analyze the display information to obtain the projection parameters of each projection beam. The projection parameters include the projection intensity corresponding to the display intensity, the projection color corresponding to the display color, the deflection angle of the projection beam, and the deflection speed. The deflection speed is also the scanning speed, which can be set according to specific display requirements.

[0080] S103. Project the corresponding projection beam onto the vehicle display screen according to the projection parameters to obtain each second pixel, and form an interactive interface based on all the second pixels.

[0081] Please see Figure 2 and Figure 3 The position information of the output end L of the beam combining optical system is already known, for example, the output end... At the center of the ball The coordinates in the three-dimensional coordinate system with the origin as the coordinate system are: ,in, Indicates the ejection end The Z-axis coordinate.

[0082] Suppose that at a certain moment the projected beam emitted from the beam combining optical system is Under normal circumstances, if the projected beam Projected onto the original projection plane On the original projection plane The projection surface forms a uniform, distortion-free image, which is the ideal interactive interface. However, the actual projection surface... With virtual original projection surface They are not the same; the original projection plane It is a planar surface and a projected bearing surface It is a spherical surface, which directly projects a flat display image onto the projection receiving surface. This will result in severe nonlinear geometric distortion.

[0083] In this embodiment of the invention, image distortion processing is used at the projection imaging unit to perform inverse nonlinear deformation on the displayed image, so that the image passing through the projection receiving surface... After projection, the image seen by the user is correct.

[0084] In this embodiment of the invention, the synchronization and control circuit calculates the projection parameters of each projection beam based on the display information of the image to be displayed and the preset first, second, and third mapping relationships. Then, through a projection beam deflector, a laser diode array, and a beam combining optical system, each projection beam is emitted from the output end of the beam combining optical system. This causes the projection beam to deflect to a designated position on the diffraction film layer. The projection beam forms a pixel at a specific position. After scanning and deflecting one pixel, the above operation is repeated until a complete image frame is rendered. Through the diffraction of the diffraction film layer, an interactive interface is finally formed and displayed to the user.

[0085] In this embodiment of the invention, the first mapping relationship is the mapping relationship between the virtual projection point formed by the projection beam projected onto the original projection surface and the real projection point formed by the projection beam projected onto the projection receiving surface; the second mapping relationship is the mapping relationship between the projection length formed by the projection beam projected onto the original projection surface and the first deflection component; the third mapping relationship is the mapping relationship between the vector from the first pixel point corresponding to the projection beam to the center of the sphere and the second deflection component; and the interactive interface is composed of a number of second pixels.

[0086] In this embodiment of the invention, the function of the diffraction film layer is to scatter the projection beam at a specific angle through the diffraction and interference effects of light when a specific projection beam is incident, thereby forming each second pixel on the outer surface of the display carrier, i.e., the user's viewing side, and forming a visible and bright interactive interface based on all the second pixels.

[0087] Specifically, step S103 includes the following steps:

[0088] S1031. Determine the virtual projection point formed by each projection beam when it is projected onto the original projection surface and the real projection point formed when it is projected onto the projection receiving surface, and establish the mapping relationship between the virtual projection point and the real projection point corresponding to the projection beam to obtain the first mapping relationship.

[0089] S1032. Determine the projection length of each projection beam when projected onto the original projection surface under theoretical conditions, and establish the mapping relationship between the projection length and the first deflection component to obtain the second mapping relationship.

[0090] S1033. Determine the mapping relationship between the second pixel point and the second deflection component corresponding to each projection beam to obtain the third mapping relationship.

[0091] S1034. The display information is analyzed according to the first, second, and third mapping relationships to obtain the projection parameters of each projection beam.

[0092] When the projection beam Projected onto a virtual original projection surface At that time, it will be on the original projection plane A virtual projection point is generated on it. Virtual projection point The coordinates in the above three-dimensional coordinate system are: Ejection end With the original projection plane mapped onto the two-dimensional plane The lines connecting its two ends are respectively the connecting lines. and connection , connection and connection The resulting angle constrains the limit value of the deflection angle, where, Represents virtual projection point X-axis coordinates Represents virtual projection point Y-axis coordinate, Represents virtual projection point The Z-axis coordinate.

[0093] Assuming the projected beam The angle between the first deflection component and the positive direction of the positive Z-axis in the polar coordinate system of the sphere is angular. Projected beam The angle between the second deflection angle and the positive direction of the XY plane is also known as the second deflection angle component. Based on angle and angle Able to determine each projection beam The final deflection angle is determined based on the first and second deflection components.

[0094] Describe the projection beam based on spatial geometric relationships. The parametric equation of the projected path is:

[0095]

[0096] in, Indicates the projected beam exist The X-axis coordinate at time; Indicates the projected beam exist The Y-axis coordinate at time; Indicates the projected beam exist The Z-axis coordinate at any given time. (Projected beam) The initial position corresponds to The direction vector corresponds to vector.

[0097] In actual projection, when the projection beam Projected onto the actual projection surface At that time, it will be on the projection receiving surface Generate a real projection point on True projection point This can be expressed using the following formula:

[0098]

[0099] Based on the parametric equation of the line and the actual projection points The calculation formula can be further obtained as follows:

[0100]

[0101] The formula can be further simplified to obtain the following... The quadratic equation in time:

[0102]

[0103] Using this quadratic equation, we can determine each true projection point. Location information for each real projection point Each corresponds to a second pixel.

[0104] According to the quadratic formula, we can further obtain:

[0105] ,Right now The vector length cannot be 0, due to the projection beam. The requirement is to be able to at least the virtual original projection surface. Since it can form an image, it must be true;

[0106] when When the quadratic equation has no solution, the projected beam... With projection bearing surface They do not intersect;

[0107] when When the quadratic equation has a unique solution, the projected beam... With projection bearing surface Tangent, correspondingly, under this condition and The value corresponds to the limit under ideal conditions; any virtual projection point exceeding this range... This would negate the theoretical significance of spherical projection;

[0108] when When the quadratic equation has two solutions, due to the projection interface... Since it is not a complete sphere, considering the actual projection situation, in this embodiment of the invention, the larger value solution is taken as the final projection position solution. The larger value equation solution is as follows:

[0109]

[0110] Based on the final solution of the quadratic equation, the true projection point can be determined. Its corresponding virtual projection point The mapping relationship between them, that is, each second pixel point and its corresponding virtual projection point The first mapping relationship between them, specifically:

[0111]

[0112] Based on each second pixel point and its corresponding virtual projection point The mapping relationship between them also allows us to obtain the coordinates of the second pixel in the spherical polar coordinate system, specifically:

[0113]

[0114] in, express Vector on the original projection plane The projected length on.

[0115] It can be seen that the position information of each second pixel point not only changes with the angle It changes with the changes, and will also change with the changes. It changes with the changes and has the following relationship:

[0116]

[0117]

[0118] Based on the above calculation formula, it can be concluded that: on the actual projected bearing surface... With the Z-axis as the normal, and the coordinates... In a set of concentric circles centered at coordinates , the directions of each circle are ( Different and The same circles will display the same effect, while different circles will display the same effect. and The changes in imaging conditions (which are not uniform) are not linear, resulting in distortion in the actual imaging.

[0119] When users view a spherical image, they will want it to appear even as the angle changes. From 0 to With uniform changes, the image can also change uniformly. For angle The maximum value.

[0120] When initially drawing the display image that needs to be projected, a uniform drawing method is used. Assume a first pixel in the display image... The coordinates in the XY plane are At the center point of the displayed image Angle between the vector and the positive X-axis And the first pixel vector With angle It has the following mapping relationship:

[0121]

[0122] in, Represents the first pixel X-axis coordinates in the XY plane; Represents the first pixel Y-axis coordinates in the XY plane; ; Represents the original projection plane With projection bearing surface The distance at the junction relative to the original projection plane The distance between the points where it intersects the Z-axis.

[0123] In actual rendering, without image distortion processing, the angle... and It has the following mapping relationship:

[0124]

[0125] Thus, based on the first pixel point vector With angle The mapping relationship and the angle without image distortion processing. and The given mapping relationship allows for the establishment of vectors. and The mapping relationship between them is obtained.

[0126] according to First pixel vector With angle The mapping relationship also allows us to derive the first deflection component and The mapping relationship between them is used to construct the second mapping relationship.

[0127] It should be noted that the display image on a flat surface undergoes a certain process during the drawing process. The angle between the vector and the positive X direction Maintain consistency with the second deflection component in the final display, i.e. This is how the third mapping relationship is constructed.

[0128] The required angles can be calculated based on the second and third mapping relationships. and angle Correspondingly, the first deflection component and the second deflection component can be calculated, and the deflection angle can be determined based on the first deflection component and the second deflection component.

[0129] The image display method of this invention, when a user generates a touch event on the in-vehicle display screen, generates an interaction command on the in-vehicle display screen that matches the user's intention, and can further execute corresponding interactive operations according to the interaction command. Simultaneously, the user can perform touch operations on the entire visible surface of the hemispherical or super-hemispherical in-vehicle display screen, extending the user's interactive behavior from a two-dimensional plane to a three-dimensional curved surface, thus improving the user's interactive experience. The hemispherical display carrier shell structure is simple, easy to install and manufacture, and can meet general in-vehicle space requirements. The super-hemispherical display carrier structure can provide users with a larger display area and a wider viewing angle, suitable for vehicles with high display effect requirements. The method generates display information for each first pixel point according to the interaction command, and then decodes the display information. The process involves analyzing and obtaining the projection parameters of each projection beam. Based on these parameters, the corresponding beam is projected onto the vehicle-mounted display screen, resulting in each second pixel. An interactive interface is then formed based on all the second pixels, achieving imaging on a three-dimensional sphere. This overcomes the limitations of traditional two-dimensional displays. Through diffraction imaging on the vehicle-mounted display screen, the main direction of the projection beam is directed towards the outer surface of the sphere, i.e., the direction of the user's observation. This creates an interactive interface with a strong sense of depth and three-dimensionality. Furthermore, due to the directionality of diffraction, the interface is brightest primarily in the direction directly facing the sphere, which helps provide privacy for the user. The interactive interface can be presented to the user in a more intuitive, vivid, and private way, improving the efficiency, enjoyment, and confidentiality of information transmission.

[0130] In this embodiment of the invention, step S101 specifically includes:

[0131] S1011. Obtain the touch event generated by the user on the vehicle display screen, and determine at least one touch point corresponding to the touch event on the vehicle display screen.

[0132] It should be noted that the previous touch event is the closest touch event in time to the current touch event, and whenever the user generates a new touch event, the current touch event and the previous touch event will also be updated accordingly. Each touch event can be stored to facilitate recording and generating interaction commands.

[0133] In this embodiment of the invention, the user's interaction intent can be formed by at least one touch event. Each touch event corresponds to at least one touch point. Therefore, the touch points corresponding to the current touch event and the previous touch event may be different. Based on the change in the position of the touch point, an interaction instruction that conforms to the user's interaction intent can be generated.

[0134] In this embodiment of the invention, the current interactive interface is also a key factor influencing the generation of interactive commands. Even if the change in the touch point position is exactly the same, different interactive interfaces can still generate different interactive commands. In this way, interactive commands that better match the user's interactive intent can be generated. For example, if the current interactive interface is a music playback interface with a volume control track, a series of touch events by the user sliding on the volume control track will adjust the music playback volume; that is, the user's interactive intent represented by this series of touch events is to adjust the music playback volume. If the current interactive interface is a traffic navigation interface, the volume control track displayed on the music playback interface may show a traffic street on the constantly changing traffic navigation interface. A series of similar touch events by the user sliding on the traffic street will switch the traffic content displayed on the vehicle display screen; that is, the user's interactive intent represented by this series of similar touch events is to adjust the displayed traffic content.

[0135] S1012. Generate user interaction instructions based on touch points, and determine the display image and the display information of each first pixel in the display image based on the interaction instructions.

[0136] In this embodiment of the invention, a two-dimensional display image is drawn according to the interactive instructions. The display image is composed of a number of first pixels. When generating the display image, the display information of each first pixel is obtained.

[0137] In this embodiment of the invention, step S1011 specifically includes:

[0138] S10111. Obtain the capacitance value of each capacitor node in the current frame, compare the capacitance value of the current frame with the reference capacitance value of each capacitor node, and determine the amount of change in capacitance value of each capacitor node in the current frame.

[0139] The reference capacitance value is the capacitance value of the corresponding capacitor node in a non-touch state. However, due to the influence of factors such as ambient temperature and vehicle vibration during actual use, the original capacitance value of each capacitor node may change. Therefore, changes in environmental parameters may also cause changes in the reference capacitance value of each capacitor node. In this embodiment of the invention, the current environmental parameters of the vehicle display screen are obtained, and the reference capacitance value of each capacitor node is determined based on the current environmental parameters, thereby obtaining a reference capacitance value that is more consistent with the current vehicle conditions.

[0140] The environmental parameters include ambient temperature, deformation, acceleration, and other parameters. These environmental parameters can be obtained by setting up sensors such as three-axis displacement sensors and gyroscopes on the vehicle display screen and temperature sensors in the vehicle system, and then transmitted to the touch controller for corresponding processing.

[0141] More specifically, by simulating different test environments composed of various environmental parameters, the mapping relationship between the capacitance value of each capacitor node in the same type of vehicle display screen and various environmental parameters under non-touch conditions can be obtained. Based on this mapping relationship, a non-linear offline parameter table is established. In this way, after obtaining the current environmental parameters, the capacitance value corresponding to the current environmental parameters can be determined by looking up the table and interpolation, and the capacitance value corresponding to the current environmental parameters is used as the reference capacitance value of the capacitor node under the current environmental parameters. Alternatively, the initial reference value of the vehicle display screen under room temperature (25℃), no bumps or other interference, and no touch conditions can be obtained first. Then, the functional relationship between each environmental parameter and the capacitance value of the capacitor node can be established. According to the functional relationship, the influence of the corresponding environmental parameters on the capacitance value can be quantified. Then, the quantified influence degree is used as the compensation coefficient of the corresponding environmental parameter. The initial reference value is compensated by the compensation coefficients corresponding to all environmental parameters and the current environmental parameters, thereby obtaining the reference capacitance value of each capacitor node under the current environmental parameters.

[0142] Of course, the reference capacitance value of each capacitor node can also be obtained based on various environmental parameters and other methods, such as dynamic baseline tracking, initial calibration mechanism, etc. There are no restrictions on the method of determining the reference capacitance value.

[0143] S10112. Determine whether a user touch event has occurred in the current frame based on the change in capacitance value.

[0144] In this embodiment of the invention, when the capacitive touchscreen detects whether a user has generated a touch event, it needs to use the capacitance value of each capacitive node in a certain frame when the user is not touching as the reference capacitance value of each capacitive node. When it is necessary to determine whether the user has touched a capacitive node in a certain frame, the capacitance value of each capacitive node in the current frame is compared with the corresponding reference capacitance value. If the capacitance value of the current frame is less than the reference capacitance value and the difference between the two exceeds a preset threshold, it can be determined that a user touch event has occurred in the current frame. The preset threshold is a negative value, that is, the change in capacitance value needs to be negative and exceed a certain amount. This can eliminate obvious noise values, such as water stains or oil stains on the surface of the vehicle display screen that cause an increase in the capacitance value of the capacitive node, and can also exclude small changes in capacitance value caused by environmental factors. This can reduce unnecessary calculation processes and improve the accuracy of subsequent touch point determination.

[0145] S10113. If a user touch event is confirmed, capacitor nodes whose capacitance value changes exceeding a preset threshold are designated as valid nodes. Specifically, the formula for determining valid nodes is:

[0146]

[0147] in, Indicates the first The change in capacitance value at each capacitor node; This indicates a preset threshold.

[0148] S10114. Determine the driving electrode and sensing electrode corresponding to each valid node.

[0149] In this embodiment of the invention, after setting each driving electrode and sensing electrode on the touch electrode layer, corresponding indexes can be established for each driving electrode and sensing electrode. For example, all driving electrodes are assigned numbers, and their indices are determined based on these numbers. Similarly, all sensing electrodes are assigned numbers, and their indices are determined based on these numbers. After determining all valid nodes, the indices of the driving electrodes and sensing electrodes corresponding to each valid node can be determined, thus obtaining the driving electrodes and sensing electrodes corresponding to each valid node.

[0150] S10115. Based on the driving electrode, sensing electrode and capacitance value change corresponding to the effective node, determine the calculation weight of each effective node, and determine at least one touch point based on the position information and calculation weight of all effective nodes on the vehicle display screen.

[0151] Assuming in the first Two sets of location information were obtained from the touch event. Based on these two sets of location information, the first touch point and the second touch point can be obtained respectively. The first touch point can correspond to the touch of one of the user's fingers, and the second touch point can correspond to the touch of the user's other finger.

[0152] It should be noted that since the area touched by a user's finger covers multiple capacitive nodes, a single touch event may correspond to multiple valid nodes, and each valid node has its corresponding driving electrode and sensing electrode.

[0153] In particular, when users interact with the vehicle display screen using multi-finger touch, such as zooming in on a display interface or window with two fingers, for example, when a user touches the vehicle display screen with both their index finger and thumb at the same time, the capacitance value of a group of capacitive nodes near the user's index finger touch point will decrease, and the capacitance value of another group of capacitive nodes near the user's thumb touch point will also decrease. In this case, the touch controller cannot determine which capacitive nodes were touched by the index finger and which were touched by the thumb.

[0154] In this embodiment of the invention, multiple possible touch points are identified through weighted centroid calculation, enabling complex user gesture interactions, such as supporting users to interact with the vehicle display screen by using two-finger zoom, rotation, etc. Secondly, it can effectively prevent two close touch points from being misjudged as one touch point, ensuring the recognition accuracy of each touch point.

[0155] More specifically, step S10115 includes:

[0156] For each valid node, the initial weight of each valid node is determined based on the change in capacitance value. ,Right now ,in, Indicates the first The base weight of each valid node.

[0157] For each valid node, the position information of each valid node on the vehicle display screen is determined based on the driving electrode and sensing electrode corresponding to the valid node, and a first compensation factor for each valid node is determined based on the position information. The position information is obtained from longitude and latitude coordinates. The first compensation factor is used to compensate for the recognition error caused by the non-uniform distribution of capacitive nodes. The larger the latitude coordinate corresponding to the sensing electrode, the larger the first compensation factor of the corresponding valid node. The smaller the latitude coordinates corresponding to the sensing electrode, the smaller the first compensation factor of the corresponding effective node. ).

[0158] Since the in-vehicle display screen is based on a hemispherical or super-hemispherical display carrier, each point in the touch electrode layer covering the outer surface of the display carrier has corresponding longitude and latitude information. Considering that the distribution of driving electrodes and sensing electrodes in the hemispherical or super-hemispherical touch electrode layer is uneven, the closer to the original projection surface, the larger the spacing between capacitor nodes; conversely, the closer to the poles, the smaller the spacing between capacitor nodes. That is, the closer to the original projection surface of the in-vehicle display screen, the sparser the electrode pattern; the closer to the poles of the in-vehicle display screen, the denser the electrode pattern. However, the influence range of each capacitor node is roughly fixed. In areas with sparse electrode patterns, a larger spherical area corresponds to the use of capacitor nodes to detect touch events, while in areas with dense electrode patterns, a smaller spherical area corresponds to the use of capacitor nodes to detect touch events.

[0159] In this embodiment of the invention, by setting a first compensation factor and increasing the value of the first compensation factor in areas with sparse electrode patterns and decreasing the value of the first compensation factor in areas with dense electrode patterns, the recognition error caused by the uneven distribution between capacitor nodes in the process of weighted centroid calculation of capacitor nodes close to the original projection surface is avoided.

[0160] For each valid node, a second compensation factor is still determined based on the location information. This second compensation factor compensates for the identification error caused by signal intensity changes due to electric field distortion at the edge capacitive nodes. The larger the latitude coordinate corresponding to the sensing electrode, the larger the second compensation factor of the corresponding valid node. The smaller the latitude coordinates corresponding to the sensing electrode, the smaller the second compensation factor of the corresponding effective node (approaching 1).

[0161] In spherical touchscreens, the electric field distribution changes, especially at the edges of the spherical cap. Furthermore, when a user's finger touches the edge of the vehicle's display, only part of the finger may be in contact with the spherical surface, while the other part remains suspended. This also leads to a significant difference in capacitance changes compared to touching the center of the display. In the central region of the display's edge, the electric field distortion is small, resulting in normal signal strength. Conversely, in the edge region, the electric field distortion is larger, leading to signal strength attenuation and typically smaller capacitance changes.

[0162] In this embodiment of the invention, by setting a second compensation factor and increasing the value of the second compensation factor as it gets closer to the edge region, the recognition error caused by the high intensity attenuation of the signal due to the special shape of the display carrier during the weighted centroid calculation process of the capacitor nodes near the edge region is avoided.

[0163] The calculated weight of each valid node is determined based on the product of its base weight, the first compensation factor, and the second compensation factor. Specifically:

[0164]

[0165] in, Indicates the first The calculated weights of each valid node; Indicates the first The first compensation factor for each effective node; Indicates the first The second compensation factor for each effective node.

[0166] That is, the basic weights are compensated using the first compensation factor and the second compensation factor, thereby obtaining the calculated weights of the effective nodes. .

[0167] In this embodiment of the invention, the driving electrode is a meridian-shaped electrode disposed on the touch electrode layer, and the sensing electrode is a parallel-shaped electrode disposed on the touch electrode layer. Specifically, the driving electrode is a series of arc-shaped electrodes converging from the poles of the display carrier to the edge of the display carrier, and the sensing electrode is a series of circular electrodes parallel to the original projection plane. The plane passing through the driving electrode and the central axis is perpendicular to the original projection plane, that is, the plane formed by the driving electrode and the central axis is perpendicular to the original projection plane, and the plane passing through the sensing electrode is parallel to the original projection plane. Each meridian formed on the touch electrode layer corresponds to a driving electrode, and similarly, each parallel formed on the touch electrode layer corresponds to a sensing electrode.

[0168] In this way, the position information of the effective nodes in the capacitor node can be determined based on the driving electrode and sensing electrode corresponding to the capacitor node.

[0169] Based on the spherical distance of the valid nodes on the vehicle display screen, the valid nodes are spatially clustered and grouped to obtain at least one group of valid nodes.

[0170] In this embodiment of the invention, in order to decouple the touch points of multiple thumbs of a user, it is determined that the capacitive nodes that are physically close in spherical space and have similar signals belong to the touch of the same finger, thereby dividing at least one group of effective nodes.

[0171] For example, the effective node with the largest change in capacitance value is taken as the first cluster center node, and the spherical distance between the other effective nodes and the cluster center node is determined. Effective nodes with a spherical distance less than a preset distance are assigned to the first group. If there are still remaining effective nodes that have not been assigned, the effective node with the largest change in capacitance value among the remaining effective nodes is found and taken as the second cluster center node. The above spatial clustering process is repeated to obtain the second group, and so on.

[0172] The weighted centroid is calculated based on the location information and calculation weight of each group of valid nodes to obtain the touch points of each group. It can be understood that the number of valid nodes obtained in the spatial clustering process determines the corresponding number of touch points.

[0173] In this embodiment of the invention, each capacitor node has its position information on the vehicle display screen. By multiplying the effective node position information in the capacitor node by the calculation weight, the weighted value of each effective node can be obtained. By accumulating the weighted values ​​of all effective nodes and dividing them by the sum of the calculation weights of all effective nodes, the position information of each group, that is, each touch point, can be obtained.

[0174] In this embodiment of the invention, the interactive instructions are obtained through the following steps:

[0175] S201. Obtain at least one touch event generated by the user on the current interactive interface.

[0176] It should be noted that each touch event can correspond to at least one touch point.

[0177] In this embodiment of the invention, a complete user interaction instruction can consist of a series of consecutive steps of interaction instructions. Each step of the interaction instruction is generated by the touch points corresponding to the current and previous touch events, respectively. This method of generating each step of the interaction instruction step by step can better understand the user's interaction intention and generate more accurate interaction instructions.

[0178] It is understandable that when a user generates multiple touch events on the current interactive interface, these touch events have a corresponding chronological order.

[0179] S202. Determine the first interactive area on the current interactive interface corresponding to the current touch event based on the touch point of the current touch event.

[0180] S203. Determine the second interactive area on the current interactive interface corresponding to the touch point of the previous touch event.

[0181] S204. Based on the first and second interaction areas, determine the touch buttons and / or interaction trajectories of the user's interaction on the current interaction interface, and generate the user's interaction commands based on the touch buttons and / or interaction trajectories.

[0182] The hemispherical or super-hemispherical design of the display carrier can better adapt to the complex space inside the vehicle. At the same time, compared with traditional flat or curved screens, the in-vehicle display based on the display carrier can provide a larger display area, interactive area and wider viewing angle within the limited space of the vehicle. Therefore, the user's touch event can not only be pressing a touch button on the current interactive interface, but also drawing an interactive trajectory on the current display interface. For example, the user can operate by sliding or rotating along different directions on the surface of the in-vehicle display. It can also be combined with touch buttons and drawing interactive trajectories on the display interface. For example, the user can operate by pressing a touch button and then sliding or rotating along different directions on the surface of the in-vehicle display.

[0183] Through this interaction method, users can perform full-range touch operations on the outer surface of the in-vehicle display screen, namely the touch electrode layer, which enriches the forms and possibilities of interaction.

[0184] In this embodiment of the invention, a number of touch buttons can be set on an interactive interface. When a user presses one of the touch buttons, the user will be redirected to another interactive interface, and the sub-touch buttons corresponding to the pressed touch button will be displayed on the new interactive interface. These sub-touch buttons are also touch buttons under the current interactive interface. By generating user interaction commands based on touch buttons and / or interaction trajectories, the unique shape and interaction method of the in-vehicle display screen can be combined with the limited space in places such as the center console of the vehicle to make full use of space and provide users with a better interactive experience.

[0185] In this embodiment of the invention, in order to provide users with a better touch experience and protect the touch electrode layer, a protective layer is covered on the outer surface of the touch electrode layer. This protective layer can be an organic or inorganic coating with high hardness and high light transmittance, such as a silicon dioxide-based hardened coating, with a pencil hardness of 4H or higher. The main function of this protective layer is to provide physical protection for the touch electrode layer underneath, preventing scratches during use, and also to provide a stable surface dielectric constant, ensuring the stability of capacitance detection.

[0186] In this embodiment of the invention, a filling layer may be provided between the protective layer and the touch electrode layer, such as a layer of transparent optical adhesive or resin. This filling layer can improve the optical effect and increase the structural strength.

[0187] The image display device provided in the embodiments of the present invention will be described below. The image display device described below and the image display method described above can be referred to in correspondence.

[0188] To address the aforementioned issues, this specification provides an image display device designed to present the interactive interface to the user in a more intuitive, vivid, and private manner, thereby improving the efficiency, enjoyment, and confidentiality of information transmission. Figure 4 This is a schematic diagram of the structure of an image display device according to an embodiment of the present invention, such as... Figure 4 As shown, the device may include:

[0189] The display generation module 10 is used to acquire the interaction commands generated by the user on the vehicle display screen and generate display information for each first pixel based on the interaction commands. The display information includes the display intensity, i.e., the display brightness value, and the display (RGB) color.

[0190] In this embodiment of the invention, the vehicle display screen includes a hemispherical or super-hemispherical display carrier, a touch electrode layer covering the outer surface of the display carrier, a diffraction film layer covering the inner surface of the display carrier, a light source, a touch sensor, a signal processing circuit, and a touch controller. The touch electrode layer corresponds to the shape of the display carrier and is also hemispherical or super-hemispherical.

[0191] In this embodiment of the invention, a nanoscale diffraction film is deposited on the inner surface of the display carrier, thereby forming an optical path coverage area. This diffraction film is prepared using precision processes such as magnetron sputtering, and its thickness is typically 50-200 nanometers. The material used to prepare the diffraction film can be titanium dioxide, silicon dioxide, or a multilayer composite structure thereof.

[0192] The parameter generation module 20 is used to parse the display information and obtain the projection parameters of each projection beam. These projection parameters include the projection intensity corresponding to the display intensity, the projection color corresponding to the display color, the deflection angle of the projection beam, and the deflection speed.

[0193] The projection diffraction module 30 is used to project the corresponding projection beam onto the vehicle display screen according to the projection parameters, to obtain each second pixel, and to form an interactive interface based on all the second pixels.

[0194] In this embodiment of the invention, the synchronization and control circuit calculates the projection parameters of each projection beam based on the display information of the image to be displayed and the preset first, second and third mapping relationships. Then, through the projection beam deflector, laser diode group and beam combining optical system, each projection beam is deflected from the emission end L of the beam combining optical system to a specified position of the diffraction film. The projection beam forms a pixel at a specific position. After completing the scanning and deflection of a pixel, the above operation is repeated until a complete image frame is rendered. Through the diffraction of the diffraction film, an interactive interface is finally formed for the user to view.

[0195] In this embodiment of the invention, the first mapping relationship is the mapping relationship between the virtual projection point formed by the projection beam projected onto the original projection surface and the real projection point formed by the projection beam projected onto the projection receiving surface; the second mapping relationship is the mapping relationship between the projection length formed by the projection beam projected onto the original projection surface and the first deflection component; the third mapping relationship is the mapping relationship between the vector from the first pixel point corresponding to the projection beam to the center of the sphere and the second deflection component; and the interactive interface is composed of a number of second pixels.

[0196] In this embodiment of the invention, the function of the diffraction film layer is to scatter the projection beam at a specific angle through the diffraction and interference effects of light when a specific projection beam is incident, thereby forming each second pixel on the outer surface of the display carrier, i.e., the user's viewing side, and forming a visible and bright interactive interface based on all the second pixels.

[0197] The image display device of this invention, when a user generates a touch event on the vehicle-mounted display screen, generates interactive commands that match the user's intentions. The device can then further execute corresponding interactive operations based on these commands. Simultaneously, the user can perform touch operations on the entire visible surface of the hemispherical or super-hemispherical vehicle-mounted display screen, extending user interaction from a two-dimensional plane to a three-dimensional curved surface, thus enhancing the user's interactive experience. The hemispherical display carrier shell structure is simple, easy to install and manufacture, and can meet general vehicle space requirements. The super-hemispherical display carrier structure can provide users with a larger display area and a wider viewing angle, suitable for vehicles with high display effect requirements. The device generates display information for each first pixel based on the interactive commands, and then decodes the display information... The process involves analyzing and obtaining the projection parameters of each projection beam. Based on these parameters, the corresponding beam is projected onto the vehicle-mounted display screen, resulting in each second pixel. An interactive interface is then formed based on all the second pixels, achieving imaging on a three-dimensional sphere. This overcomes the limitations of traditional two-dimensional displays. Through diffraction imaging on the vehicle-mounted display screen, the main direction of the projection beam is directed towards the outer surface of the sphere, i.e., the direction of the user's observation. This creates an interactive interface with a strong sense of depth and three-dimensionality. Furthermore, due to the directionality of diffraction, the interface is brightest primarily in the direction directly facing the sphere, which helps provide privacy for the user. The interactive interface can be presented to the user in a more intuitive, vivid, and private way, improving the efficiency, enjoyment, and confidentiality of information transmission.

[0198] To address the aforementioned issues, this specification also provides an in-vehicle display screen, which includes a hemispherical or super-hemispherical display carrier, a touch electrode layer covering the outer surface of the display carrier, and a diffraction film layer covering the inner surface of the display carrier. User interaction commands are obtained based on the touch electrode layer, and the diffraction film layer is used to diffract the projection beam and form a second pixel. The in-vehicle display screen performs the steps of the image display method described in any of the above descriptions to generate the projection beam.

[0199] Figure 5 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 5 As shown, the electronic device may include: a processor 510, a communication interface 520, a memory 530, and a communication bus 540, wherein the processor 510, the communication interface 520, and the memory 530 communicate with each other via the communication bus 540. The processor 510 can call logical commands in the memory 530 to execute an image display method, which includes:

[0200] Obtain the interaction commands generated by the user on the in-vehicle display screen, and generate the display information of each first pixel based on the interaction commands;

[0201] The displayed information is analyzed to obtain the projection parameters of each projection beam;

[0202] The corresponding projection beam is projected onto the vehicle display screen according to the projection parameters to obtain each second pixel, and an interactive interface is formed based on all the second pixels.

[0203] The vehicle-mounted display screen includes a hemispherical or super-hemispherical display carrier, a touch electrode layer covering the outer surface of the display carrier, and a diffraction film layer covering the inner surface of the display carrier. The user's interaction commands are obtained based on the touch electrode layer, and the diffraction film layer is used to diffract the projection beam and form a second pixel.

[0204] Furthermore, the logical instructions in the aforementioned memory 530 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0205] On the other hand, the present invention also provides a computer program product, the computer program product comprising a computer program stored on a non-transitory computer-readable storage medium, the computer program comprising program instructions, wherein when the program instructions are executed by a computer, the computer is able to execute the image display method provided by the above methods, the method comprising:

[0206] Obtain the interaction commands generated by the user on the in-vehicle display screen, and generate the display information of each first pixel based on the interaction commands;

[0207] The displayed information is analyzed to obtain the projection parameters of each projection beam;

[0208] The corresponding projection beam is projected onto the vehicle display screen according to the projection parameters to obtain each second pixel, and an interactive interface is formed based on all the second pixels.

[0209] The vehicle-mounted display screen includes a hemispherical or super-hemispherical display carrier, a touch electrode layer covering the outer surface of the display carrier, and a diffraction film layer covering the inner surface of the display carrier. The user's interaction commands are obtained based on the touch electrode layer, and the diffraction film layer is used to diffract the projection beam and form a second pixel.

[0210] In another aspect, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to perform the aforementioned image display methods, the method comprising:

[0211] Obtain the interaction commands generated by the user on the in-vehicle display screen, and generate the display information of each first pixel based on the interaction commands;

[0212] The displayed information is analyzed to obtain the projection parameters of each projection beam;

[0213] The corresponding projection beam is projected onto the vehicle display screen according to the projection parameters to obtain each second pixel, and an interactive interface is formed based on all the second pixels.

[0214] The vehicle-mounted display screen includes a hemispherical or super-hemispherical display carrier, a touch electrode layer covering the outer surface of the display carrier, and a diffraction film layer covering the inner surface of the display carrier. The user's interaction commands are obtained based on the touch electrode layer, and the diffraction film layer is used to diffract the projection beam and form a second pixel.

[0215] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0216] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0217] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. An image display method, characterized in that, The method includes: Obtain the user's interaction commands on the in-vehicle display screen, and generate display information for each first pixel based on the interaction commands; The displayed information is analyzed to obtain the projection parameters of each projection beam; The corresponding projection beam is projected onto the vehicle display screen according to the projection parameters to obtain each second pixel, and an interactive interface is formed based on all the second pixels. The vehicle-mounted display screen includes a hemispherical or super-hemispherical display carrier, a touch electrode layer covering the outer surface of the display carrier, and a diffraction film layer covering the inner surface of the display carrier. The user's interaction commands are obtained based on the touch electrode layer, and the diffraction film layer is used to diffract the projection beam and form a second pixel. The step of projecting the corresponding projection beam onto the vehicle display screen according to the projection parameters to obtain each second pixel, and forming an interactive interface based on all the second pixels, specifically includes: Determine the virtual projection point formed by each projection beam projected onto the original projection surface and the real projection point formed by projecting onto the projection receiving surface, and establish the mapping relationship between the virtual projection point and the real projection point corresponding to the projection beam to obtain the first mapping relationship; Determine the projection length formed by each projection beam projected onto the original projection surface, and establish a mapping relationship between the projection length and the first deflection component to obtain the second mapping relationship; the projection length is the length from the center of the display carrier to the virtual projection point; The mapping relationship between the vector from the first pixel point corresponding to each projection beam to the center of the sphere of the display carrier and the second deflection component is determined to obtain the third mapping relationship; The display information is analyzed based on the first, second, and third mapping relationships to obtain the projection parameters of each projection beam; The original projection surface is the largest cross section passing through the center of the display carrier sphere, the projection receiving surface is the inner surface of the display carrier, the display information includes the display intensity and the display color, the projection parameters include the projection intensity corresponding to the display intensity, the projection color corresponding to the display color, the deflection angle of the projection beam and the deflection speed, the deflection angle is obtained by the first and second deflection components, the first deflection component is the angle between the projection beam and the positive direction of the positive Z axis of the sphere polar coordinate system, and the second deflection angle component is the angle between the projection beam and the positive direction of the XY plane.

2. The image display method according to claim 1, characterized in that, The step of acquiring user interaction commands generated on the in-vehicle display screen and generating display information for each first pixel based on the interaction commands specifically includes: Acquire touch events generated by the user on the in-vehicle display screen, and determine at least one touch point corresponding to the touch event on the in-vehicle display screen; The user's interaction commands are generated based on the touch points, and the display image and the display information of each first pixel in the display image are determined based on the interaction commands.

3. The image display method according to claim 2, characterized in that, The interactive instructions are obtained through the following steps: Acquire at least one touch event generated by the user on the current interactive interface; Determine the first interactive area on the current interactive interface corresponding to the current touch event based on the touch point of the current touch event; The second interactive area corresponding to the previous touch event on the current interactive interface is determined based on the touch point of the previous touch event; Based on the first and second interaction areas, determine the touch buttons and / or interaction trajectories of the user's interaction on the current interaction interface, and generate the user's interaction commands based on the touch buttons and / or interaction trajectories.

4. The image display method according to claim 2, characterized in that, The outer surface of the touch electrode layer is provided with a number of driving electrodes and a number of sensing electrodes. Each driving electrode has an intersection point with a sensing electrode, and the intersection of the driving electrode and the sensing electrode forms a capacitor node of the vehicle display screen.

5. The image display method according to claim 4, characterized in that, The step of acquiring touch events generated by the user on the in-vehicle display screen and determining at least one touch point corresponding to the touch event on the in-vehicle display screen specifically includes: Obtain the capacitance value of each capacitor node in the current frame, compare the capacitance value of the current frame with the reference capacitance value of each capacitor node, and determine the amount of change in capacitance value of each capacitor node in the current frame. Determine whether a user touch event occurred in the current frame based on the change in capacitance value; If a user touch event is determined to have occurred, the capacitor node whose capacitance value changes by more than a preset threshold is considered a valid node. Determine the driving electrode and sensing electrode corresponding to each effective node; Based on the change in driving electrode, sensing electrode, and capacitance value corresponding to the effective node, the calculation weight of each effective node is determined. Based on the position information and calculation weight of all effective nodes on the vehicle display screen, at least one touch point is determined.

6. The image display method according to claim 5, characterized in that, The calculation weight of each effective node is determined based on the change in the driving electrode, sensing electrode, and capacitance value corresponding to the effective node. Based on the position information and calculation weights of all effective nodes on the vehicle display screen, at least one set of longitude and latitude coordinates is determined, specifically including: The initial weights of each effective node are determined based on the change in capacitance value. Based on the driving electrode and sensing electrode corresponding to the effective node, the position information of each effective node on the vehicle display screen is determined, and the first compensation factor of each effective node is determined based on the position information; the larger the latitude coordinate corresponding to the sensing electrode, the larger the first compensation factor of the corresponding effective node; the smaller the latitude coordinate corresponding to the sensing electrode, the smaller the first compensation factor of the corresponding effective node. The second compensation factor for each valid node is determined based on the location information; the larger the latitude coordinate corresponding to the sensing electrode, the larger the second compensation factor of the corresponding valid node; the smaller the latitude coordinate corresponding to the sensing electrode, the smaller the second compensation factor of the corresponding valid node and the closer it is to 1. The calculated weight of each valid node is determined by multiplying the basic weight of the valid node, the first compensation factor, and the second compensation factor. Based on the spherical distance of the valid nodes on the vehicle display screen, the valid nodes are spatially clustered and grouped to obtain at least one group of valid nodes. The touch points for each group are obtained by calculating the weighted centroid based on the location information and weight of each group of valid nodes.

7. An image display device, characterized in that, The device includes: The display generation module is used to acquire the interaction commands generated by the user on the vehicle display screen and generate the display information of each first pixel according to the interaction commands. The parameter generation module is used to parse the display information and obtain the projection parameters of each projection beam. The projection diffraction module is used to project the corresponding projection beam onto the vehicle display screen according to the projection parameters to obtain each second pixel point, and to form an interactive interface based on all the second pixel points. The vehicle-mounted display screen includes a hemispherical or super-hemispherical display carrier, a touch electrode layer covering the outer surface of the display carrier, and a diffraction film layer covering the inner surface of the display carrier. The user's interaction commands are obtained based on the touch electrode layer, and the diffraction film layer is used to diffract the projection beam and form a second pixel. The projection diffraction module specifically includes: Determine the virtual projection point formed by each projection beam projected onto the original projection surface and the real projection point formed by projecting onto the projection receiving surface, and establish the mapping relationship between the virtual projection point and the real projection point corresponding to the projection beam to obtain the first mapping relationship; Determine the projection length formed by each projection beam projected onto the original projection surface, and establish a mapping relationship between the projection length and the first deflection component to obtain the second mapping relationship; the projection length is the length from the center of the display carrier to the virtual projection point; The mapping relationship between the vector from the first pixel point corresponding to each projection beam to the center of the sphere of the display carrier and the second deflection component is determined to obtain the third mapping relationship; The display information is analyzed based on the first, second, and third mapping relationships to obtain the projection parameters of each projection beam; The original projection surface is the largest cross section passing through the center of the display carrier sphere, the projection receiving surface is the inner surface of the display carrier, the display information includes the display intensity and the display color, the projection parameters include the projection intensity corresponding to the display intensity, the projection color corresponding to the display color, the deflection angle of the projection beam and the deflection speed, the deflection angle is obtained by the first and second deflection components, the first deflection component is the angle between the projection beam and the positive direction of the positive Z axis of the sphere polar coordinate system, and the second deflection angle component is the angle between the projection beam and the positive direction of the XY plane.

8. A vehicle-mounted display screen, characterized in that, The display includes a hemispherical or super-hemispherical display carrier, a touch electrode layer covering the outer surface of the display carrier, and a diffraction film layer covering the inner surface of the display carrier. User interaction commands are obtained based on the touch electrode layer. The diffraction film layer is used to diffract the projection beam and form a second pixel. The vehicle display screen performs the steps of the image display method as described in any one of claims 1 to 6 to generate the projection beam.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the steps of the image display method as described in any one of claims 1 to 6.

Images