Mechanical matrix, control method and device for mechanical matrix
Patent Information
- Application Number
- CN202180005753.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-06-21
- Publication Date
- 2026-09-25
- Estimated Expiration
- 2041-06-21
AI Technical Summary
[0003]机械矩阵形成的立体形状是预先设置的,调整方式的灵活性较低
Smart Images

Figure CN116171569B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of mechanical structures, specifically to mechanical matrices, control methods and devices for mechanical matrices. Background Technology
[0002] The mechanical matrix comprises multiple matrix units, each capable of bidirectional movement along a straight line, meaning the height of each unit is adjustable. These units can be arranged in rows and columns. The number of matrix units can be customized based on the specific application environment. By controlling the height of the matrix units, various static and dynamic patterns can be constructed to simulate three-dimensional terrain features, urban planning changes, movable type printing, text patterns, wave motion, and more. The device can also be combined with digital imaging to create a variety of realistic three-dimensional dynamic patterns.
[0003] The three-dimensional shape formed by the mechanical matrix is preset, and the adjustment method has low flexibility. Summary of the Invention
[0004] This application provides a mechanical matrix, a method for controlling the mechanical matrix, and an apparatus that can improve the flexibility of the adjustment method of the mechanical matrix.
[0005] In a first aspect, a mechanical matrix is provided, comprising multiple motion units; the height of the top of each motion unit is adjustable; each motion unit is provided with a sensor, the sensor being used to output contact information, the contact information being used to indicate whether the top of the motion unit is in contact with a target.
[0006] By installing sensors on the motion unit, the contact information output by the sensors is used to indicate whether the motion unit is in contact with the target. This enables the mechanical matrix to have human-machine interaction capabilities and allows for control of the mechanical matrix based on the contact information output by the sensors, thus improving the control flexibility of the mechanical matrix.
[0007] In conjunction with the first aspect, in some possible implementations, the plurality of motion units includes a first motion unit and a second motion unit. In the mechanical array adjusted according to the contact information, the first motion unit and the second motion unit form a recessed structure. The height of the top end of the first motion unit is less than the height of the top end of the second motion unit. The second motion unit surrounds the first motion unit. The first motion unit includes a contact motion unit among the plurality of motion units that contacts the target.
[0008] When the target comes into contact with a motion unit in the mechanical matrix, the height of the top of the motion unit is adjusted so that a recessed structure is formed in the mechanical array after adjustment based on the contact information, and the target is positioned within this recess. Compared to shelves with fixed shapes, the flexible shelf formation method can reduce the space occupied by the shelf.
[0009] In conjunction with the first aspect, in some possible implementations, the first motion unit is the contact motion unit, and the second motion unit includes the neighboring motion units among the plurality of motion units whose distance from the contact motion unit is less than a preset value.
[0010] The first moving unit located at the bottom of the recessed structure is in contact with the target, so that the bottom of the recessed structure adapts to the shape of the target, providing stable support for the target and improving the stability of the support for the placed items.
[0011] The second motion unit surrounding the bottom of the recessed structure does not contact the target, and the distance between the second motion unit and the first motion unit located at the bottom of the recessed structure is less than or equal to a preset value, so that the shape and size of the recessed structure are adapted to the shape of the target, improving the support stability of the mechanical matrix for the placed items and preventing the target from shaking.
[0012] In conjunction with the first aspect, in some possible implementations, the mechanical matrix is located in the vehicle, the vehicle is in a bumpy state, the direction of the change in the height of the contact motion unit is opposite to the direction of the vibration of the vehicle, the amount of change in the height of the contact motion unit is positively correlated with the vibration distance of the vehicle, and the contact motion unit is the motion unit that contacts the target among the plurality of motion units.
[0013] In conjunction with the first aspect, in some possible implementations, the target is an electronic display device, and in the mechanical array adjusted according to the contact information, the contact motion unit among the plurality of motion units that contacts the target forms a support, the support being used to set the orientation of the target.
[0014] When the vehicle vibrates, the absolute height of the vehicle changes. Based on the vibration information, the height of the contact motion unit is adjusted so that the top of the contact motion unit moves relative to the vehicle. The top of the contact motion unit moves in the opposite direction to the vibration direction of the vehicle, and the difference in height of the contact motion unit is positively correlated with the vibration distance of the vehicle.
[0015] In other words, by controlling the relative motion between the contact motion unit and the vehicle, the variation in the absolute distance to the target is reduced, thereby reducing the bumps experienced by the target.
[0016] In conjunction with the first aspect, in some possible implementations, the target is an electronic display device, and in the mechanical array adjusted according to the contact information, the contact motion unit among the plurality of motion units that contacts the target forms a support, the support being used to set the orientation of the target.
[0017] The target is electronic display devices. The mechanical matrix is controlled to form a support, and the orientation of the electronic display devices is adjusted to improve the user experience.
[0018] In conjunction with the first aspect, in some possible implementations, the support oriented the target toward the user's head.
[0019] The supports formed at the top of each motion unit in the mechanical matrix allow the electronic wire device to face the user's head, thus improving the user experience.
[0020] In conjunction with the first aspect, in some possible implementations, a slope is formed at the top of at least one of the motion units, causing the target to slide to a target position located in a plane of symmetry of the user's head, with the support located at the target position.
[0021] Placing the electronic display device on a symmetrical plane above the head ensures that the distance between the user's eyes and the display device is equal, thus improving the user experience.
[0022] In conjunction with the first aspect, in some possible implementations, the sliding of the target on the slope causes the bottom edge of the target to be perpendicular to the user's direct line of sight, the formation of the bracket causes the bottom edge to be perpendicular to the plane of symmetry, and the target to face the user's head.
[0023] This ensures that the bottom edge of the target is perpendicular to the user's direct line of sight. Therefore, when forming the support, without altering the motion unit contacted by the bottom edge of the target, the target's posture better matches the user's posture requirements for the electronic display device, improving the user experience.
[0024] In conjunction with the first aspect, in some possible implementations, the mechanical array is used to display an image, the plurality of motion units correspond to a plurality of pixels of the image, and in the mechanical array adjusted according to the contact information, the color of at least one pixel is changed, the at least one pixel being a pixel corresponding to at least one of the contact motion units and neighboring motion units, the contact motion unit being the motion unit that is in contact with the target among the plurality of motion units, and the neighboring motion unit being the motion unit whose distance from the contact motion unit is less than a preset value.
[0025] In the case where multiple motion units correspond to multiple pixels in the image displayed by the mechanical array, the color of each pixel can be adjusted according to the contact information output by the support structure, making the control method of the mechanical matrix more flexible.
[0026] Secondly, a control method for a mechanical matrix is provided, characterized in that the mechanical matrix includes multiple motion units, each motion unit is equipped with a sensor, and the method includes: acquiring contact information output by the sensors on the multiple motion units, the contact information being used to indicate whether the top end of the motion unit is in contact with a target; adjusting the height of the top end of at least one of the motion units according to the contact information, wherein the at least one motion unit includes a contact motion unit and / or a neighboring motion unit, the top end of the contact motion unit is in contact with the target, and the distance between the neighboring motion unit and the contact motion unit is less than a preset value.
[0027] By installing sensors on the motion units, the contact information output by the sensors is used to indicate whether the tip of the motion unit is in contact with the target. In the case of contact motion units in the mechanical matrix whose tips are in contact with the target, the height of the tip of at least one of the contact motion units and its neighboring motion units is adjusted to adjust the three-dimensional shape formed by the motion units. This allows for more flexible adjustment of the three-dimensional shape formed by each motion unit in the mechanical matrix.
[0028] In conjunction with the second aspect, in some possible implementations, the height of the top end is an absolute height, the plurality of motion units include a first motion unit and a second motion unit, and the adjustment of the height of the top end of at least one of the motion units causes the first motion unit and the second motion unit to form a concave structure, the height of the top end of the first motion unit is less than the height of the top end of the second motion unit, the second motion unit surrounds the first motion unit, and the first motion unit includes the contact motion unit.
[0029] When the target comes into contact with the motion unit in the mechanical matrix, the height of the top of the motion unit is adjusted to form a recessed structure, and the target is positioned within this recess. Compared to a shelf with a fixed shape, adjusting the height of the top of the motion unit in the mechanical matrix to form a shelf when the motion unit is in contact with the target reduces the space occupied by the shelf.
[0030] In conjunction with the second aspect, in some possible implementations, in the adjusted mechanical matrix, the first motion unit is the contact motion unit.
[0031] The first moving unit located at the bottom of the recessed structure is in contact with the target, so that the bottom of the recessed structure adapts to the shape of the target, providing stable support for the target and improving the stability of the support for the placed items.
[0032] In conjunction with the second aspect, the second motion unit includes the adjacent motion unit.
[0033] The second motion unit surrounding the bottom of the recessed structure does not contact the target, and the distance between the second motion unit and the first motion unit located at the bottom of the recessed structure is less than or equal to a preset value, so that the shape and size of the recessed structure are adapted to the shape of the target, improving the support stability of the mechanical matrix for the placed items and preventing the target from shaking.
[0034] In conjunction with the second aspect, in some possible implementations, the mechanical matrix is located within the vehicle, and the method further includes: acquiring bump information, the bump information indicating the vibration direction and vibration distance of the vehicle vibration, the vibration direction being a direction perpendicular to the sea level, and the vibration distance indicating the absolute height change of the vehicle along the vibration direction; determining an adjustment height difference based on the bump information, the adjustment height difference being positively correlated with the vibration distance; and adjusting the height of the top end of at least one of the motion units based on the contact information, including: adjusting the height of the top end of the contact motion unit along a direction opposite to the vibration direction, the amount of height change of the contact motion unit being the adjustment height difference.
[0035] When the vehicle vibrates, the absolute height of the vehicle changes. Based on the vibration information, the height of the contact motion unit is adjusted so that the top of the contact motion unit moves relative to the vehicle. The top of the contact motion unit moves in the opposite direction to the vibration direction of the vehicle, and the difference in height of the contact motion unit is positively correlated with the vibration distance of the vehicle.
[0036] In other words, by controlling the relative motion between the contact motion unit and the vehicle, the variation in the absolute distance to the target is reduced, thereby reducing the bumps experienced by the target.
[0037] In conjunction with the second aspect, in some possible implementations, the mechanical matrix is located in the vehicle, and the method further includes: acquiring bump indication information, the bump indication information being used to indicate that the vehicle is in a bumpy state; adjusting the height of the top of at least one of the motion units according to the contact information includes: adjusting the height of the top of the contact motion unit according to the bump indication information and first contact information output by a first sensor to minimize the difference between a first pressure and a second pressure, wherein the first sensor is disposed at the top of the contact motion unit, the first contact information is used to indicate the first pressure, the first pressure being the pressure exerted on the contact motion unit when the vehicle is in the bumpy state, and the second pressure being the pressure exerted on the contact motion unit when the vehicle is in a smooth driving state.
[0038] By controlling the height of the top of the contact motion unit in the mechanical matrix, the difference in pressure on the contact motion unit under bumpy and smooth driving conditions is minimized, thereby reducing the bumps experienced by the target located at the top of the contact motion unit.
[0039] In conjunction with the second aspect, in some possible implementations, the target is an electronic display device, and in the adjusted mechanical matrix, the contact motion unit forms a support, which is used to set the orientation of the target.
[0040] The target is electronic display devices. The mechanical matrix is controlled to form a support, and the orientation of the electronic display devices is adjusted to improve the user experience.
[0041] In conjunction with the second aspect, in some possible implementations, the method further includes: determining, based on the contact information, that the target is an electronic display device.
[0042] This method provides a simple way to determine whether a target is an electronic display device by using contact information.
[0043] In conjunction with the second aspect, in some possible implementations, head position information is obtained, which is used to indicate the position of the user's head, and the bracket makes the target face the user's head.
[0044] Based on the acquired head position information, the height of the top of the motion unit in the mechanical matrix is controlled to form a support, which makes the target face the user's head, thereby improving the user experience.
[0045] The mechanical matrix can be located in the vehicle, and the head position information can be determined based on images captured by cameras in the vehicle.
[0046] In conjunction with the second aspect, in some possible implementations, head posture information is obtained, which is used to indicate the plane of symmetry of the user's head; a target position is determined based on the head posture information, the target position being located on the plane of symmetry; adjusting the height of the top of at least one of the motion units includes: adjusting the height of at least one of the motion units to form a slope, such that the target slides to the target position, and the support is located at the target position.
[0047] Placing the electronic display device on a symmetrical plane above the head ensures that the distance between the user's eyes and the display device is equal, thus improving the user experience.
[0048] In conjunction with the second aspect, in some possible implementations, the sliding of the target on the slope causes the bottom edge of the target to be perpendicular to the plane of symmetry; the formation of the bracket causes the target to rotate around the bottom edge, and the target after rotating around the bottom edge faces the user's head.
[0049] This ensures that the bottom edge of the target is perpendicular to the user's direct line of sight. As a result, when forming the support, without changing the motion unit that the bottom edge of the target contacts, the target's posture better matches the user's posture requirements for the electronic display device, thus improving the user experience.
[0050] For example, after the target slides on the slope, the height of the top of the motion unit below the target can be adjusted so that the target rotates around its display plane in a direction perpendicular to its bottom edge, making the bottom edge of the target perpendicular to the plane of symmetry, that is, making the bottom edge of the target parallel to the line connecting the eyes. Then, the height of the top of the motion unit below the target can be adjusted so that the target rotates along its bottom edge to form a support.
[0051] In conjunction with the second aspect, in some possible implementations, the mechanical array is used to display an image, the plurality of motion units correspond to a plurality of pixels of the image, and the method further includes: adjusting the color of at least one pixel according to the contact information, wherein the at least one pixel is a pixel corresponding to at least one of the contact motion unit and the neighboring motion units.
[0052] In the case where multiple motion units correspond to multiple pixels in the image displayed by the mechanical array, the color of each pixel can be adjusted according to the contact information output by the support structure, making the control method of the mechanical matrix more flexible.
[0053] Thirdly, a control method for a mechanical matrix is provided. The mechanical matrix includes multiple motion units, each of which is equipped with a sensor. The sensor outputs contact information to indicate whether the tip of the motion unit equipped with the sensor is in contact with a target. The method includes: acquiring button formation information; adjusting the height of the tip of at least one of the first and second motion units among the multiple motion units according to the button formation information to form a button. In the adjusted mechanical matrix, the height of the tip of the first motion unit located in the area where the button is located is different from the height of the tip of the second motion unit, and the second motion unit surrounds the first motion unit; and outputting button information, which is determined based on the contact information output by the sensor on the first motion unit.
[0054] The mechanical matrix can be controlled to form buttons only when there is a need for them. The button information can be determined based on the contact information output by the sensors set on each motion unit in the mechanical matrix, thereby realizing the human-computer interaction function of the mechanical matrix and improving the versatility of the mechanical matrix application.
[0055] In conjunction with the third aspect, in some possible implementations, the method further includes: acquiring button cancellation information; and adjusting the height of the top of at least one of the first motion unit and the second motion unit according to the button cancellation information to cancel the button.
[0056] Buttons can be eliminated when no user input is required, thereby reducing the space occupied by buttons.
[0057] Fourthly, a control device for a mechanical matrix is provided, the mechanical matrix including multiple motion units, each motion unit being equipped with a sensor, the control device including: an acquisition module for acquiring contact information output by the sensors on the multiple motion units, the contact information being used to indicate whether the top end of the motion unit is in contact with a target; and an adjustment module for adjusting the height of the top end of at least one of the motion units according to the contact information, the at least one motion unit including a contact motion unit and / or a neighboring motion unit, the top end of the contact motion unit being in contact with the target, and the distance between the neighboring motion unit and the contact motion unit being less than a preset value.
[0058] In conjunction with the fourth aspect, in some possible implementations, the height of the top end is an absolute height, the plurality of motion units include a first motion unit and a second motion unit, and the height of the top end of at least one of the motion units is adjusted such that the first motion unit and the second motion unit form a concave structure, the height of the top end of the first motion unit is less than the height of the top end of the second motion unit, the second motion unit surrounds the first motion unit, and in the adjusted mechanical array, the first motion unit includes the contact motion unit.
[0059] In conjunction with the fourth aspect, in some possible implementations, in the adjusted mechanical matrix, the first motion unit is the contact motion unit.
[0060] In conjunction with the fourth aspect, in some possible implementations, the second motion unit includes the adjacent motion unit.
[0061] In conjunction with the fourth aspect, in some possible implementations, the mechanical matrix is located within the vehicle. The acquisition module is further configured to acquire bump information, which indicates the vibration direction and distance of the vehicle's vibration. The vibration direction is perpendicular to the sea level, and the vibration distance indicates the absolute height change of the vehicle along the vibration direction. The control device further includes a processing module configured to determine an adjustment height difference based on the bump information, wherein the adjustment height difference is positively correlated with the vibration distance. The adjustment module is further configured to adjust the height of the top of the contact motion unit along a direction opposite to the vibration direction, wherein the height change of the contact motion unit is the adjustment height difference.
[0062] In conjunction with the fourth aspect, in some possible implementations, the mechanical matrix is located in the vehicle, and the control device further includes a processing module for determining that the vehicle is in a bumpy state; the adjustment module is further used to adjust the height of the top of the contact motion unit according to the first contact information output by the first sensor, so as to minimize the difference between the first pressure and the second pressure, wherein the first contact information is used to indicate the first pressure, the first pressure being the pressure exerted on the contact motion unit when the vehicle is in the bumpy state, and the second pressure being the pressure exerted on the contact motion unit when the vehicle is in a stable driving state.
[0063] In conjunction with the fourth aspect, in some possible implementations, whether the target is an electronic display device or not, in the adjusted mechanical matrix, the contact motion unit forms a support, and the support is used to set the orientation of the target.
[0064] In conjunction with the fourth aspect, in some possible implementations, the control device further includes a processing module, which is used to determine, based on the contact information, that the target is an electronic display device.
[0065] In conjunction with the fourth aspect, in some possible implementations, the acquisition module is further configured to acquire head position information, the head position information being used to indicate the position of the user's head, and the bracket causing the target to face the user's head.
[0066] In conjunction with the fourth aspect, in some possible implementations, the acquisition module is further configured to acquire head posture information, the head posture information being used to indicate the plane of symmetry of the user's head; the processing module is further configured to determine a target position based on the head posture information, the target position being located on the plane of symmetry; the adjustment module is further configured to adjust the height of at least one of the motion units to form a slope, so that the target slides to the target position, and the support is located at the target position.
[0067] In conjunction with the fourth aspect, in some possible implementations, the head posture information is also used to indicate the user's direct gaze direction, and the sliding rotation of the target on the slope causes the bottom edge of the target to be perpendicular to the direct gaze direction; the formation of the bracket causes the bottom edge to be perpendicular to the plane of symmetry, and causes the target to face the user's head.
[0068] In conjunction with the fourth aspect, in some possible implementations, the mechanical array is used to display an image, the plurality of motion units correspond to a plurality of pixels in the image, and the adjustment module is further used to adjust the color of at least one of the pixels according to the contact information, wherein the at least one pixel is a pixel corresponding to at least one of the contact motion unit and the neighboring motion unit.
[0069] Fifthly, a control device for a mechanical matrix is provided. The mechanical matrix includes multiple motion units, each of which is equipped with a sensor. The sensor outputs contact information to indicate whether the tip of the motion unit is in contact with a target. The control device includes: an acquisition module for acquiring button formation information; an adjustment module for adjusting the height of the tip of at least one of the first and second motion units among the multiple motion units according to the button formation information to form a button, wherein the second motion unit surrounds the first motion unit, and in the adjusted mechanical matrix, the height of the tip of the first motion unit is different from the height of the tip of the second motion unit; and an output module for outputting button information, which is determined based on the contact information output by the sensor on the first motion unit.
[0070] In conjunction with the fifth aspect, in some possible implementations, the acquisition module is further configured to acquire button cancellation information; the adjustment module is further configured to adjust the height of the top of at least one of the first motion unit and the second motion unit according to the button cancellation information, so as to cancel the button.
[0071] In a sixth aspect, an electronic device is provided, comprising at least one memory and at least one processor, the at least one memory being used to store a program and the at least one processor being used to run the program to implement the method of the first aspect.
[0072] In a seventh aspect, a chip is provided, characterized in that it includes at least one processor and an interface circuit, the interface circuit being used to provide program instructions or data to the at least one processor, the at least one processor being used to execute the program instructions to implement the method described in the first aspect.
[0073] Eighthly, a computer-readable storage medium is provided, characterized in that the computer-readable medium stores program code for execution by a device, which, when executed by the device, implements the method described in the first aspect.
[0074] Ninth aspect, a computer program product is provided, the computer program product comprising a computer program, wherein when the computer program product is executed by a computer, the computer performs the method described in the first aspect above.
[0075] It should be understood that, in this application, the method of the first aspect can specifically refer to the first aspect and the method in any of the various implementations of the first aspect.
[0076] In a tenth aspect, a terminal is provided, comprising a mechanical matrix as described in the first aspect, and a control device for the mechanical matrix as described in the fourth aspect, a control device for the mechanical matrix as described in the fifth aspect, or an electronic device as described in the sixth aspect.
[0077] Furthermore, the terminal can be transportation equipment, such as cars, trucks, motorcycles, buses, ships, airplanes, helicopters, lawnmowers, recreational vehicles, amusement park vehicles, construction equipment, trams, golf carts, trains, handcarts, etc. Attached Figure Description
[0078] Figure 1 This is a schematic structural diagram of a mechanical matrix provided in an embodiment of this application.
[0079] Figure 2 This is a schematic flowchart of a mechanical matrix control method provided in an embodiment of this application.
[0080] Figure 3 This is a schematic flowchart of another mechanical matrix control method provided in the embodiments of this application.
[0081] Figure 4 This is a schematic flowchart of an electronic display device determination method provided in an embodiment of this application.
[0082] Figure 5 This is a schematic structural diagram of a mechanical matrix provided in an embodiment of this application.
[0083] Figure 6 This is a schematic structural diagram of another mechanical matrix provided in the embodiments of this application.
[0084] Figure 7 This is a schematic structural diagram of another mechanical matrix provided in the embodiments of this application.
[0085] Figure 8 This is a schematic flowchart of another mechanical matrix control method provided in the embodiments of this application.
[0086] Figures 9 to 13 This is a schematic structural diagram of the mechanical matrix provided in the embodiments of this application.
[0087] Figure 14 This is a schematic flowchart of another mechanical matrix control method provided in the embodiments of this application.
[0088] Figure 15 This is a schematic structural diagram of the mechanical matrix provided in the embodiments of this application.
[0089] Figure 16 This is a schematic flowchart of another mechanical matrix control method provided in the embodiments of this application.
[0090] Figure 17 This is a schematic structural diagram of the mechanical matrix provided in the embodiments of this application.
[0091] Figure 18 This is a schematic flowchart of another mechanical matrix control method provided in the embodiments of this application.
[0092] Figure 19 This is a schematic flowchart of another mechanical matrix control method provided in the embodiments of this application.
[0093] Figure 20 This is a schematic flowchart of another mechanical matrix control method provided in the embodiments of this application.
[0094] Figure 21 This is a schematic structural diagram of an in-vehicle system provided in an embodiment of this application.
[0095] Figure 22This is a schematic structural diagram of a control device for a mechanical matrix provided in an embodiment of this application.
[0096] Figure 23 This is a schematic structural diagram of another mechanical matrix control device provided in the embodiments of this application.
[0097] Figure 24 This is a schematic structural diagram of another mechanical matrix control device provided in the embodiments of this application. Detailed Implementation
[0098] The technical solutions in this application will now be described with reference to the accompanying drawings.
[0099] A mechanical matrix consists of multiple matrix units, each capable of bidirectional movement along a straight line, meaning the height of each unit is adjustable. Mechanical matrices can be used to display text, graphics, and animated sequences. By controlling the height of each matrix unit, various 3D graphic effects can be achieved. The control of the mechanical matrix, in conjunction with lighting, sound, and other media, provides viewers with an excellent audiovisual and visual experience.
[0100] The three-dimensional shape formed by the mechanical matrix is preset, and the flexibility of adjusting the three-dimensional shape is low.
[0101] To address the aforementioned problems, embodiments of this application provide a mechanical matrix, as well as a control method and apparatus for the mechanical matrix.
[0102] Figure 1 This is a schematic structural diagram of a mechanical matrix provided in an embodiment of this application.
[0103] The mechanical matrix 100 includes multiple motion units 110, and the height of the top of each motion unit 110 is adjustable.
[0104] The height of the top of the motion unit 110 can be used to indicate the distance between the top of the motion unit 110 and the reference plane. The reference plane can be a horizontal plane or it can be at a certain angle to the horizontal plane.
[0105] Each motion unit 110 is equipped with a sensor 120, which outputs contact information. The contact information indicates whether the tip of the motion unit 110 is in contact with the target.
[0106] It should be understood that the contact information output by each sensor is used to indicate whether the tip of the motion unit that sets the sensor is in contact with the target.
[0107] By setting a sensor on each motion unit, the contact information output by the sensor can indicate whether the top of the motion unit with the sensor is in contact with the target, thereby making the control of the three-dimensional shape formed by the mechanical matrix more flexible.
[0108] The sensor can continuously output contact information, indicating whether the tip of the moving unit is in contact with the target through different information content. Alternatively, the sensor can output contact information only when the tip of the moving unit is in contact with the target. Or, the sensor can output contact information only when the tip of the moving unit is not in contact with the target.
[0109] The height of the top of each motion unit 110 can be adjusted according to the contact between the top of each motion unit 110 and the target, so that the three-dimensional shape formed by the mechanical matrix changes with the contact with the target.
[0110] When user input is required, the height of the top of the motion unit 110 can be adjusted so that the three-dimensional shape formed by the mechanical matrix meets the requirements of ergonomics, thus improving the coordination between humans, machines, and the environment and enhancing user satisfaction.
[0111] In mechanical structures, each moving unit can be a structure with a fixed shape or a structure with an adjustable shape.
[0112] For example, the motion unit can be cylindrical or similar in shape, and can move longitudinally along the column, thus making the height of the top of the motion unit adjustable. Alternatively, the motion unit can be a telescopic structure, with its bottom fixed, allowing the height of the top of the motion unit to be adjusted by extending or retracting it.
[0113] Sensor 120 can be a pressure sensor, an optical sensor, etc.
[0114] The pressure sensor can be located at the top or bottom of the motion unit 110. The contact information output by the pressure sensor can be used to indicate the magnitude of the pressure. If the pressure indicated by the contact information output by the pressure sensor is greater than or equal to a preset value, it can be determined that the motion unit with the sensor is in contact with the target; conversely, if the pressure indicated by the contact information output by the pressure sensor is less than the preset value, it can be determined that the motion unit with the sensor is not in contact with the target.
[0115] An optical sensor can be disposed at the top of the motion unit 110. The contact information output by the optical sensor can be used to indicate the magnitude of the light intensity. When the light intensity indicated by the contact information output by the optical sensor is less than or equal to a preset value, it can be determined that the motion unit with the sensor is in contact with the target; conversely, if the light intensity indicated by the contact information output by the optical sensor is greater than the preset value, it can be determined that the motion unit with the sensor is not in contact with the target.
[0116] It can be adopted Figure 2 The method shown controls the mechanical matrix 100.
[0117] Figure 2 This is a schematic flowchart of a mechanical matrix control method provided in an embodiment of this application.
[0118] The mechanical matrix comprises multiple motion units, each equipped with a sensor. For details, please refer to... Figure 1 Explanation.
[0119] The control method 1000 for the mechanical matrix includes steps S1010 to S1020.
[0120] In S1010, contact information output by sensors mounted on the plurality of motion units is acquired, the contact information being used to indicate whether the top of the motion unit is in contact with the target.
[0121] In S1020, based on the contact information, the height of the top of at least one of the motion units is adjusted. The at least one motion unit includes a contact motion unit and / or a neighboring motion unit. The top of the contact motion unit contacts the target, and the distance between the neighboring motion unit and the contact motion unit is less than a preset value.
[0122] By installing sensors on the motion units, the contact information output by the sensors indicates whether the motion unit is in contact with the target. When the motion unit is in contact with the target, the height of the top of the motion unit is adjusted to adjust the three-dimensional shape formed by the motion unit. Thus, the adjustment method for the three-dimensional shape formed by each motion unit in the mechanical matrix is more flexible.
[0123] The height of the top of the motion unit 110 can be adjusted according to the contact situation between the top of each motion unit and the target, so that the three-dimensional shape formed by the mechanical matrix changes with the contact situation with the target.
[0124] Mechanical matrices can be used to display three-dimensional shapes.
[0125] When a user's finger or other object touches or slides at different positions on the 3D model, sensors at the top of each motion unit forming the 3D shape output contact information. Based on the contact information output by each sensor, an adjustment method corresponding to the user's operation can be determined, and the height of the top of each motion unit can be adjusted.
[0126] For example, a mechanical matrix displays the shape of a cake. Based on the contact information output by various sensors in the mechanical matrix, when it is determined that a target (such as a user's finger) passes through the top surface of the cake, the height of the top of the motion unit at the position where the user passed can be lowered to display the shape of the cake after it has been cut.
[0127] Mechanical matrices can be used for storing objects.
[0128] When a mechanical matrix is used to place objects, the height of the top of each moving unit refers to its absolute height. Absolute height, also known as altitude, refers to the vertical distance from sea level, or the height relative to the mean sea level.
[0129] When the mechanical matrix can be used for object placement, in the adjusted mechanical matrix obtained in S1020, the first motion unit and the second motion unit form a recessed structure. The height of the top of the first motion unit is less than the height of the top of the second motion unit, and the second motion unit surrounds the first motion unit. In the adjusted mechanical array, the first motion unit includes the contact motion unit.
[0130] By controlling the height of the top of at least one motion unit in the mechanical matrix, a recessed structure is formed by the first motion unit and the second motion unit surrounding the first motion unit. The first motion unit includes a contact motion unit, meaning the target is located within the recessed structure. Thus, the recessed structure can restrict the range of motion of the target, improving the stability when placing objects.
[0131] The shape of the shelf is fixed, and it occupies space when no items are placed in it. When the target comes into contact with the motion unit in the mechanical matrix, the height of the motion unit is adjusted to form a recessed structure, which constitutes the shelf. The shelf is formed when items are placed in it, thus reducing its space occupation.
[0132] It should be understood that there can be multiple contact motion units, and the first motion unit may include all contact motion units in the mechanical array.
[0133] Since there can be multiple targets placed on the mechanical matrix, each continuous contact motion unit can be understood as corresponding to a single target. Therefore, the height of the top of each motion unit can be adjusted to form a recessed structure corresponding to each target. The following explanation uses a single target as an example.
[0134] The number of first motion units can be multiple. In the adjusted mechanical matrix, the first motion unit includes a contact motion unit. The first motion unit may include only contact motion units, or it may include adjacent motion units, or it may include other motion units.
[0135] All first motion units can be contact motion units. The first motion units located below the target are in contact with the target, providing stable support and improving the stability of the placed object.
[0136] The second motion unit may include adjacent motion units. That is, the distance between the second motion unit and the first motion unit can be less than or equal to a preset value.
[0137] The distance between the second motion unit located around the target and the first motion unit located below the target is less than or equal to a preset value, so that the shape and size of the recessed structure are adapted to the shape of the target, thereby improving the stability of the placed items.
[0138] The mechanical matrix can be located in a vehicle. The vehicle can be a car, truck, motorcycle, bus, ship, airplane, helicopter, lawnmower, recreational vehicle, amusement park vehicle, construction equipment, tram, golf cart, train, handcart, etc., and the embodiments in this application do not impose any particular limitation.
[0139] During vehicle operation, bumps may occur. The height of the contact motion unit placed below the target on the mechanical matrix can be adjusted to reduce the bumps experienced by the target.
[0140] On the one hand, bump information can be obtained, which is used to indicate the direction and distance of the vehicle's vibration, wherein the vibration direction is a direction perpendicular to the sea level.
[0141] The adjustment height difference can be determined based on the bump information, and the adjustment height difference is positively correlated with the vibration distance.
[0142] The height of the top of the contact motion unit can be adjusted in a direction opposite to the vibration direction, and the change in the height of the contact motion unit is the adjustment height difference.
[0143] When the vehicle is bumpy, the height of the top of the first motion unit is adjusted in the opposite direction to the vibration direction. The height difference is positively correlated with the vibration distance of the vehicle bumps, thereby reducing the range of change in the distance between the target and the sea level and reducing the bumps experienced by the target.
[0144] It should be understood that the contact motion unit may change during the adjustment of the height of the top of each motion unit. For example, at time t0, the motion unit in contact with the target is contact motion unit 1. At time t0, the height of contact motion unit 1 is lowered. During the descent of contact motion unit 1, motion units other than contact motion unit 1 come into contact with the target. For example, at time t1 during the descent of contact motion unit 1, the motion unit in contact with the target is contact motion unit 2. Contact motion unit 2 may include all or some of the motion units in contact motion unit 1, and contact motion unit 2 may also include other motion units besides contact motion unit 1.
[0145] It should be understood that during the process of adjusting the height of the contact motion unit based on the bump information, the new target unit that comes into contact with the target can also be used as a contact motion unit for height adjustment.
[0146] On the other hand, when the vehicle is in a bumpy state, the height of the top of the contact motion unit can be adjusted according to the first contact information output by the first sensor to minimize the difference between the first pressure and the second pressure. The first contact information is used to indicate the first pressure, which is the pressure on the contact motion unit when the vehicle is in a bumpy state, and the second pressure is the pressure on the contact motion unit when the vehicle is in a stable driving state.
[0147] The first sensor may be disposed in the contact motion unit.
[0148] The vehicle can be determined to be in a bumpy state based on bump information or other information. For example, if the bump information indicates that the vehicle's vibration distance is greater than a preset value, it can be determined that the vehicle is in a bumpy state.
[0149] It should be understood that the second pressure can be the pressure output by the first sensor when the vehicle is in the aforementioned bumpy state. Alternatively, the second pressure can also be the average value of the pressure output by the first sensor over a period of time.
[0150] By adjusting the height of the top of the contact motion unit during vehicle bumps, the difference between the first pressure on the contact motion unit under bumpy conditions and the second pressure on the contact motion unit under smooth driving conditions can be reduced, thus reducing the bumps experienced by the target.
[0151] Specifically, the positive correlation coefficient between the adjustment height difference and the vibration distance can be adjusted based on the difference between the first pressure on the contact motion unit under bumpy conditions and the second pressure on the contact motion unit under smooth driving conditions, thereby correcting the adjustment height difference and further reducing the bumps experienced by the target.
[0152] The pressure on the contact motion unit can be understood as the pressure component in the vertical direction.
[0153] When a mechanical matrix is used for placing objects, and the target placed on the mechanical matrix is an electronic display device, the orientation of the electronic display device can be adjusted by adjusting the height of the moving units in the mechanical matrix.
[0154] Specifically, in the adjusted mechanical matrix, the contact motion unit forms a support, which is used to set the orientation of the target.
[0155] Furthermore, based on the contact information output by each sensor, it can be determined whether the target is an electronic display device.
[0156] The support can orient the target toward a preset direction.
[0157] Alternatively, head position information can be obtained to indicate the position of the user's head. Thus, the resulting support can orient the target toward the user's head.
[0158] Head position information can be determined based on image information captured by a camera.
[0159] For example, a mechanical matrix can be located around the driver's seat in a vehicle, and cameras in the vehicle can capture images of the driver's head to determine its position. This head position information can then be used to indicate the driver's head position.
[0160] Furthermore, head posture information can also be obtained, which is used to indicate the symmetry plane of the user's head.
[0161] Head posture information can include the orientation of the user's face. Based on head posture and head position information, the plane of symmetry of the user's head can be determined.
[0162] The target position can be determined based on the head posture information, and the target position is located in the plane of symmetry.
[0163] The height of at least one of the motion units can be adjusted to form a slope, allowing the target to slide to the target position. A support can be located at the target position. That is, the support can be used to set the orientation of the target at the target position.
[0164] Placing the electronic display device on a symmetrical plane above the head ensures that the distance between the user's eyes and the display device is equal, thus improving the user experience.
[0165] Furthermore, the head posture information is also used to indicate the user's direct gaze direction. As the target slides to the target position, the resulting slope can also change the angle between the target's base and the direct gaze direction. After the target slides on the slope, the target's base may become perpendicular to the direct gaze direction.
[0166] The bracket is formed so that the target can rotate around the bottom edge, and the target after rotating around the bottom edge faces the user's head.
[0167] By adjusting the height of the top of the motion unit, the target can be slid. This sliding causes the plane containing the target's bottom edge, which is perpendicular to the target's display plane, to be perpendicular to the plane of symmetry of the user's head. In other words, the sliding of the target makes its bottom edge parallel to the plane containing the user's face. Subsequently, the support structure allows the target's bottom edge to be perpendicular to the plane of symmetry, and the target to face the user's head.
[0168] This makes it easier to orient the target toward the user's head, ensuring the target display meets user needs and improving user experience.
[0169] In some embodiments, after the target slides on the slope, it may be perpendicular to the plane of symmetry of the user's head.
[0170] To improve the user experience, mechanical arrays can be used to display images. Multiple motion units can correspond to multiple pixels of the image, and different pixels can display the same or different colors.
[0171] When the tip of at least one of the motion units is in contact with the target, in addition to adjusting the height of the motion unit, the color corresponding to each motion unit can also be adjusted. That is, based on the contact information, the color of at least one pixel can be adjusted, where the at least one pixel corresponds to at least one of the contacting motion unit and the neighboring motion units.
[0172] The color of a pixel can be represented by its pixel value. An image's pixel value can be a red-green-blue (RGB) color value, and it can be a long integer representing the color. For example, a pixel value of 256*Red+100*Green+76Blue, where Blue represents the blue component, Green represents the green component, and Red represents the red component. Within each color component, the smaller the value, the lower the brightness; the larger the value, the higher the brightness. For grayscale images, the pixel value can be a grayscale value.
[0173] By setting sensors on the motion units, the color of the corresponding pixels of the motion units can be adjusted according to the contact between the motion units and the target, making the adjustment of the image of the three-dimensional shape formed by each motion unit in the mechanical matrix more flexible.
[0174] Figure 3 This is a schematic flowchart of a mechanical matrix control method provided in an embodiment of this application.
[0175] Cup holders are usually designed near the front seats of vehicles. While the vehicle is in motion, you can place your water bottle or other items in the cup holder to prevent them from tipping over due to bumps in the road. The cup holder can also be used as storage space for personal items such as phones and keys, which is very convenient.
[0176] Generally, in order to ensure that the water cup is placed stably in the cup holder, the shape and size of the cup holder are limited, making it impossible to place large items, which reduces the convenience that the cup holder brings to the user as a storage space.
[0177] The mechanical matrix can be located within the vehicle's cabin. It can be positioned between the driver and front passenger seats, or in other locations such as the rear seats. The mechanical matrix can be at the same height as the seats, or slightly higher or lower, to facilitate the placement of items on the matrix by the driver or other vehicle users.
[0178] A mechanical matrix can include multiple motion units. Taking a support rod of the same shape as each motion unit as an example, the mechanical matrix has multiple support rods arranged in a matrix, and each support rod can move up and down along its longitudinal direction. Items can be placed on the mechanical matrix. A mechanical matrix can also be called a storage array or a storage platform, etc.
[0179] The control method 200 for the mechanical matrix can be executed by the surface control module. The control method 200 for the mechanical matrix includes steps S210-S250.
[0180] In S210, the tops of the multiple support rods are positioned at the initial horizontal plane.
[0181] Each support rod can move either above or below the initial horizontal plane. For example, the support rod whose top is at the initial plane is located in the middle of its range of motion.
[0182] In S220, the support rod in contact with the target is identified.
[0183] The target can be an item placed on the mechanical matrix by the driver or other members of the vehicle.
[0184] Each support rod is equipped with a sensor at its top. This could be a pressure sensor or a light sensor. The surface control module receives information from each sensor and determines which support rod should contact the target based on this information.
[0185] The pressure sensor detects pressure signals and converts them into electrical signals. When the pressure indicated by the output signal of the pressure sensor at the top of the support rod is greater than or equal to a preset value, it is determined that the top of the support rod is in contact with the target.
[0186] The light sensor detects light intensity signals and converts them into electrical signals for output. When the light intensity indicated by the output signal of the light sensor at the top of the support rod is less than a preset value, it is determined that the top of the support rod is in contact with the target.
[0187] In S230, it is determined whether the target is an electronic display device.
[0188] The shape of the area where the support rod in contact with the target is located can be used to determine whether the target is an electronic display device.
[0189] Furthermore, when the sensor installed on the support rod is a pressure sensor, it is also possible to determine whether the target is an electronic display device based on the pressure indicated by the sensor installed at the top of each support rod that contacts the target.
[0190] By combining information such as the size and mass of electronic display devices like smartphones and tablets, it can be determined whether the target device is indeed an electronic display device. For details, please refer to... Figure 3 Explanation.
[0191] If the target is determined to be an electronic display device, proceed to S240.
[0192] In S240, the height of the support rod is adjusted in bracket mode.
[0193] Adjusting the height of the support rod in the bracket mode creates a bracket that allows the surface of the electronic display device to face the driver. For details, please refer to [link / reference needed]. Figure 4 Explanation.
[0194] When the target is an electronic display device, adjusting the height of the support rod so that the surface of the target used for display faces the driver can improve the driver's convenience when using the electronic display device.
[0195] If it is determined that the target is not an electronic display device, proceed to S250.
[0196] In the S250, the height of the support rod can be adjusted in the placement mode.
[0197] Adjusting the height of the support rod in placement mode creates a recessed structure, allowing the target to be positioned within this recess and thus fixed in place. For details, please refer to... Figure 8 Explanation.
[0198] By adjusting multiple support rods to fix the target's position, it is possible to prevent the target from falling off the mechanical matrix when the vehicle is traveling in a bumpy environment.
[0199] Figure 4 This is a schematic flowchart of an electronic display device determination method provided in an embodiment of this application.
[0200] The electronic display device determination method 300 includes steps S310-S330 and can be executed by the surface control module. By executing the electronic display device determination method 300, the surface control module can determine whether the target is an electronic display device.
[0201] The target is located on the mechanical matrix, such as Figure 5 As shown in the diagram. Based on the information output by the sensors installed on each support rod, the support rod in contact with the target can be determined. The area where the support rod in contact with the target is located can be called the contact area. At this point, the contact situation between the target and each support rod can be described as follows: Figure 6 As shown. Each support rod can be represented as a point; support rods that do not contact the target are represented as hollow points, and points that contact the target are represented as solid points.
[0202] In S310, determine whether the bottom surface of the target is rectangular. Specifically, this can be done in S311-S313.
[0203] In S311, the vertices of the contact area are determined.
[0204] Electronic display devices are generally rectangular, and the points with the largest and smallest coordinates in two perpendicular directions of the contact area can be identified as vertices.
[0205] The horizontal and vertical axes of the support rod matrix are perpendicular to each other. Based on the position of each support rod in the support rod matrix, the vertices of the contact area can be represented as: the uppermost point in the vertical direction (x... t ,y t ), the lowest point in the vertical direction (x) d ,y d ), the leftmost point horizontally (x) l ,y l ), the rightmost point horizontally (x) r ,y r ).
[0206] In S312, the edges of the contact area are determined based on the vertices.
[0207] From the top point (x t ,y t Starting from the line containing ) to the bottom point (x) d ,y d Starting from the row containing the target, determine the set of edge points in the support rod matrix. The set of edge points includes: the leftmost edge contact point in each row (the leftmost point in contact with the target), the rightmost edge contact point in each row (the rightmost point in contact with the target), the topmost edge contact point in each column (the topmost point in contact with the target), and the bottommost edge contact point in each column (the bottommost point in contact with the target). An edge contact point is a point located at the edge of the point that contacts the target.
[0208] For the set of edge points, the x-coordinate is in x l and x t Between, and the y-coordinate y l and y tBy fitting a straight line to the points between them, we can obtain the expression for the edge L1 of the contact region. For the set of edge points, the x-coordinates within the x-coordinate range... r and x t Between, and the y-coordinate y r and y t By fitting a straight line between the points, we can obtain the expression for the edge L2 of the contact area.
[0209] For the set of edge points, the x-coordinate is in x l and x d Between, and the y-coordinate y l and y d By fitting a straight line to the points between them, we can obtain the expression for the edge L3 of the contact region. For the set of edge points, the x-coordinates within the x-coordinate range... r and x d Between, and the y-coordinate y r and y d By fitting a straight line between the points, we can obtain the expression for the edge L4 of the contact area.
[0210] For N points, a straight line can be fitted, and each point can be represented as (x i ,y i ), x i ∈[1,N],y i ∈[1,N], where i and N are both positive integers. The following formula can be used for linear fitting:
[0211]
[0212] Where a and b are the parameters of the fitted straight line expression. The fitted straight line can be expressed as: y = ax + b.
[0213] Therefore, based on the number and coordinates of the edge contact points used to determine each edge, the linear expression of the edge can be determined, that is, the individual edges of the contact area are determined, such as... Figure 7 As shown.
[0214] The mechanical matrix can be rectangular. Parts of the target may extend beyond the edges of the mechanical matrix. For example, a corner of a rectangular electronic display device might extend beyond the left edge of the mechanical matrix. In this case, multiple support rods located along the left edge of the mechanical matrix contact the electronic display device. The uppermost point of the multiple support rods contacting the target along the left edge can be considered as the leftmost point in the horizontal direction (x). l1 ,y l1 ), combined with the uppermost point in the vertical direction (x t ,y t ), calculate the expression for edge L1; and take the lowest point among the multiple support rods that are in contact with the target on the left edge as the leftmost point of another lateral direction (x l2 ,yl2 ), combined with the lowest point in the vertical direction (x d ,y d ), calculate the expression for edge L3.
[0215] In S313, determine whether there exist two sets of edges, where the two edges in each set are parallel to each other.
[0216] Group L1 to L4, with each group containing lines derived from completely different vertices. L1 to L4 can be divided into two groups, each containing two edges. One group consists of edge L1 (derived from the top and leftmost points) and edge L4 (derived from the bottom and rightmost points). The other group consists of edge L2 (derived from the top and rightmost points) and edge L3 (derived from the bottom and leftmost points).
[0217] Determine whether two sides in each pair are parallel.
[0218] The inclination angle of each edge can be calculated. The inclination angle of the i-th edge can be expressed as arctan(b). i , i = 1, 2, 3, 4.
[0219] When the difference between the inclination angles of two sides in a set is less than a preset value, the two sides can be considered parallel. The preset value could be, for example, 2°.
[0220] If all sides in each group are parallel, the target's base can be determined to be rectangular. That is, when |arctan b1 - arctan b4| ≤ θ and |arctan b2 - arctan b3| ≤ θ, the target's base is determined to be rectangular; otherwise, the target's base is determined not to be rectangular. Here, θ is a preset angle value, such as 1°, 2°, or 3°.
[0221] When the bottom surface of the target is not rectangular, it can be determined that the target is not an electronic display device, and S250 is performed.
[0222] When the target bottom surface is rectangular, proceed with S320.
[0223] In S320, determine whether the aspect ratio of the target bottom surface meets the preset ratio range.
[0224] The length and width of the target can be calculated based on the four sides L1 to L4, thereby determining the aspect ratio of the target.
[0225] The length l of the target can be represented as:
[0226]
[0227] The width d of the target can be expressed as:
[0228]
[0229] This allows us to determine the aspect ratio k of the target's base:
[0230]
[0231] The preset ratio range can be determined based on the known aspect ratio of the electronic display device. Table 1 shows the parameters for different types of electronic display devices.
[0232] Table 1
[0233]
[0234]
[0235] The preset ratio range can be greater than or equal to the minimum aspect ratio of various known types of electronic display devices, and less than or equal to the maximum aspect ratio of various known types of electronic display devices.
[0236] When the aspect ratio of the bottom surface of the target does not meet the preset ratio range, it can be determined that the target is not an electronic display device, and S250 is performed.
[0237] When the aspect ratio of the target bottom surface meets the preset ratio range, proceed to S330.
[0238] In S330, it is determined whether the ratio of the pressure exerted by the target on the mechanical matrix to the area of the target's bottom surface meets the preset pressure range.
[0239] The area of the target's bottom surface can be determined based on the edges of the contact area.
[0240] When the target does not exceed the range of the mechanical matrix, the contact area is rectangular, and the area of the target's bottom surface is the area of the contact area.
[0241] When the target is outside the range of the mechanical matrix, the contact area is not rectangular. The area of the target's bottom surface, determined by the contact area, can be used to accurately determine whether the target is an electronic device.
[0242] The preset pressure range can be greater than or equal to the minimum and maximum pressure among a number of known types of electronic display devices placed on a horizontal surface.
[0243] When an electronic display device of mass m is placed on a horizontal surface, the pressure P is equal to the weight of the electronic display device, which can be expressed as:
[0244]
[0245] Where g is the acceleration due to gravity.
[0246] Assuming the target remains within the range of the mechanical matrix, and the support rods of the mechanical matrix are evenly distributed and subjected to uniform force, the pressure F of each support rod is:
[0247]
[0248] Where ρ is the density of the support rod.
[0249] When the target is within the range of the mechanical matrix, and the mechanical matrix support rods are evenly arranged and subjected to uniform force, the judgment on whether the ratio of the target's weight to the target area meets the preset pressure range can also be converted into the judgment on the pressure on the support rods covered by the target.
[0250] If no more than three consecutive support rods are in contact with the target at the edge of the mechanical matrix, it can be determined that the target has not exceeded the range of the mechanical matrix.
[0251] When the ratio of the target's weight to the target's bottom surface area does not meet the preset pressure range, it can be determined that the target is not an electronic display device, and S250 is performed.
[0252] When the ratio of the target's weight to its area meets the preset pressure range, the target can be identified as an electronic display device, and S240 can be performed.
[0253] Figure 8 This is a schematic flowchart of a mechanical matrix control method provided in an embodiment of this application.
[0254] If the target is an electronic display device, the surface control module can perform steps S410-S420 to implement method S240.
[0255] In S410, the driver's head position is acquired.
[0256] The driver's head pose can be represented by the position of the origin of the head coordinate system within the vehicle coordinate system, and the directions in which the axes of the head coordinate system point within the vehicle coordinate system. Generally, a vehicle coordinate system is established with its center of mass as the origin. The x-axis of the vehicle coordinate system can be the direction of vehicle travel, i.e., the direction the front of the vehicle is pointing; the y-axis can be the lateral direction of the vehicle; and the z-axis can be the vertically upward direction. Therefore, the head coordinate system can be understood as a local coordinate system.
[0257] The origin of the head coordinate system is the center of the driver's head, the x-axis is the horizontal direction perpendicular to the driver's line of sight, the z-axis is the direction from the origin to the driver's line of sight, and the y-axis is the direction perpendicular to both the x-axis and the y-axis. The y-axis can also point towards the top of the driver's head.
[0258] The driver's direct line of sight can also be understood as the direction the driver is looking at, which can be a direction that is perpendicular or approximately perpendicular to the plane where the driver's eyes and mouth are located.
[0259] In a vehicle, a driver monitoring system (DMS) determines the driver's head position. A DMS is a system based on image processing and / or voice processing technologies to monitor the driver's state inside the vehicle, primarily used to ensure driving safety and improve the driving experience. DMS can utilize image recognition algorithms, computer vision algorithms, eye tracking, pupil detection, and other technologies to achieve driver identification or driver state detection. Driver state detection includes the detection of the driver's head position.
[0260] A Driver Monitoring System (DMS) can acquire images from cameras. It can then identify the driver's head and eyes within these images to determine their positions. For example, a DMS can use a neural network model to process the camera-captured images to determine the driver's head and eye positions. The driver's head position can be represented as its location within the vehicle's coordinate system. The driver's eye position can be represented as the location of both eyes within the vehicle's coordinate system, or as the relative position of the eyes to the head. Based on the relative positions of the driver's head and eyes, the driver's posture can be determined.
[0261] The surface control module can send a detection request to the DMS. Based on this request, the DMS detects the driver's head pose. The DMS can then send the driver's head pose to the surface control module. Signal transmission between the surface control module and the DMS can be relayed through the cockpit domain controller (CDC) or the vehicle identification unit (VIU).
[0262] Normally, when placing an item, the user will subconsciously look at the location where the item is placed. The driver's head position can be obtained when at least one support rod in the mechanical matrix is in contact with the target.
[0263] In the S420, the height of the support rod is adjusted according to the driver's head position so that the electronic display device faces the driver.
[0264] S420 can be executed by the surface control module. Specifically, S421 to S422 can be performed.
[0265] In S421, the target position is determined based on the driver's head position.
[0266] The target location is within the driver's line of sight.
[0267] The target position can be located on the curve where the plane of symmetry of the driver's head intersects the surface of the mechanical matrix. For example, the target position can be the location where the driver's direct line of sight intersects the surface of the mechanical matrix. The driver's direct line of sight can be determined based on the driver's head posture.
[0268] When the CDC receives the driver's head pose, it can also determine the target position and send it to the surface control module. The target position can be used to represent the location of the origin of the device coordinate system in the vehicle coordinate system.
[0269] S423 is performed when the electronic display device is in the target position.
[0270] If the electronic display device is not at the target location, S422 can be performed. Following S422, S423 can be performed.
[0271] In S422, the height of the support rod is adjusted to form a slope, allowing the electronic display device to slide to the target position.
[0272] The electronic display device, located on the slope, slides from a higher position to a lower position under the influence of gravity. Figure 9 and Figure 10 The diagram shows the slope formed by the support rods and the changing position of the electronic display device located on the slope.
[0273] During the sliding process of the electronic display device, the information output by the sensor at the top of the support rod can determine whether the electronic display device has reached the target position.
[0274] The target can be set at the target location using S422.
[0275] In S423, adjust the height of the support rod to form a bracket.
[0276] By forming a support, the display surface of the electronic display device can be made to face the driver.
[0277] Specifically, a device coordinate system can be established for the electronic display device, which can be understood as a local coordinate system. The origin of this device coordinate system can be the centroid of the electronic display device or another location on the device. The z-axis of the device coordinate system is perpendicular to the display surface of the electronic display device. Generally, the display surface is rectangular, the x-axis can be the direction of the base, and the y-axis can be the direction of the side adjacent to the base. The origin of the device coordinate system is located at the center of the electronic display device. The base can be preset to be either the longer or shorter side.
[0278] The display surface faces the driver, meaning the z-axis of the device coordinate system points towards the driver. In some embodiments, the z-axis of the device coordinate system may be parallel to the z-axis of the head coordinate system.
[0279] By adjusting the height of the support rod to create a slope, the electronic display device, positioned on the slope, can rotate under the influence of gravity. The height of the support rod can be adjusted to create a slope, allowing the electronic display device to rotate along the z-axis of the device coordinate system. This rotation along the z-axis of the device coordinate system ensures that the projection of the x-axis of the device coordinate system onto the xy-plane of the vehicle coordinate system is parallel to the projection of the x-axis of the head coordinate system onto the xy-plane of the vehicle coordinate system.
[0280] It should be understood that the orientation of the electronic display device can also be adjusted during or before performing S422, so that the projection of the x-axis of the device coordinate system onto the xy-plane of the vehicle coordinate system is parallel to the projection of the x-axis of the head coordinate system onto the xy-plane of the vehicle coordinate system. For example... Figure 11 As shown, before performing S422, the electronic display device is located at position P1, and the angle between the projection of the x-axis of the device coordinate system onto the xy-plane of the vehicle coordinate system and the projection of the x-axis of the head coordinate system onto the xy-plane of the vehicle coordinate system is α, where α is greater than 0. After performing S422, the electronic display device is located at position P2, and the projection of the x-axis of the device coordinate system onto the xy-plane of the vehicle coordinate system is parallel to the projection of the x-axis of the head coordinate system onto the xy-plane of the vehicle coordinate system.
[0281] The height of the support rod can be adjusted to form a slope, so that the electronic display device can rotate along the y-axis of the device coordinate system. After rotating around the y-axis, the x-axis of the device coordinate system of the electronic display device is parallel to the x-axis of the head coordinate system.
[0282] By making the projection of the x-axis of the device coordinate system onto the xy-plane of the vehicle coordinate system parallel to the projection of the x-axis of the head coordinate system onto the xy-plane of the vehicle coordinate system, and by making the x-axis of the device coordinate system parallel to the x-axis of the head coordinate system, the bottom edge of the display device can be made perpendicular to the driver's direct line of sight, thus improving the user experience.
[0283] The target is located at the target position, which is located on the plane of symmetry of the driver's head. When the projection of the x-axis of the equipment coordinate system onto the xy plane of the vehicle coordinate system is parallel to the projection of the x-axis of the head coordinate system onto the xy plane of the vehicle coordinate system, and the x-axis of the equipment coordinate system is parallel to the x-axis of the head coordinate system, the z-axis of the equipment coordinate system is coplanar with the z-axis of the head coordinate system.
[0284] Next, adjust the height of the support rod so that the electronic display device rotates along the x-axis of the device coordinate system, such as... Figure 12As shown, the electronic display device, after rotating along the x-axis of the equipment coordinate system, faces the driver. When the height adjustment of the support rod reduces the angle between the z-axis of the equipment coordinate system and the position of the electronic display device and the position of the driver's head, it can be understood that the height adjustment of the support rod makes the electronic display device face the driver.
[0285] For example, such as Figure 13 As shown, rotation of the electronic display device along the x-axis of the device coordinate system (dashed line) can make the z-axis of the device coordinate system parallel to the z-axis of the head coordinate system (solid line). Alternatively, rotation of the electronic display device along the x-axis of the device coordinate system can make the z-axis of the device coordinate system point towards the position of the driver's head.
[0286] Generally, the x-axis of the head coordinate system is parallel or approximately parallel to the xy-plane of the vehicle coordinate system. The normal of the mechanical matrix is usually set perpendicular to the xy-plane of the vehicle coordinate system. Therefore, when the projection of the x-axis of the equipment coordinate system onto the xy-plane of the vehicle coordinate system is parallel to the projection of the x-axis of the head coordinate system onto the xy-plane of the vehicle coordinate system, it can be considered that the x-axis of the equipment coordinate system is parallel to the x-axis of the head coordinate system. Then, a bracket can be formed to adjust the height of the support rod. The bracket ensures that the projection of the z-axis of the equipment coordinate system onto the yz-plane of the head coordinate system is parallel to the projection of the z-axis of the head coordinate system.
[0287] With the driver's head pose received by the CDC, the CDC can also determine the target orientation of the electronic display device. The target orientation can be used to indicate the direction of each coordinate axis of the device's coordinate system. The target orientation can be such that the projection of the device's x-axis onto the vehicle's xy-plane is parallel to the projection of the head's x-axis onto the vehicle's xy-plane, and the x-axis of the device's coordinate system is parallel to the x-axis of the head's coordinate system, thus aligning the electronic display device towards the driver's z-axis.
[0288] The CDC can send the target attitude to the surface control module, which can then adjust the height of the support rod according to the target attitude to adjust the attitude of the electronic display device, so that the adjusted attitude of the electronic display device is the target attitude.
[0289] In some embodiments, the location where the user places items can be recorded. This allows the height of the support rod to be adjusted based on the user's habits, when the mechanical matrix is in contact with the target, so that the target slides to the corresponding position. The positions of other items besides the electronic display device placed by the user each time, the number of times those other items are placed in that position, and the target position corresponding to the electronic display device and the number of times each target position is set can be recorded separately. This determines the frequently used positions for other items and the frequently used target positions for the electronic display device.
[0290] When the mechanical matrix is in contact with the target, it can be determined whether the target is an electronic display device. If the target is determined not to be an electronic display device, the height of the support rod can be adjusted to allow the target to slide to its usual position. If the target is determined to be an electronic display device, the height of the support rod can be adjusted to allow the target to slide to its usual target position. This makes the position of the slid target more consistent with the user's habits.
[0291] Figure 14 This is a schematic flowchart of a mechanical matrix control method provided in an embodiment of this application.
[0292] If the target is not an electronic display device, the surface control module can perform S510-S423 to implement method S250.
[0293] In the mechanical matrix, the absolute height corresponding to the lowest point of each support rod is the same. The lowest point of each support rod can be preset. Figure 14 The method controls the mechanical matrix, and the height change of the support rod in the mechanical matrix can be achieved as follows: Figure 15 As shown.
[0294] In S510, the support rod below the target descends to its lowest point.
[0295] Specifically, S511-S512 can be performed.
[0296] In S511, the support rod in contact with the target descends to its lowest point.
[0297] In S512, determine whether any of the unlowered support rods are in contact with the target.
[0298] The unlowered support rod can be understood as the support rod in the mechanical matrix that has not undergone S511.
[0299] If any of the unlowered support rods is in contact with the target, proceed to S511. If all the unlowered support rods are in contact with the target, proceed to S520.
[0300] The support rod that descends to its lowest point is the support rod below the target.
[0301] Each support rod can be equipped with a pressure sensor or a light sensor.
[0302] The support rod in contact with the target can be either a support rod whose pressure, as indicated by a pressure sensor, is greater than a preset value, or a support rod whose light intensity, as indicated by a light sensor, is greater than a preset value. In other words, if the pressure indicated by the support rod's pressure sensor is very low, for example, 0, it is considered that the support rod is not in contact with the target; similarly, if the light intensity indicated by the support rod's light sensor is very low, for example, 0, it is considered that the support rod is in contact with the target.
[0303] Alternatively, S510 can be executed by performing S513-S514.
[0304] In S513, the support rod that is in contact with the target descends until it is no longer in contact with the target and then stops descending.
[0305] In S514, it is determined whether each support rod in the mechanical matrix is in contact with the target.
[0306] If any support rod is in contact with the target, and the position of the support rod in contact with the target is higher than the lowest point, proceed to S511. If no support rods are in contact with the target, or if the contact with the target is at the lowest point, do not proceed to S513.
[0307] S510 ends when all support structures above the lowest point are not in contact with the target.
[0308] After S510 is performed, in the mechanical matrix, the support rods below the target are all in contact with the target, or in a critical state of contact with the target.
[0309] In S520, among the support rods that have descended to their lowest point, the support rods that were not in contact with the target rise to the position where they are in contact with the target.
[0310] It should be understood that during the ascent of the support rod from its lowest point, the sensor at the top of the support rod continuously monitors the movement. The ascent of the support rod stops when it contacts the target.
[0311] For example, in the support rod that has descended to the lowest point, the support rods that are not in contact with the target can be raised layer by layer outwards.
[0312] In S530, the support rods within a preset distance range around the support rod that has descended to the lowest point in S510 rise.
[0313] For example, the rising height of the support rod within the preset distance range can be in an arithmetic sequence.
[0314] In other words, the height that the support rod that is not in contact with the target can rise during the S510 process can decrease as the distance between the support rod and the target increases.
[0315] In some embodiments, during S530, the support rod within a preset distance range around the support rod that descended to its lowest point in S510 may come into contact with the target as it rises. The support rod may then cease rising after contacting the target.
[0316] S520 ensures that all support rods below the target are in contact with the target, providing stable support at the bottom. S530 raises the support rods on the sides of the target, providing stable support laterally and preventing the target from tilting or tipping over.
[0317] Figure 16 This is a schematic flowchart of a mechanical matrix control method provided in an embodiment of this application.
[0318] During vehicle operation, the vehicle may experience bumps and jolting due to road conditions and other factors. To make the objects on the mechanical matrix more stable, after method 200 or method 300, the surface control module can employ... Figure 16 The mechanical matrix is controlled in the manner shown.
[0319] The control method 1600 for the mechanical matrix includes S1601-S1602.
[0320] The mechanical matrix includes the height of the first support rod, which is in contact with the target.
[0321] In S1601, bump information is acquired, which is used to indicate the direction and distance of vehicle vibration.
[0322] The vibration can be upward or downward. The vibration direction can be positive or negative along the z-axis of the vehicle coordinate system, or it can be vertically upward or downward. The vertical direction is perpendicular to the horizon.
[0323] Bump information can be collected by the vehicle dynamics control system (VDC). The surface control module can receive bump information sent by the VDC. The bump information sent by the VDC can be forwarded via the CDC.
[0324] In S1602, based on the bump information, the adjustment direction and the adjustment height difference are determined, wherein the adjustment direction is opposite to the vibration direction and the adjustment height difference is positively correlated with the vibration distance.
[0325] In S1603, the height of the first support rod is adjusted along the adjustment direction, and the change in the height of the first support rod is the adjustment height difference.
[0326] In some embodiments, the adjustment of the height difference is inversely proportional to the vehicle's vibration distance.
[0327] Furthermore, in S1603, the height of each support rod in the mechanical matrix can be adjusted along the adjustment direction, or the coverage of the first support rod in contact with the target and the support rods within a preset distance range surrounding the first support rod can be adjusted, and the height change of each support rod is the adjustment height difference.
[0328] like Figure 17 As shown by the dashed box, the mechanical matrix contains support rods located vertically downwards from the target. In S1603, if the height of the support rods surrounding the target is not adjusted, these rods will come into contact with the target during vehicle vibrations, potentially causing significant vibrations to the target. Adjusting the height of each support rod in the mechanical matrix along the adjustment direction can effectively reduce the vibrations experienced by the target.
[0329] Furthermore, the sensor mounted on the support rod can be a pressure sensor. Following S1603, S1604 can be performed.
[0330] In S1604, the height of the first support rod can be adjusted based on the pressure information output by the sensor installed on the first support rod.
[0331] The first support rod is the support rod that is in contact with the target. The sensor installed on the first support rod is the first sensor.
[0332] When the vehicle is traveling smoothly, the first contact information output by the first sensor indicates a first pressure. When the vehicle is experiencing bumps, the first contact information output by the first sensor indicates a second pressure. The height of the first support rod is adjusted to minimize the difference between the first and second pressures. This reduces the impact of bumps on the target.
[0333] In some embodiments, the determination of the adjustment direction and distance required for adjusting the first support rod in S1601 to S1602 and S1604 can be performed by the CDC. The CDC can send the adjustment direction and adjustment height difference to the surface control module. The surface control module can determine the displacement of each support rod based on the adjustment direction and adjustment height difference, and control the movement of the support rods.
[0334] Figure 18 This is a schematic flowchart of a mechanical matrix control method provided in an embodiment of this application.
[0335] The mechanical matrix comprises multiple identical support rods arranged in a matrix, each capable of vertical movement. A sensor is mounted at the top of each support rod.
[0336] These multiple support rods correspond to multiple pixels. For example, one or more support rods may correspond to one pixel, or one support rod may correspond to multiple pixels. A display device may be mounted on top of each support rod, or projection may be made onto the mechanical matrix, thus the mechanical matrix can be used to display an image, and the multiple support rods may correspond to multiple pixels. The following explanation uses the example of mounting a display device on top of each support rod, with each support rod corresponding to one pixel.
[0337] The control method 1700 for the mechanical matrix includes S1701 to S1705.
[0338] In S1701, the surface control module sends surface control commands to the electronic control unit (ECU).
[0339] Surface control commands are used to indicate the height and / or movement speed of each support rod in the display area. Surface control commands are also used to indicate the color of the pixels corresponding to each support rod in the display area.
[0340] The display area can be the area where all or part of the support rods are located in the mechanical matrix.
[0341] When items are placed on the surface of the mechanical matrix or buttons are displayed, the display area can be an area outside the area where the items are located or the area where the buttons are located.
[0342] In S1702, the ECU adjusts the mechanical matrix according to the surface control commands.
[0343] The ECU can adjust the height of the support rods in the display area and the color of the pixels according to the surface control commands.
[0344] S1701-S1702 can be performed only once to give the support rod of the display area a static shape. Alternatively, S1701-S1702 can be performed multiple times to give the support rod of the display area a dynamically changing shape.
[0345] In S1703, the surface control module acquires contact information output by each sensor, which is used to indicate whether the support rod where the sensor is located is in contact with the target.
[0346] In S1704, the surface control module sends adjustment commands to the ECU.
[0347] In S1705, the ECU adjusts the mechanical matrix according to the adjustment instructions.
[0348] The ECU can adjust the height of the support rods in the display area and the color of the pixels according to the adjustment instructions.
[0349] The ECU can adjust the height of at least one support rod in the display area and adjust the color of the pixel corresponding to at least one support rod.
[0350] Prior to S1701, the CDC could send generation commands to the surface control module, and the surface control commands could be determined based on the generation commands. The generation commands could be used to instruct the shape, color, etc., of the support rods forming in the display area. The surface control module could store the correspondence between the generation commands and the surface control commands.
[0351] For example, prior to S1701, the CDC sends a generation command to the surface control module, which indicates the three-dimensional shape of the cream cake. In S1701, the surface control module sends a surface control command corresponding to the three-dimensional shape of the cream cake to the ECU. In S1702, the ECU can set the display area to the shape of a cream cake by setting the height of each support rod and the color of the corresponding pixel in the display area. The upper surface of the cake may include multiple protrusions, and the color of the protruding areas may differ from the color of the flat areas on the upper surface of the cake. For example, the color of the flat areas on the upper surface of the cake may be off-white (to represent cream), the shape of the protrusions may be text, the outline of fruit, etc., and the color of the protrusions may be red or the color of the fruit.
[0352] The user can trace a target such as a pen tip or the edge of a paper across the top surface of the cake. In S1703, the CDC acquires contact information from each sensor output to determine which support rod among the various support rods forming the top surface of the cake is in contact with the target. In S1704, the CDC sends an adjustment command that can instruct the height of the support rod in contact with the target to be lowered, creating a recess. The adjustment command also instructs the color of the pixel corresponding to the support rod in contact with the target to be adjusted to yellow or orange (to represent the color of the cake beneath the cream).
[0353] For example, in S1702, the ECU can set a portion of the display area as a plane by setting the height of each support rod in the display area. By dynamically setting the color of the pixels corresponding to each support rod, the ECU can display a top-down view of a pond or lake in that portion of the display area. For instance, this portion can display a dynamic scene of fish swimming in a pond.
[0354] The user can touch or swipe across this area with their fingertips or other objects. In S1703, the CDC acquires contact information from each sensor output to identify the support rods forming the upper surface of the cake that are in contact with the user's fingertips or other objects. In S1704, the CDC sends adjustment instructions that can be used to instruct the adjustment of the height of the support rods near the target in this area to create a three-dimensional ripple effect. The adjustment instructions also instruct the adjustment of the color of the pixels corresponding to the support rods near the target in this area to create water ripples.
[0355] When the support rods are in contact with the target, the height of the support rods is adjusted based on the contact information sent by the sensors at the top of each support rod, and the color of the corresponding pixels of each support rod is adjusted, which can improve the flexibility of the image displayed by the mechanical structure.
[0356] Before proceeding with S1701, the CDC can acquire user input information. This user input information can be used to instruct on the 3D image. Based on the user input information, the CDC can send a generation command corresponding to the user-instructed 3D image to the surface control module. Thus, the user can select the 3D image displayed by the mechanical matrix according to their preferences.
[0357] Figure 19 This is a schematic flowchart of a mechanical matrix control method provided in an embodiment of this application.
[0358] The mechanical matrix comprises multiple motion units, each equipped with a sensor. The sensors output contact information, indicating whether the tip of the motion unit is in contact with a target. Specifically, the mechanical matrix can be found in [reference needed]. Figure 1 Explanation.
[0359] The control method 2200 for the mechanical matrix includes steps S2201 to S2203. The surface control module can execute steps S2201 to S2203.
[0360] S2201, Obtain button formation information.
[0361] It can receive button formation information sent by other devices. Alternatively, other modules in the device can generate button formation information and store it in a cache unit or other storage unit, from which the surface control module in the device can read the button formation information.
[0362] S2202, based on the button formation information, adjust the height of the top of at least one of the first and second motion units among the plurality of motion units to form a button, wherein the second motion unit surrounds the first motion unit, and in the adjusted mechanical matrix, the height of the top of the first motion unit located in the area where the button is located is different from the height of the top of the second motion unit.
[0363] S2203, Output button information, which is determined based on the contact information output by the sensor on the first motion unit.
[0364] The button information can be used to instruct the user on the operation of the button.
[0365] Compared to inputting information on a flat surface, inputting information via buttons is more ergonomic and improves user satisfaction. Through steps S2201 to S2202, the height of the top of the motion unit 110 is adjusted to form a button when user input is required. Compared to having fixed buttons on the control panel, forming buttons only when user input is needed reduces space requirements.
[0366] It should be understood that the number of buttons generated based on the button generation information can be one or more.
[0367] The user operation sensed by the sensor can be contact information output by a sensor located on the support rod at the button. Alternatively, the user operation sensed by the sensor can be determined based on the contact between the support rod at each button and the target.
[0368] The contact information output by the sensor can be used to indicate whether the support rod on which the sensor is mounted is in contact with the target. Based on the contact information output by the sensors mounted on the support rods at the button locations, the sequence of button presses by the user and the duration of each button press can be determined.
[0369] The output key press information can be sent to a processing unit for processing user operations. After receiving the key press information, the processing unit can send a button cancellation message. The surface control module can then cancel the created button based on the button cancellation message.
[0370] In other words, after S2203, button cancellation information can be obtained. Furthermore, based on the button cancellation information, the height of at least one of the motion units can be adjusted to cancel the button.
[0371] Deleting the button makes the height of the first motion unit and the second motion unit the same. Alternatively, the height of the motion units can be adjusted in other ways based on the button deletion information to form a three-dimensional shape.
[0372] Figure 20 This is a schematic flowchart of a mechanical matrix control method provided in an embodiment of this application.
[0373] The mechanical matrix comprises multiple identical support rods arranged in a matrix, each capable of vertical movement. A sensor is mounted at the top of each support rod.
[0374] The control method 2300 for the mechanical matrix includes S2301-S2308.
[0375] In S2301, the CDC sends a button formation request to the surface control module.
[0376] The CDC can perform S2301 when user input is required, such as when the user needs to confirm whether to power off the vehicle or turn on the electronic parking brake light.
[0377] In S2302, the surface control module sends a button formation command to the ECU, which is used to indicate the height of each support rod in the first area.
[0378] It should be understood that items may be placed on the mechanical matrix. The first area forming the button should be different from the location where the item is placed. The surface control module is performing... Figure 2 During the aforementioned steps, the position of the item placed on the mechanical matrix can be recorded. Alternatively, the surface control module can determine the support rod in contact with the item based on the contact information sent by each sensor of the mechanical matrix when the S2301 receive button request is made, thereby determining the position of the item. Based on the position of the item, the surface control module determines a first area outside the area where the item is located.
[0379] The shape of the first area and the relative heights of the various support rods at different locations within the first area can be preset.
[0380] The button forming command can instruct the height of each support rod in the first area to increase or decrease, forming a depression or a bulge, so that the height of each support rod in the first area is different from that of other support rods around the first area.
[0381] In S2303, the ECU controls the mechanical matrix forming button.
[0382] The ECU can adjust the height of each support rod in the first area of the mechanical matrix according to the button command, thereby forming at least one button.
[0383] When the first area is not continuous, multiple buttons can be formed.
[0384] In S2304, the surface control module receives contact information from the sensors located at the top of each support rod in the first area, and determines the user's input information based on this contact information.
[0385] The surface control module can determine the support rod that is in contact with the user based on the contact information from the sensors installed at the top of each support rod in the first area.
[0386] The shape of the support rod in contact with the user can be used to determine whether the user has pressed a button. A sensor located at the top of the support rod can be a pressure sensor. The pressure sensed by each sensor can be used to determine whether the user has pressed the button. For example, if the pressure sensed by each sensor is within a preset range, it can be determined that the user has pressed the button.
[0387] The user's input information can be determined by the order in which each support rod in the first area contacts the user, which can be used to determine the order in which the user presses or touches multiple buttons, or by the user's sliding operation.
[0388] In S2305, the surface control module sends the user's input information to the CDC.
[0389] In S2306, the CDC sends a response message to the surface control module.
[0390] In S2307, the surface control module sends a button cancellation command to the ECU based on the response information. The button cancellation command is used to indicate the height of each support rod in the first area.
[0391] In S2308, the ECU controls the mechanical matrix cancellation button.
[0392] The ECU can adjust the height of each support rod within the area indicated by the second position information in the mechanical matrix by pressing the button to cancel the command.
[0393] The button cancellation command can instruct the ECU to adjust all the support rods in the first area to the same height, thereby making the support rods in the first area the same height and restoring the first area to flatness.
[0394] Figure 21 This is a schematic structural diagram of an in-vehicle system provided in an embodiment of this application.
[0395] The vehicle system 2400 includes a mechanical matrix 100, a surface control unit 2401, an ECU 2402, a CDC 2403, a pose detection module 2404, a camera 2405, and a VDC 2406. One or more of the surface control unit 2401, ECU 2402, CDC 2403, pose detection module 2404, and VDC 2406 can be integrated into a single device, or each of these components can be an independent device.
[0396] The mechanical matrix 100 includes multiple motion units, each with an adjustable top height. Each motion unit 110 is equipped with a sensor. For details, please refer to... Figure 1 Explanation.
[0397] The surface control unit 2401 can receive contact information sent by each sensor in the mechanical matrix 100. This contact information indicates whether the motion unit of the sensor is in contact with the target. Therefore, the surface control unit 2401 can determine the adjustment method of each motion unit in the mechanical matrix 100 based on the contact information. For example, the adjustment method of the motion unit may include the adjusted height of the motion unit, the speed of movement during the adjustment process, etc. The surface control unit 2401 can also send control information to the ECU 2402, which instructs on the adjustment method of each motion unit in the mechanical matrix 100.
[0398] The ECU 2402 can receive control information sent by the surface control unit 2401, and according to the control information, control each motion unit in the mechanical matrix 100 to adjust according to the adjustment method indicated by the control information. By controlling each motion unit in the mechanical matrix through the ECU 2402, the three-dimensional image formed by the mechanical matrix can be adjusted.
[0399] In some embodiments, the surface control unit 2401 can determine whether the target is an electronic display device based on the contact information sent by each sensor.
[0400] If the target is not an electronic display device, the surface control unit 2401 can determine the adjustment method so that the target is located in the recessed structure formed by the various motion units of the mechanical matrix.
[0401] When the target is an electronic display device, the surface control unit 2401 can send a detection request to the CDC 2403. The CDC 2403 can then forward the detection request to the pose detection module 2404.
[0402] The pose detection module 2404 can be located in the DMS. Based on the detection request, the pose detection module 2404 processes the image captured by the camera 2405 to determine the driver's head pose. The pose detection module 2404 can also send the driver's head pose to the CDC 2403.
[0403] The CDC 2403 can also determine the target position and target attitude based on the driver's head posture, and send the target position and target attitude to the surface control unit 2401. The target attitude causes the electronic display device to face the driver.
[0404] The surface control unit 2401 can determine the adjustment method of each motion unit in the mechanical matrix 100 based on the target position and target attitude. This adjustment method ensures that the target is located at the target position and in the target attitude within the adjusted mechanical matrix.
[0405] In other words, when the target is an electronic display device, the vehicle system 2400 can orient the electronic display device toward the driver.
[0406] Furthermore, when the target is placed on the mechanical matrix, if the vehicle is in a bumpy state, the VDC 2406 can send bump information to the CDC 2403. The bump information indicates the direction and distance of the vehicle's vibration. The CDC 2403 can determine buffering information based on the bump information and send the buffering amount to the surface control unit 2401. The buffering information may include adjustment direction and adjustment height difference. The adjustment direction is opposite to the vibration direction, and the adjustment height difference is positively correlated with the vibration distance. The surface control unit 2401 can determine the adjustment method based on the buffering information so that each motion unit of the mechanical matrix adjusts according to the buffering information.
[0407] Furthermore, the CDC 2403 can also store the target position of the electronic display device determined each time, as well as the number of times each target position is determined. In cases where the driver's head posture or other information cannot be obtained, the CDC 2403 can send the target position that has been recorded the most frequently determined position to the surface control unit 2401. Similarly, the CDC 2403 can also record the target posture determined each time, as well as the number of times that target posture is determined. In cases where the driver's head posture or other information cannot be obtained, the CDC 2403 can also send the target posture that has been recorded the most frequently determined position to the surface control unit 2401.
[0408] In other embodiments, CDC 2403 may send stereoscopic image information to surface control unit 2401. Surface control unit 2401 may determine an adjustment method corresponding to the stereoscopic image information so that the mechanical matrix displays the stereoscopic image indicated by the stereoscopic image information.
[0409] The above text combined Figures 1 to 21 The mechanical matrix provided in this application and the method embodiments of this application are described below, in conjunction with Figures 22 to 24 This section describes the apparatus embodiments of the present application. It should be understood that the descriptions of the method embodiments correspond to the descriptions of the apparatus embodiments; therefore, any parts not described in detail can be found in the foregoing method embodiments.
[0410] Figure 22 This is a schematic structural diagram of a control device for a mechanical matrix provided in an embodiment of this application.
[0411] The mechanical matrix consists of multiple motion units, each equipped with a sensor.
[0412] The control device 2000 for the mechanical matrix includes an acquisition module 2010 and an adjustment module 2020.
[0413] The acquisition module 2010 is used to acquire contact information output by sensors installed on the plurality of motion units, the contact information being used to indicate whether the top of the motion unit is in contact with the target.
[0414] The adjustment module 2020 is used to adjust the height of the top end of at least one of the motion units according to the contact information. The at least one motion unit includes a contact motion unit and / or a neighboring motion unit. The top end of the contact motion unit is in contact with the target, and the distance between the neighboring motion unit and the contact motion unit is less than a preset value.
[0415] Optionally, the height of the top is an absolute height, and the plurality of motion units include a first motion unit and a second motion unit.
[0416] The height of the top end of the at least one of the motion units is adjusted such that the first motion unit and the second motion unit form a recessed structure, the height of the top end of the first motion unit is less than the height of the top end of the second motion unit, the second motion unit surrounds the first motion unit, and in the adjusted mechanical array, the first motion unit includes the contact motion unit.
[0417] Optionally, in the adjusted mechanical matrix, the first motion unit is the contact motion unit, and the second motion unit includes the adjacent motion unit.
[0418] Optionally, the mechanical matrix is located in the vehicle.
[0419] The acquisition module 2010 is also used to acquire bump information, which is used to indicate the vibration direction and vibration distance of the vehicle, wherein the vibration direction is a direction perpendicular to the sea level.
[0420] The device 2000 also includes a processing module. The processing module is used to determine an adjustment height difference based on the bump information, the adjustment height difference being positively correlated with the vibration distance.
[0421] The adjustment module 2020 is also used to adjust the height of the top end of the contact motion unit in a direction opposite to the vibration direction, wherein the change in height of the contact motion unit is the adjustment height difference.
[0422] Optionally, the mechanical matrix is located in the vehicle.
[0423] The control device also includes a processing module, which is used to determine that the vehicle is in a bumpy state.
[0424] The adjustment module 2020 is also used to adjust the height of the top of the contact motion unit according to the first contact information output by the first sensor, so as to minimize the difference between the first pressure and the second pressure. The first contact information is used to indicate the first pressure, which is the pressure on the contact motion unit when the vehicle is in the bumpy state, and the second pressure is the pressure on the contact motion unit when the vehicle is in the stable driving state.
[0425] Optionally, the target may be an electronic display device.
[0426] In the adjusted mechanical matrix, the contact motion unit forms a support, which is used to set the orientation of the target.
[0427] Optionally, the control device 2000 further includes a processing module, which is used to determine, based on the contact information, that the target is an electronic display device.
[0428] Optionally, the acquisition module 2010 is further configured to acquire head position information, the head position information being used to indicate the position of the user's head, and the bracket causing the target to face the user's head.
[0429] Optionally, the acquisition module 2010 is further configured to acquire head posture information, the head posture information being used to indicate the plane of symmetry of the user's head.
[0430] The processing module is also used to determine the target position based on the head posture information, wherein the target position is located in the plane of symmetry.
[0431] The adjustment module 2020 is also used to adjust the height of at least one of the motion units to form a slope, so that the target slides to the target position and the support is located at the target position.
[0432] Optionally, the head posture information is also used to indicate the user's direct gaze direction, and the sliding rotation of the target on the slope makes the bottom edge of the target perpendicular to the direct gaze direction.
[0433] The support is formed such that the bottom edge is perpendicular to the plane of symmetry and that the target is oriented toward the user's head.
[0434] Optionally, the mechanical array is used to display an image, and the plurality of motion units correspond to a plurality of pixels in the image.
[0435] The adjustment module 2020 is further configured to adjust the color of at least one pixel according to the contact information, wherein the at least one pixel is a pixel corresponding to at least one motion unit among the contact motion unit and the neighboring motion units.
[0436] Figure 23 This is a schematic structural diagram of a control device for a mechanical matrix provided in an embodiment of this application.
[0437] The mechanical matrix comprises multiple motion units, each equipped with a sensor. The sensors output contact information, indicating whether the tip of the motion unit is in contact with a target.
[0438] The control device 4000 of the mechanical matrix includes an acquisition module 4010, an adjustment module 4020, and an output module 4030.
[0439] The acquisition module 4010 is used to acquire button formation information.
[0440] The adjustment module 4020 is used to adjust the height of at least one of the first and second motion units among the plurality of motion units according to the button formation information to form a button. The second motion unit surrounds the first motion unit. In the adjusted mechanical matrix, the height of the first motion unit located in the area where the button is located is different from the height of the second motion unit.
[0441] The output module 4030 is used to output button information, which is determined based on the contact information output by the sensor on the first motion unit.
[0442] Optionally, the acquisition module 4010 is also used to acquire button cancellation information;
[0443] The adjustment module 4020 is further configured to adjust the height of at least one of the first motion unit and the second motion unit according to the button elimination information, so as to eliminate the button.
[0444] Figure 24This is a schematic structural diagram of a control device for a mechanical matrix provided in an embodiment of this application.
[0445] The control device 3000 for the mechanical matrix includes at least one memory 3010 and at least one processor 3020. The at least one memory 3010 is used to store a program, and the at least one processor 3020 is used to run the program to implement the method described above.
[0446] Devices 2000, 3000, and 4000 may be vehicles with storage and / or human-machine interaction functions, or other components with storage and / or human-machine interaction functions. These devices include, but are not limited to: vehicle-mounted terminals, vehicle-mounted controllers, vehicle-mounted modules, vehicle-mounted components, vehicle-mounted chips, and vehicle-mounted units. Vehicles can implement the methods provided in this application through these vehicle-mounted terminals, vehicle-mounted controllers, vehicle-mounted modules, vehicle-mounted components, vehicle-mounted chips, and vehicle-mounted units.
[0447] The device can also be a smart terminal other than a vehicle that has storage and / or human-computer interaction functions, or it can be installed in a smart terminal other than a vehicle that has storage and / or human-computer interaction functions, or it can be installed in a component of the smart terminal. The smart terminal can be other terminal devices such as smart transportation equipment, smart home equipment, and robots. The device includes, but is not limited to, the smart terminal or the controller, chip, sensor, and other components within the smart terminal.
[0448] Devices 2000 and 3000 can be general-purpose devices or special-purpose devices. In specific implementations, the device can also be a desktop computer, laptop computer, network server, PDA (personal digital assistant), mobile phone, tablet computer, wireless terminal device, embedded device, or other device with processing capabilities. The embodiments of this application do not limit the type of device.
[0449] Devices 2000 and 3000 can also be chips or processors with processing capabilities, and the device may include multiple processors. The processor can be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. The chip or processor with processing capabilities may be located within the sensor, or it may be located at the receiving end of the sensor's output signal.
[0450] It should be understood that the processor in the embodiments of this application can be a central processing unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.
[0451] It should also be understood that the memory in the embodiments of this application can be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate synchronous DRAM (DDR SDRAM), enhanced synchronous DRAM (ESDRAM), synchronous linked DRAM (SLDRAM), and direct rambus RAM (DR RAM).
[0452] The descriptions of the processes corresponding to the above-mentioned figures each have their own emphasis. For parts of a process that are not described in detail, please refer to the relevant descriptions of other processes.
[0453] This application also provides a computer-readable storage medium, characterized in that the computer-readable storage medium has program instructions that, when the program instructions are executed directly or indirectly, enable the method described above to be implemented.
[0454] This application also provides a computer program product containing instructions that, when run on a computing device, cause the computing device to perform the methods described above, or cause the computing device to perform the functions of the apparatus described above.
[0455] This application also provides a chip system, characterized in that the chip system includes at least one processor, and when program instructions are executed in the at least one processor, the method described above is implemented.
[0456] This application also provides an in-vehicle system for providing mechanical matrix control functions for a vehicle. It includes at least one mechanical matrix control device mentioned in the above embodiments of this application, as well as a mechanical matrix. At least one sensor device within the system can be integrated into a single unit or device, or at least one sensor device within the system can be independently configured as a component or device.
[0457] This application also provides a vehicle, which includes a control device for at least one of the mechanical matrices mentioned in the above embodiments of this application.
[0458] This application also provides a terminal, including at least one control device for the mechanical matrix mentioned in the above embodiments of this application.
[0459] Furthermore, the terminal can be transportation equipment, such as cars, trucks, motorcycles, buses, ships, airplanes, helicopters, lawnmowers, recreational vehicles, amusement park vehicles, construction equipment, trams, golf carts, trains, handcarts, etc.
[0460] The above embodiments can be implemented, in whole or in part, by software, hardware, firmware, or any other combination thereof. When implemented using software, the above embodiments can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more sets of available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium. A semiconductor medium can be a solid-state drive.
[0461] It should be understood that the term "and / or" in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. A and B can be singular or plural. Additionally, the character " / " in this article generally indicates an "or" relationship between the preceding and following related objects, but it can also represent an "and / or" relationship. Please refer to the context for a more accurate understanding.
[0462] In this application, "at least one" means one or more, and "more than one" means two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or multiple items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.
[0463] It should be understood that in the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0464] As used in this specification, the terms "component," "module," "system," etc., are used to refer to computer-related entities, hardware, firmware, combinations of hardware and software, software, or software in execution. For example, a component can be, but is not limited to, a process running on a processor, a processor, an object, an executable file, an execution thread, a program, and / or a computer. As illustrated, applications running on computing devices and computing devices can both be components. One or more components may reside in a process and / or an execution thread, and components may be located on a single computer and / or distributed among two or more computers. Furthermore, these components can be executed from various computer-readable media on which various data structures are stored. Components can communicate, for example, via local and / or remote processes based on signals having one or more data packets (e.g., data from two components interacting with another component between a local system, a distributed system, and / or a network, such as the Internet interacting with other systems via signals).
[0465] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0466] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.
[0467] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.
[0468] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0469] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.
[0470] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0471] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A mechanical matrix, characterized in that, The mechanical matrix includes multiple motion units (110); The height of the top of each motion unit (110) is adjustable; Each motion unit (110) is provided with a sensor (120) for outputting contact information, which indicates whether the top of the motion unit (110) is in contact with the target; The mechanical matrix is located in the vehicle. When the vehicle is in a bumpy state, the contact motion unit is configured such that the direction of its height change is opposite to the direction of the vehicle vibration, and the amount of its height change is positively correlated with the vibration distance of the vehicle vibration. The contact motion unit is the motion unit that contacts the target among the plurality of motion units (110).
2. The mechanical matrix according to claim 1, characterized in that, The plurality of motion units (110) includes a first motion unit and a second motion unit. In the mechanical matrix adjusted according to the contact information, the first motion unit and the second motion unit form a recessed structure. The height of the top of the first motion unit is less than the height of the top of the second motion unit. The second motion unit surrounds the first motion unit. The first motion unit includes a contact motion unit among the plurality of motion units (110) that contacts the target.
3. The mechanical matrix according to claim 2, characterized in that, The first motion unit is the contact motion unit, and the second motion unit includes the neighboring motion unit among the plurality of motion units (110) whose distance from the contact motion unit is less than a preset value.
4. The mechanical matrix according to any one of claims 1-3, characterized in that, The target is an electronic display device. In the mechanical matrix adjusted according to the contact information, the contact motion unit in the plurality of motion units (110) that is in contact with the target forms a support, and the support is used to set the orientation of the target.
5. The mechanical matrix according to claim 4, characterized in that, The bracket directs the target toward the user's head.
6. The mechanical matrix according to claim 5, characterized in that, At least one of the motion units forms a slope at its top, causing the target to slide to a target position located in a plane of symmetry of the user's head, with the support located at the target position.
7. The mechanical matrix according to claim 6, characterized in that, The sliding of the target on the slope causes the bottom edge of the target to be perpendicular to the user's direct line of sight, and the formation of the bracket causes the bottom edge to be perpendicular to the plane of symmetry, and the target to face the user's head.
8. The mechanical matrix according to any one of claims 1-3, characterized in that, The mechanical matrix is used to display an image, and the plurality of motion units (110) correspond to a plurality of pixels of the image. In the mechanical matrix adjusted according to the contact information, the color of at least one pixel changes. The at least one pixel is a pixel corresponding to at least one of the contact motion units and the neighboring motion units. The contact motion unit is the motion unit that is in contact with the target among the plurality of motion units (110), and the neighboring motion unit is the motion unit that is less than a preset value away from the contact motion unit.
9. A control method for a mechanical matrix, characterized in that, The mechanical matrix includes multiple motion units, each of which is equipped with a sensor. The method includes: The contact information output by the sensors installed on the plurality of motion units is obtained, and the contact information is used to indicate whether the top of the motion unit is in contact with the target; Based on the contact information, the height of the top of at least one of the motion units is adjusted. The at least one motion unit includes a contact motion unit and / or a neighboring motion unit. The top of the contact motion unit contacts the target, and the distance between the neighboring motion unit and the contact motion unit is less than a preset value. The mechanical matrix is located in the vehicle, and the method further includes: Obtain bump information, which is used to indicate the vibration direction and vibration distance of the vehicle. The vibration direction is perpendicular to the sea level, and the vibration distance is used to indicate the absolute height change of the vehicle along the vibration direction. Based on the bump information, an adjustment height difference is determined, and the adjustment height difference is positively correlated with the vibration distance; The step of adjusting the height of the top of at least one of the motion units according to the contact information includes: adjusting the height of the top of the contact motion unit in a direction opposite to the vibration direction, wherein the height change of the contact motion unit is the adjusted height difference.
10. The method according to claim 9, characterized in that, The height of the top is an absolute height, and the plurality of motion units include a first motion unit and a second motion unit. The height of the top end of the at least one of the motion units is adjusted such that the first motion unit and the second motion unit form a concave structure, the height of the top end of the first motion unit is less than the height of the top end of the second motion unit, the second motion unit surrounds the first motion unit, and in the adjusted mechanical matrix, the first motion unit includes the contact motion unit.
11. The method according to claim 10, characterized in that, In the adjusted mechanical matrix, the first motion unit is the contact motion unit, and the second motion unit includes the adjacent motion unit.
12. The method according to any one of claims 9-11, characterized in that, The mechanical matrix is located in the vehicle. The method further includes: determining that the vehicle is in a bumpy state; The step of adjusting the height of the top of at least one of the motion units according to the contact information includes: adjusting the height of the top of the contact motion unit according to the first contact information output by the first sensor so as to minimize the difference between the first pressure and the second pressure, wherein the first contact information is used to indicate the first pressure, the first pressure is the pressure on the contact motion unit when the vehicle is in the bumpy state, and the second pressure is the pressure on the contact motion unit when the vehicle is in the stable driving state.
13. The method according to any one of claims 9-11, characterized in that, The target is an electronic display device. In the adjusted mechanical matrix, the contact motion unit forms a support, which is used to set the orientation of the target.
14. The method according to claim 13, characterized in that, The method further includes: determining, based on the contact information, that the target is an electronic display device.
15. The method according to claim 13, characterized in that, The method further includes: The head position information is obtained to indicate the position of the user's head, and the bracket makes the target face the user's head.
16. The method according to claim 15, characterized in that, The method further includes: Obtain head posture information, which is used to indicate the plane of symmetry of the user's head; Based on the head posture information, the target position is determined, and the target position is located in the plane of symmetry; Adjusting the height of the top of at least one of the motion units includes: Adjust the height of the top of at least one of the motion units to form a slope, so that the target slides to the target position, and the support is located at the target position.
17. The method according to claim 16, characterized in that, The head posture information is also used to indicate the user's direct gaze direction. The sliding of the target on the slope causes the bottom edge of the target to be perpendicular to the plane of symmetry; The support is formed such that the bottom edge is perpendicular to the plane of symmetry and that the target is oriented toward the user's head.
18. The method according to any one of claims 9-11, characterized in that, The mechanical matrix is used to display an image, the plurality of motion units correspond to a plurality of pixels in the image, and the method further includes: Based on the contact information, the color of at least one pixel is adjusted, wherein the at least one pixel is a pixel corresponding to at least one of the contact motion units and the neighboring motion units.
19. A control device for a mechanical matrix, characterized in that, The mechanical matrix includes multiple motion units, each motion unit is equipped with a sensor, and the control device includes: The acquisition module is used to acquire contact information output by sensors installed on the plurality of motion units, the contact information being used to indicate whether the top of the motion unit is in contact with the target; An adjustment module is used to adjust the height of the top end of at least one of the motion units according to the contact information. The at least one motion unit includes a contact motion unit and / or a neighboring motion unit. The top end of the contact motion unit is in contact with the target, and the distance between the neighboring motion unit and the contact motion unit is less than a preset value. The mechanical matrix is located in the vehicle. The acquisition module is further configured to acquire bump information, wherein the bump information is used to indicate the vibration direction and vibration distance of the vehicle vibration, wherein the vibration direction is perpendicular to the sea level, and the vibration distance is used to indicate the absolute height change of the vehicle along the vibration direction. The control device further includes a processing module for determining an adjustment height difference based on the bump information, wherein the adjustment height difference is positively correlated with the vibration distance; The adjustment module is also used to adjust the height of the top of the contact motion unit in a direction opposite to the vibration direction, wherein the change in the height of the contact motion unit is the adjustment height difference.
20. The apparatus according to claim 19, characterized in that, The height of the top is an absolute height, and the plurality of motion units include a first motion unit and a second motion unit. The height of the top end of the at least one of the motion units is adjusted such that the first motion unit and the second motion unit form a concave structure, the height of the top end of the first motion unit is less than the height of the top end of the second motion unit, the second motion unit surrounds the first motion unit, and in the adjusted mechanical matrix, the first motion unit includes the contact motion unit.
21. The apparatus according to claim 20, characterized in that, In the adjusted mechanical matrix, the first motion unit is the contact motion unit, and the second motion unit includes the adjacent motion unit.
22. The apparatus according to any one of claims 19-21, characterized in that, The mechanical matrix is located in the vehicle. The control device also includes a processing module, which is used to determine that the vehicle is in a bumpy state. The adjustment module is further configured to adjust the height of the top of the contact motion unit according to the first contact information output by the first sensor, so as to minimize the difference between the first pressure and the second pressure. The first contact information is used to indicate the first pressure, which is the pressure on the contact motion unit when the vehicle is in the bumpy state, and the second pressure is the pressure on the contact motion unit when the vehicle is in the stable driving state.
23. The apparatus according to any one of claims 19-21, characterized in that, The target is an electronic display device. In the adjusted mechanical matrix, the contact motion unit forms a support, which is used to set the orientation of the target.
24. The apparatus according to claim 23, characterized in that, The control device further includes a processing module, which is used to determine that the target is an electronic display device based on the contact information.
25. The apparatus according to claim 23, characterized in that, The acquisition module is further configured to acquire head position information, which is used to indicate the position of the user's head, and the bracket makes the target face the user's head.
26. The apparatus according to claim 25, characterized in that, The acquisition module is further configured to acquire head posture information, which is used to indicate the symmetry plane of the user's head. The processing module is further configured to determine the target position based on the head posture information, wherein the target position is located in the plane of symmetry; The adjustment module is also used to adjust the height of at least one of the motion units to form a slope, so that the target slides to the target position and the bracket is located at the target position.
27. The apparatus according to claim 26, characterized in that, The head posture information is also used to indicate the user's direct gaze direction. The target's sliding and rotation on the slope causes the bottom edge of the target to be perpendicular to the direct viewing direction; The support is formed such that the bottom edge is perpendicular to the plane of symmetry and that the target is oriented toward the user's head.
28. The apparatus according to any one of claims 19-21, characterized in that, The mechanical matrix is used to display an image, and the plurality of motion units correspond to a plurality of pixels in the image. The adjustment module is further configured to adjust the color of at least one pixel according to the contact information, wherein the at least one pixel is a pixel corresponding to at least one of the contact motion units and the neighboring motion units.
29. A control device for a mechanical matrix, characterized in that, It includes at least one memory and at least one processor, the at least one memory being used to store a program and the at least one processor being used to run the program to implement the method of any one of claims 9-18.
30. A chip, characterized in that, It includes at least one processor and an interface circuit, the interface circuit being used to provide program instructions or data to the at least one processor, the at least one processor being used to execute the program instructions to implement the method of any one of claims 9-18.
31. A computer-readable storage medium, characterized in that, The computer-readable medium stores program code for execution by the device, which, when executed by the device, implements the method as described in any one of claims 9-18.
Citation Information
Patent Citations
A method and apparatus for display matrix wall data interaction
CN108989707A
Pressure self-adaptive mattress
CN211483736U
Display device
JP2020102065A