Display module-based control system, related methods, devices, vehicles, and media

Abstract

Embodiments of the present application provide a display module-based control system, related methods, devices, vehicles and media; the control system comprises a user information acquisition device and a display module of a vehicle, the display module of the vehicle is electrically connected with a vehicle power supply; the user information acquisition device is electrically connected with the display module, and the user information acquisition device is detachably connected with the display module; wherein: the user information acquisition device is used for collecting user information for a user in the vehicle; the display module is used for powering the user information acquisition device when there is a use demand for the user information acquisition device. Through the embodiments of the present application, the power supply of the user information acquisition device can be controlled through the display module, thereby prolonging the service life of the user information acquisition device.

Description

Technical Field

[0001] This invention relates to the technical field of vehicles, and in particular to a control system based on a display module, a control method for a user information collection device, a control device for a user information collection device, a vehicle, and a computer-readable storage medium. Background Technology

[0002] Currently, user information collection devices for the second row of the vehicle cabin, such as cameras, are integrated into the vehicle's roof and fixed behind the display module. The camera's power supply can be connected to the vehicle's constant power supply, providing continuous power support for stable operation. The image information collected by the camera is transmitted to the in-vehicle entertainment system via a high-speed serial link. This collected image information can be applied to second-row gesture recognition, object prompts, and other related applications, thereby improving the in-vehicle interactive experience and enhancing passenger convenience.

[0003] In practical applications, the camera is powered by the KL30 (Klemme 30, constant power wire), which supplies power to the camera when the vehicle is powered on; this continuous power supply mode leads to a significant reduction in the camera's lifespan. Summary of the Invention

[0004] In view of the above problems, a control system based on a display module, a control method for a user information collection device, a control device for a user information collection device, a vehicle, and a computer-readable storage medium are proposed to overcome or at least partially solve the above problems, comprising:

[0005] A control system based on a display module includes a user information acquisition device and a vehicle display module; the vehicle display module is electrically connected to the vehicle's power supply; the user information acquisition device is electrically connected to the display module, and the user information acquisition device is detachably connected to the display module; wherein:

[0006] The user information collection device is used to collect user information from the users in the vehicle.

[0007] The display module is used to supply power to the user information collection device when there is a need to use the user information collection device.

[0008] Optionally, the display module is movably connected to the vehicle, and a mounting block is provided on the display module, with the user information collection device detachably mounted on the mounting block;

[0009] The display module is used to determine, when the display module is turned on, whether there is a need to use the user information collection device.

[0010] Optionally, the control system further includes: an in-vehicle entertainment system;

[0011] The in-vehicle entertainment system is communicatively connected to the display module; the in-vehicle entertainment system is used to send a second control command to the display module in response to a first control command for the user information collection device;

[0012] The display module is used to control the user information collection device when it receives the second control command.

[0013] Optionally, the in-vehicle entertainment system is connected to the display module via wired communication, and the display module is connected to the user information collection device via wired communication.

[0014] The user information collection device is used to interact with the display module via a wired communication connection;

[0015] The display module is used to interact with the in-vehicle entertainment system via a wired communication connection.

[0016] Optionally, the user information collection device is wirelessly connected to the in-vehicle entertainment system; the user information collection device is used to send video data to the in-vehicle entertainment system via wireless connection.

[0017] Optionally, the display module is further configured to send a heartbeat packet to the user information collection device via a wired communication connection, and receive an acknowledgment packet for the heartbeat packet returned by the user information collection device via a wired communication connection; when the acknowledgment packet returned by the user information collection device is not received for N consecutive times, a fault notification message is sent to the in-vehicle entertainment system via a wired communication connection; where N is a positive integer.

[0018] Optionally, the display module is further configured to restart the wired communication connection with the user information collection device when sending the fault notification information to the in-vehicle entertainment system; and to close the wired communication connection with the user information collection device after restarting the wired communication connection with the user information collection device M times consecutively without receiving the confirmation packet returned by the user information collection device; wherein M is a positive integer.

[0019] Optionally, the user information collection device is further configured to generate its own device status information and / or its own diagnostic information, and send the own device status information and / or the self-diagnostic information to the display module via a wired communication connection;

[0020] The display module is also used to send its own device status information and / or its own diagnostic information to the in-vehicle entertainment system via a wired communication connection.

[0021] Optionally, the in-vehicle entertainment system is connected to a server;

[0022] The user information collection device is further configured to send authentication information to the server through the in-vehicle entertainment system. The authentication information is used by the server to authenticate the user information collection device. When the server successfully authenticates the user information collection device based on the authentication information, it issues a communication key to the user information collection device. The communication key is used for data encryption and decryption when the user information collection device interacts with the in-vehicle entertainment system and / or the display module.

[0023] Optionally, the display module is movably mounted on the top of the vehicle interior; the user information collection module is mounted on the display module.

[0024] This invention also provides a control method for a user information collection device, applied to the control system described above; the method includes:

[0025] When the user information collection device is connected to the display module, the usage requirements for the user information collection device are obtained.

[0026] When the usage requirements are met, power is supplied to the user information collection device.

[0027] Optionally, obtaining the usage requirements for the user information collection device includes:

[0028] Determine the operating status of the display module of the control system;

[0029] When the display module is in the working state, it is determined that there is a demand for the use of the user information collection device.

[0030] Optionally, obtaining the usage requirements for the user information collection device includes:

[0031] Upon receiving a power supply control command for the user information collection device, it is determined that there is a demand for the user information collection device; wherein, the power supply control command is a command to supply power to the user information collection device generated based on user operation.

[0032] Optionally, the method further includes:

[0033] Send a heartbeat packet to the user information collection device and receive an acknowledgment packet for the heartbeat packet returned by the user information collection device;

[0034] If the user information collection device fails to return the confirmation packet N times consecutively, an error message will be displayed.

[0035] Optionally, the method further includes:

[0036] When an error is detected, communication with the user information collection module is restarted.

[0037] If no confirmation packet is received from the user information collection device after M consecutive restarts of communication with the user information collection module, then communication with the user information collection module is closed.

[0038] Optionally, the method further includes:

[0039] When an abnormality is detected in the power supply to the user information collection device, the power supply to the user information collection device is stopped.

[0040] Optionally, the method further includes:

[0041] When the data traffic uploaded by the user information collection device exceeds the threshold, the reception of data uploaded by the user information collection device will be stopped.

[0042] This invention also provides a control device for a user information collection device, applied to the control system described above; the device includes:

[0043] The detection module is used to obtain the usage requirements for the user information collection device when the user information collection device is connected to the display module.

[0044] The power supply module is used to supply power to the user information collection device based on the usage requirements.

[0045] This invention also provides a vehicle including the control system described above, the control system being used to implement the control method for the user information collection device described above.

[0046] This invention also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the above-described control method for a user information collection device.

[0047] The embodiments of the present invention have the following advantages:

[0048] In this embodiment of the invention, the control system includes a user information collection device and a vehicle display module. The vehicle display module is electrically connected to the vehicle's power supply. The user information collection device is electrically connected to the display module and is detachably connected to it. The user information collection device is used to collect user information from users in the vehicle. The display module supplies power to the user information collection device when there is a demand for its use. Through this embodiment of the invention, the power supply to the user information collection device can be controlled via the display module, thereby extending the service life of the user information collection device. Attached Figure Description

[0049] To more clearly illustrate the technical solution of the present invention, the accompanying drawings used in the description of the present invention will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0050] Figure 1 This is a schematic diagram of the structure of a control system based on a display module according to an embodiment of the present invention;

[0051] Figure 2 This is a schematic diagram of another control system based on a display module according to an embodiment of the present invention;

[0052] Figure 3 This is a schematic diagram of another control system based on a display module according to an embodiment of the present invention;

[0053] Figure 4 This is a flowchart illustrating the steps of a control method for a user information collection device according to an embodiment of the present invention;

[0054] Figure 5 This is a schematic diagram of the structure of a control device for a user information collection device according to an embodiment of the present invention. Detailed Implementation

[0055] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without inventive effort are within the scope of protection of the present invention.

[0056] To extend the lifespan of the user information collection device located at the display module, this embodiment of the invention provides a control system based on the display module. This control system may include the display module and the user information collection device. Specifically, the power supply to the user information collection device can be controlled by the display module. The display module only supplies power to the user information collection device when there is a demand for its use. Compared to directly using a KL30 power supply, the power supply to the user information collection device in this embodiment of the invention is more controllable, thus avoiding unnecessary power supply and extending the lifespan of the user information collection device.

[0057] For details, please refer to Figure 1 , Figure 1 A schematic diagram of a control system based on a display module according to an embodiment of the present invention is shown; as follows: Figure 1 As shown, the control system 10 based on the display module may include a user information collection device 120 and a vehicle display module 110; the vehicle display module 110 is electrically connected to the vehicle power supply; the user information collection device 120 is electrically connected to the display module 110, and the user information collection device 120 is detachably connected to the display module 110. The vehicle display module 110 is powered by the vehicle power supply 140; the user information collection device 120 is powered by the display module 110; wherein:

[0058] User information collection device 120 is used to collect user information from users in vehicles;

[0059] The display module 110 is used to supply power to the user information collection device 120 when there is a need to use the user information collection device 120.

[0060] The vehicle's display module 110 can be installed in the vehicle's roof to play audio and video to users in the rear seats. The display module 110 can be directly powered by the vehicle's power supply 140. For example, the display module 110 can be directly powered by KL30, or it can be powered by a power line controlled by the ignition switch (such as KL15). This embodiment of the invention does not limit this.

[0061] The display module 110 may include an MCU (Microcontroller Unit), and the power supply to the user information acquisition device 120 may be controlled by the MCU. For example, the display module 110 may be a ceiling-mounted screen or a central control display screen; this embodiment of the invention does not impose any limitations on this.

[0062] User information collection device 120 can refer to a device used to collect user information of users inside the vehicle, such as a camera, etc., but this embodiment of the invention does not limit it.

[0063] The user information collection device 120 can be connected to the display module 110 and powered by the display module 110. Specifically, after the display module 110 is turned on, it can first detect whether there is a current demand for the use of the user information collection device 120. For example, if a user needs to use the user information collection device 120, they can perform the corresponding operation; after the display module 110 detects this operation, it can determine that there is a current demand for the use of the user information collection device 120.

[0064] For example, if the user information collection device 120 is enabled when the display module 110 is enabled by default, then the display module 110 can determine that there is a current demand for the user information collection device 120.

[0065] When it is determined that there is a demand for the user information collection device 120, the display module 110 can supply power to the user information collection device 120 based on the power supply of the vehicle power supply 140. Conversely, if it is determined that there is no demand for the user information collection device 120, the display module 110 can choose not to supply power to the user information collection device 120, thereby extending the service life of the user information collection device 120.

[0066] In practical applications, the user information collection device 120 and the display module 110 can be detachably connected, meaning that the user information collection device 120 can be replaced, thereby reducing the time spent on after-sales service for the user information collection device 120 and simplifying the steps for replacing the user information collection device 120.

[0067] Furthermore, when the user information collection device 120 is a camera, the camera can also be a high-definition camera. By installing the high-definition camera on the display module 110, compared with a low-pixel fixed camera, the image information acquired by the high-definition camera in this embodiment of the invention is more conducive to realizing a large-scale visual model of the cabin. Moreover, the user can adjust the angle of the detachable camera, thereby making the camera's viewing angle more conducive to collecting clearer user information of the in-vehicle users.

[0068] In practical applications, based on the communication key, when the user information collection device 120 is disassembled, other devices connected to the display module 110 will also be unable to communicate with the display module 110 because they do not have the communication key. This effectively prevents the display module 110 from being attacked by malicious data due to the pins not connected to the user information collection device 120 being connected to other devices.

[0069] In some feasible embodiments, the display module 110 can identify whether the user information collection device 120 is installed in place based on pin communication.

[0070] In this embodiment of the invention, the control system 10 includes a user information collection device 120 and a vehicle display module 110. The vehicle display module 110 is electrically connected to the vehicle's power supply. The user information collection device 120 is electrically connected to the display module 110 and is detachably connected to the display module 110. The user information collection device 120 is used to collect user information from users in the vehicle. The display module 110 is used to supply power to the user information collection device 120 when there is a demand for its use. Through this embodiment of the invention, the power supply to the user information collection device 120 can be controlled by the display module 110, thereby extending the service life of the user information collection device 120.

[0071] In one embodiment of the present invention, the display module 110 is movably connected to the vehicle, and a mounting block is provided on the display module 110. The user information collection device 120 is detachably mounted on the mounting block.

[0072] The display module 110 is used to determine the existence of a need for the user information collection device 120 when the display module 110 is turned on.

[0073] In some feasible embodiments, the display module 110 can be movably connected to the vehicle, that is, the display module 110 can move inside the vehicle; the display module 110 is provided with a mounting block, and the user information collection device 120 is detachably mounted on the mounting block.

[0074] That is, the user can install the user information collection device 120 on the mounting block to achieve electrical connection between the user information collection device 120 and the display module 110; when the user needs to replace the user information collection device 120 or for other reasons, and needs to remove the user information collection device 120, the user can also remove the user information collection device 120 from the mounting block to disconnect the connection between the user information collection device 120 and the display module 110.

[0075] For example, the display module 110 can be a foldable screen that can be moved relative to the vehicle when not in use, thereby folding up and going into hibernation. When in use, it can be moved relative to the vehicle, thereby unfolding and activating.

[0076] For example, it can be set by default that when the display module 110 is turned on, the user information collection device 120 is powered on; specifically, when the display module 110 is turned on, the MCU of the display module 110 can then determine that there is a current demand for the user information collection device 120.

[0077] At this time, the MCU of the display module 110 can control the power supply to the user information collection device 120; by automatically supplying power to the user information collection device 120 when the display module 110 is turned on, the power supply strategy of the user information collection device 120 can be enriched to adapt to different scenarios.

[0078] In one embodiment of the present invention, such as Figure 2 As shown, the control system 10 also includes:

[0079] The in-vehicle entertainment system 130 is communicatively connected to the display module 110; the in-vehicle entertainment system 130 is used to send a second control command to the display module 110 in response to a first control command to the user information collection device 120.

[0080] The display module 110 is used to control the user information collection device 120 when it receives a second control command.

[0081] In some feasible embodiments, users can control the user information collection device 120 according to their own needs, such as controlling the user information collection device 120 to turn on, off, restart, pause, resume, or rotate. When users need to control the user information collection device 120, they can perform user operations, such as voice operations or button operations.

[0082] In response to the user's operation, the vehicle's in-vehicle entertainment system 130, which is communicatively connected to the display module 110, can generate a first control command for the user information collection device 120. In response to this first control command, the in-vehicle entertainment system 130 can send a second control command to the display module 110. The second control command can be a control command generated by the in-vehicle entertainment system 130 based on the first control command and recognizable by the display module 110.

[0083] After receiving the second control command, the display module 110 can respond to the second control command by sending a third control command to the user information collection device 120, or respond to the second control command by controlling the power supply to the user information collection device 120. The third control command can be a control command generated by the display module 110 based on the second control command and recognizable by the user information collection device 120.

[0084] After receiving a third control command, the user information collection device 120 can respond to the third control command and perform corresponding operations, such as: shutting down, restarting, pausing, continuing, rotating, etc. This embodiment of the invention does not limit this.

[0085] In one embodiment of the present invention, the second control command is a power supply command; the display module 110 is used to determine, upon receiving the power supply command, that there is a demand for the use of the user information collection device 120.

[0086] In some feasible embodiments, when the second control command is a power supply command, the display module 110, upon receiving the power supply command, can determine, in response to the command, that there is currently a demand for the user information collection device 120; furthermore, the display module 110 can begin supplying power to the user information collection device 120. By supplying power to the user information collection device 120 during user control, the power supply strategy for the user information collection device 120 can be enriched to adapt to different scenarios.

[0087] In one embodiment of the present invention, the in-vehicle entertainment system 130 is connected to the display module 110 via wired communication, and the display module 110 is connected to the user information collection device 120 via wired communication.

[0088] User information collection device 120 is used to interact with display module 110 via wired communication connection;

[0089] The display module 110 is used to interact with the in-vehicle entertainment system 130 via a wired communication connection.

[0090] In some feasible embodiments, the in-vehicle entertainment system 130 can be connected to the display module 110 via wired communication; the display module 110 can also be connected to the user information collection device 120 via wired communication; for example, the in-vehicle entertainment system 130 can be connected to the display module 110 via a CANFD (Controller Area Network Flexible Data-rate) bus; the display module 110 can be connected to the user information collection device 120 via a UART (Universal Asynchronous Receiver / Transmitter).

[0091] In practical applications, the user information collection device 120 can interact with the display module 110 via a wired communication connection. For example, the user information collection device 120 can send the collected information to the display module 110 via a wired communication connection; or the display module 110 can send control commands to the user information collection device 120 via a wired communication connection. This embodiment of the invention does not limit this.

[0092] The display module 110 can interact with the in-vehicle entertainment system 130 via a wired communication connection. For example, the display module 110 can send information obtained from the user information collection device 120 to the in-vehicle entertainment system 130 via a wired communication connection. As another example, the in-vehicle entertainment system 130 can send a second control command to the display module via a wired communication connection. This embodiment of the invention does not limit this.

[0093] In one embodiment of the present invention, the display module 110 is further configured to send a heartbeat packet to the user information collection device 120 via a wired communication connection, and receive an acknowledgment packet for the heartbeat packet returned by the user information collection device 120 via the wired communication connection; when no acknowledgment packet is received from the user information collection device 120 for N consecutive times, a fault notification message is sent to the in-vehicle entertainment system 130 via the wired communication connection; wherein, N is a positive integer.

[0094] In some feasible embodiments, a heartbeat detection mechanism is provided between the display module 110 and the user information collection device 120; specifically, the display module 110 can send heartbeat packets to the user information collection device 120 through a wired communication connection, and the sending interval of the heartbeat packets can be set according to the actual situation; for example, 100 milliseconds.

[0095] After receiving a heartbeat packet via a wired communication connection, the user information collection device 120 can send an acknowledgment packet to the display module 110 via the same connection. In practical applications, if the display module 110 fails to receive an acknowledgment packet from the user information collection device 120 for N consecutive times, the display module 110 can determine that the user information collection device 120 is malfunctioning or that there is a communication failure between the display module 110 and the user information collection device 120.

[0096] At this time, the display module 110 can send a fault notification message to the in-vehicle entertainment system 130 via a wired communication connection to notify the in-vehicle entertainment system 130 that there is a fault in the communication link between the user information collection device 120 or the display module 110 and the user information collection device 120. After receiving the fault notification message, the user information of the in-vehicle entertainment system 130 can be displayed to the user in the vehicle so that the user can be informed of the fault of the user information collection device 120 in a timely manner.

[0097] For example, N can be a positive integer set according to the actual situation; for example, N can be 5; when no confirmation packet is received from the user information collection device 120 for 5 consecutive times, the display module 110 can send a fault notification message to the in-vehicle entertainment system 130.

[0098] In one embodiment of the present invention, the display module 110 is further configured to restart the wired communication connection with the user information collection device 120 when sending fault notification information to the in-vehicle entertainment system 130; and to close the wired communication connection with the user information collection device 120 after restarting the wired communication connection with the user information collection device 120 M times consecutively without receiving an acknowledgment packet returned by the user information collection device 120; wherein M is a positive integer.

[0099] In some feasible embodiments, when the display module 110 sends a fault notification message to the in-vehicle entertainment system 130, it can also restart the wired communication connection between the display module 110 and the user information collection device 120. For example, the wired communication connection between the display module 110 and the user information collection device 120 can be a UART.

[0100] After restarting the wired communication connection with the user information collection device 120 M times, if the display module 110 still does not receive an acknowledgment packet from the user information collection device 120, the display module 110 can determine that the wired communication connection cannot be restored to normal. At this time, the display module 110 can close the wired communication connection with the user information collection device 120. By restarting first, fault recovery can be performed to a certain extent, thereby improving the intelligence of the control system 10.

[0101] In one embodiment of the present invention, the user information collection device 120 is further configured to generate its own device status information and / or its own diagnostic information, and send its own device status information and / or its own diagnostic information to the display module 110 via a wired communication connection.

[0102] The display module 110 is also used to send its own device status information and / or its own diagnostic information to the in-vehicle entertainment system 130 via a wired communication connection.

[0103] In some feasible embodiments, the user information collection device 120 can also generate its own device status information and self-diagnostic information; wherein, the self-device status information may refer to the current device status information of the user information collection device 120, such as: collection angle, collection frequency, etc. The self-diagnostic information may refer to the diagnostic result information generated by the user information collection device 120 after self-diagnosis, which may include log information of the self-diagnosis process, etc., and the embodiments of the present invention do not limit this.

[0104] After generating its own device status information and / or self-diagnostic information, the user information collection device 120 can send its own device status information and / or self-diagnostic information to the display module 110 via a wired communication connection.

[0105] After receiving its own device status information and / or its own diagnostic information, the display module 110 can forward its own device status information and / or its own diagnostic information to the in-vehicle entertainment system 130 via a wired communication connection. This allows the in-vehicle entertainment system 130 to monitor the status of the user information collection device 120 and, in the event of a malfunction in the user information collection device 120, to display the fault to the user based on the self-diagnostic information.

[0106] In one embodiment of the present invention,

[0107] The user information collection device 120 is also used to send authentication information to the server through the in-vehicle entertainment system 130. The authentication information is used to authenticate the user information collection device 120 on the server side. When the server successfully authenticates the user information collection device 120 based on the authentication information, it issues a communication key to the user information collection device 120. The communication key is used to encrypt and decrypt data when the user information collection device 120 interacts with the in-vehicle entertainment system 130 and / or the display module 110.

[0108] In some feasible embodiments, the user information collection device 120 can interact with the server through a communication link composed of the display module 110 and the in-vehicle entertainment system 130 to complete device authentication. The server can be deployed on a local server or a cloud server; this embodiment of the invention does not impose any restrictions on this.

[0109] Specifically, the user information collection device 120 can generate authentication information and send it to the server through the communication link formed by the display module 110 and the in-vehicle entertainment system 130. After receiving the authentication information, the server can authenticate the user information collection device 120 based on it. For example, the authentication information may include the device identifier of the user information collection device 120. Based on this device identifier, the server can determine whether the user information collection device 120 has the permission to connect to the display module 110. If it does, the authentication is successful.

[0110] Upon successful authentication, the server can send a communication key to the user information collection device 120 via the communication link formed by the display module 110 and the in-vehicle entertainment system 130. After receiving the communication key, the user information collection device 120 can use it to encrypt and decrypt the data exchanged with the display module 110 or the in-vehicle entertainment system 130.

[0111] In practical applications, when the user information collection device 120 is a detachable device, even if the user information collection device 120 is disassembled and then reinstalled into the display module 110, normal communication between the user information collection device 120, the display module 110, and the in-vehicle entertainment system 130 can still be achieved based on the communication key. When a device is connected to the display module 110 but does not have a communication key, it cannot interact with the in-vehicle entertainment system 130 and the display module 110, thus ensuring system security.

[0112] In one embodiment of the present invention, the user information collection device 120 is wirelessly connected to the in-vehicle entertainment system 130, and the user information collection device 120 is used to send video data to the in-vehicle entertainment system 130 via the wireless connection.

[0113] In some feasible embodiments, the transmission rate of CAN and other devices in the vehicle is relatively slow; in order to quickly transmit the user information collected by the user information collection device 120 to the in-vehicle entertainment system 130, the user information collection device 120 can transmit the video data it has collected and generated to the in-vehicle entertainment system 130 through a wireless connection.

[0114] In one embodiment of the present invention, the display module 110 is further configured to stop supplying power to the user information collection device 120 when an abnormality is detected in the power supply to the user information collection device 120.

[0115] In some feasible embodiments, the display module 110 can also detect whether there is an abnormality in the power supply to the user information collection device 120; specifically, it can detect the power supply link to the user information collection device 120, for example, by detecting the current of the power supply link and whether the current value exceeds a threshold.

[0116] When an abnormality is detected in the power supply of the user information collection device 120, the display module 110 can stop supplying power to the user information collection device 120 to avoid damage to the user information collection device 120 due to the abnormal power supply.

[0117] For example, when the detected current value exceeds the threshold, the display module 110 can stop supplying power to the user information collection device 120.

[0118] In one embodiment of the present invention, the display module 110 is further configured to stop receiving data uploaded by the user information collection device 120 when the data traffic uploaded by the user information collection device 120 exceeds a threshold.

[0119] In some feasible embodiments, the display module 110 can also be used to detect the data traffic of the data uploaded by the user information collection device 120; when the data traffic exceeds a threshold, the display module 110 can stop receiving the data uploaded by the user information collection device 120 to avoid the display module 110 processing abnormal data.

[0120] For example, such as Figure 3 As shown, the vehicle power supply 140 can supply power to the in-vehicle entertainment system 130 and the display module 110 respectively. The display module 110 can supply power to the user information collection device 1201 based on GND (Ground) and PWR (Power). The display module 110 and the user information collection device 1201 interact with each other by TX (Transmit) and RX (Receive).

[0121] The in-vehicle entertainment system 130 sends video data to be played by the display module 110 to the display module 110 via a video link. Additionally, the in-vehicle entertainment system 130 can also interact with the display module 110 via the CAN FD bus, and further interact with the user information collection device 1201. The user information collection device 1201 can wirelessly transmit video data to the in-vehicle entertainment system 130.

[0122] The data link transmission path is as follows: First, the information is transmitted from the in-vehicle entertainment system 130 to the display module 110MCU via the CANFD bus. Then, the display module 110MCU transmits the information to the user information collection device 1201 via UART. The entire link is bidirectional.

[0123] Users can use this communication link to issue common operation commands such as restart, pause, and resume to the user information collection device 1201. At the same time, the user information collection device 1201 can report its own device status and diagnostic information to the in-vehicle entertainment system 130 through this link, thereby enabling users to effectively control the camera and monitor the device status in real time.

[0124] The MCU of the display module 110 has a heartbeat detection mechanism for its UART communication with the camera. Specifically, the heartbeat packet transmission interval is set to 100 milliseconds. During communication, if the MCU fails to receive an acknowledgment packet from the camera five consecutive times, it determines that the UART communication has failed. At this time, the MCU will send a fault notification message to the in-vehicle entertainment system 130 via the CANFD bus and simultaneously initiate a restart operation for the UART communication. If the UART communication still cannot be restored after three restarts, the UART communication will be shut down.

[0125] In one embodiment of the present invention, the display module 110 is movably disposed on the top of the vehicle interior; the user information collection module 120 is disposed on the display module 110.

[0126] In some feasible embodiments, in order to increase the collection area of ​​the user information collection module 120, the display module 110 can be movably installed on the top of the vehicle interior; for example, the display module 110 can be a ceiling-mounted screen, which can be moved above the first row of seats, or above the second row of seats and the third row of seats.

[0127] The user information collection module 120 can be mounted on the display module 110. For example, the fixed end of the user information collection module 120 can be detachably mounted on the rear shell of the display module 110, or detachably mounted along the rear shell corresponding to the edge of the display module 110. When the display module 110 moves to the top of the vehicle interior, it can move the user information collection module 120 to the top of the vehicle interior, thereby enabling the user information collection module 120 to collect user information from various areas inside the vehicle.

[0128] Based on the control system described above, this embodiment of the invention also provides a control method for a user information collection device, which can be referred to... Figure 4 The diagram illustrates a flowchart of the steps of a control method for a user information collection device according to an embodiment of the present invention.

[0129] like Figure 4 As shown, the method may include the following steps:

[0130] Step 401: With the user information collection device connected to the display module, obtain the usage requirements for the user information collection device.

[0131] When connected to the display module, the user information collection device can first obtain the user's or vehicle's usage needs for the device. For example, if a user needs to use the device, they can perform the corresponding operation; after detecting this operation, the display module can determine that there is a current usage need for the device.

[0132] Step 402: Power the user information collection device when needed.

[0133] After obtaining the usage requirements for the user information collection device, power can be supplied to the device based on these requirements. For example, when the usage requirement is "the user information collection device needs to be used," power can be supplied to the device. Conversely, if the usage requirement is "it does not need to be used," power can be withheld from the device, thereby extending its lifespan.

[0134] In one embodiment of the present invention, the usage requirements for the user information collection device can be obtained in the following manner:

[0135] Sub-step 11: Determine the working status of the display module of the control system.

[0136] In some feasible embodiments, the operating state of the display module of the control system can be determined first; wherein, the operating state may include a dormant operating state and an active operating state.

[0137] Sub-step 12: When the display module is in the working state, determine that there is a demand for the use of user information collection equipment.

[0138] If the display module is determined to be in a dormant state, then there is no current demand for the user information collection device; the demand is "not required to use the user information collection device." Conversely, if the display module is determined to be in an active state, then there is a current demand for the user information collection device; the demand is "required to use the user information collection device."

[0139] In another embodiment of the present invention, the usage requirements for the user information collection device can also be obtained in the following manner:

[0140] Sub-step 21: Upon receiving a power supply control command for the user information collection device, determine that there is a demand for the user information collection device; wherein, the power supply control command is a command to supply power to the user information collection device based on user operation.

[0141] In some feasible embodiments, if a user needs to invoke a user information collection device to collect information about users inside the vehicle, the corresponding user operation can be performed in the in-vehicle entertainment system to generate a power supply control command for powering the user information collection device.

[0142] After generating a power supply control command, the in-vehicle entertainment system can send it to the display module. Upon receiving the power supply control command for the user information collection device, the display module can determine that there is a current demand for the user information collection device and respond to the power supply control command by supplying power to the user information collection device.

[0143] In one embodiment of the present invention, the above method may further include the following steps:

[0144] Send a heartbeat packet to the user information collection device and receive an acknowledgment packet in response to the heartbeat packet from the user information collection device; if no acknowledgment packet is received from the user information collection device for N consecutive times, issue an error message.

[0145] In some feasible embodiments, a heartbeat detection mechanism is provided between the display module and the user information collection device; specifically, the display module can send heartbeat packets to the user information collection device, and the sending interval of the heartbeat packets can be set according to the actual situation.

[0146] After receiving a heartbeat packet, the user information collection device can send an acknowledgment packet to the display module. In practical applications, if the display module fails to receive an acknowledgment packet from the user information collection device N times consecutively, the display module can determine that the user information collection device is malfunctioning, or that there is a communication failure between the display module and the user information collection device.

[0147] At this point, the display module can provide an error message; specifically, it can send a fault notification to the in-vehicle entertainment system to inform the user information collection device of the in-vehicle entertainment system or the communication link between the display module and the user information collection device that there is a fault. Upon receiving this fault notification, the in-vehicle entertainment system can display the user information to the in-vehicle user so that the user is promptly informed of any malfunctions in the user information collection device.

[0148] In one embodiment of the present invention, the above method may further include the following steps:

[0149] When an error message is displayed, communication with the user information collection module is restarted; if no confirmation packet is received from the user information collection device after M consecutive restarts of communication with the user information collection module, communication with the user information collection module is closed.

[0150] In some feasible embodiments, when the display module issues an error message, it can also restart the wired communication connection between the display module and the user information collection device.

[0151] After restarting the wired communication connection with the user information collection device M times, if the display module still does not receive an acknowledgment packet from the user information collection device, the display module can determine that the wired communication connection cannot be restored to normal. At this time, the display module can close the wired communication connection with the user information collection device. By restarting first, fault recovery can be performed to a certain extent, thereby improving the intelligence of the control system.

[0152] In one embodiment of the present invention, the above method may further include the following steps:

[0153] When an abnormality is detected in the power supply to the user information collection device, power supply to the user information collection device is stopped.

[0154] In some feasible embodiments, the display module can also detect whether there is an abnormality in the power supply to the user information collection device; specifically, it can detect the power supply link to the user information collection device, for example, by detecting the current of the power supply link and whether the current value exceeds a threshold.

[0155] When an abnormality is detected in the power supply of the user information collection device, the display module can stop supplying power to the user information collection device to avoid damage caused by the abnormal power supply.

[0156] For example, when the detected current value exceeds the threshold, the display module can stop supplying power to the user information collection device.

[0157] In one embodiment of the present invention, the above method may further include the following steps:

[0158] When the data traffic uploaded by the user information collection device exceeds the threshold, the reception of data uploaded by the user information collection device will be stopped.

[0159] In some feasible embodiments, the display module can also be used to detect the data traffic of the data uploaded by the user information collection device; when the data traffic exceeds a threshold, the display module can stop receiving the data uploaded by the user information collection device to avoid the display module processing abnormal data.

[0160] In one embodiment of the present invention, the user information collection device can interact with the server through a communication link consisting of the display module and the in-vehicle entertainment system to complete device authentication. Specifically, the user information collection device can generate authentication information and send it to the server through the communication link between the display module and the in-vehicle entertainment system. After receiving the authentication information, the server can authenticate the user information collection device based on the authentication information. For example, the authentication information may include the device identifier of the user information collection device. Based on the device identifier, the server can determine whether the user information collection device has the permission to connect to the display module. If it does, the authentication is successful.

[0161] Upon successful authentication, the server can send a communication key to the user information collection device via the communication link formed by the display module and the in-vehicle entertainment system. After receiving the communication key, the user information collection device can use it to encrypt and decrypt the data exchanged with the display module or the in-vehicle entertainment system.

[0162] In practical applications, when the user information collection device is detachable, even if it is disassembled and then reinstalled on the display module, normal communication between the user information collection device, the display module, and the in-vehicle entertainment system can still be achieved based on the communication key. When a device is connected to the display module but lacks the communication key, it cannot interact with the in-vehicle entertainment system and the display module, thus ensuring system security.

[0163] In this embodiment of the invention, when the user information collection device is connected to the display module, the usage requirements for the user information collection device are obtained; based on the usage requirements, power is supplied to the user information collection device. Through this embodiment of the invention, the power supply to the user information collection device can be controlled via the display module, thereby extending the service life of the user information collection device.

[0164] It should be noted that, for the sake of simplicity, the method embodiments are all described as a series of actions. However, those skilled in the art should understand that the embodiments of the present invention are not limited to the described order of actions, because according to the embodiments of the present invention, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions involved are not necessarily essential to the embodiments of the present invention.

[0165] Reference Figure 5 The diagram shows a structural schematic of a control device for a user information collection device according to an embodiment of the present invention, which may include the following modules:

[0166] The detection module 501 is used to obtain the usage requirements for the user information collection device when the user information collection device is connected to the display module.

[0167] The power supply module 502 is used to supply power to the user information collection device according to usage requirements.

[0168] In some embodiments of the present invention, the detection module 501 is used to determine the working state of the display module of the control system; when the display module is in the working state of being turned on, it is determined that there is a demand for the use of the user information collection device.

[0169] In some embodiments of the present invention, the detection module 501 is used to determine that there is a demand for the user information collection device when a power supply control command for the user information collection device is received; wherein, the power supply control command is a command to supply power to the user information collection device based on user operation.

[0170] In some embodiments of the present invention, the apparatus further includes:

[0171] The error message module is used to send heartbeat packets to the user information collection device and receive confirmation packets for the heartbeat packets returned by the user information collection device; when no confirmation packets are received from the user information collection device for N consecutive times, an error message is displayed.

[0172] In some embodiments of the present invention, the apparatus further includes:

[0173] The communication shutdown module is used to restart communication with the user information collection module when an abnormality is detected; and to shut down communication with the user information collection module if no confirmation packet is received from the user information collection device after restarting communication with the user information collection module M times consecutively.

[0174] In some embodiments of the present invention, the apparatus further includes:

[0175] The power supply stop module is used to stop supplying power to the user information collection device when an abnormality is detected in the power supply to the user information collection device.

[0176] In some embodiments of the present invention, the apparatus further includes:

[0177] The data transmission stop module is used to stop receiving data uploaded by the user information collection device when the data traffic exceeds a threshold.

[0178] In this embodiment of the invention, when the user information collection device is connected to the display module, it detects whether there is a demand for the use of the user information collection device; when there is a demand, it supplies power to the user information collection device. Through this embodiment, the power supply to the user information collection device can be controlled via the display module, thereby extending the service life of the user information collection device.

[0179] This invention also provides a vehicle including the control system described above, the control system being used to implement the control method for the user information collection device described above.

[0180] This invention also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the above-described control method for a user information collection device.

[0181] As the apparatus embodiment is basically similar to the method embodiment, it is described in a relatively simple manner. For relevant details, please refer to the description of the method embodiment.

[0182] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other.

[0183] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, apparatus, or computer program products. Therefore, embodiments of the present invention can take the form of entirely hardware embodiments, entirely software embodiments, or embodiments combining software and hardware aspects. Furthermore, embodiments of the present invention can take the form of computer program products implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0184] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing terminal device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal device, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0185] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing terminal device to operate in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0186] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal equipment, causing a series of operational steps to be performed on the computer or other programmable terminal equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable terminal equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0187] Although preferred embodiments of the present invention have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments as well as all changes and modifications falling within the scope of the embodiments of the present invention.

[0188] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or terminal device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or terminal device. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or terminal device that includes said element.

[0189] The foregoing has provided a detailed description of the control system based on a display module, a control method for a user information collection device, a control device for a user information collection device, a vehicle, and a computer-readable storage medium. Specific examples have been used to illustrate the principles and implementation methods of the invention. The descriptions of the embodiments above are only for the purpose of helping to understand the method and core ideas of the invention. Furthermore, those skilled in the art will recognize that, based on the ideas of the invention, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of the invention.

Claims

1. A control system based on a display module, characterized in that, The control system includes a user information collection device and a vehicle display module; the vehicle display module is electrically connected to the vehicle's power supply; the user information collection device is electrically connected to the display module, and the user information collection device is detachably connected to the display module; wherein: The user information collection device is used to collect user information from the users in the vehicle. The display module is used to supply power to the user information collection device when there is a need to use the user information collection device.

2. The control system according to claim 1, characterized in that, The display module is movably connected to the vehicle, and a mounting block is provided on the display module. The user information collection device is detachably mounted on the mounting block. The display module is used to determine, when the display module is turned on, whether there is a need to use the user information collection device.

3. The control system according to any one of claims 1-2, characterized in that, The control system also includes: an in-vehicle entertainment system; The in-vehicle entertainment system is communicatively connected to the display module; the in-vehicle entertainment system is used to send a second control command to the display module in response to a first control command for the user information collection device; The display module is used to control the user information collection device when it receives the second control command.

4. The control system according to claim 3, characterized in that, The in-vehicle entertainment system is connected to the display module via wired communication, and the display module is connected to the user information collection device via wired communication. The user information collection device is used to interact with the display module via a wired communication connection; The display module is used to interact with the in-vehicle entertainment system via a wired communication connection.

5. The control system according to claim 4, characterized in that, The user information collection device is wirelessly connected to the in-vehicle entertainment system; the user information collection device is used to send video data to the in-vehicle entertainment system via wireless connection.

6. The control system according to claim 4, characterized in that, The display module is also used to send a heartbeat packet to the user information collection device via a wired communication connection, and to receive an acknowledgment packet for the heartbeat packet returned by the user information collection device via a wired communication connection; when the acknowledgment packet returned by the user information collection device is not received for N consecutive times, a fault notification message is sent to the in-vehicle entertainment system via a wired communication connection; where N is a positive integer.

7. The control system according to claim 6, characterized in that, The display module is further configured to restart the wired communication connection with the user information collection device when sending the fault notification information to the in-vehicle entertainment system; and to close the wired communication connection with the user information collection device after restarting the wired communication connection with the user information collection device M times consecutively without receiving the confirmation packet returned by the user information collection device; wherein M is a positive integer.

8. The control system according to claim 4, characterized in that, The user information collection device is also used to generate its own device status information and / or its own diagnostic information, and send the own device status information and / or the self-diagnostic information to the display module through a wired communication connection; The display module is also used to send its own device status information and / or its own diagnostic information to the in-vehicle entertainment system via a wired communication connection.

9. The control system according to claim 3, characterized in that, The user information collection device is also used to send authentication information to the server through the in-vehicle entertainment system. The authentication information is used to authenticate the user information collection device on the server. When the server successfully authenticates the user information collection device based on the authentication information, it issues a communication key to the user information collection device. The communication key is used for data encryption and decryption when the user information collection device interacts with the in-vehicle entertainment system and / or the display module.

10. The control system according to any one of claims 1-2, characterized in that, The display module is movably mounted on the top of the vehicle interior; the user information collection module is mounted on the display module.

11. A control method for a user information collection device, characterized in that, Applied in a control system as described in any one of claims 1-10; the method comprises: When the user information collection device is connected to the display module, the usage requirements for the user information collection device are obtained. Based on the aforementioned usage requirements, power is supplied to the user information collection device.

12. The method according to claim 11, characterized in that, The process of obtaining usage requirements for the user information collection device includes: Determine the operating status of the display module of the control system; When the display module is in the working state, it is determined that there is a demand for the use of the user information collection device.

13. The method according to any one of claims 11-12, characterized in that, The process of obtaining usage requirements for the user information collection device includes: Upon receiving a power supply control command for the user information collection device, it is determined that there is a demand for the user information collection device; wherein, the power supply control command is a command to supply power to the user information collection device based on user operation.

14. The method according to any one of claims 11-13, characterized in that, The method further includes: Send a heartbeat packet to the user information collection device and receive an acknowledgment packet for the heartbeat packet returned by the user information collection device; If the user information collection device fails to return the confirmation packet N times consecutively, an error message will be displayed.

15. The method according to claim 14, characterized in that, The method further includes: When an error is detected, communication with the user information collection module is restarted. If no confirmation packet is received from the user information collection device after M consecutive restarts of communication with the user information collection module, then communication with the user information collection module is closed.

16. The method according to any one of claims 11-15, characterized in that, The method further includes: When an abnormality is detected in the power supply to the user information collection device, the power supply to the user information collection device is stopped.

17. The method according to any one of claims 11-16, characterized in that, The method further includes: When the data traffic uploaded by the user information collection device exceeds the threshold, the reception of data uploaded by the user information collection device will be stopped.

18. A control device for a user information collection equipment, characterized in that, Applied in a control system as described in any one of claims 1-10; the device comprises: The detection module is used to obtain the usage requirements for the user information collection device when the user information collection device is connected to the display module. The power supply module is used to supply power to the user information collection device based on the usage requirements.

19. A vehicle, characterized in that, The system includes the control system as described in any one of claims 1-10, wherein the control system is used to implement the control method for the user information collection device as described in any one of claims 11-17.

20. A computer-readable storage medium, characterized in that, A computer program is stored on the computer-readable storage medium, and when executed by a processor, the computer program implements the control method of the user information collection device as described in any one of claims 11-17.

Images