Vehicle electric control table board method and device and vehicle

Abstract

The invention relates to the field of vehicle table board control, in particular to a vehicle table board electric control method and device and a vehicle. The monitoring operation on the rear-row electric table board is detected, the monitoring function can be actively started, and the blank that a driver cannot monitor the use state of the rear-row table board is filled. And the rear-row cameras are called to record video pictures, so that a detailed basis is provided for accurately analyzing the use behaviors of the passengers. The use behavior is analyzed based on the video picture, and the dangerous behavior can be accurately identified. And once the dangerous behavior is identified, the corresponding target control strategy is obtained and executed, so that effective reverse control of the rear-row electric table board is realized. Therefore, a driver does not need to turn the head to pay attention to the back row all the time, and misoperation of passengers can be stopped in time in the driving process. For example, when a passenger may cause a hand pinching danger due to misoperation, the system can quickly respond and control the table plate according to the target control strategy, so that the injury condition is avoided, and the safety of the passenger in the back row in the driving process is comprehensively guaranteed.

Description

Technical Field

[0001] The present invention relates to the field of vehicle table top control, and in particular to a vehicle electric control table top method, device and vehicle. Background Art

[0002] As consumers use cars in increasingly diverse scenarios, the interior of the car is no longer just a simple driving space, and the demand for entertainment, office, dining and other diversified scenarios is booming. Especially in the back row of a five-seater car, passengers expect to handle work affairs conveniently or have a comfortable meal while driving. The emergence of a small table has become an ideal carrier that meets the needs of such diversified scenarios. It is arranged behind the backrest of the front seat, providing a stable and practical operating surface for the rear passengers, greatly expanding the functionality of the interior space.

[0003] The small car table in the prior art is mainly used for rear passengers, which makes it impossible for the driver to monitor its usage status and difficult to perform reverse control operations, so that it is impossible to effectively prevent passengers from operating it incorrectly or getting their hands pinched and injured due to improper operation during driving. Summary of the invention

[0004] In view of this, an embodiment of the present invention provides a vehicle electronically controlled table method, device and vehicle to solve the problem that the driver can neither monitor the usage status of the rear table nor perform reverse control operations, so that it is impossible to effectively prevent passengers from operating incorrectly or getting their hands pinched and injured due to improper operation during driving.

[0005] In a first aspect, an embodiment of the present invention provides a method for controlling an electric table top of a vehicle, the method comprising:

[0006] Detecting monitoring operations triggered in the vehicle for the rear electric table;

[0007] In response to the monitoring operation, a camera deployed in the rear row of the vehicle is called to record a video of passengers in the rear row of the vehicle using the rear electric table top;

[0008] Analyze the video screen to obtain the passenger's usage behavior of the rear electric table board;

[0009] If the usage behavior is a dangerous behavior, the target control strategy corresponding to the usage behavior is obtained, and the rear electric table top is controlled to perform the operation indicated by the target control strategy.

[0010] Furthermore, after calling a camera deployed in the rear row of the vehicle to collect a video image of the rear electric table board from the passengers in the rear row of the vehicle, the method further includes:

[0011] Extracting multiple key areas corresponding to the rear electric table from the video screen;

[0012] Determine the importance of the corresponding key area based on the behavioral characteristics of the passenger in each key area, and determine the target scaling ratio corresponding to the importance based on the mapping relationship between the preset importance and the scaling ratio;

[0013] The key area in the video image is scaled according to the target scaling ratio, and the scaled video image is displayed on the central control screen of the vehicle.

[0014] Furthermore, after displaying the zoomed video image on the central control screen of the vehicle, the method further includes:

[0015] detecting a vehicle state of the vehicle and a passenger state of the passenger;

[0016] Analyzing whether the vehicle status and the passenger status meet the recording stop condition;

[0017] If the recording stop condition is met, a recording stop instruction is sent to the camera, and a desktop usage video consisting of the recorded video images is stored.

[0018] Furthermore, the analyzing the video screen to obtain the passenger's use behavior of the rear electric table top includes:

[0019] Extracting the motion features of the passenger from the video picture, and extracting the morphological features of the rear electric table from the video picture;

[0020] Calculating the matching degree between the action feature, the morphological feature and the behavior feature corresponding to each preset behavior;

[0021] The preset behavior with the highest matching degree is used as the passenger's usage behavior of the rear electric table.

[0022] Furthermore, the obtaining of the target control strategy corresponding to the usage behavior and controlling the rear electric table to perform the operation indicated by the target control strategy includes:

[0023] Acquire a target control strategy library, wherein the target control strategy library includes target control strategies corresponding to different dangerous behaviors;

[0024] Querying the target dangerous behavior hit by the use behavior from the target control strategy library, and determining the original control strategy corresponding to the target dangerous behavior;

[0025] Detecting the environmental conditions of the vehicle's current driving environment;

[0026] Analyze whether there are safety hazards when controlling the rear electric table according to the original control strategy under the environmental conditions;

[0027] If there is a potential safety hazard, determining the key link in the original control strategy that causes the potential safety hazard, and updating the key link in the original control strategy based on the environmental conditions to obtain the target control strategy;

[0028] Obtain the table control component associated with the target control strategy, and send the target control strategy to the corresponding table control component, so that the table control component controls the rear electric table to perform corresponding operations according to the target control strategy.

[0029] Furthermore, the obtaining of the target control strategy corresponding to the usage behavior and controlling the rear electric table to perform the operation indicated by the target control strategy includes:

[0030] Acquire multiple candidate control strategies associated with the usage behavior, and display the candidate control strategies on the central control screen of the vehicle;

[0031] Detecting a touch operation on the central control screen;

[0032] In response to the touch operation, determining the selected candidate control strategy as the target control strategy;

[0033] Obtain the table control component associated with the target control strategy, and send the target control strategy to the corresponding table control component, so that the table control component controls the rear electric table to perform corresponding operations according to the target control strategy.

[0034] Furthermore, the method further comprises:

[0035] If the usage behavior is not a dangerous behavior, predicting the passenger's critical behavior at the next moment based on the usage behavior, and analyzing the degree of danger of the critical behavior;

[0036] If the danger level is greater than a preset level, a warning message is sent to the driver of the vehicle;

[0037] Obtain the control instruction of the driver based on the warning information feedback, and control the rear electric table panel to perform the operation indicated by the control instruction.

[0038] Furthermore, the method further comprises:

[0039] If the risk level is less than the preset level, obtaining a historical behavior matching the use behavior from the candidate historical behaviors of the passenger;

[0040] Obtaining the desktop usage corresponding to the historical behavior to determine the usage demand corresponding to the usage behavior;

[0041] The rear electric table top is controlled to perform corresponding operations according to the usage requirements.

[0042] In a second aspect, an embodiment of the present invention provides a control device for an electric table top of a vehicle, the device comprising:

[0043] A detection module, used to detect a monitoring operation triggered in the vehicle with respect to the rear electric table;

[0044] A response module, used to respond to the monitoring operation and call a camera deployed in the rear row of the vehicle to collect a video of the passengers in the rear row of the vehicle using the rear electric table;

[0045] An analysis module, used for analyzing the video image to obtain the passenger's usage behavior of the rear electric table board;

[0046] The control module is used to obtain the control strategy corresponding to the usage behavior if the usage behavior is a dangerous behavior, and control the rear electric table to perform the operation indicated by the control strategy.

[0047] In a third aspect, an embodiment of the present invention provides a vehicle, comprising: a memory and a processor, the memory and the processor being communicatively connected to each other, the memory storing computer instructions, and the processor executing the method of the first aspect or any corresponding embodiment thereof by executing the computer instructions.

[0048] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium having computer instructions stored thereon, the computer instructions being used to enable a computer to execute the method of the first aspect or any corresponding embodiment thereof.

[0049] This application can actively turn on the monitoring function by detecting the monitoring operation of the rear electric table, filling the gap that the driver cannot monitor the usage status of the rear table. Calling the rear camera to record the video screen provides a detailed basis for accurately analyzing the passenger's usage behavior. Based on the analysis of usage behavior based on the video screen, dangerous behavior can be accurately identified. Once the dangerous behavior is identified, the corresponding target control strategy is obtained and executed to achieve effective counter-control of the rear electric table. In this way, the driver does not need to turn his head to pay attention to the back row all the time, and can stop the passenger's misoperation in time during driving. For example, when a passenger may cause a risk of pinching his hand due to improper operation, the system can respond quickly and control the table according to the target control strategy to avoid injuries, thereby fully ensuring the safety of the rear passengers during driving. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0051] Figure 1 is a schematic flow chart of a vehicle electronic control table method according to some embodiments of the present invention;

[0052] Figure 2 is a flow chart of another vehicle electronic control table method according to some embodiments of the present invention;

[0053] Figure 3 is a flow chart of another vehicle electric control table method according to some embodiments of the present invention;

[0054] Figure 4 is a structural block diagram of a vehicle electric control table device according to an embodiment of the present invention;

[0055] Figure 5 It is a schematic diagram of the hardware structure of the electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0056] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0057] According to an embodiment of the present invention, a vehicle electronic control table method, device and vehicle are provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0058] In this embodiment, a vehicle electric control table method is provided. Figure 1 is a flow chart of a vehicle electric control table method according to an embodiment of the present invention. Figure 1 As shown, the process includes the following steps:

[0059] Step S101, detecting a monitoring operation on a rear electric table top triggered in a vehicle.

[0060] In the embodiment of the present application, after the camera function APP interface on the car's large screen is clicked and opened by the driver (this operation can be compared to the way of opening the mobile phone APP in daily life, and is realized by touching the corresponding icon on the large screen), two soft switch options of monitoring and reverse control will be presented (these two options have a specially designed HMI interface, which is convenient for the driver to intuitively distinguish and select). At this time, the system will monitor the driver's operation selection of these two soft switches in real time. When the driver clicks and selects the monitoring soft switch option, it means that the monitoring operation for the rear electric table board is detected. This selection action will be received by the car's entertainment host controller, and then trigger the subsequent related processes, which is equivalent to sending a start signal to the entire monitoring process.

[0061] Step S102, in response to the monitoring operation, calls a camera deployed at the rear row of the vehicle to record a video of passengers at the rear row of the vehicle using the rear electric table.

[0062] In an embodiment of the present application, when it is detected that the driver has selected the monitoring soft switch, it will immediately trigger a switch signal, which is used to retrieve the OMC camera image request. After receiving the request, the lens unfolding and retracting mechanism of the OMC camera begins to operate (just like the camera lens is extended to prepare for shooting), so that the camera enters a ready state for shooting, and the camera is started at this time. Then, the system will first determine the OMC camera permissions (covering storage, location, MIC and other aspects of permissions). If the camera permissions are in an authorized state (for example, it has been authorized before, allowing this use or allowing use within one year, etc.), then the OMC camera can be successfully called to perform recording. When the passengers in the back row of the vehicle are using the electric small table, the OMC camera starts to collect the corresponding pictures, and feeds back the collected video stream information to the DHU controller through the LVDS communication protocol, thereby completing the recording and acquisition process of the video picture, and providing original materials for subsequent analysis.

[0063] Step S103, analyzing the video footage to obtain the passengers' usage behavior of the rear electric table top.

[0064] In the embodiment of the present application, analyzing the video screen to obtain the passenger's use behavior of the rear electric table includes the following steps A1-A3:

[0065] Step A1, extracting the motion features of the passengers from the video image, and extracting the morphological features of the rear electric table from the video image.

[0066] Specifically, after receiving the video image, the built-in image analysis algorithm is used to start processing. First, for each frame in the video image (or sampling at intervals of a certain number of frames, depending on the specific algorithm strategy and accuracy requirements), the area where the passenger is located in the image is locked, and the passenger's body parts, such as hands, arms, body and other key parts, are identified. By analyzing the position changes and angle changes of these parts between consecutive frames, action features such as the movement trajectory of the hand (whether it is a straight line movement, arc movement or other trajectory), the extension or bending angle changes of the limbs, the body rotation direction and amplitude, etc. are extracted. For example, if the passenger's hand in the picture makes a translational movement from one side of the table to the other side, and the arm has a corresponding extension movement, the specific parameters of the hand translation and arm extension are recorded as part of the action features.

[0067] Similarly, for each frame, focus on the image part of the electric table top to identify key elements such as the outline of the table top and the relative position of each component. By analyzing the changes of these elements over time, morphological features are extracted, such as the opening and closing angle of the table top (for example, the table top is lifted up from a horizontal state to a certain angle, and this angle value is an important parameter of the morphological feature), the extended length (if the table top has a retractable function, the length data of its extension or shortening), and the overall flatness (whether there is a tilt, etc.). For example, the opening and closing angle of the table top can be calculated through the angle between the edge line of the table top in the image and the reference line, and this can be recorded as a morphological feature in preparation for subsequent analysis.

[0068] Step A2, calculating the matching degree between the action feature and the morphological feature and the behavior feature corresponding to each preset behavior.

[0069] Specifically, based on a large number of actual usage scenarios in the past and standard behavior patterns set by humans, multiple preset behaviors and their corresponding behavior feature libraries have been established. For example, the preset behaviors include "opening the table normally", "closing the table normally", "adjusting the height of the table", "forcibly pushing and pulling the table when it is stuck", and other different situations. For the preset behavior of "opening the table normally", the corresponding behavior feature may be that the passenger's hand has an upward pulling action, and the opening and closing angle of the table gradually increases from the initial 0 degrees to a certain angle, and the overall shape of the table is stable without abnormal shaking, etc.; for "closing the table normally", the hand has a downward pressing action, and the opening and closing angle of the table gradually decreases, etc.

[0070] The extracted motion features of the current passenger and the morphological features of the electric table are compared and analyzed with the behavioral features corresponding to each preset behavior. Use a suitable mathematical algorithm to calculate the matching degree. For example, you can use the vector space model to regard each feature as a dimension in the vector space, calculate the cosine similarity between the currently extracted feature vector and the preset behavior feature vector, and obtain a similarity value as the matching degree; or use a distance-based measurement method, such as calculating the Euclidean distance. The closer the distance, the higher the matching degree (the distance value can be converted into a representation of the matching degree through a certain conversion, such as when the distance is 0, the matching degree is 100%, and the larger the distance, the lower the matching degree). For each preset behavior, the corresponding matching degree value is calculated in this way, thereby obtaining a set of matching degree results corresponding to different preset behaviors.

[0071] Step A3, taking the preset behavior with the highest matching degree as the passenger's usage behavior of the rear electric table.

[0072] Specifically, after obtaining the matching degree values ​​corresponding to each preset behavior, these values ​​are compared to find the preset behavior corresponding to the one with the largest matching degree. For example, after calculation, the matching degree corresponding to the preset behavior of "normal opening of the table board" is 80%, the matching degree corresponding to "normal closing of the table board" is 60%, the matching degree corresponding to "adjusting the height of the table board" is 30%, etc. Then, the "normal opening of the table board" with the highest matching degree is identified as the current passenger's use behavior of the rear electric table board, so as to judge how the passenger is specifically operating the electric table board, and provide a basis for subsequent further decisions (such as whether there is a dangerous behavior that requires intervention, etc.).

[0073] Step S104, if the use behavior is a dangerous behavior, obtain the target control strategy corresponding to the use behavior, and control the rear electric table to perform the operation indicated by the target control strategy.

[0074] In the embodiment of the present application, obtaining the target control strategy corresponding to the usage behavior and controlling the rear electric table to perform the operation indicated by the target control strategy includes the following steps B1-B6:

[0075] Step B1, obtaining a target control strategy library, wherein the target control strategy library includes target control strategies corresponding to different dangerous behaviors.

[0076] Specifically, the target control strategy library has been built and stored by the vehicle manufacturer or relevant technical team based on a large number of actual tests, simulations and analysis of the use scenarios of the rear electric table in the vehicle. This library can be regarded as a database or data set, which contains information of many entries, each of which corresponds to a possible dangerous behavior, such as "the risk of pinching the hand due to the rapid opening and closing of the table", "the tilt and imbalance of the table due to excessive leaning of the passenger", "the abnormal shaking of the table during bumpy driving", etc., and for each dangerous behavior, a corresponding control strategy is formulated in detail. For example, the control strategy for "the risk of pinching the hand due to the rapid opening and closing of the table" may be to immediately suspend the opening and closing action of the table, issue an alarm to remind the driver, etc. The relevant control modules of the vehicle (such as the module responsible for managing the control logic of the rear electric table) can obtain this complete target control strategy library from the vehicle's storage system through a specific access interface or data call instruction, so as to prepare for the subsequent search for matching strategies.

[0077] Step B2, querying the target dangerous behavior hit by the use behavior from the target control strategy library, and determining the original control strategy corresponding to the target dangerous behavior.

[0078] Specifically, after analyzing the passenger's use behavior of the rear electric table through the previous steps (for example, it has been determined that the passenger has the behavior of quickly and vigorously pushing the table to open and close), the system will compare this use behavior with the various dangerous behaviors recorded in the target control strategy library one by one. This comparison process may be determined by analyzing whether the characteristics of the use behavior (such as the strength, speed, state change of the table, etc.) match the characteristics of each dangerous behavior definition. Once it is found that the current use behavior meets the description of a dangerous behavior in the target control strategy library, it means that the target dangerous behavior has been "hit". For example, the opening and closing speed of the table in the use behavior exceeds the normal safety threshold, and matches the characteristics of the dangerous behavior of "the table opens and closes quickly, causing the risk of pinching the hand". Then, the original control strategy corresponding to the dangerous behavior is determined, that is, the relevant strategy content of specific control measures such as pausing the table action and issuing an alarm for the "fast opening and closing of the table causing the risk of pinching the hand" that was previously formulated for "the table opens and closes quickly, causing the risk of pinching the hand".

[0079] Step B3, detecting the environmental conditions of the vehicle's current driving environment.

[0080] Specifically, the vehicle is equipped with a variety of sensors to obtain information related to the driving environment. For example, the speed sensors installed around the vehicle body can monitor the vehicle's driving speed in real time, the vibration sensors on the chassis can sense the bumpiness of the road, the light sensors can determine whether it is daytime or nighttime and the light intensity, and the meteorological sensors installed on the outside of the vehicle body can detect whether there are weather conditions such as rain, snow, fog, etc. These sensors will continuously collect data and transmit the data to the vehicle's processing unit or related environmental monitoring modules. Then, the processing unit will integrate the data from these different sensors to form a comprehensive understanding of the vehicle's current driving environment, such as concluding that the vehicle is currently driving at a speed of 80 kilometers per hour on a slightly bumpy road, and is in the daytime but the sunlight is strong.

[0081] Step B4, analyzing whether there are safety hazards when controlling the rear electric table top according to the original control strategy under environmental conditions.

[0082] Specifically, based on the current driving environment of the vehicle, analysis is performed in combination with the original control strategy that has been determined. For example, the original control strategy is to immediately suspend the opening and closing of the table. If the current vehicle is in a high-speed driving state, suddenly suspending the table movement may cause the passengers in the car to accidentally collide due to inertia, or if the road is severely bumpy, directly suspending the action may cause other structural damage to the table due to vibration. In this case, it can be determined that there is a safety hazard in controlling the rear electric table according to the original control strategy under such an environment; on the contrary, if the environment is relatively stable and the execution of the original strategy will not cause other adverse consequences, it is considered that there is no safety hazard. This analysis process requires comprehensive consideration of the possible impact of environmental factors and the original strategy on the table, passengers in the car, and overall driving safety.

[0083] Step B5: If there is a potential safety hazard, determine the key link in the original control strategy that causes the potential safety hazard, and update the key link in the original control strategy based on the environmental conditions to obtain a target control strategy.

[0084] Specifically, when it is determined that there is a safety hazard, carefully sort out each link of the original control strategy. For example, the original control strategy is "after receiving a danger signal, immediately stop the operation of the table motor, and at the same time, issue an alarm on the large screen inside the car." After analysis, it is found that the link of "immediately stop the operation of the table motor" is easy to cause passengers to collide with the table or other parts of the car due to inertia under the current environment of high-speed vehicle driving and bumpy road conditions, so it is determined that this is the key link that causes safety hazards. Then, it is updated according to environmental conditions. For example, it can be changed to "after receiving a danger signal, first gradually reduce the operating speed of the table motor to make it stop slowly, and at the same time issue an alarm on the large screen inside the car, and dynamically adjust the motor's braking force according to the bumpy conditions of the vehicle to ensure that the table stops smoothly." Through such adjustment and optimization of key links, a new target control strategy that is more suitable for the current environmental conditions is formed to avoid possible safety hazards.

[0085] Step B6, obtain the table control component associated with the target control strategy, and send the target control strategy to the corresponding table control component, so that the table control component controls the rear electric table to perform corresponding operations according to the target control strategy.

[0086] Specifically, the vehicle's control system has a clear architecture and component association relationship, and will clearly record the specific execution components corresponding to each control strategy. For the control of the rear electric table, the relevant table control components may include a motor driver that controls the operation of the table motor, a controller corresponding to the mechanical transmission device that adjusts the angle and position of the table, etc. By querying the system's configuration information or component association table, the table control components associated with the target control strategy can be accurately obtained. After that, the updated target control strategy is sent to the corresponding table control components through the vehicle's internal communication bus (such as the CAN bus) in a specific data format (such as a control instruction set). After receiving the instructions, these table control components will drive the corresponding motors, transmission devices and other components according to the requirements of the target control strategy to control the rear electric table to perform corresponding operations such as slow stop and adjustment to a specific safe position, thereby achieving reasonable control of dangerous behaviors and ensuring safety in the vehicle.

[0087] As an example, first obtain the target control strategy library containing various strategies corresponding to dangerous behaviors, and query the original control strategy that matches the dangerous behavior of quickly opening and closing the table, that is, immediately stop the movement of the table. At this time, the system detects that the vehicle is driving on a bumpy road at high speed. After analysis, directly stopping the movement of the table in this environment may cause the table to be damaged due to sudden force caused by the shaking of the vehicle, which poses a safety hazard. Therefore, it is determined that there is a problem with the key link of "immediately stop the movement of the table" in the original strategy. Based on the current environmental conditions, this link is updated to "first reduce the speed of the table movement, and then gradually stop after the vehicle is driving smoothly", so as to obtain a new target control strategy. Finally, the system obtains the table motor control component associated with this strategy and sends the updated target control strategy to it. According to the new strategy, the motor control component controls the rear electric table to slow down first and then stop smoothly, avoiding potential dangers.

[0088] In the embodiment of the present application, obtaining the target control strategy corresponding to the usage behavior and controlling the rear electric table to perform the operation indicated by the target control strategy includes the following steps C1-C4:

[0089] Step C1, obtaining multiple candidate control strategies associated with the usage behavior, and displaying the candidate control strategies on the central control screen of the vehicle.

[0090] Specifically, after analyzing the specific use behavior of the passenger on the rear electric table (for example, determining that the passenger is adjusting the height of the table), the vehicle's control system will search for all possible control strategies associated with the use behavior based on pre-set strategy association rules. These control strategies are usually formulated in advance by vehicle manufacturers based on comprehensive factors such as different usage scenarios, safety requirements, and table functional characteristics, and stored in the vehicle's control strategy database. For example, for the use behavior of "adjusting the height of the table", the associated candidate control strategies may include "raising the table to the specified height at a normal speed", "raising the table slowly in stages to ensure stability", "pausing the current raising operation and prompting the passenger to confirm again", and so on.

[0091] Then, the vehicle's central control system will display these candidate control strategies in an intuitive and clear form on the vehicle's central control screen. It may be presented in the form of a list, with each strategy having a simple text description to facilitate the driver to understand its general content; or a graphical interface is used to display each candidate control strategy with different icons and text descriptions, such as an upward arrow icon to represent the strategy of raising the table top, with text descriptions of the specific raising method next to it, so that the driver can see the selectable control strategy options at a glance.

[0092] Step C2, detecting the touch operation on the central control screen.

[0093] Specifically, the vehicle's central control screen is equipped with a touch detection function, which can sense in real time whether there is a touch action on the screen surface through built-in touch sensing technology (such as capacitive touch technology, etc.). When the driver sees the candidate control strategies displayed on the central control screen and wants to make a selection, when he touches the screen with his finger, the touch sensing module will immediately capture the touch event, including the touch position, touch duration, touch gesture (such as click, long press, slide, etc.) and other information, and transmit these touch-related data to the vehicle's central control system. The central control system will then know that a touch operation has occurred on the central control screen, and then prepare to perform subsequent response processing based on this touch operation.

[0094] Step C3, responding to the touch operation, determining the selected candidate control strategy as the target control strategy.

[0095] Specifically, after receiving the data related to the touch operation, the data will be parsed and judged first. For example, if the touch operation is a short click action, the system will determine which candidate control strategy the click falls into based on the screen position coordinates of the click. If the click position corresponds to the display area of ​​the candidate control strategy "slowly raise the table in stages to ensure stability", the central control system will determine that the strategy is selected and mark it as the target control strategy.

[0096] For some complex touch gestures, such as long pressing a strategy icon to pop up a detailed description window and then clicking to confirm the selection, or switching between multiple candidate strategies through sliding gestures, the central control system also has corresponding processing logic, which can accurately identify the intentions corresponding to these complex gestures, thereby correctly determining the final selected candidate control strategy as the target control strategy.

[0097] Step C4, obtaining the table control component associated with the target control strategy, and sending the target control strategy to the corresponding table control component, so that the table control component controls the rear electric table to perform corresponding operations according to the target control strategy.

[0098] Specifically, when the target control strategy is determined (such as the previously selected strategy of "slowly raising the table in stages to ensure stability"), the system will find the corresponding table control components based on the association configuration. For the rear electric table, the relevant control components may include the motor controller that controls the operation of the table lifting motor, the signal processing module corresponding to the sensor that monitors the height position of the table, etc.

[0099] After finding the associated table control components, the central control system will package the target control strategy and send it to these table control components in a specific data format and communication protocol (for example, through the CAN bus communication protocol inside the vehicle, the control strategy is converted into the corresponding digital signal instructions). After receiving these instructions, the table control component will perform corresponding operations according to the specific requirements of the target control strategy. For example, the motor controller will control the motor to operate gradually at a lower speed and in several stages according to the strategy of "slowly raising the table in stages to ensure stability", driving the table to rise smoothly to the corresponding height. At the same time, the relevant sensors will monitor the height of the table in real time and feedback to the control component to ensure that the entire operation process complies with the setting of the target control strategy, and achieve accurate and safe control of the rear electric table.

[0100] As an example, suppose that the rear passenger of the vehicle is trying to raise the electric table, but the table shakes during the operation. After the system recognizes this usage behavior through camera analysis, it executes step C1 to obtain multiple candidate control strategies associated with it from the strategy library, such as "immediately stop the table raising operation and check the table connection parts", "reduce the raising speed and continue to observe the shaking", "pause the operation and automatically adjust the table balance mechanism", and clearly display them in a list on the vehicle's central control screen. Entering step C2, after the driver sees the strategy displayed on the screen, after thinking, his finger clicks on the option "reduce the raising speed and continue to observe the shaking", and the touch detection system of the central control screen quickly captures this operation. In response to this touch operation, the system determines that the clicked candidate control strategy is the target control strategy in step C3. Then, in step C4, the system obtains the table control component associated with the target control strategy, which is the motor controller that controls the table motor speed, based on the preset association relationship, and sends the instruction of "reducing the lifting speed and continuously observing the shaking condition" to the motor controller in a specific data format through the CAN bus. After receiving the instruction, the motor controller reduces the motor speed, so that the rear electric table is raised at a slower speed according to the target control strategy, while continuously monitoring the shaking condition of the table to ensure the smooth use of the table.

[0101] This application can actively turn on the monitoring function by detecting the monitoring operation of the rear electric table, filling the gap that the driver cannot monitor the usage status of the rear table. Calling the rear camera to record the video screen provides a detailed basis for accurately analyzing the passenger's usage behavior. Based on the analysis of usage behavior based on the video screen, dangerous behavior can be accurately identified. Once the dangerous behavior is identified, the corresponding target control strategy is obtained and executed to achieve effective counter-control of the rear electric table. In this way, the driver does not need to turn his head to pay attention to the back row all the time, and can stop the passenger's misoperation in time during driving. For example, when a passenger may cause a risk of pinching his hand due to improper operation, the system can respond quickly and control the table according to the target control strategy to avoid injuries, thereby fully ensuring the safety of the rear passengers during driving.

[0102] In the embodiment of the present application, after calling the camera deployed in the rear row of the vehicle to collect the video image of the rear electric table board of the passengers in the rear row of the vehicle, as shown in FIG. Figure 2 As shown, the method also includes:

[0103] Step S201, extracting multiple key areas corresponding to the rear electric table top from the video image.

[0104] In the embodiment of the present application, when the camera in the vehicle captures the video image containing the rear electric table (for example, the image captured by the OMC camera mentioned above can be used for analysis here after relevant transmission and processing), the key area will be extracted by image recognition and analysis technology. The system will pre-set which parts of the electric table belong to the key area, such as the area where the operation buttons of the table are located, which is an important part that affects the function of the table; the edge of the table, because it involves the possible risk of pinching hands and the observation of the change of the table state; and the support structure connection part of the table, whose state can reflect the stability of the table, etc.

[0105] Through the image recognition algorithm, the overall outline of the electric table top is locked in each frame of the video, and then the areas where the above-mentioned operation buttons are located, the edge parts, the supporting structure connection parts, etc. are accurately divided from the entire table top image according to the pre-set position, shape and other feature standards, and identified as independent key areas. In this way, the extraction of multiple key areas of the rear electric table top from the video screen is completed, preparing for the subsequent analysis of the corresponding behavioral characteristics of each area.

[0106] Step S202, based on the behavioral characteristics of the passengers in each key area, the importance of the corresponding key area is determined, and based on the mapping relationship between the preset importance and the scaling ratio, the target scaling ratio corresponding to the importance is determined.

[0107] In the embodiment of the present application, for each extracted key area, the behavioral characteristics generated by the passenger's interaction with it are analyzed. For example, for the area where the table operation buttons are located, the frequency of the passenger's finger touching the button, the pressing force, the operation time and other behavioral details are observed; at the edge of the table, pay attention to whether the passenger's hand is close, whether there is any attempt to cross the edge or apply external force to the edge; for the supporting structure connection part, pay attention to whether the passenger has related behaviors such as touching and shaking. By analyzing these behavioral characteristics, the passenger's behavioral activity in different key areas and the possible impact can be judged.

[0108] The importance of each key area is determined based on the above behavioral characteristics analysis results. If within a certain period of time, it is found that the passenger frequently operates the area where the table operation buttons are located, and the operation strength and duration show that they have a key impact on the adjustment of the table function, then this area will be judged to be of high importance; and if the edge of the table is only occasionally approached by the passenger, without any substantial dangerous actions or frequent interactions, then its importance is relatively low. Through such a comprehensive evaluation, the corresponding importance level is determined for each key area, such as high, medium, and low levels, or a specific value (such as 1-10 points) is used to quantify the importance.

[0109] The vehicle control system has a pre-set mapping relationship between the preset importance and the scaling ratio. For example, the scaling ratio corresponding to the importance of "high" is 2 times, the scaling ratio corresponding to the importance of "medium" is 1.5 times, and the scaling ratio corresponding to the importance of "low" is to maintain the original size (i.e. 1 times). After the importance of each key area is determined, the target scaling ratio corresponding to each key area can be found according to this mapping relationship, providing a basis for the next step of scaling the key area.

[0110] Step S203, scaling the key area in the video image according to the target scaling ratio, and displaying the scaled video image on the central control screen of the vehicle.

[0111] In the embodiment of the present application, for each key area with a determined target zoom ratio, an image zoom algorithm is used in the video screen to perform a corresponding zoom operation. For example, for an area where a desktop operation button with a high degree of importance and a target zoom ratio of 2 is located, the image size of the area in the video screen is proportionally enlarged by 2 times through a corresponding image interpolation or other zoom algorithm, so that the button operation details and surrounding related conditions can be displayed more clearly.

[0112] After completing the scaling of all key areas according to their respective target scaling ratios, the entire scaled video screen is integrated, and then the processed video screen data is transmitted to the vehicle's central control screen display module through the vehicle's internal information transmission link. After the central control screen receives the data, it displays the scaled video screen in an appropriate display format and layout, allowing the driver to more focus and clearly observe the key areas of the rear electric table board and the passengers' behavioral performance in interacting with it, assisting the driver to better understand the rear situation and make corresponding decisions.

[0113] As an example, the camera in the vehicle captured the video footage of the rear electric table. First, the outline of the electric table was locked through image recognition technology, and several key areas such as the table's operation button area, edge area, and support structure connection area were extracted. Then, the passenger behavior characteristics were analyzed, and it was found that passengers frequently pressed and adjusted the operation button area, with many hand movements and long operation time. Based on this, it was determined that the area was more important; while for the edge area, passengers only occasionally touched it with their hands, and the behavior was less, so the importance was relatively low; the support structure connection area, passengers basically had no substantial interaction with it, and the importance was the lowest. In the mapping relationship between the preset importance and the scaling ratio, high importance corresponds to 2 times magnification, medium corresponds to 1.5 times magnification, and low corresponds to keeping the original size. Therefore, the target scaling ratio of the operation button area is 2 times, the edge area is kept at the original size, and the support structure connection area is also kept at the original size. Then, the image scaling algorithm is used to process the corresponding key areas according to their respective target scaling ratios, and the image of the operation button area is enlarged by 2 times to make its details clearer. Finally, the entire scaled video screen is transmitted to the vehicle's central control screen for display, allowing the driver to observe the situation in the key areas and the passengers' interactive behavior more closely.

[0114] In the embodiment of the present application, after displaying the zoomed video screen on the central control screen of the vehicle, the method further includes: detecting the vehicle status of the vehicle and the passenger status of the passenger. Analyzing whether the vehicle status and the passenger status meet the stop recording condition. If the stop recording condition is met, sending a stop recording instruction to the camera, and storing the desktop usage video composed of the recorded video screen.

[0115] Vehicles are equipped with a variety of sensors to obtain status information in different aspects. For example, the speed sensor monitors the vehicle's speed in real time to determine whether the vehicle is stationary (speed is 0), driving at a low speed (such as below a certain safety speed threshold, such as below 30 kilometers per hour) or driving at a high speed (above a certain speed value, such as above 80 kilometers per hour); the acceleration sensor senses the acceleration and deceleration of the vehicle to understand whether the vehicle has sudden braking, sudden acceleration and other sudden operations; the steering angle sensor grasps the steering angle of the vehicle to determine whether the vehicle is driving in a straight line or turning and the magnitude of the turn; and there are also door status sensors that can detect whether the door is closed, open or half-open. In addition, the vehicle's electronic system will also obtain information such as whether it is currently in automatic driving mode, the operating status of various on-board electronic equipment (such as whether the entertainment system is turned on, whether the navigation system is working, etc.), etc., and the current status of the vehicle can be fully known by combining these data fed back by different sensors and systems.

[0116] Corresponding sensors will be installed in the car to detect the status of passengers. For example, pressure sensors are installed on the seats to determine whether there are passengers on the seats and the passenger's sitting posture (normal sitting posture or tilted, lying, etc.) through pressure distribution; sensors at the seat belt buckles are used to detect whether the passengers have fastened their seat belts; cameras are installed at appropriate locations in the car (in addition to cameras used to record the use of the table board, there may be other auxiliary monitoring cameras), and image recognition technology is used to analyze the passenger's facial expressions and body movements (whether there are abnormal waving, struggling, etc.), and it can also determine whether the passenger is awake or asleep, etc.; at the same time, combined with some smart wearable devices (if the passenger wears them and has a connection and interaction with the vehicle system), such as smart bracelets, etc., feedback on health data such as heart rate and blood oxygen, to further understand the passenger's physical condition, thereby forming a complete detection result of the passenger's status.

[0117] In the vehicle control system, a series of clear stop recording conditions are set in advance according to different usage scenarios, safety requirements, and functional requirements. For example, from the perspective of vehicle status, if the vehicle has stopped and all doors are open (which means that passengers may be about to get off the vehicle and there is no need to continue recording the use of the table), this is a vehicle status condition that satisfies the stop recording; or if the vehicle suddenly switches from normal driving to emergency braking mode (it may encounter an emergency, and the focus is on driving safety rather than the use of the table), it also meets the stop recording condition. From the perspective of passenger status, if all passengers have left the back seats (no one is seated through seat pressure sensors, etc.), or if a passenger actively initiates a request to stop recording through the control button in the car (similar to having a special function button for passengers to operate), it will also be considered to meet the stop recording condition. In addition, it is also possible to set conditions based on the vehicle and passenger status. For example, when the vehicle is driving at high speed, all the back passengers have fastened their seat belts and remain quiet and have not operated the table for more than a certain period of time (indicating that the table is temporarily not in use and there is no need to continue recording), which also meets the stop recording condition.

[0118] The detected current vehicle status information and passenger status information are compared and analyzed with the set stop recording conditions one by one. For example, if the current detected vehicle speed is 0, all doors are open, and the pressure sensor of the rear seat shows that no passengers are seated, it can be determined that the stop recording conditions are met by matching the relevant clauses in the stop recording conditions regarding the vehicle being stopped and the passengers leaving; or if the vehicle is in motion, but the camera observes that the rear passenger has fallen asleep and has not operated the table for a long time, after comparing it with the comprehensive stop recording conditions, it can also be concluded that the stop recording conditions are met.

[0119] If the recording stop condition is met, a recording stop instruction is sent to the camera, and a desktop usage video consisting of the recorded video screen is stored.

[0120] When the analysis determines that the conditions for stopping recording are met, the vehicle generates a stop recording command signal. This command signal will be transmitted through the corresponding line according to the internal communication protocol of the vehicle (such as the commonly used CAN bus communication protocol, etc.) and sent to the camera that is currently recording the video on the desktop. After the camera receives this stop recording command, it stops the current video acquisition work and ends the picture recording process.

[0121] When the camera stops recording, the previously recorded video images (these images fully record the use process of the rear electric table) will be orderly integrated to form a complete table use video file. The vehicle's storage system (usually a device with storage function such as an onboard hard disk or a large-capacity storage chip) will allocate corresponding storage space for this video file, and store the table use video according to certain naming rules (such as a naming method that includes key information such as recording time and vehicle identification number, which is convenient for subsequent search and management) and storage formats (such as common MP4 and other video formats, which is convenient for playback and viewing), so that subsequent drivers or relevant personnel can retrieve and view it at any time as needed to understand the use of the rear electric table and analyze whether there is any abnormal operation.

[0122] In the embodiments of the present application, Figure 3 As shown, the method also includes the following steps:

[0123] Step S301: If the use behavior does not belong to dangerous behavior, predict the passenger's critical behavior at the next moment based on the use behavior, and analyze the degree of danger of the critical behavior.

[0124] In an embodiment of the present application, after determining through video screen analysis and other means that the current passenger's use of the rear electric table does not constitute a dangerous behavior (for example, the passenger is just normally adjusting the angle of the table or smoothly opening the table and other routine operations), the system will infer the passenger's key behavior at the next moment based on a pre-established behavior prediction model. This behavior prediction model is built based on a large amount of actual data collected in the past on the use of the table by passengers. For example, if the current passenger is slowly opening the table, and according to previous data, after the table is opened to a certain angle, most passengers will try to place items on the table, then the system will predict that the passenger's key behavior at the next moment may be to place items on the opened table.

[0125] At the same time, other factors will be comprehensively considered, such as the in-car environment (for example, whether the current in-car temperature is suitable; if the temperature is high, passengers may tend to take drinks and place them on the table), the passenger status (using seat pressure sensors to determine whether the passenger's sitting posture is comfortable; if it is not comfortable, the table position may be adjusted to better change the sitting posture, etc.), etc., in order to predict as accurately as possible the key behaviors that the passenger is likely to perform at the next moment from multiple dimensions.

[0126] The system will analyze the degree of danger for the predicted key behaviors. This analysis process will take into account multiple factors. The first is the physical properties of the table itself, such as the load-bearing limit of the table. If it is predicted that the passenger will place heavy items on the table, and the weight of the items is close to or exceeds the load-bearing limit, the degree of danger will increase accordingly; the second is the driving state of the vehicle. If the vehicle is driving on a bumpy road or at high speed, some behaviors that seem safe at ordinary times (such as placing items on the table, adjusting the position of the table, etc.) may also become dangerous. For example, when the vehicle is bumpy, items may easily slip and hit passengers, or adjusting the table may cause the passenger's center of gravity to be unstable. In this case, the degree of danger will also be judged to be high; the third is to combine the relevant knowledge of ergonomics to judge whether the key behavior will cause potential harm to the passenger himself. For example, if a passenger reaches for items on the table in an awkward posture, it may cause body strain, which will also increase the degree of danger.

[0127] By conducting a quantitative or qualitative assessment of these factors (for example, risk weights corresponding to different factors can be set, and scores can be assigned based on the actual situation of each factor. Finally, a comprehensive calculation can be made to obtain a numerical value for the risk level or to divide the risk levels into low, medium, and high levels), the risk level of the predicted key behaviors can be determined.

[0128] Step S302: If the danger level is greater than a preset level, a warning message is sent to the driver in the vehicle.

[0129] In the embodiment of the present application, a threshold of danger level is set in advance in the vehicle control system according to different usage scenarios, vehicle types, safety requirements, etc. This threshold is used as a standard for determining whether to send a warning message to the driver. For example, when the danger level value reaches 60 points (out of 100 points) or the danger level is "medium" or above, it is determined that the danger level is greater than the preset level, which means that the driver needs to be reminded to pay attention to the situation at the rear electric table.

[0130] When the analysis shows that the risk level of the key behavior is greater than the preset level, the system will send warning information to the driver through the communication link inside the vehicle in an appropriate manner. A common method is to pop up a warning window on the vehicle's central control screen, which describes the predicted dangerous situation at the rear electric table, such as "The rear table is expected to have a risk of overweight items, please pay attention"; at the same time, the voice broadcast system in the car can also use clear voice to remind the driver, such as "Please note that the rear table may be in a dangerous situation", to ensure that the driver can know and pay attention to the relevant warning content in a timely manner.

[0131] Step S303, obtaining the driver's control instructions based on the warning information feedback, and controlling the rear electric table panel to perform the operation indicated by the control instructions.

[0132] In the embodiment of the present application, after receiving the warning information, the driver will make corresponding operations according to the actual situation to deal with possible dangerous situations, and these operations will be converted into control instructions and acquired by the vehicle system. For example, the warning window that pops up on the vehicle's central control screen may provide several control options for the driver to choose, such as "prevent the use of the table", "adjust the angle of the table", "no operation", etc. The driver clicks on the corresponding option through the touch screen to issue a control instruction; or the car is equipped with physical buttons corresponding to different table control functions. The driver presses the corresponding button (such as pressing the "stop table action" button), and the vehicle system can also receive the corresponding control instruction. In addition, some vehicles support voice control function. The driver can directly say voice commands such as "pause table operation", and the vehicle's voice recognition system will parse and convert it into corresponding control instructions, which will be passed to the module responsible for managing the control of the rear electric table.

[0133] After obtaining the control command fed back by the driver, the corresponding control execution path will be found according to the command content, and the relevant table control components will be driven to perform the operation. For example, if the control command is "prevent the use of the table", the system will send the command to the controller that controls the operation of the table motor through the CAN bus and other communication methods. After receiving the command, the controller will immediately stop the motor, stop the current action of the table, and keep it in the current state, thereby avoiding possible dangerous situations; if the command is "adjust the angle of the table", the motor will be controlled to drive the transmission mechanism of the table according to the specific angle parameters and other information contained in the command, and the table will be adjusted to the specified angle to ensure that it meets the safety state expected by the driver and ensure the safety and normal use of the passengers in the car.

[0134] In an embodiment of the present application, the method further includes: if the risk level is less than a preset level, obtaining a historical behavior matching the use behavior from the candidate historical behaviors of the passenger, obtaining the table usage corresponding to the historical behavior, and determining the use demand corresponding to the use behavior, and controlling the rear electric table to perform corresponding operations according to the use demand.

[0135] In the embodiment of the present application, a standard value or level for measuring the degree of danger is preset as a preset level (for example, when the value of the degree of danger is set to be less than 30 points or the danger level is set to "low", the degree of danger is determined to be less than the preset level). After the analysis shows the degree of danger of the passenger's key behavior towards the rear electric table, this degree of danger will be compared with the preset level for judgment. If, after comparison, it is found that the degree of danger is indeed within a range less than the preset level, it means that the current passenger's behavior is relatively safe, and the subsequent process is initiated.

[0136] The vehicle will continuously record the various behaviors of passengers using the rear electric table in the past, forming a database containing many candidate historical behaviors. These historical behaviors record the details of passengers operating the table in different scenarios, such as opening the table to place items when taking a break during the ride, frequently adjusting the height and angle of the table when working in the car, and other specific behaviors, as well as the corresponding time, vehicle driving status and other related information.

[0137] When it is necessary to obtain historical behaviors that match the current usage behaviors, matching judgments will be made from multiple dimensions. First, the key features of the current usage behaviors are analyzed. For example, if the current passenger is slowly pulling the table board towards him / her, the system will focus on features such as operating actions (such as the direction and speed of pulling), table board state changes (movement of the table board position), etc. Then, historical behaviors with similar features are searched in the candidate historical behavior database. For example, there have been passengers who have similarly slowly pulled the table board towards themselves, and then performed subsequent behaviors such as placing items. These historical behaviors with similar operating actions and table board state change features will be screened out as a set of historical behaviors that match the current usage behaviors.

[0138] For each matched historical behavior selected, the corresponding table usage record is queried in detail. For example, a matched historical behavior shows that the passenger first slowly pulled the table closer to himself, then placed the laptop on the table, and adjusted the table to an inclined angle for easy viewing of the screen, and continued to use it for a period of time, during which time the table angle was fine-tuned several times to adapt to different viewing angles. These specific circumstances of how the table was used and adjusted constitute the table usage corresponding to the historical behavior.

[0139] By comprehensively analyzing the usage of the table corresponding to multiple matching historical behaviors, the usage needs corresponding to the current usage behavior can be inferred. For example, from multiple historical behaviors, it is found that as long as there is an operation like slowly pulling the table closer to oneself, it is mostly for the purpose of placing items or conveniently operating electronic devices. Then it can be determined that the current passenger is doing the same behavior of pulling the table, and his potential usage needs are most likely to be for placing items or conveniently operating something, thereby determining the usage needs corresponding to the current usage behavior.

[0140] According to the determined usage requirements, the vehicle control system will select the appropriate strategy from a variety of pre-set control strategies to meet this requirement. For example, if the usage requirement is to facilitate passengers to place items, relevant control strategies will be formulated, such as adjusting the table to a horizontal and stable position and ensuring that the table has sufficient load-bearing capacity; if the usage requirement is to facilitate the operation of electronic devices, it may be necessary to control the table to adjust to a suitable tilt angle and ensure that the surface of the table is stable to prevent electronic devices from slipping.

[0141] After determining the control strategy, find the corresponding table control components, such as the controller corresponding to the motor and transmission device that controls the table angle adjustment, and the control module of the hydraulic or electric lifting mechanism responsible for adjusting the height of the table. Then, send the control instructions to these table control components through the vehicle's internal communication bus (such as CAN bus, etc.). After receiving the instructions, the table control components drive the corresponding motors, hydraulic devices and other components to operate the rear electric table according to the instructions. For example, if the control instruction is to adjust the table to a specific tilt angle, the motor controller will drive the motor to rotate, and drive the table to gradually adjust to the specified angle through the transmission mechanism, thereby meeting the passengers' usage needs and improving the riding experience.

[0142] In this embodiment, a control device for a vehicle electric table top is also provided, and the device is used to implement the above-mentioned embodiments and preferred implementation modes, and the details that have been explained will not be repeated. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0143] This embodiment provides a control device for a vehicle electric table top, such as Figure 4 As shown, including:

[0144] A detection module 401 is used to detect a monitoring operation triggered in the vehicle with respect to the rear electric table;

[0145] The response module 402 is used to respond to the monitoring operation and call the camera deployed in the rear row of the vehicle to collect the video images of the passengers in the rear row of the vehicle using the rear electric table board;

[0146] Analysis module 403, used to analyze the video screen to obtain the passenger's use behavior of the rear electric table;

[0147] The control module 404 is used to obtain the control strategy corresponding to the usage behavior if the usage behavior is a dangerous behavior, and control the rear electric table to execute the operation indicated by the control strategy.

[0148] In an embodiment of the present application, the device also includes: a display module, which is used to collect video images of the rear electric table from the passengers in the rear row of the vehicle. The method also includes: extracting multiple key areas corresponding to the rear electric table from the video images; determining the importance of the corresponding key areas based on the behavioral characteristics of the passengers in each key area, and determining the target zoom ratio corresponding to the importance based on the mapping relationship between the preset importance and the zoom ratio; zooming the key areas in the video image according to the target zoom ratio, and displaying the zoomed video image on the central control screen of the vehicle.

[0149] In an embodiment of the present application, the device also includes: a storage module, used to detect the vehicle status of the vehicle and the passenger status of the passenger; analyze whether the vehicle status and the passenger status meet the conditions for stopping recording; if the conditions for stopping recording are met, send a stop recording instruction to the camera, and store the table top usage video composed of the recorded video screen.

[0150] In an embodiment of the present application, the analysis module 403 is used to extract the passenger's action features from the video screen, and to extract the morphological features of the rear electric table from the video screen; calculate the matching degree between the action features and the morphological features and the behavioral features corresponding to each preset behavior; and use the preset behavior with the highest matching degree as the passenger's usage behavior of the rear electric table.

[0151] In an embodiment of the present application, the control module 404 is used to obtain a target control strategy library, wherein the target control strategy library includes target control strategies corresponding to different dangerous behaviors; query the target dangerous behavior hit by the use behavior from the target control strategy library, and determine the original control strategy corresponding to the target dangerous behavior; detect the environmental conditions of the vehicle's current driving environment; analyze whether there are safety hazards when controlling the rear electric table according to the original control strategy under the environmental conditions; if there are safety hazards, determine the key links in the original control strategy that cause the safety hazards, and update the key links in the original control strategy based on the environmental conditions to obtain the target control strategy; obtain the table control component associated with the target control strategy, and send the target control strategy to the corresponding table control component, so that the table control component controls the rear electric table to perform corresponding operations according to the target control strategy.

[0152] In an embodiment of the present application, the control module 404 is used to obtain multiple candidate control strategies associated with usage behaviors, and display the candidate control strategies on the central control screen of the vehicle; detect touch operations acting on the central control screen; respond to the touch operations, and determine the selected candidate control strategy as the target control strategy; obtain the table control component associated with the target control strategy, and send the target control strategy to the corresponding table control component, so that the table control component controls the rear electric table to perform corresponding operations according to the target control strategy.

[0153] In the embodiment of the present application, the device further includes: an early warning module, which is used to predict the critical behavior of the passenger at the next moment based on the use behavior if the use behavior does not belong to the dangerous behavior, and analyze the dangerousness of the critical behavior; if the dangerousness is greater than the preset degree, send a warning message to the driver in the vehicle;

[0154] Obtain the driver's control instructions based on the warning information feedback, and control the rear electric table panel to perform the operations indicated by the control instructions.

[0155] In an embodiment of the present application, the device also includes: a prediction module, which is used to obtain historical behaviors that match the usage behaviors from the passenger's candidate historical behaviors if the degree of danger is less than a preset degree; obtain the table usage corresponding to the historical behavior to determine the usage requirements corresponding to the usage behavior; and control the rear electric table to perform corresponding operations according to the usage requirements.

[0156] See also Figure 5 , Figure 5 is a schematic diagram of the structure of an electronic device provided by an optional embodiment of the present invention, such as Figure 5 As shown, the electronic device includes: one or more processors 10, a memory 20, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. The various components are connected to each other using different buses for communication, and can be installed on a common mainboard or installed in other ways as needed. The processor can process instructions executed in the electronic device, including instructions stored in or on the memory to display graphical information of the GUI on an external input / output device (such as a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple electronic devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 5 A processor 10 is taken as an example.

[0157] The processor 10 may be a central processing unit, a network processor or a combination thereof. The processor 10 may further include a hardware chip. The hardware chip may be a dedicated integrated circuit, a programmable logic device or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic or any combination thereof.

[0158] The memory 20 stores instructions executable by at least one processor 10, so that the at least one processor 10 executes the method shown in the above embodiment.

[0159] The memory 20 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created by the use of an electronic device based on the presentation of a small program landing page, etc. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 20 may optionally include a memory remotely arranged relative to the processor 10, and these remote memories may be connected to the electronic device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0160] The memory 20 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid state drive; the memory 20 may also include a combination of the above types of memory. The electronic device also includes a communication interface 30 for the electronic device to communicate with other devices or a communication network.

[0161] The embodiment of the present invention also provides a computer-readable storage medium. The method according to the embodiment of the present invention can be implemented in hardware, firmware, or can be implemented as a computer code that can be recorded in a storage medium, or can be implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and will be stored in a local storage medium through a network download, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state hard disk, etc.; further, the storage medium can also include a combination of the above types of memories. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor, or hardware, the method shown in the above embodiment is implemented.

[0162] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A method for controlling a vehicle electric table, characterized in that: The method comprises: Detecting monitoring operations triggered in the vehicle for the rear electric table; In response to the monitoring operation, a camera deployed in the rear row of the vehicle is called to record a video of passengers in the rear row of the vehicle using the rear electric table top; Analyze the video screen to obtain the passenger's usage behavior of the rear electric table board; If the usage behavior is a dangerous behavior, the target control strategy corresponding to the usage behavior is obtained, and the rear electric table top is controlled to perform the operation indicated by the target control strategy.

2. The method according to claim 1, characterized in that After calling the camera deployed in the rear row of the vehicle to collect the video images of the rear electric table board from the passengers in the rear row of the vehicle, the method further includes: Extracting multiple key areas corresponding to the rear electric table from the video screen; Determine the importance of the corresponding key area based on the behavioral characteristics of the passenger in each key area, and determine the target scaling ratio corresponding to the importance based on the mapping relationship between the preset importance and the scaling ratio; The key area in the video image is scaled according to the target scaling ratio, and the scaled video image is displayed on the central control screen of the vehicle.

3. The method according to claim 2, characterized in that After displaying the zoomed video image on the central control screen of the vehicle, the method further includes: detecting a vehicle state of the vehicle and a passenger state of the passenger; Analyzing whether the vehicle status and the passenger status meet the recording stop condition; If the recording stop condition is met, a recording stop instruction is sent to the camera, and a desktop usage video consisting of the recorded video images is stored.

4. The method according to claim 1, characterized in that The analyzing the video screen to obtain the passenger's use behavior of the rear electric table top includes: Extracting the motion features of the passenger from the video picture, and extracting the morphological features of the rear electric table from the video picture; Calculating the matching degree between the action feature, the morphological feature and the behavior feature corresponding to each preset behavior; The preset behavior with the highest matching degree is used as the passenger's usage behavior of the rear electric table.

5. The method according to claim 1, characterized in that The obtaining of the target control strategy corresponding to the usage behavior and controlling the rear electric table to perform the operation indicated by the target control strategy includes: Acquire a target control strategy library, wherein the target control strategy library includes target control strategies corresponding to different dangerous behaviors; Querying the target dangerous behavior hit by the use behavior from the target control strategy library, and determining the original control strategy corresponding to the target dangerous behavior; Detecting the environmental conditions of the vehicle's current driving environment; Analyze whether there are safety hazards when controlling the rear electric table according to the original control strategy under the environmental conditions; If there is a potential safety hazard, determining the key link in the original control strategy that causes the potential safety hazard, and updating the key link in the original control strategy based on the environmental conditions to obtain the target control strategy; Obtain the table control component associated with the target control strategy, and send the target control strategy to the corresponding table control component, so that the table control component controls the rear electric table to perform corresponding operations according to the target control strategy.

6. The method according to claim 1, characterized in that The obtaining of the target control strategy corresponding to the usage behavior and controlling the rear electric table to perform the operation indicated by the target control strategy includes: Acquire multiple candidate control strategies associated with the usage behavior, and display the candidate control strategies on the central control screen of the vehicle; Detecting a touch operation on the central control screen; In response to the touch operation, determining the selected candidate control strategy as the target control strategy; Obtain the table control component associated with the target control strategy, and send the target control strategy to the corresponding table control component, so that the table control component controls the rear electric table to perform corresponding operations according to the target control strategy.

7. The method according to claim 1, characterized in that The method further comprises: If the usage behavior is not a dangerous behavior, predicting the passenger's critical behavior at the next moment based on the usage behavior, and analyzing the degree of danger of the critical behavior; If the danger level is greater than a preset level, a warning message is sent to the driver of the vehicle; Obtain the control instruction of the driver based on the warning information feedback, and control the rear electric table panel to perform the operation indicated by the control instruction.

8. The method according to claim 7, characterized in that The method further comprises: If the risk level is less than the preset level, obtaining a historical behavior matching the use behavior from the candidate historical behaviors of the passenger; Obtaining the desktop usage corresponding to the historical behavior to determine the usage demand corresponding to the usage behavior; The rear electric table top is controlled to perform corresponding operations according to the usage requirements.

9. A control device for a vehicle electric table, characterized in that: The device comprises: A detection module, used to detect a monitoring operation triggered in the vehicle with respect to the rear electric table; A response module, used to respond to the monitoring operation and call a camera deployed in the rear row of the vehicle to collect a video of the passengers in the rear row of the vehicle using the rear electric table; An analysis module, used for analyzing the video image to obtain the passenger's usage behavior of the rear electric table board; The control module is used to obtain the control strategy corresponding to the usage behavior if the usage behavior is a dangerous behavior, and control the rear electric table to perform the operation indicated by the control strategy.

10. A vehicle, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the method according to any one of claims 1 to 7 by executing the computer instructions.

Images