Vehicle main driver seat function dynamic response method and device, storage medium and program

Abstract

Embodiments of the present application disclose a vehicle main driver seat function dynamic response method and device, a storage medium and a program, which are applied to a cockpit domain controller in a domain control system of a target vehicle. The method comprises: obtaining target data, the target data comprising at least one of audio data and image data; in the case where a child is detected to perform a control operation on the main driver seat, identifying an intention source corresponding to the control operation according to the target data; if the intention source is the child's own intention, matching the main driver seat with a first function authority, and judging whether to respond to the control operation according to the first function authority; and if the intention source is the intention of other passengers, responding to the control operation according to the intention of other passengers. The present application is beneficial to avoiding the child from climbing into the main driver seat and triggering vehicle driving related functions without the knowledge of other passengers, thereby affecting subsequent driving, and improving driving safety.

Description

Technical Field

[0001] This application relates to the field of data processing technology, specifically to a method for dynamic response of the driver's seat function in a vehicle, as well as related devices, storage media, and programs. Background Technology

[0002] In real-life situations, such as during holiday traffic jams or while waiting for someone, boredom might lead children to climb onto the driver's seat and trigger the steering wheel, horn, center console display, or other components. If this triggering action involves starting the vehicle, changing wheel direction, honking the horn, or lowering the chassis—actions directly related to driving—it can create safety hazards for the vehicle's subsequent operation. Summary of the Invention

[0003] This application provides a method and related device for dynamic response of vehicle driver's seat functions, in order to prevent children from climbing into the driver's seat and triggering vehicle driving-related functions, thereby affecting driving and improving driving safety.

[0004] In a first aspect, embodiments of this application provide a dynamic response method for the driver's seat function of a vehicle, applied to a cockpit domain controller in a domain control system of a target vehicle. The domain control system includes the cockpit domain controller, a microphone, and an in-vehicle camera, wherein the microphone and the in-vehicle camera are communicatively connected to the cockpit domain controller; the method includes:

[0005] Acquire target data, wherein the target data includes at least one of audio data and image data, wherein the audio data is audio information inside the target vehicle collected by the sound pickup device, and the image data is image information inside the target vehicle collected by the in-vehicle camera;

[0006] When a child is detected performing a control operation in the driver's seat, the source of intent corresponding to the control operation is identified based on the target data. The source of intent is either the child's own intent or the intent of other drivers or passengers. The source of intent is used to characterize the object that drives the child to perform the control operation.

[0007] If the intent originates from the child's own intent, then a first functional permission is matched to the driver's seat, and it is determined whether to respond to the control operation based on the first functional permission. The first functional permission is used to represent the usage permission provided by the target vehicle to the child currently performing the control operation.

[0008] If the intent originates from the intent of another driver or passenger, the control operation is responded to based on that other driver or passenger's intent.

[0009] Secondly, embodiments of this application provide a dynamic response device for the driver's seat function of a vehicle, applied to the cockpit domain controller in the domain control system of a target vehicle. The domain control system includes the cockpit domain controller, a microphone, and an in-vehicle camera, wherein the microphone and the in-vehicle camera are communicatively connected to the cockpit domain controller; the device includes:

[0010] The acquisition unit is used to acquire target data, which includes at least one of audio data and image data. The audio data is audio information inside the target vehicle collected by the sound pickup device, and the image data is image information inside the target vehicle collected by the in-vehicle camera. The judgment unit is used to determine whether a child has entered the driver's seat based on the target data.

[0011] The identification unit is configured to, if a child is detected performing a control operation in the driver's seat, identify the source of intent corresponding to the control operation based on the target data, wherein the source of intent is the child's own intent or the intent of other drivers or passengers, and the source of intent is used to characterize the object that drives the child to perform the control operation;

[0012] A matching unit is configured to match a first functional permission to the driver's seat when the intention source is the child's own intention, and to determine whether to respond to the control operation based on the first functional permission. The first functional permission is used to represent the usage permission provided by the target vehicle to the child currently performing the control operation.

[0013] The response unit is further configured to respond to the control operation according to the intention of another driver or passenger when the source of the intention is the intention of another driver or passenger.

[0014] Thirdly, embodiments of this application provide an electronic device including a processor, a memory, a communication interface, and one or more programs, the one or more programs being stored in the memory and configured to be executed by the processor, the programs including instructions for performing the steps in the first aspect of embodiments of this application.

[0015] Fourthly, embodiments of this application provide a computer storage medium storing a computer program for electronic data interchange, wherein the computer program causes a computer to perform some or all of the steps described in the first aspect of this embodiment.

[0016] As can be seen, in this embodiment, target data is acquired through the cockpit domain controller, and the target data includes at least one of audio data and image data. Then, when a child is detected performing a control operation in the driver's seat, the source of intent corresponding to the control operation is identified based on the target data. The source of intent is either the child's own intent or the intent of another passenger, where the source of intent represents the object that drives the child to perform the control operation. If the source of intent is the child's own intent, a first functional permission is matched to the driver's seat, and a decision is made based on the first functional permission to respond to the control operation. The first functional permission represents the usage rights provided by the target vehicle to the child currently performing the control operation. If the source of intent is the intent of another passenger, the control operation is responded to based on the intent of that other passenger. Thus, this application can identify whether a child's control operation is based on their own will or the will of other drivers or passengers, based on the intent of the child to perform the control operation. This allows the application to determine whether to respond to the child's control operation based on different situations, thus meeting the needs of drivers and passengers. This helps to prevent children from climbing into the driver's seat and triggering vehicle driving-related functions without the knowledge of other drivers or passengers, thereby affecting subsequent driving and improving driving safety. Attached Figure Description

[0017] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1A This is a schematic diagram of the architecture of an example vehicle driver's seat function dynamic response system provided in an embodiment of this application;

[0019] Figure 1B This is a component example diagram of an electronic device provided in an embodiment of this application;

[0020] Figure 2 This is a flowchart illustrating a dynamic response method for the driver's seat function of a vehicle, provided in an embodiment of this application.

[0021] Figure 3A This is a functional unit block diagram of a vehicle driver's seat function dynamic response device provided in an embodiment of this application;

[0022] Figure 3B This is a block diagram of the functional units of another vehicle driver's seat function dynamic response device provided in this application embodiment. Detailed Implementation

[0023] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present application.

[0024] The terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.

[0025] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0026] The embodiments of this application will now be described with reference to the accompanying drawings.

[0027] The technical solution of this application can be applied to, for example... Figure 1A The example domain control system 10 shown includes a cockpit domain controller, a body domain controller, an autonomous driving domain controller, a powertrain domain controller, a chassis domain controller, and a central control display screen. All of the cockpit, body, autonomous driving, powertrain, and chassis domain controllers are communicatively connected to the central control display screen, and any two of these controllers can be communicatively connected. Through information interaction, the cockpit, body, autonomous driving, powertrain, and chassis domain controllers, along with the central control display screen, can comprehensively provide functions such as vehicle structure (e.g., windows, sunroof), chassis structure (chassis, tires, etc.), driving function control, and powertrain system control for the driver and passengers.

[0028] The electronic device in this application can be structured as follows: Figure 1BAs shown, the electronic device can be an electronic cockpit domain controller, a body domain controller, an autonomous driving domain controller, a powertrain domain controller, a chassis domain controller, or a central control display screen. The electronic device may include a processor 110, a memory 120, a communication interface 130, and one or more programs 121, wherein the one or more programs 121 are stored in the memory 120 and configured to be executed by the processor 110, and the one or more programs 121 include instructions for performing any step in the above method embodiments.

[0029] The communication interface 130 is used to support communication between the cockpit domain controller 100 and other devices. The processor 110 may be, for example, a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logic blocks, units, and circuits described in conjunction with the embodiments of this application. The processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0030] The memory 120 can be volatile memory or non-volatile memory, or may include both. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate synchronous DRAM (DDR SDRAM), enhanced synchronous DRAM (ESDRAM), synchronous linked DRAM (SLDRAM), and direct rambus RAM (DR RAM).

[0031] In a specific implementation, the processor 110 is used to execute any step performed by the cockpit domain controller in the following method embodiments, and when performing data transmission such as sending, it may selectively call the communication interface 130 to complete the corresponding operation.

[0032] It should be noted that the above schematic diagram of the electronic device is only an example, and the actual number of components included may be more or less, and no single limitation is made here.

[0033] Please see Figure 2 , Figure 2 This is a flowchart illustrating a dynamic response method for the driver's seat function in a vehicle, as provided in an embodiment of this application. This method can be applied to applications such as... Figure 1A The cockpit domain controller in the vehicle driver's seat function dynamic response system shown herein includes the cockpit domain controller, a microphone, and an in-vehicle camera. The microphone and the in-vehicle camera are communicatively connected to the cockpit domain controller. Figure 2 As shown, the dynamic response method for the driver's seat function of this vehicle includes:

[0034] S210, acquire target data, the target data including at least one of audio data and image data.

[0035] The audio data refers to the audio information inside the target vehicle collected by the sound pickup device, and the image data refers to the image information inside the target vehicle collected by the in-vehicle camera.

[0036] In practice, the cockpit domain controller can acquire target data in real time, allowing it to analyze the data and identify whether it contains information indicating the intentions of other occupants. Thus, when a child is detected entering the driver's seat and performing control actions, the cockpit domain controller can directly obtain the identification results, thereby improving the vehicle's response efficiency.

[0037] Alternatively, in a specific implementation, before acquiring the child target data, the cockpit domain controller can first detect whether a child has entered the driver's seat. If so, it acquires the target data. Specifically, the domain controller system also includes a gravity sensor located in the driver's seat. The cockpit domain controller first acquires gravity data from the gravity sensor, which characterizes changes in gravity in the driver's seat. The cockpit domain controller then determines whether the gravity in the driver's seat has increased based on the gravity data. If so, it determines whether the increased gravity difference is greater than a preset range. If so, and if the gravity difference is within the preset range, it determines that a child has entered the driver's seat. If the gravity difference is not within the preset range, it determines that no child has entered the driver's seat. The preset range characterizes a preset range of child weights. Therefore, acquiring the target data and parsing it to obtain the identification result after detecting a child's presence in the driver's seat based on weight data reduces the real-time processing load on the cockpit domain controller.

[0038] When acquiring target data after detecting a child entering the driver's seat based on weight data, the target data can be at least one of the total audio and image data from the entire driving process. Alternatively, the target data can be at least one of the audio and image data from a preset time period prior to detecting a child entering the driver's seat. This reduces the amount of data transmission and improves data transmission efficiency.

[0039] Furthermore, after detecting a child entering the driver's seat based on weight data and acquiring the target data, the cockpit domain controller can further determine whether a child has entered the driver's seat based on audio or image information. Specifically, when using image data, determining whether a child has entered the driver's seat includes: extracting a target image of the driver's seat area from the image data, and then further determining whether a child has entered the driver's seat based on the target image. When using audio data, determining whether a child has entered the driver's seat includes: extracting the child's audio information from the audio data, identifying the corresponding sound source location based on the audio information, and then determining whether the sound source location is located in the driver's seat to determine whether the child has entered the driver's seat.

[0040] S220, when a child is detected performing a control operation in the driver's seat, the source of intent corresponding to the control operation is identified based on the target data, wherein the source of intent is the child's own intent or the intent of other drivers or passengers.

[0041] The "source of intent" refers to the object that drives the child to perform the control operation. That is, the child's own intent refers to the control operation performed by the child according to their own will, while the intent of other occupants refers to the control operation performed by the child according to the intent of other occupants.

[0042] S230, if the intention originates from the child's own intention, then a first function permission is matched to the driver's seat, and it is determined whether to respond to the control operation based on the first function permission.

[0043] The first functional permission is used to characterize the usage permissions that the target vehicle provides to the child currently performing the control operation.

[0044] In specific implementation, regarding matching the first functional permission to the driver's seat, the audio or image information of the child performing the control operation can be obtained first. Then, based on the mapping relationship between the audio or image information and identity information, the child's identity information corresponding to the child's audio or image information can be retrieved from the database. Next, based on the mapping relationship between the child's identity information and functional permissions, the first functional permission corresponding to the child's identity information is matched, that is, the first functional permission currently matched to the driver's seat is obtained.

[0045] Furthermore, if the first functional permission includes a control operation currently being performed by the child, then the controller can respond to that control operation and communicate with at least one of the body domain controller, autonomous driving domain controller, powertrain domain controller, chassis domain controller, and central control display to execute the control operation. For example, if the control operation is for playing a video of a target video, and the first functional permission includes video playback permission, the cockpit domain controller can communicate with the central control display to control the central control display to play the video.

[0046] S240, if the intention originates from the intention of another driver or passenger, then the control operation is responded to according to the intention of the other driver or passenger.

[0047] In practice, if the first functional permission corresponding to the child does not include the permission for the function corresponding to the child's current control operation, and the intention comes from the intention of other drivers or passengers, it indicates that the driver or passenger allows the child to use the function corresponding to the current control operation. That is, the target vehicle can temporarily grant the child permission to use the function corresponding to the current control operation based on the intention of other drivers or passengers. Therefore, the cockpit domain controller can respond to the control operation based on the intention of other drivers or passengers.

[0048] In specific implementation, the response control operation can be controlled directly by the cockpit domain controller, or the cockpit domain controller can send execution commands to the body domain controller, powertrain domain controller, autonomous driving domain controller, chassis domain controller, and central control display screen, and then the cockpit domain controller can control the body domain controller, powertrain domain controller, autonomous driving domain controller, chassis domain controller, or central control display screen to implement the function corresponding to the control operation.

[0049] For example, when the child is currently performing a control operation that activates the horn, the cockpit domain controller can send an activating horn command to the power domain controller in response to the horn activation control operation. The activating horn command is used to instruct the power domain controller to control the horn to sound.

[0050] As can be seen, in this embodiment, target data is acquired through the cockpit domain controller, and the target data includes at least one of audio data and image data. Then, when a child is detected performing a control operation in the driver's seat, the source of intent corresponding to the control operation is identified based on the target data. The source of intent is either the child's own intent or the intent of another passenger, where the source of intent represents the object that drives the child to perform the control operation. If the source of intent is the child's own intent, a first functional permission is matched to the driver's seat, and a decision is made based on the first functional permission to respond to the control operation. The first functional permission represents the usage rights provided by the target vehicle to the child currently performing the control operation. If the source of intent is the intent of another passenger, the control operation is responded to based on the intent of that other passenger. Thus, this application can identify whether a child's control operation is based on their own will or the will of other drivers or passengers, based on the intent of the child to perform the control operation. This allows the application to determine whether to respond to the child's control operation based on different situations, thus meeting the needs of drivers and passengers. This helps to prevent children from climbing into the driver's seat and triggering vehicle driving-related functions without the knowledge of other drivers or passengers, thereby affecting subsequent driving and improving driving safety.

[0051] In one possible example, when the target data includes audio data, the step of identifying the source of intent corresponding to the control operation based on the target data includes: identifying the audio data to obtain a semantic recognition result; determining whether the semantic recognition result includes a directional statement, the directional statement being used to characterize the intent of other occupants to instruct the child to perform a control operation, the occupants in the target vehicle including the child entering the driver's seat and the other occupants; if yes, then the source of intent is determined to be the intent of other occupants; if no, then the source of intent is determined to be the child's intent.

[0052] In practice, the cockpit domain controller can identify audio information to obtain semantic recognition results. After including directional statements in the semantic recognition results, the correlation between the directional statements and the control operations performed by the child is determined. If there is a correlation, the intention can be determined to originate from the intention of other drivers or passengers; if there is no correlation, the intention can be determined to originate from the child's own intention.

[0053] Specifically, the association between the directive statement and the control operation performed by the child includes temporal association and object association. Temporal association refers to the chronological order of the control operation performed by the child and the directive statement. If the directive statement occurs before the child performs the control operation, the association is valid; otherwise, it is not. After determining whether temporal association is valid, object association is determined. Object association refers to whether the execution object in the directive statement is the child. If it is, the association is valid; otherwise, it is not.

[0054] As can be seen in this example, audio data can be used to identify situations where directional statements exist, thereby ensuring the accuracy of intent source identification, improving the accuracy of the cockpit domain controller's response strategy to control operations performed by children, and enhancing the riding experience for drivers and passengers.

[0055] In one possible example, when the target data includes image data, the step of identifying the source of intent corresponding to the control operation based on the target data includes: identifying the actions of occupants based on the image data, wherein the occupants in the target vehicle include a child entering the driver's seat and other occupants; determining whether other occupants have performed an auxiliary action, the auxiliary action being used to characterize the action of assisting a child to enter the driver's seat; if yes, then determining the source of intent as the intent of other occupants; if no, then determining the source of intent as the child's intent.

[0056] In practice, the cockpit domain controller can directly acquire image data and extract the portion of the image data related to the child's control operations. This portion of the image includes images taken within a first preset time period before the child performs the control operation. This portion of the image is input into a motion recognition model, and the model's recognition results determine whether other occupants have performed auxiliary actions. The motion recognition model is generated based on preset auxiliary actions. For example, preset auxiliary actions include other occupants holding the child's hand while performing operations. When the motion recognition model identifies image frames in the portion of the image related to the child's control operations where other occupants are holding the child's hand, it can be determined that other occupants have performed auxiliary actions.

[0057] Alternatively, in a specific implementation, the cockpit domain controller can acquire both audio and image data simultaneously. If the cockpit domain controller fails to identify a directional statement based on the audio data, it can further identify whether other drivers or passengers have performed auxiliary actions based on the image data. This comprehensive evaluation of audio and image data can improve the accuracy of the recognition results.

[0058] As can be seen in this example, the source of the child's intention to perform the current control operation can be identified by judging whether other drivers or passengers are performing auxiliary actions in the image data, thus ensuring the accuracy of the intention source judgment.

[0059] In one possible example, if the intent originates from another driver or passenger, the step of responding to the control operation based on the other driver or passenger's intent includes: determining the identity of a target driver or passenger corresponding to the other driver or passenger's intent; matching a second functional permission corresponding to the target driver or passenger's identity; determining, based on the second functional permission, whether the other driver or passenger has the permission to perform the control operation; if yes, then performing the step of responding to the control operation based on the other driver or passenger's intent; if no, then not responding to the control operation.

[0060] The second functional permission is used to characterize the scope of usable functions provided by the target vehicle to the target driver and passengers. The target driver and passengers refers to the driver or passengers who express the intentions of other drivers and passengers.

[0061] In practice, after determining that the intent originates from another driver or passenger, voiceprint or facial information corresponding to that intent can be obtained. This information is then used to match the identity of the target driver or passenger, and further matched to obtain a second functional permission that maps to that identity. Based on this second functional permission, it is determined whether the target driver or passenger has permission to perform the control operation currently being performed by the child. If so, the control operation can be responded to; otherwise, it can be ignored.

[0062] Specifically, if other drivers or passengers intend to determine based on audio data, the cockpit domain controller can perform voiceprint recognition processing on the audio data to obtain a voiceprint recognition result; then, based on the voiceprint recognition result, determine the target driver or passenger corresponding to the instruction statement; then, match the voice information of the target driver or passenger in the voice database to obtain the identity of the target driver or passenger corresponding to the voice information of the target driver or passenger, and match the second functional permissions corresponding to the identity of the target driver or passenger.

[0063] Alternatively, specifically, if other drivers or passengers intend to determine the location based on image data, the cockpit domain controller can perform facial recognition processing on the image data to obtain a facial recognition result; then, based on the facial recognition result, determine the target driver or passenger corresponding to the auxiliary action; then, match the facial information of the target driver or passenger in the image database to obtain the identity of the target driver or passenger corresponding to the facial information of the target driver or passenger, and match the second functional permission corresponding to the identity of the target driver or passenger.

[0064] As can be seen, in this example, by determining the second functional permissions of the target driver or passenger corresponding to the intentions of other drivers and passengers, and judging whether the second functional permissions have the right to use control operations, it is possible to further determine whether to respond to control operations. This can provide more accurate services to drivers and passengers and ensure the safety and reliability of responding to control operations.

[0065] In one possible example, if the intent originates from the intent of another driver or passenger, before responding to the control operation based on the intent of the other driver or passenger, the process includes: determining whether the function corresponding to the control operation is a child-disabled function; if yes, then not responding to the control operation; if no, then performing the action of responding to the control operation based on the intent of the other driver or passenger.

[0066] The control operation refers to the hardware or software functions of the target vehicle. Examples include video playback, vehicle start-up, and horn activation.

[0067] Among them, the child-disabled function refers to the function of the target vehicle that prohibits all children from using it.

[0068] In practice, if a child is detected to be performing a control operation based on the intention of another driver or passenger, the function corresponding to the control operation is compared with the child disabling function set in the target vehicle. If the comparison is successful, the control operation is not responded to; if the comparison fails, the control operation is responded to based on the intention of another driver or passenger.

[0069] For example, if the child-disabling function includes the vehicle start function, and the intent originates from the intent of another driver or passenger, if the control operation is a vehicle start operation, then the vehicle start function corresponding to the vehicle start operation is compared with the child-disabling function to obtain a comparison result that the vehicle start function is the child-disabling function. In this case, even if the intent of the control permission originates from the intent of another driver or passenger, the cockpit domain controller will not respond to the control operation.

[0070] As can be seen in this example, by setting a child-blocking function to restrict control actions performed based on the intentions of other drivers or passengers, the safety of responding to control actions performed by children can be further improved.

[0071] In one possible example, the first functional permission includes access to entertainment functions provided by the target vehicle to the child currently performing the control operation, and the domain controller system also includes a central control display screen, the entertainment functions being provided by software application functions presented on the central control display screen.

[0072] The control operations include hardware control operations and software control operations. Software control operations refer to operations performed on the functions of the software application. Hardware control operations refer to actions triggered by the child through direct touchscreen hardware. For example, hardware control operations could include horn activation, car start activation, and air conditioning start / stop activation. Software control operations refer to actions triggered by the child through the central control display screen, affecting either software or hardware. For example, software actions triggered by the child through the central control display screen include audio and video playback, while hardware actions triggered by the child through the central control display screen include controlling the sunroof opening / closing and adjusting the chassis height.

[0073] Furthermore, since children are not old enough to drive, in practice, the target vehicle can provide children with access to entertainment functions by default. This access is granted to children to trigger entertainment-related software through the central control display screen.

[0074] In practice, the content of the first functional permissions can be adjusted and set when the child's identity information is entered. Specifically, when entering the child's identity information, the permission range option is provided through the central control display screen, and the car owner can set the range of the first functional permissions corresponding to the child according to their needs. This permission range option includes entertainment function usage permissions and non-entertainment function usage permissions. Among them, entertainment functions are provided by entertainment-related software provided by the central control display screen, and driving functions are provided by software other than entertainment-related software provided by the central control display screen, as well as hardware that can be directly touched and triggered by the target vehicle. Entertainment function usage permissions include audio playback permissions, video playback permissions, etc., and driving function usage permissions include the target vehicle's start permissions, window adjustment permissions, chassis adjustment permissions, horn triggering permissions, etc. Specifically, the car owner can add some driving function usage permissions or delete at least some entertainment function usage permissions as needed.

[0075] As can be seen in this example, by providing children with first-level functional permissions, including access to entertainment functions, the target vehicle can meet children's entertainment needs and improve their riding experience.

[0076] In one possible example, if the intent originates from the child's own intent, and if the control operation is for a non-entertainment function, the method further includes: sending an authentication request to the central control display screen; receiving authentication information input from the central control display screen according to the authentication request; responding to the control operation if the authentication is successful; and not responding to the control operation if the authentication fails.

[0077] In practice, when the first functional permission does not include the function corresponding to the control operation currently being performed by the child, the cockpit domain controller can determine whether to respond to the child's current control operation based on the first functional permission. In this case, the cockpit domain controller can send an authentication request to the central control display and obtain the authentication information entered by the child on the display. If the authentication information is verified, it indicates that the actual intent of the child's current control operation originates from the intent of another driver or passenger, and the control operation can be responded to. If authentication fails, it indicates that the actual intent of the child's current control operation still originates from the child's own intent, and therefore the control operation can be ignored.

[0078] For example, after all occupants have left the target vehicle, if the sunroof is found to be open, the occupants can instruct a child to close it. When the child performs the sunroof-closing function, the cockpit domain controller determines, based on the acquired target data, that the child's intention in performing this action stems from the child's own intent. If the corresponding first functional permission does not include sunroof control permission, the cockpit domain controller does not respond. At this time, the cockpit domain controller can send an authentication request. If the password entered by the child in the request is successfully verified, it indicates that the actual intent of the child's current window control operation stems from the intent of another occupant, and therefore the control operation can be responded to. If the password entered by the child in the request is not successfully verified, it indicates that the actual intent of the child's current control operation still stems from the child's own intent, and therefore the control operation can be ignored.

[0079] As can be seen in this example, sending an authentication request to the central control display screen when the cockpit domain controller does not respond to the control operation made by the child according to his / her own intention can improve the accuracy of determining the source of the intention, and can more accurately provide the driver and passengers with the right to use, thus meeting the needs of the driver and passengers.

[0080] This application can divide electronic devices into functional units based on the above method examples. For example, each function can be divided into its own functional unit, or two or more functions can be integrated into one processing unit. The integrated unit can be implemented in hardware or as a software functional unit. It should be noted that the unit division in this application embodiment is illustrative and only represents one logical functional division; other division methods may be used in actual implementation.

[0081] Figure 3A This is a functional unit block diagram of a vehicle driver's seat function dynamic response device provided in an embodiment of this application. This vehicle driver's seat function dynamic response device 30 can be applied to, for example... Figure 1AThe vehicle driver's seat function dynamic response device 30, as shown in the electronic device of the vehicle driver's seat function dynamic response system, includes:

[0082] The acquisition unit 310 is used to acquire target data, which includes at least one of audio data and image data. The audio data is audio information inside the target vehicle collected by the sound pickup device, and the image data is image information inside the target vehicle collected by the in-vehicle camera. The judgment unit is used to determine whether a child has entered the driver's seat based on the target data.

[0083] The identification unit 320 is configured to identify the source of intent corresponding to the control operation based on the target data if a child is detected performing a control operation in the driver's seat. The source of intent is either the child's own intent or the intent of other drivers or passengers. The source of intent is used to characterize the object that drives the child to perform the control operation.

[0084] Matching unit 330 is used to match a first function permission to the driver's seat when the intention source is the child's own intention, and to determine whether to respond to the control operation based on the first function permission. The first function permission is used to represent the usage permission provided by the target vehicle to the child currently performing the control operation.

[0085] The response unit 340 is further configured to respond to the control operation according to the intention of another driver or passenger when the intention source is the intention of another driver or passenger.

[0086] In one possible example, when the target data includes audio data, in the step of identifying the source of intent corresponding to the control operation based on the target data, the identification unit 320 is specifically used to identify the audio data to obtain a semantic recognition result; determine whether the semantic recognition result includes a directional statement, which is used to characterize the intent of other occupants to instruct the child to perform a control operation, wherein the occupants in the target vehicle include the child entering the driver's seat and the other occupants; if yes, then the source of intent is determined to be the intent of other occupants; if no, then the source of intent is determined to be the child's intent.

[0087] In one possible example, when the target data includes image data, in terms of identifying the source of intent corresponding to the control operation based on the target data, the identification unit 320 is specifically configured to identify the actions of the occupants based on the image data, wherein the occupants in the target vehicle include a child entering the driver's seat and other occupants; determine whether other occupants have performed an auxiliary action, the auxiliary action being used to characterize the action of assisting a child to enter the driver's seat; if so, determine that the source of intent is the intent of other occupants; if not, determine that the source of intent is the child's intent.

[0088] In one possible example, if the intent originates from another driver or passenger, the device further includes an identity recognition unit, which is used to determine the identity of a target driver or passenger corresponding to the intent of the other driver or passenger; match a second functional permission corresponding to the target driver or passenger identity; determine, based on the second functional permission, whether the other driver or passenger has the permission to perform the control operation; if so, perform the control operation based on the intent of the other driver or passenger; if not, do not respond to the control operation.

[0089] In one possible example, if the intent originates from the intent of another driver or passenger, the device further includes a determining unit configured to determine, before responding to the control operation based on the intent of the other driver or passenger, whether the function corresponding to the control operation is a child-disabled function; if yes, then not responding to the control operation; if no, then performing the response to the control operation based on the intent of the other driver or passenger.

[0090] In one possible example, the first functional permission includes access to entertainment functions provided by the target vehicle to the child currently performing the control operation, and the domain controller system also includes a central control display screen, the entertainment functions being provided by software application functions presented on the central control display screen.

[0091] In one possible example, if the intent originates from the child's own intent, and if the control operation is for a non-entertainment function, the device further includes a sending unit, specifically configured to send an authentication request to the central control display screen; receive authentication information input from the central control display screen according to the authentication request; if the authentication is successful, respond to the control operation; if the authentication fails, do not respond to the control operation.

[0092] When using integrated units, the functional unit composition block diagram of the vehicle driver's seat function dynamic response device 40 provided in this application embodiment is as follows: Figure 3B As shown. In Figure 3BThe vehicle driver's seat function dynamic response device 40 includes a processing module 420 and a communication module 410. The processing module 420 controls and manages the actions of the vehicle driver's seat function dynamic response device 40, for example, the steps executed by the acquisition unit 310, the identification unit 320, the matching unit 330, and the response unit 340, and / or other processes for executing the techniques described herein. The communication module 410 supports interaction between the vehicle driver's seat function dynamic response device 40 and other devices. Figure 3B As shown, the vehicle driver's seat function dynamic response device 40 may also include a storage module 430, which is used to store the program code and data of the vehicle driver's seat function dynamic response device 40.

[0093] The processing module 420 can be a processor or controller, such as a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an ASIC, an FPGA, or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the embodiments of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc. The communication module 410 can be a transceiver, RF circuitry, or a communication interface, etc. The storage module 430 can be a memory.

[0094] All relevant content in each scenario involved in the above method embodiments can be referenced from the functional descriptions of the corresponding functional modules, and will not be repeated here. The above-mentioned vehicle driver's seat function dynamic response device can perform the above-mentioned... Figure 2 The steps performed by the cockpit domain controller in the dynamic response method for the driver's seat function of the vehicle shown.

[0095] This application also provides a computer storage medium storing a computer program for electronic data interchange, which causes a computer to perform some or all of the steps of any of the methods described in the above method embodiments, wherein the computer includes an electronic device.

[0096] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0097] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0098] In the several embodiments provided in this application, it should be understood that the disclosed apparatus can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of the units described above is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical or other forms.

[0099] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0100] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0101] If the integrated units described above are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage device (CMD). Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned memory includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0102] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, which may include: flash drive, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0103] The embodiments of this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A method for dynamic response of functions in the driver's seat of a vehicle, characterized in that, A cockpit domain controller is applied in a vehicle domain control system. The domain control system includes the cockpit domain controller, a microphone, and an in-vehicle camera, wherein the microphone and the in-vehicle camera are communicatively connected to the cockpit domain controller. The domain control system also includes a body domain controller, an autonomous driving domain controller, a powertrain domain controller, a chassis domain controller, and a central control display screen. The method includes: Acquire target data, the target data including at least one of audio data and image data, the audio data including audio information inside the vehicle collected by the sound pickup device, and the image data including image information inside the vehicle collected by the in-vehicle camera; When a child is detected performing a control operation in the driver's seat, the source of intent corresponding to the control operation is identified based on the target data. The source of intent is either the child's own intent or the intent of other drivers or passengers. The source of intent is used to characterize the object that drives the child to perform the control operation. If the intent originates from the child's own intent, then a first functional permission is assigned to the driver's seat, and it is determined whether to respond to the control operation based on the first functional permission. The first functional permission is used to represent the usage permission provided by the vehicle to the child currently performing the control operation. If the intent originates from the intent of other drivers or passengers, then the control operation is responded to based on the intent of the other drivers or passengers. in, When the target data includes audio data, the step of identifying the source of intent corresponding to the control operation based on the target data includes: identifying the audio data to obtain a semantic recognition result; determining whether the semantic recognition result includes a directional statement, the directional statement being used to characterize the intent of other occupants to instruct the child to perform a control operation, the occupants in the vehicle including the child entering the driver's seat and the other occupants; if yes, then the source of intent is determined to be the intent of other occupants; if no, then the source of intent is determined to be the child's intent. or, When the target data includes image data, the step of identifying the source of intent corresponding to the control operation based on the target data includes: identifying the actions of the occupants based on the image data, wherein the occupants in the vehicle include children entering the driver's seat and other occupants; determining whether other occupants have performed auxiliary actions, wherein the auxiliary actions are used to characterize the actions of assisting a child to enter the driver's seat; If so, then the intent originates from other drivers or passengers; If not, then the source of the intention is determined to be the child's intention.

2. The method as described in claim 1, characterized in that, When the source of the intent is the intent of another driver or passenger, the step of responding to the control operation based on the intent of the other driver or passenger includes: Identify the target driver / passenger whose intentions correspond to those of other drivers / passengers; Match the second functional permissions corresponding to the identity of the target driver or passenger; Based on the second functional permission, determine whether the other drivers and passengers have the permission to perform the control operation; If so, then the control operation in response to the intentions of the other drivers and passengers is performed; If not, the control operation will not be responded to.

3. The method as described in claim 1, characterized in that, When the source of the intent is the intent of another driver or passenger, before responding to the control operation based on the intent of the other driver or passenger, the following steps are included: Determine whether the function corresponding to the control operation is a child-disabled function; If so, then the control operation will not be responded to; If not, then the control operation is performed in response to the intentions of the other occupants.

4. The method as described in claim 3, characterized in that, When the source of the intent is the intent of another driver or passenger, before responding to the control operation based on the intent of the other driver or passenger, the following steps are included: Determine whether the function corresponding to the control operation is a child-disabled function; If so, then the control operation will not be responded to; If not, then the control operation is performed in response to the intentions of the other occupants.

5. The method according to any one of claims 1 to 4, characterized in that, The first functional permission includes the right to use the entertainment functions provided by the vehicle to the child currently performing the control operation. The domain controller system also includes a central control display screen, and the entertainment functions are provided by software application functions presented on the central control display screen.

6. The method as described in claim 5, characterized in that, If the intention originates from the child's own intention, and if the control operation is for a non-entertainment function, the method further includes: Send an authentication request to the central control display screen; Receive authentication information input from the central control display screen according to the authentication request; If the verification passes, then the control operation is executed. If verification fails, the control operation will not be responded to.

7. A dynamic response device for the driver's seat function of a vehicle, characterized in that, A cockpit domain controller is applied in a vehicle domain control system. The domain control system includes the cockpit domain controller, a microphone, and an in-vehicle camera. The microphone and the in-vehicle camera are communicatively connected to the cockpit domain controller. The domain control system also includes a body domain controller, an autonomous driving domain controller, a powertrain domain controller, a chassis domain controller, and a central control display screen. The device includes: The acquisition unit is used to acquire target data, which includes at least one of audio data and image data. The audio data is audio information inside the vehicle collected by the sound pickup device, and the image data is image information inside the vehicle collected by the in-vehicle camera. The judgment unit is used to determine whether a child has entered the driver's seat based on the target data. The identification unit is configured to, if a child is detected performing a control operation in the driver's seat, identify the source of intent corresponding to the control operation based on the target data, wherein the source of intent is the child's own intent or the intent of other drivers or passengers, and the source of intent is used to characterize the object that drives the child to perform the control operation; A matching unit is configured to match a first functional permission to the driver's seat when the intention source is the child's own intention, and to determine whether to respond to the control operation based on the first functional permission. The first functional permission is used to represent the usage permission provided by the vehicle to the child currently performing the control operation. The response unit is further configured to respond to the control operation according to the intention of another driver or passenger when the source of the intention is the intention of another driver or passenger; in, When the target data includes audio data, the step of identifying the source of intent corresponding to the control operation based on the target data includes: identifying the audio data to obtain a semantic recognition result; determining whether the semantic recognition result includes a directional statement, the directional statement being used to characterize the intent of other occupants to instruct the child to perform a control operation, the occupants in the vehicle including the child entering the driver's seat and the other occupants; if yes, then the source of intent is determined to be the intent of other occupants; if no, then the source of intent is determined to be the child's intent. or, When the target data includes image data, the step of identifying the source of intent corresponding to the control operation based on the target data includes: identifying the actions of the occupants based on the image data, wherein the occupants in the vehicle include children entering the driver's seat and other occupants; determining whether other occupants have performed auxiliary actions, wherein the auxiliary actions are used to characterize the actions of assisting a child to enter the driver's seat; If so, then the intent originates from other drivers or passengers; If not, then the source of the intention is determined to be the child's intention.

8. An electronic device, characterized in that, The system includes a processor, memory, and a communication interface, with one or more programs stored in the memory and configured to be executed by the processor, the programs including instructions for performing the steps of the method as described in any one of claims 1-7.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, wherein the computer program causes a computer to perform the steps of the method as described in any one of claims 1-7.

10. A computer program product, characterized in that, The computer program product includes a computer program that causes a computer to perform the steps of the method as described in any one of claims 1-7.

Images