Vehicle control instruction response duration determination method and device, equipment and medium

Abstract

The invention discloses a vehicle control instruction response duration determination method and device, equipment and a medium, and belongs to the technical field of automobiles. The method comprises the steps that after camera shooting equipment is started, a vehicle control instruction is issued, a first timestamp of issuing the vehicle control instruction is obtained, the camera shooting equipment is used for shooting the process that a vehicle control component responds to the vehicle control instruction, and the vehicle control component is vehicle-mounted equipment responding to the vehicle control instruction; according to a response mode of the vehicle control component, performing image processing on a shooting result of the camera equipment so as to determine a second timestamp of the vehicle control component in response to the vehicle control instruction; the difference value between the second timestamp and the first timestamp is calculated, the difference value serves as the response duration of the vehicle control component responding to the vehicle control instruction, and compared with a traditional mode that the time when the vehicle machine replies to receive the vehicle control instruction or the time when the page skips serves as the time when the vehicle control component responds to the vehicle control instruction, the real perception of a user is better met, and the user experience is improved. The accuracy of determining the response duration of the vehicle control component responding to the vehicle control instruction can be improved, and user complaints are reduced.

Description

Technical Field

[0001] The present application relates to the field of automobile technology, and in particular to a method, device, equipment and computer-readable storage medium for determining a vehicle control command response duration. Background Art

[0002] With the rapid development of smart cockpits in cars, voice interaction is an important part of smart cockpits, and its performance will directly affect users' evaluation of smart cockpits. How to efficiently and accurately determine the response time of the vehicle control component to the vehicle control command has become an urgent problem to be solved. The vehicle control component is a vehicle-mounted device that responds to the vehicle control command. In the related art, due to the limitations of the test equipment and the test method, the time when the vehicle computer replies to receive the vehicle control command or the time when the page jumps is used to replace the time when the vehicle control component responds to the vehicle control command, and the response time of the vehicle control command is determined by the time when the vehicle control command is issued and the time when the vehicle computer replies to receive the vehicle control command, or by the time when the vehicle control command is issued and the time when the page jumps. However, the time when the vehicle computer replies to receive the vehicle control command or the time when the page jumps is different from the time when the vehicle control component responds to the vehicle control command. Generally, the time when the vehicle control component responds to the vehicle control command is later than the time when the vehicle computer replies to receive the vehicle control command or the time when the page jumps, resulting in poor accuracy of the determined response time of the vehicle control component responding to the vehicle control command, which eventually causes user complaints. Summary of the invention

[0003] The present application provides a method, device, equipment and computer-readable storage medium for determining the response time of a vehicle control command, which can solve the technical problems in the prior art of using the time when the vehicle computer replies to the vehicle control command or the time when the page jumps instead of the time when the vehicle control component responds to the vehicle control command, resulting in poor accuracy of the response time of the vehicle control component in response to the vehicle control command, which ultimately causes user complaints.

[0004] In a first aspect, an embodiment of the present application provides a method for determining a vehicle control command response time, the method comprising:

[0005] After starting the camera device, issuing a vehicle control command and obtaining a first timestamp of issuing the vehicle control command, the camera device is used to shoot a process of a vehicle control component responding to the vehicle control command, the vehicle control component being a vehicle-mounted device that responds to the vehicle control command;

[0006] According to the response mode of the vehicle control component, performing image processing on the shooting result of the camera device to determine a second timestamp of the vehicle control component responding to the vehicle control command;

[0007] The difference between the second timestamp and the first timestamp is calculated, and the difference is used as the response time length of the vehicle control component to respond to the vehicle control instruction.

[0008] In combination with the first aspect, in one implementation, performing image processing on the shooting result of the camera device according to the response mode of the vehicle control component to determine the second timestamp of the vehicle control component responding to the vehicle control instruction includes:

[0009] When the response mode of the vehicle control component is to move the position of the vehicle control component, the position of the mark in the first frame of the shooting result is used as the initial position, the mark is fixed on the surface of the vehicle control component, and the color of the mark is different from the color of the vehicle control component itself;

[0010] Starting from the second frame of the photographing result, the first picture in which the position of the mark moves relative to the initial position is determined as the target picture;

[0011] The shooting timestamp of the target image is used as the second timestamp.

[0012] In combination with the first aspect, in one implementation, performing image processing on the shooting result of the camera device according to the response mode of the vehicle control component to determine the second timestamp of the vehicle control component responding to the vehicle control instruction includes:

[0013] When the response mode of the vehicle control component is to turn on or off the light, the light transmittance of the area corresponding to the mark in the first frame of the shooting result is used as the initial light transmittance, the mark is fixed on the surface of the vehicle control component, the surface material of the mark on the side close to the vehicle control component is opaque material, and the surface material of the other side of the mark is translucent material;

[0014] Starting from the second frame of the photographing result, determining the first picture in which the light transmittance of the area corresponding to the mark changes relative to the initial light transmittance as the target picture;

[0015] The shooting timestamp of the target image is used as the second timestamp.

[0016] In combination with the first aspect, in one implementation, performing image processing on the shooting result of the camera device according to the response mode of the vehicle control component to determine the second timestamp of the vehicle control component responding to the vehicle control instruction includes:

[0017] When the response mode of the vehicle control component is to turn on or off the light, the reflectivity of the area corresponding to the mark in the first frame of the shooting result is used as the initial reflectivity, the mark is fixed on the surface of the object illuminated by the light of the vehicle control component, and the surface material of the mark close to the vehicle control component is a reflective material;

[0018] Starting from the second frame of the photographing result, the first picture in which the reflectivity of the area corresponding to the mark changes relative to the initial reflectivity is determined as the target picture;

[0019] The shooting timestamp of the target image is used as the second timestamp.

[0020] In combination with the first aspect, in one implementation, performing image processing on the shooting result of the camera device according to the response mode of the vehicle control component to determine the second timestamp of the vehicle control component responding to the vehicle control instruction includes:

[0021] When the response mode of the vehicle control component is to control the air flow inside and outside the vehicle, the shape of the mark in the first frame of the shooting result is used as the initial shape, the mark is fixed at the vent of the vehicle control component, and the mark is a mark that is easy to flutter in the wind;

[0022] Starting from the second frame of the photographing result, determining the first picture in which the shape of the logo changes relative to the initial shape as the target picture;

[0023] The shooting timestamp of the target image is used as the second timestamp.

[0024] In combination with the first aspect, in one implementation, after determining the response time of each vehicle control component of the vehicle in response to the vehicle control command, the method further includes:

[0025] Obtaining the user's perception coefficient of each vehicle control component executing a vehicle control command;

[0026] Obtain the frequency coefficient of use of each vehicle control component by the user;

[0027] Based on each of the response time lengths, each of the perception coefficients, each of the usage frequency coefficients and the number of vehicle control components of the vehicle, a vehicle control instruction response time length is determined.

[0028] In combination with the first aspect, in one implementation, the vehicle control command response time of the vehicle is determined based on each of the response time, each of the perception coefficients, each of the usage frequency coefficients and the number of vehicle control components of the vehicle, and the corresponding formula is:

[0029]

[0030] Among them, T is the vehicle control command response time, N i is the response time of the i-th vehicle control component to the vehicle control command, a i is the user's perception coefficient of executing the vehicle control command on the i-th vehicle control component, b i is the frequency coefficient of the user's use of the i-th vehicle control component, and N is the number of vehicle control components.

[0031] In a second aspect, an embodiment of the present application provides a vehicle control command response time determination device, the vehicle control command response time determination device comprising:

[0032] an acquisition module, used to issue a vehicle control command and obtain a first timestamp of the issuance of the vehicle control command after starting a camera device, wherein the camera device is used to shoot a process of a vehicle control component responding to the vehicle control command, and the vehicle control component is a vehicle-mounted device that responds to the vehicle control command;

[0033] An image processing module, used for performing image processing on the shooting result of the camera device according to the response mode of the vehicle control component, so as to determine a second timestamp of the vehicle control component responding to the vehicle control instruction;

[0034] The calculation module is used to calculate the difference between the second timestamp and the first timestamp, and use the difference as the response time length of the vehicle control component to respond to the vehicle control instruction.

[0035] In the third aspect, an embodiment of the present application provides a vehicle control command response time determination device, the vehicle control command response time determination device comprising a processor, a memory, and a vehicle control command response time determination program stored in the memory and executable by the processor, wherein when the vehicle control command response time determination program is executed by the processor, the steps of the vehicle control command response time determination method as described in any one of the first aspects are implemented.

[0036] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a vehicle control command response time determination program is stored. When the vehicle control command response time determination program is executed by a processor, the steps of the vehicle control command response time determination method as described in any one of the first aspects are implemented.

[0037] The beneficial effects brought by the technical solution provided by the embodiments of the present application include:

[0038] After turning on a camera device, a vehicle control instruction is issued and a first timestamp of the vehicle control instruction is obtained, wherein the camera device is used to shoot a process of a vehicle control component responding to the vehicle control instruction, and the vehicle control component is a vehicle-mounted device that responds to the vehicle control instruction; according to the response method of the vehicle control component, image processing is performed on the shooting result of the camera device to determine a second timestamp of the vehicle control component responding to the vehicle control instruction; the difference between the second timestamp and the first timestamp is calculated, and the difference is used as the response time of the vehicle control component responding to the vehicle control instruction; image processing is used to determine the timestamp of the vehicle control component responding to the vehicle control instruction. Compared with the traditional method of taking the time when the vehicle computer replies to receiving the vehicle control instruction or the time when the page jumps as the time when the vehicle control component responds to the vehicle control instruction, this method is more in line with the user's real perception, can improve the accuracy of determining the response time of the vehicle control component responding to the vehicle control instruction, and reduce user complaints. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 This is a flow chart of a first embodiment of a method for determining a vehicle control command response time of the present application;

[0040] Figure 2 This is a functional module diagram of an embodiment of a device for determining a vehicle control command response duration of the present application;

[0041] Figure 3 A schematic diagram of the hardware structure of a vehicle control command response time determination device involved in an embodiment of the present application. DETAILED DESCRIPTION

[0042] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0043] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0044] In a first aspect, an embodiment of the present application provides a method for determining the response duration of a vehicle control command.

[0045] In one embodiment, referring to Figure 1 , Figure 1 This is a flow chart of the first embodiment of the method for determining the vehicle control command response time of the present application. Figure 1 As shown, the method for determining the vehicle control command response time includes:

[0046] Step 110: after starting the camera device, issuing a vehicle control command and obtaining a first timestamp of issuing the vehicle control command, the camera device is used to shoot a process of the vehicle control component responding to the vehicle control command, the vehicle control component being a vehicle-mounted device that responds to the vehicle control command;

[0047] Among them, the vehicle control components are vehicle-mounted devices that respond to vehicle control commands, including but not limited to windows, seats, sunroofs, sunshades, trunks, rearview mirrors, exterior lights, interior lights, air conditioners, etc. The camera equipment can be arranged inside or outside the vehicle to shoot the process of the vehicle control components responding to the vehicle control commands. The vehicle control commands can be issued through an artificial mouth arranged on the base model, and the first timestamp of issuing the vehicle control commands can be collected using an audio processing module. The base model simulates the upper part of a person, and the artificial mouth is placed at the mouth position of the base model. Similarly, the base model can be arranged inside or outside the vehicle.

[0048] Preferably, the base model, artificial mouth, camera equipment and audio processing module can be integrated together to form a set of testing equipment. The camera equipment adopts a retractable and bendable universal structure and is fixed at the top position of the base model head, which can realize flexible alignment with vehicle control components at different positions on the vehicle.

[0049] In specific implementation, before issuing vehicle control instructions, the camera device needs to be turned on first to ensure that the camera device can record the moment when the vehicle control components respond to the vehicle control instructions; then the vehicle control instructions are issued through the artificial mouth arranged on the base model, and the audio processing module is used to collect the first timestamp of issuing the vehicle control instructions.

[0050] Step 120: performing image processing on the shooting result of the camera device according to the response mode of the vehicle control component to determine a second timestamp of the vehicle control component responding to the vehicle control command;

[0051] It is understandable that different vehicle control components execute vehicle control commands in different ways. For example, the window responds by moving the window position, the interior light responds by turning the light on or off, and the air conditioner responds by controlling the air flow inside and outside the vehicle. The shooting result of the camera device consists of multiple frames of pictures, among which the first frame of the picture can be regarded as a picture of the vehicle control component before the vehicle control command is issued.

[0052] In specific implementation, according to the response mode of the vehicle control component, the shooting result of the camera device is processed to determine the target picture when the vehicle control component starts to respond to the vehicle control command, and the shooting timestamp of the target picture is used as the second timestamp.

[0053] Exemplarily, when the vehicle control command is to open the window, the target image at which the window starts to respond to the vehicle control command is determined by comparing it with the first frame of the shooting result, and the shooting timestamp of the target image is used as the second timestamp.

[0054] Step 130: Calculate the difference between the second timestamp and the first timestamp, and use the difference as the response time of the vehicle control component to the vehicle control command.

[0055] It can be understood that the response time of the vehicle control component in response to the vehicle control command is the difference between the timestamp when the vehicle control component starts to respond to the vehicle control command and the timestamp when the vehicle control command is issued.

[0056] Exemplarily, when the vehicle control command is to open the window, the second timestamp when the window starts to respond to the vehicle control command is T2, and the first timestamp when the vehicle control command is issued is T1. By calculating the difference between T2 and T1, the response time of the window in response to the vehicle control command can be determined.

[0057] In this embodiment, after turning on the camera device, a vehicle control instruction is issued and a first timestamp for issuing the vehicle control instruction is obtained. The camera device is used to shoot a process of a vehicle control component responding to the vehicle control instruction. The vehicle control component is a vehicle-mounted device that responds to the vehicle control instruction. According to the response method of the vehicle control component, the shooting result of the camera device is image processed to determine a second timestamp when the vehicle control component responds to the vehicle control instruction. The difference between the second timestamp and the first timestamp is calculated, and the difference is used as the response duration of the vehicle control component to the vehicle control instruction. Image processing is used to determine the timestamp of the vehicle control component responding to the vehicle control instruction. Compared with the traditional method of taking the moment when the vehicle computer replies to receiving the vehicle control instruction or the moment when the page jumps as the moment when the vehicle control component responds to the vehicle control instruction, this method is more in line with the user's real perception, can improve the accuracy of determining the response duration of the vehicle control component to the vehicle control instruction, and reduce user complaints.

[0058] Furthermore, in one embodiment, the image processing of the shooting result of the camera device according to the response mode of the vehicle control component to determine the second timestamp of the vehicle control component responding to the vehicle control command includes:

[0059] Step 210: When the response mode of the vehicle control component is to move the position of the vehicle control component, the position of the mark in the first frame of the shooting result is used as the initial position, the mark is fixed on the surface of the vehicle control component, and the color of the mark is different from the color of the vehicle control component itself;

[0060] In specific implementation, when the vehicle control component responds by moving the position of the vehicle control component, a mark that can be distinguished from the color of the vehicle control component itself is pre-set on the surface of the vehicle control component. The position of the mark in the first frame of the shooting result is used as the initial position.

[0061] Step 220: starting from the second frame of the photographing result, determine the first picture in which the position of the mark moves relative to the initial position as the target picture;

[0062] Furthermore, starting from the second frame of the shooting result, the position of the mark in each frame is compared with the position of the mark in the first frame, and the target picture for the vehicle control component to start responding to the vehicle control command is determined by judging the position change of the mark. Specifically, the first picture in which the position of the mark moves relative to the initial position is determined as the target picture.

[0063] Step 230: Use the shooting timestamp of the target image as the second timestamp.

[0064] The shooting timestamp of the first picture in which the position of the mark moves relative to the initial position represents the timestamp when the vehicle control component starts to respond to the vehicle control instruction, so the shooting timestamp of the target picture is used as the second timestamp.

[0065] Exemplarily, a red mark is pasted on the surface of the vehicle window, and before and after the vehicle control command is issued, the timestamp when the vehicle window starts to respond to the vehicle control command is determined by determining the position change of the red mark.

[0066] In this embodiment, when the response method of the vehicle control component is to move the position of the vehicle control component, an image processing method is used to determine the position change of the mark fixed on the surface of the vehicle control component to determine the second timestamp of the vehicle control component responding to the vehicle control command. The determination efficiency is high and meets the user's real feelings.

[0067] Furthermore, in one embodiment, the image processing of the shooting result of the camera device according to the response mode of the vehicle control component to determine the second timestamp of the vehicle control component responding to the vehicle control command includes:

[0068] Step 310: When the response mode of the vehicle control component is to turn on or off the light, the light transmittance of the area corresponding to the mark in the first frame of the shooting result is used as the initial light transmittance, the mark is fixed on the surface of the vehicle control component, the surface material of the mark on the side close to the vehicle control component is an opaque material, and the surface material of the other side of the mark is a translucent material;

[0069] In specific implementation, when the vehicle control component responds to turning on or off the light, a mark is fixed on the surface of the vehicle control component in advance, and the surface material of the mark on the side close to the vehicle control component is opaque material, and the surface material of the other side of the mark is translucent material. The light transmittance of the area corresponding to the mark in the first frame of the shooting result is used as the initial light transmittance.

[0070] Step 320: starting from the second frame of the photographing result, determine the first picture in which the transmittance of the area corresponding to the mark changes relative to the initial transmittance as the target picture;

[0071] Furthermore, starting from the second frame of the shooting result, the transmittance of the area corresponding to the mark in each frame is compared with the initial transmittance, and the target image for the vehicle control component to start responding to the vehicle control command is determined by judging the change in the transmittance of the mark area. Specifically, the first image in which the transmittance of the area corresponding to the mark changes relative to the initial transmittance is determined as the target image.

[0072] Step 330: Use the shooting timestamp of the target image as the second timestamp.

[0073] The shooting timestamp of the first picture in which the transmittance of the area corresponding to the mark changes relative to the initial transmittance represents the timestamp when the vehicle control component starts to respond to the vehicle control command, so the shooting timestamp of the target picture is used as the second timestamp.

[0074] Exemplarily, a logo is pasted on the surface of the headlight, the front of the logo is acrylic material of the same color as the lampshade, and the back of the logo is opaque material. Before and after the vehicle control command is issued, that is, when the light is turned on or off, the target image at which the headlight starts to respond to the vehicle control command is determined by determining the change in the transmittance of the area corresponding to the logo in the shooting result relative to the initial transmittance, and the shooting timestamp of the target image is used as the second timestamp. Since the logo is opaque, the image will have obvious differences, so the efficiency of determining the target image is high.

[0075] In step 310-step 330, when it is necessary to determine the second timestamp of the interior lights responding to the vehicle control command, the camera device is arranged inside the vehicle; when it is necessary to determine the second timestamp of the exterior lights responding to the vehicle control command, the camera device is arranged outside the vehicle.

[0076] In this embodiment, when the response mode of the vehicle control component is to turn on or off the light, an image processing method is used to determine the transmittance change of the area corresponding to the logo fixed on the surface of the vehicle control component to determine the second timestamp of the vehicle control component responding to the vehicle control command. The determination efficiency is high and meets the user's real experience.

[0077] Furthermore, in one embodiment, the performing of image processing on the shooting result of the camera device according to the response mode of the vehicle control component to determine the second timestamp of the vehicle control component responding to the vehicle control command includes:

[0078] Step 410: When the response mode of the vehicle control component is to turn on or off the light, the reflectivity of the area corresponding to the mark in the first frame of the shooting result is used as the initial reflectivity, the mark is fixed on the surface of the object illuminated by the light of the vehicle control component, and the surface material of the side of the mark close to the vehicle control component is a reflective material;

[0079] In a specific implementation, when the vehicle control component responds by turning on or off the light, a mark is fixed on the surface of the object illuminated by the light of the vehicle control component, and the surface material of the mark close to the vehicle control component is a reflective material. The reflectivity of the area corresponding to the mark in the first frame of the shooting result is used as the initial reflectivity.

[0080] Step 420: starting from the second frame of the photographing result, determine the first picture in which the reflectivity of the area corresponding to the mark changes relative to the initial reflectivity as the target picture;

[0081] Furthermore, starting from the second frame of the shooting result, the reflectivity of the area corresponding to the mark in each frame is compared with the initial reflectivity, and the target image for the vehicle control component to start responding to the vehicle control command is determined by judging the change in the reflectivity of the mark area. Specifically, the first image in which the reflectivity of the area corresponding to the mark changes relative to the initial reflectivity is determined as the target image.

[0082] Step 430: Use the shooting timestamp of the target image as the second timestamp.

[0083] The shooting timestamp of the first picture in which the reflectivity of the area corresponding to the mark changes relative to the initial reflectivity represents the timestamp when the vehicle control component starts to respond to the vehicle control command, so the shooting timestamp of the target picture is used as the second timestamp.

[0084] Exemplarily, a mark with reflective properties is pasted on the surface of the headlight. Before and after the vehicle control command is issued, that is, when the light is turned on or off, the target image at which the headlight starts to respond to the vehicle control command is determined by determining the change in the reflectivity of the area corresponding to the mark in the shooting result relative to the initial reflectivity, and the shooting timestamp of the target image is used as the second timestamp. Due to the reflection at the mark, the image will have obvious differences, so the efficiency of determining the target image is high.

[0085] In step 410-step 430, when it is necessary to determine the second timestamp of the interior lights responding to the vehicle control command, the camera device is arranged outside the vehicle; when it is necessary to determine the second timestamp of the exterior lights responding to the vehicle control command, the camera device is arranged inside the vehicle.

[0086] In this embodiment, when the response mode of the vehicle control component is to turn on or off the light, an image processing method is used to determine the change in reflectivity of the area corresponding to the logo fixed on the surface of the vehicle control component to determine the second timestamp of the vehicle control component responding to the vehicle control command. The determination efficiency is high and meets the user's real experience.

[0087] It can be understood that when the camera is inside the vehicle and the second timestamp of the interior lights responding to the vehicle control command is determined by steps 310-340, if the second timestamp of the exterior lights responding to the vehicle control command needs to be determined, the camera does not need to be moved outside the vehicle, and a reflective mark is only required to be fixed on the surface of the object illuminated by the exterior lights, and the second timestamp of the exterior lights responding to the vehicle control command is determined by steps 410-430. The second timestamps of the interior lights and exterior lights responding to the vehicle control command can be determined without moving the camera back and forth, and the test efficiency is high.

[0088] Similarly, when the camera is outside the vehicle, and after the second timestamp of the exterior lights responding to the vehicle control command is determined using steps 310-340, if the second timestamp of the interior lights responding to the vehicle control command needs to be determined, the camera does not need to be moved into the vehicle, and a reflective mark is only required to be fixed on the surface of the object illuminated by the interior lights, and the second timestamp of the interior lights responding to the vehicle control command is determined using steps 410-430. The second timestamps of the interior lights and exterior lights responding to the vehicle control command can be determined without moving the camera back and forth, and the test efficiency is high.

[0089] Furthermore, in one embodiment, the performing of image processing on the shooting result of the camera device according to the response mode of the vehicle control component to determine the second timestamp of the vehicle control component responding to the vehicle control command includes:

[0090] Step 510: When the response mode of the vehicle control component is to control the air flow inside and outside the vehicle, the shape of the mark in the first frame of the shooting result is used as the initial shape, and the mark is fixed at the vent of the vehicle control component, and the mark is a mark that is easy to flutter in the wind;

[0091] In specific implementation, when the response mode of the vehicle control component is to control the air flow inside and outside the vehicle, a mark that is easy to flutter in the wind is fixed at the vent of the vehicle control component in advance, such as a ribbon, a paper strip, a cloth strip, etc. The shape of the mark in the first frame of the shooting result is used as the initial shape.

[0092] Step 520: starting from the second frame of the photographing result, determine the first picture in which the shape of the logo changes relative to the initial shape as the target picture;

[0093] Furthermore, starting from the second frame of the shooting result, the shape of the mark in each frame is compared with the shape of the mark in the first frame, and the target image at which the vehicle control component starts to respond to the vehicle control command is determined by judging the shape change of the mark. Specifically, due to the change of airflow, the shape of the ribbon will change significantly, so the first image in which the shape of the mark changes relative to the initial shape is determined as the target image.

[0094] Step 530: Use the shooting timestamp of the target image as the second timestamp.

[0095] The shooting timestamp of the first picture in which the shape of the logo changes relative to the initial shape represents the timestamp when the vehicle control component starts to respond to the vehicle control instruction, so the shooting timestamp of the target picture is used as the second timestamp.

[0096] Exemplarily, a ribbon is attached to the air vent of the air conditioner, and the timestamp when the air conditioner starts to respond to the vehicle control command is determined by determining the shape change of the ribbon before and after the vehicle control command is issued.

[0097] In this embodiment, when the response mode of the vehicle control component is to control the air flow inside and outside the vehicle, an image processing method is used to judge the shape change of the logo fixed at the air vent of the vehicle control component to determine the second timestamp of the vehicle control component responding to the vehicle control command. The determination efficiency is high and meets the user's real feelings.

[0098] Furthermore, in one embodiment, after determining the response time of each vehicle control component of the vehicle in response to the vehicle control command, the method further includes:

[0099] Step 610, obtaining the user's perception coefficient of each vehicle control component executing the vehicle control command;

[0100] It is understandable that users have different perception coefficients of the execution of vehicle control commands by various vehicle control components. For example, users have a higher tolerance for the speed of trunk adjustment because it is outside the cabin and the execution perception is low; users have a lower tolerance for the speed of seat adjustment because they sit on the seat and can quickly feel its movement changes.

[0101] During specific implementation, the user's perception coefficient of the execution of vehicle control commands by each vehicle control component can be determined through user interviews, questionnaires, etc., so as to find the key factors felt by the user and give calculation weights based on the user experience.

[0102] Step 620, obtaining the user's usage frequency coefficient of each vehicle control component;

[0103] It is understandable that users have different usage frequency coefficients for various vehicle control components. For example, opening the window is a high-frequency command, while opening the electric rear wing is a low-frequency command.

[0104] In the specific implementation, the user usage frequency coefficient of each vehicle control component is determined through the user tracking data of previous models, so as to find the key factors felt by the user and give calculation weights based on the user experience.

[0105] Step 630: Determine the vehicle control command response time of the vehicle based on each of the response time periods, each of the perception coefficients, each of the usage frequency coefficients, and the number of vehicle control components of the vehicle.

[0106] In specific implementation, the vehicle control command response time of the vehicle is determined based on the response time of each vehicle control component in response to the vehicle control command, the perception coefficient of each vehicle control component executing the vehicle control command, the usage frequency coefficient of each vehicle control component and the number of vehicle control components in the vehicle.

[0107] The vehicle control command response time of the vehicle is determined based on the response time, the perception coefficient, the usage frequency coefficient and the number of vehicle control components of the vehicle, and the corresponding formula is:

[0108]

[0109] Among them, T is the vehicle control command response time, N i is the response time of the i-th vehicle control component to the vehicle control command, a i is the user's perception coefficient of executing the vehicle control command on the i-th vehicle control component, b i is the frequency coefficient of the user's use of the i-th vehicle control component, and N is the number of vehicle control components.

[0110] In this embodiment, the perception coefficient of the user on the execution of the vehicle control command by each vehicle control component and the frequency coefficient of the user on the use of each vehicle control component are obtained; based on the response time, the perception coefficient, the frequency coefficient and the number of vehicle control components of the vehicle, the vehicle control command response time of the vehicle is determined. The vehicle control command response time of the vehicle determined in this way is consistent with the user's actual feeling, which has guiding significance in the early stage of new model competitive benchmarking and function acceptance.

[0111] It should be noted that this application is also applicable to voice command response time testing where the interaction is limited to the vehicle computer, such as multimedia and navigation. During the test, you only need to adjust the retractable gimbal camera to aim the camera at the vehicle computer screen and determine the time when the vehicle computer page changes.

[0112] In a second aspect, an embodiment of the present application also provides a device for determining the response duration of a vehicle control command.

[0113] In one embodiment, referring to Figure 2 , Figure 2 This is a functional module diagram of an embodiment of a vehicle control command response time determination device of the present application. Figure 2 As shown, the vehicle control command response time determination device 200 includes:

[0114] The acquisition module 210 is used to issue a vehicle control command and obtain a first timestamp of the vehicle control command after the camera device is turned on. The camera device is used to shoot a process of the vehicle control component responding to the vehicle control command. The vehicle control component is a vehicle-mounted device that responds to the vehicle control command.

[0115] An image processing module 220, configured to perform image processing on the shooting result of the camera device according to the response mode of the vehicle control component, so as to determine a second timestamp of the vehicle control component responding to the vehicle control command;

[0116] The calculation module 230 is used to calculate the difference between the second timestamp and the first timestamp, and use the difference as the response time length of the vehicle control component to respond to the vehicle control instruction.

[0117] Furthermore, in one embodiment, the image processing module is specifically used for:

[0118] When the response mode of the vehicle control component is to move the position of the vehicle control component, the position of the mark in the first frame of the shooting result is used as the initial position, the mark is fixed on the surface of the vehicle control component, and the color of the mark is different from the color of the vehicle control component itself;

[0119] Starting from the second frame of the photographing result, the first picture in which the position of the mark moves relative to the initial position is determined as the target picture;

[0120] The shooting timestamp of the target image is used as the second timestamp.

[0121] Furthermore, in one embodiment, the image processing module is specifically used for:

[0122] When the response mode of the vehicle control component is to turn on or off the light, the light transmittance of the area corresponding to the mark in the first frame of the shooting result is used as the initial light transmittance, the mark is fixed on the surface of the vehicle control component, the surface material of the mark on the side close to the vehicle control component is opaque material, and the surface material of the other side of the mark is translucent material;

[0123] Starting from the second frame of the photographing result, determining the first picture in which the light transmittance of the area corresponding to the mark changes relative to the initial light transmittance as the target picture;

[0124] The shooting timestamp of the target image is used as the second timestamp.

[0125] Furthermore, in one embodiment, the image processing module is specifically used for:

[0126] When the response mode of the vehicle control component is to turn on or off the light, the reflectivity of the area corresponding to the mark in the first frame of the shooting result is used as the initial reflectivity, the mark is fixed on the surface of the object illuminated by the light of the vehicle control component, and the surface material of the mark close to the vehicle control component is a reflective material;

[0127] Starting from the second frame of the photographing result, the first picture in which the reflectivity of the area corresponding to the mark changes relative to the initial reflectivity is determined as the target picture;

[0128] The shooting timestamp of the target image is used as the second timestamp.

[0129] Furthermore, in one embodiment, the image processing module is specifically used for:

[0130] When the response mode of the vehicle control component is to control the air flow inside and outside the vehicle, the shape of the mark in the first frame of the shooting result is used as the initial shape, the mark is fixed at the vent of the vehicle control component, and the mark is a mark that is easy to flutter in the wind;

[0131] Starting from the second frame of the photographing result, determining the first picture in which the shape of the logo changes relative to the initial shape as the target picture;

[0132] The shooting timestamp of the target image is used as the second timestamp.

[0133] Furthermore, in one embodiment, the vehicle control command response time determination device further includes a determination module, and the determination module is specifically configured to:

[0134] After determining the response time of each vehicle control component of the vehicle in response to the vehicle control command, obtaining the user's perception coefficient of each vehicle control component executing the vehicle control command;

[0135] Obtain the frequency coefficient of use of each vehicle control component by the user;

[0136] Based on each of the response time lengths, each of the perception coefficients, each of the usage frequency coefficients and the number of vehicle control components of the vehicle, a vehicle control instruction response time length is determined.

[0137] Further, in one embodiment, the determination module is specifically used to determine the vehicle control command response time of the vehicle according to the following formula, and the corresponding formula is:

[0138]

[0139] Among them, T is the vehicle control command response time, N i is the response time of the i-th vehicle control component to the vehicle control command, a i is the user's perception coefficient of executing the vehicle control command on the i-th vehicle control component, b i is the frequency coefficient of the user's use of the i-th vehicle control component, and N is the number of vehicle control components.

[0140] Among them, the functional implementation of each module in the above-mentioned vehicle control command response time determination device corresponds to the various steps in the above-mentioned vehicle control command response time determination method embodiment, and its functions and implementation processes will not be repeated here one by one.

[0141] In a third aspect, an embodiment of the present application provides a device for determining the response time of a vehicle control command. The device for determining the response time of a vehicle control command may be a personal computer (PC), a laptop computer, a server, or other device with data processing capabilities.

[0142] Reference Figure 3 , Figure 3 Schematic diagram of the hardware structure of the vehicle control command response time determination device involved in the embodiment of the present application. In the embodiment of the present application, the vehicle control command response time determination device may include a processor, a memory, a communication interface and a communication bus.

[0143] The communication bus may be of any type and is used to interconnect the processor, the memory, and the communication interface.

[0144] The communication interface includes an input / output (I / O) interface, a physical interface, and a logical interface, etc., which are used to interconnect the components inside the vehicle control command response time determination device, and an interface used to interconnect the vehicle control command response time determination device with other devices (such as other computing devices or user devices). The physical interface can be an Ethernet interface, an optical fiber interface, an ATM interface, etc.; the user device can be a display, a keyboard, etc.

[0145] The memory can be various types of storage media, such as random access memory (RAM), read-only memory (ROM), non-volatile RAM (NVRAM), flash memory, optical storage, hard disk, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), etc.

[0146] The processor may be a general-purpose processor, and the general-purpose processor may call the vehicle control instruction response time determination program stored in the memory, and execute the vehicle control instruction response time determination method provided in the embodiment of the present application. For example, the general-purpose processor may be a central processing unit (CPU). The method executed when the vehicle control instruction response time determination program is called may refer to the various embodiments of the vehicle control instruction response time determination method of the present application, and will not be repeated here.

[0147] Those skilled in the art will understand that Figure 3 The hardware structure shown in the figure does not constitute a limitation on the present application, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0148] In a fourth aspect, an embodiment of the present application also provides a computer-readable storage medium.

[0149] A vehicle control command response time determination program is stored on the computer-readable storage medium of the present application, wherein when the vehicle control command response time determination program is executed by the processor, the steps of the vehicle control command response time determination method as described above are implemented.

[0150] Among them, the method implemented when the vehicle control command response time determination program is executed can refer to the various embodiments of the vehicle control command response time determination method of the present application, and will not be repeated here.

[0151] It should be noted that the serial numbers of the above-mentioned embodiments of the present application are only for description and do not represent the advantages or disadvantages of the embodiments.

[0152] The terms "including" and "having" and any variations thereof in the specification and claims of this application and the above-mentioned drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices. The terms "first", "second" and "third" are used to distinguish different objects, etc., and do not represent a sequence, nor do they limit "first", "second" and "third" to different types.

[0153] In the description of the embodiments of the present application, "exemplary", "for example" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary", "for example" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary", "for example" or "for example" is intended to present related concepts in a specific way.

[0154] In the description of the embodiments of the present application, unless otherwise specified, “ / ” means or, for example, A / B can mean A or B; the “and / or” in the text is merely a description of the association relationship of associated objects, indicating that three relationships may exist, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, “multiple” refers to two or more than two.

[0155] In some processes described in the embodiments of the present application, multiple operations or steps that appear in a specific order are included, but it should be understood that these operations or steps may not be executed in the order in which they appear in the embodiments of the present application or in parallel, and the sequence number of the operation is only used to distinguish the different operations, and the sequence number itself does not represent any execution order. In addition, these processes may include more or fewer operations, and these operations or steps may be executed in sequence or in parallel, and these operations or steps may be combined.

[0156] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, disk, CD) as described above, and includes a number of instructions for a terminal device to execute the methods described in each embodiment of the present application.

[0157] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A method for determining the response time of a vehicle control command, characterized in that: The method for determining the vehicle control command response time includes: After starting the camera device, issuing a vehicle control command and obtaining a first timestamp of issuing the vehicle control command, the camera device is used to shoot a process of a vehicle control component responding to the vehicle control command, the vehicle control component being a vehicle-mounted device that responds to the vehicle control command; According to the response mode of the vehicle control component, performing image processing on the shooting result of the camera device to determine a second timestamp of the vehicle control component responding to the vehicle control command; The difference between the second timestamp and the first timestamp is calculated, and the difference is used as the response time length of the vehicle control component to respond to the vehicle control instruction.

2. The method for determining the vehicle control command response time as claimed in claim 1, characterized in that: The step of performing image processing on the shooting result of the camera device according to the response mode of the vehicle control component to determine the second timestamp of the vehicle control component responding to the vehicle control instruction includes: When the response mode of the vehicle control component is to move the position of the vehicle control component, the position of the mark in the first frame of the shooting result is used as the initial position, the mark is fixed on the surface of the vehicle control component, and the color of the mark is different from the color of the vehicle control component itself; Starting from the second frame of the photographing result, the first picture in which the position of the mark moves relative to the initial position is determined as the target picture; The shooting timestamp of the target image is used as the second timestamp.

3. The method for determining the vehicle control command response time as claimed in claim 1, characterized in that: The step of performing image processing on the shooting result of the camera device according to the response mode of the vehicle control component to determine the second timestamp of the vehicle control component responding to the vehicle control instruction includes: When the response mode of the vehicle control component is to turn on or off the light, the light transmittance of the area corresponding to the mark in the first frame of the shooting result is used as the initial light transmittance, the mark is fixed on the surface of the vehicle control component, the surface material of the mark on the side close to the vehicle control component is opaque material, and the surface material of the other side of the mark is translucent material; Starting from the second frame of the photographing result, determining the first picture in which the light transmittance of the area corresponding to the mark changes relative to the initial light transmittance as the target picture; The shooting timestamp of the target image is used as the second timestamp.

4. The method for determining the vehicle control command response time as claimed in claim 1, characterized in that: The step of performing image processing on the shooting result of the camera device according to the response mode of the vehicle control component to determine the second timestamp of the vehicle control component responding to the vehicle control instruction includes: When the response mode of the vehicle control component is to turn on or off the light, the reflectivity of the area corresponding to the mark in the first frame of the shooting result is used as the initial reflectivity, the mark is fixed on the surface of the object illuminated by the light of the vehicle control component, and the surface material of the mark close to the vehicle control component is a reflective material; Starting from the second frame of the photographing result, the first picture in which the reflectivity of the area corresponding to the mark changes relative to the initial reflectivity is determined as the target picture; The shooting timestamp of the target image is used as the second timestamp.

5. The method for determining the vehicle control command response time as claimed in claim 1, characterized in that: The step of performing image processing on the shooting result of the camera device according to the response mode of the vehicle control component to determine the second timestamp of the vehicle control component responding to the vehicle control instruction includes: When the response mode of the vehicle control component is to control the air flow inside and outside the vehicle, the shape of the mark in the first frame of the shooting result is used as the initial shape, the mark is fixed at the vent of the vehicle control component, and the mark is a mark that is easy to flutter in the wind; Starting from the second frame of the photographing result, determining the first picture in which the shape of the logo changes relative to the initial shape as the target picture; The shooting timestamp of the target image is used as the second timestamp.

6. The method for determining the vehicle control command response time as claimed in claim 1, characterized in that: After determining the response time of each vehicle control component of the vehicle in response to the vehicle control command, the method further includes: Obtaining the user's perception coefficient of each vehicle control component executing a vehicle control command; Obtain the frequency coefficient of use of each vehicle control component by the user; Based on each of the response time lengths, each of the perception coefficients, each of the usage frequency coefficients and the number of vehicle control components of the vehicle, a vehicle control instruction response time length is determined.

7. The method for determining the vehicle control command response time as claimed in claim 6, characterized in that: The vehicle control command response time of the vehicle is determined based on the response time, the perception coefficient, the usage frequency coefficient and the number of vehicle control components of the vehicle, and the corresponding formula is: Among them, T is the vehicle control command response time, N i is the response time of the i-th vehicle control component to the vehicle control command, a i is the user's perception coefficient of executing the vehicle control command on the i-th vehicle control component, b i is the frequency coefficient of the user's use of the i-th vehicle control component, and N is the number of vehicle control components.

8. A device for determining the response time of a vehicle control command, characterized in that: The vehicle control instruction response time determination device comprises: an acquisition module, used to issue a vehicle control command and obtain a first timestamp of the vehicle control command after starting a camera device, wherein the camera device is used to shoot a process of a vehicle control component responding to the vehicle control command, and the vehicle control component is a vehicle-mounted device that responds to the vehicle control command; An image processing module, used for performing image processing on the shooting result of the camera device according to the response mode of the vehicle control component, so as to determine a second timestamp of the vehicle control component responding to the vehicle control instruction; The calculation module is used to calculate the difference between the second timestamp and the first timestamp, and use the difference as the response time length of the vehicle control component to respond to the vehicle control instruction.

9. A vehicle control command response time determination device, characterized in that: The vehicle control command response time determination device includes a processor, a memory, and a vehicle control command response time determination program stored in the memory and executable by the processor, wherein when the vehicle control command response time determination program is executed by the processor, the steps of the vehicle control command response time determination method as described in any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a vehicle control command response time determination program, wherein when the vehicle control command response time determination program is executed by the processor, the steps of the vehicle control command response time determination method as described in any one of claims 1 to 7 are implemented.

Images