Method and device for judging activity state of target object in vehicle
By arranging distance measuring sensors and sensors in the car and establishing a virtual three-dimensional coordinate system, the problem that pets in the car cannot obtain their position and status in blind spots is solved, and accurate judgment and timely response to the pet's status are achieved.
Patent Information
- Application Number
- CN202410975105.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-19
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2044-07-19
AI Technical Summary
When the pet is in a blind spot outside the area that can be captured by the shooting equipment, it is impossible to obtain the position and status of the pet through image capturing or learning processing, resulting in the inability to correctly and promptly respond to the pet's needs.
By arranging multiple ranging sensors on the vehicle, a virtual three-dimensional coordinate system is established, and a signal transmitter is set up on the induction member, the position and orientation of the induction member are calculated using the three-point positioning principle and signal distance measurement, and the activity status of the target object is judged by the target object. .
Accurate acquisition of pet location and orientation in the car, solves the blind spot problem, and ensures timely response to pet status and meets needs.
Smart Images

Figure CN118901615A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of smart cockpits, and in particular to a method and device for determining the activity status of a target object in a vehicle. Background Art
[0002] In recent years, with the continuous increase in the number of pets, dogs and cats account for the majority. With the rapid growth of industries such as transportation and tourism, and with the increase in the rate of pet owners taking short-distance / long-term self-driving tours around the city and driving back home during the Spring Festival, the scene of self-driving with pets is becoming more and more frequent. Therefore, in the car, while ensuring the safety of the driver and passengers themselves, it is also necessary to ensure the normal placement and supervision of the pets to meet the activities and needs of the pets.
[0003] Since pets are living things, their actual movements and positions in the cabin are not completely controlled except when they are placed and fixed in bags or airline boxes in the car. When riding in a car, pets such as dogs and cats may switch between normal riding, interacting with their owners, looking out from a height to observe the road outside the car, and feeling carsick in special scenarios such as traffic jams. Therefore, when there are many items stored in the car and the pet owner cannot always pay attention to the pet's status, especially when there is only one driver in the car and no other passengers, the driver cannot always pay attention to the pet's status during driving. At this time, it is very necessary to automatically judge the pet's needs and provide services related to the pet's needs.
[0004] At present, the identification of the position, status and action of pets in the car is mainly dealt with through methods such as image recognition, motion capture, odor collection, and sound collection and recognition. The main purpose is to turn on the pet mode in time to prevent the pet from suffocating in the closed cabin when the pet is left alone in an unmanned cabin. The existing methods that rely on image recognition technology and voice recognition modules, use pre-installed camera devices in the car to capture and process images to identify whether the pet is in the car, and compare the collected voice with the pre-recorded voice to determine the pet's status. When there are many items in the car, the pet happens to move to the blind spot of the shooting, or there is noise in the outside world and the pet is in a sleeping state and the sound volume is small and difficult to capture, it is impossible to respond to the pet's status correctly and in time. Summary of the invention
[0005] The present application provides a method and device for determining the activity status of a target object in a vehicle, which can solve the problem that when the target object in the vehicle is in a blind spot outside the capture area of a shooting device, the position and status of the target object cannot be obtained by image capture or learning processing.
[0006] In a first aspect, an embodiment of the present application provides a method for determining the activity state of a target object in a vehicle, the method comprising:
[0007] A virtual three-dimensional coordinate system is established by using a plurality of distance measuring sensors arranged on the vehicle, and a corresponding relationship between the sensing element arranged at the target object and the virtual three-dimensional coordinate system is established;
[0008] Based on the relative position relationship between the sensing element and the distance measuring sensor, the position and orientation information of the sensing element is periodically obtained;
[0009] The activity state of the target object is determined based on the changes in the position and orientation of the sensing element within a unit time.
[0010] In combination with the first aspect, in one implementation, establishing a virtual three-dimensional coordinate system by using a plurality of distance measuring sensors arranged on the vehicle specifically includes:
[0011] Based on the three-point positioning principle, a distance measuring sensor is arranged at two symmetrical points of the vehicle parallel to the vehicle body floor, and a distance measuring sensor is arranged at a position higher than the vehicle body floor;
[0012] A virtual three-dimensional coordinate system is constructed according to the position coordinates of three distance measuring sensors arranged on the vehicle;
[0013] Wherein, the distance measuring sensor can measure the distance of the sensing element.
[0014] In combination with the first aspect, in one implementation,
[0015] The sensing element is in the form of a collar structure with an axial dimension, and a plurality of signal transmitters with directional visual markings are arranged in a surrounding manner on the outer circumference of the sensing element;
[0016] The signal transmitter comprises two signal transmitting points which are arranged at intervals and along the central axis direction of the induction element, and the signal transmitting points on the same side of the induction element have the same signal frequency band.
[0017] In combination with the first aspect, in one implementation, obtaining the position and orientation information of the sensing element specifically includes:
[0018] According to the distance information of the signal transmitting point in the signal transmitter relative to the distance measuring sensor, the position of the sensing element is calculated to obtain the position of the target object;
[0019] According to the distance information of the two signal transmitting points in the signal transmitter relative to the distance measuring sensor, the direction of the line between the two signal transmitting points is calculated, and the direction of the sensing element is obtained to obtain the direction of the target object.
[0020] In combination with the first aspect, in one implementation, the activity state of the target object includes active state, orientation requirement, interaction requirement, outside vehicle observation requirement, sleeping state, and discomfort state.
[0021] In combination with the first aspect, in one implementation, determining the active state specifically includes:
[0022] If the position change rate of the sensing element per unit time is greater than a preset displacement change value, or the orientation change frequency of the sensing element per unit time is greater than a preset frequency change value, then the target object is determined to be in an active state;
[0023] If the position change rate of the sensing element within a plurality of consecutive unit times is not greater than a preset displacement change value, or the orientation change frequency of the sensing element within a unit time is not greater than a preset frequency change value, then it is determined that the target object is in a low activity state.
[0024] In combination with the first aspect, in one implementation,
[0025] The orientation requirements include up and down pitch requirements and front and back, left and right requirements;
[0026] The up and down pitch direction requirement is that if the sensing element is facing above the horizontal plane and the angle between it and the XY plane of the virtual three-dimensional coordinate system is greater than the set angle, the target object is determined to be facing upward; if the sensing element is facing below the horizontal plane and the angle between it and the XY plane of the virtual three-dimensional coordinate system is greater than the set angle, the target object is determined to be facing downward; if the angle between the sensing element and the XY plane of the virtual three-dimensional coordinate system is not greater than the set angle, the target object is determined to be facing horizontally;
[0027] The front, rear, left, and right direction requirements are: if the sensing element is facing the front direction of the vehicle and the angle between it and the ZX plane of the virtual three-dimensional coordinate system is less than a preset angle, the target object is determined to be facing forward; if the sensing element is facing the rear direction of the vehicle and the angle between it and the ZX plane of the virtual three-dimensional coordinate system is less than a preset angle, the target object is determined to be facing backward; if the angle between the sensing element and the ZX plane of the virtual three-dimensional coordinate system is greater than a preset angle and the sensing element is facing the left or right direction of the vehicle, the target object is determined to be facing left or right;
[0028] Among them, in the virtual three-dimensional coordinate system, the length direction of the vehicle is the X-axis, the width direction is the Y-axis, and the vertical direction is the Z-axis.
[0029] In combination with the first aspect, in one implementation,
[0030] When the sensing element is initially in the rear area of the vehicle, if it is detected that the sensing element moves beyond the front boundary of the rear area and continues for a set time, and the orientation of the sensing element is horizontally ahead or upward, it is determined that the target object has an interaction need with the front environment;
[0031] When the sensing element is initially in the non-driving area of the front row of the vehicle, if it is detected that the sensing element has moved beyond the rear end boundary of the front area and continues for a set time, and the orientation of the sensing element is horizontally backward or upward, it is determined that there is a need for interaction between the target object and the rear environment.
[0032] In combination with the first aspect, in one implementation,
[0033] When the sensing element is initially in the rear area of the vehicle, if it is detected that the sensing element is facing upward to the left or upward to the right, it is determined that the target object has a need to look outside the vehicle, and the retractable electric platform mounted on the corresponding side door guard is deployed;
[0034] When the sensor is initially located in the front passenger area of the vehicle, if it is detected that the sensor is facing upward and not in the driving direction, it is determined that the target object has a need to look outside the vehicle, and the retractable electric platform mounted on the passenger side door guard is deployed;
[0035] When the sensing element is in the upper cover area of the dashboard, it is determined that the target object has a need to observe the road in front of the vehicle. When the vehicle is in non-parking or parking mode, the electric air conditioner is started to automatically increase the air volume of the front windshield defogger outlet to drive the target object away. When the vehicle is in parking mode, no action is taken.
[0036] In combination with the first aspect, in one implementation,
[0037] When the target object is determined to be in a low-activity state based on the changes in the position and orientation of the sensing element within a unit time, if it is determined that the distance between the sensing element and the surface of the vehicle's internal parts assembly is less than a set distance and lasts for a first set time, the target object is determined to be in a sleeping or uncomfortable state, and an active confirmation prompt for the target object's state is given.
[0038] In a second aspect, an embodiment of the present application provides a device for determining an activity state of a target object in a vehicle, comprising:
[0039] A sensing element, which is used to be arranged at the target object and keep consistent with the position and orientation of the target object;
[0040] A plurality of distance measuring sensors arranged on the vehicle to establish a virtual three-dimensional coordinate system and to measure the distance of a sensing component located in the vehicle;
[0041] The control unit is used to calculate the relative position relationship between the sensing element and the ranging sensor based on the distance measurement data of the ranging sensor to the sensing element, thereby obtaining the position and orientation information of the sensing element, and determine the activity state of the target object based on the position and orientation changes of the sensing element within a unit time.
[0042] The beneficial effects brought by the technical solution provided in the embodiments of the present application include:
[0043] (1) Using a multi-point ranging method, the position and orientation of the sensor worn by the target object in the virtual three-dimensional coordinate system are directly calculated, that is, the position and orientation of the pet in the car are determined, which solves the problem that when the target object in the car is in a blind spot outside the capture area of the shooting equipment, it is impossible to obtain the position and state of the target object through image capture or learning processing. The specific action and overall outline of the target object are captured and learned and judged, which is simplified to obtain the positioning and orientation of the sensor worn by the target object, ensuring the full-time and full-area effectiveness of the basic information obtained by the sensor, so as to correctly and timely respond to the pet's status;
[0044] (2) Based on the boundary relationship between the target object's position and orientation and the vehicle's internal area, and the state change of the target object's position and orientation within a unit time, the needs and intentions of the target object are judged, and by changing the internal structure of the vehicle, convenience is provided for meeting the needs of the target object. BRIEF DESCRIPTION OF THE DRAWINGS
[0045] Figure 1 A flowchart of a method for determining the activity state of a target object in a vehicle according to the present application;
[0046] Figure 2 This is a schematic diagram of the functional modules of the device for determining the activity status of a target object in a vehicle according to the present application. DETAILED DESCRIPTION
[0047] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0048] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.
[0049] On the first aspect, an embodiment of the present application provides a method for determining the activity status of a target object in a vehicle, which effectively solves the technical problem that when a pet in the vehicle is in a blind spot outside the capture area of the shooting device, the pet's position or status cannot be obtained through image capture or learning processing.
[0050] In one embodiment, referring to Figure 1 , Figure 1 FIG. 1 is a flow chart of a method for determining the activity state of a target object in a vehicle according to the present application. Figure 1 As shown, the method for determining the activity state of a target object in a vehicle includes:
[0051] S1: A virtual three-dimensional coordinate system is established by arranging a plurality of distance measuring sensors on the vehicle, and a corresponding relationship between the sensing element arranged at the target object and the virtual three-dimensional coordinate system is established; it should be noted that the target object in the present application is a living pet such as a cat or dog located in the vehicle.
[0052] S2: periodically obtain the position and orientation information of the sensing element based on the relative position relationship between the sensing element and the distance measuring sensor;
[0053] S3: According to the position and orientation changes of the sensing element in a unit time, the activity state of the target object is determined. After the activity state of the target object is determined, the needs of the target object can also be responded to through the vehicle computer logic control.
[0054] Furthermore, in one embodiment, a virtual three-dimensional coordinate system is established by using a plurality of distance measuring sensors arranged on the vehicle, specifically including:
[0055] S101: Based on the three-point positioning principle, a distance measuring sensor is arranged at two symmetrical points of the vehicle parallel to the vehicle body floor, and a distance measuring sensor is arranged at a position higher than the vehicle body floor; the distance measuring sensor can measure the distance of the sensing element.
[0056] S102: constructing a virtual three-dimensional coordinate system according to the position coordinates of three distance measuring sensors arranged on the vehicle;
[0057] Specifically, based on the three-point positioning principle, before or after the vehicle leaves the factory, a ranging sensor that can measure the distance to the sensing component is arranged at two symmetrical points parallel to the vehicle body floor, and another ranging sensor is arranged at a position higher than the above two ranging sensors (for example, the roof). At this time, if a sensing component with a signal transmitting function is placed within the virtual three-dimensional coordinate system constructed by the three ranging sensors, and the sensing component transmits a group of signals per unit time, the position of the sensing component can be reversely calculated through the distance of the sensing component relative to the three ranging sensors.
[0058] Furthermore, if the ranging sensor is a device installed before the vehicle leaves the factory, the entire vehicle's interior surface data can be imported into the vehicle computer based on the virtual three-dimensional coordinate system, which serves as a basis for judging whether the target object in the vehicle touches the spatial boundaries of each area / component assembly when it moves.
[0059] Specifically, for the specific structural form of the sensor, the sensor is a collar structure with an axial dimension (that is, a collar that can be worn on the neck of a pet), and a plurality of signal transmitters with directional visual markings are arranged in a circumferential manner on the outer periphery of the sensor. When using the sensor for the first time, it is necessary to activate the signal transmitter in the sensor in the positioning sensor coordinate matching mode started on the car screen, click "Add a new sensor and match the position", and move and place the sensor according to the matching prompts on the car screen. After completing the coordination action according to each step, click "Complete the positioning and orientation of the current sensor in this position area" on the car screen to finally complete the overall sensor matching. When the user has multiple pets, multiple sensors with different appearances (such as identification stickers, color differences, texture differences, etc.) can be matched with the car computer, marked as collar A, collar B, etc., and the identity of the sensor can be renamed through the car computer.
[0060] Of course, in actual application, the sensing element may be replaced by other devices that can sense the distance between the distance measuring sensor and the distance measuring sensor to achieve self-position determination and orientation determination.
[0061] Furthermore, in one embodiment, obtaining the position and orientation information of the sensing element specifically includes:
[0062] S201: Calculate the position of the sensing element to obtain the position of the target object according to the distance information of the signal transmitting point in the signal transmitter relative to the distance measuring sensor;
[0063] S202: According to the distance information of the two signal transmitting points in the signal transmitter relative to the distance measuring sensor, the direction of the line between the two signal transmitting points is calculated, and the direction of the sensing element is obtained to obtain the direction of the target object.
[0064] Specifically, the signal transmitter includes two signal transmitting points that are spaced apart and arranged along the central axis of the sensing element, and the signal transmitting points on the same side of the sensing element have the same signal frequency band. That is, there is a group of signal transmitting points at each of the two axial ends of the sensing element, and two different signal frequency bands are set for each group of signal generating points to distinguish the two ends. For example, the frequency band of the signal transmitting point close to the head of the target object is frequency band A1, and the frequency band of the signal transmitting point close to the tail of the target object is frequency band A2. When multiple ranging sensors in the vehicle receive signals of frequency bands A1 and A2 respectively, the vehicle area where the head and neck of the target object are approximately located can be obtained based on the relative distance information between the two and the rangefinder; and the direction of the A1-A2 line can be calculated through the background program, that is, the approximate direction of the head and neck of the target object wearing the sensing element.
[0065] The following is an explanation of the matching positioning and orientation and coordinate calibration process of the sensing component with reference to specific examples.
[0066] First, place the sensor in an area where the three distance measuring sensors on the vehicle can receive the sensor signal. Click to turn on "Positioning sensor coordinate matching mode" in the car computer screen menu. According to the image and text prompts displayed on the car computer screen, activate the signal transmitter in the sensor. Click "Add sensor and match position" in the car computer screen menu. Complete the placement operation according to the prompt "Place the current sensor head upward on the seat cushion in the main driver's seat area" displayed on the car computer. The distance measuring sensor measures the distance and calculates to determine whether the sensor is located on the seat cushion in the main driver's seat area. If not, the car computer screen flashes "The main driver's area has not successfully sensed the existence of the current sensor. Please try again". Then complete the placement operation again according to the prompt "Place the current sensor head upward on the seat cushion in the main driver's seat area" displayed on the car computer.
[0067] When it is determined that the sensing component is located on the seat cushion in the main driver's seat area, the car computer screen displays "The main driver's area successfully senses the existence of the current sensing component", and the placement operation is completed according to the prompt of "Put the current sensing component head up on the seat cushion in the passenger seat area" displayed by the car computer. The ranging sensor measures the distance and calculates to determine whether the sensing component is located on the seat cushion in the passenger seat area. If not, the car computer screen flashes "The passenger area did not successfully sense the existence of the current sensing component, please try again", and then the placement operation is completed again according to the prompt of "Put the current sensing component head up on the main and passenger seat areas" displayed by the car computer; when it is determined that the sensing component is located on the seat cushion in the passenger seat area, the car computer screen displays "The passenger area successfully senses the existence of the current sensing component", and the placement operation is completed according to the prompt of "Put the current sensing component head up on the seat cushion in the right rear area" displayed by the car computer. The ranging sensor measures the distance and calculates to determine whether the sensing component is located on the seat cushion in the right rear area.
[0068] When it is determined that the sensor is not located on the seat cushion in the right area of the rear row, the car computer screen will flash with the message "The current sensor was not successfully sensed on the right side of the rear row, please try again", and then the placement operation will be completed again according to the prompt "Place the current sensor with its head facing up on the seat cushion in the right area of the rear row" displayed by the car computer; when it is determined that the sensor is located on the seat cushion in the right area of the rear row, the car computer screen will display "The current sensor is successfully sensed in the right area of the rear row", and then the car computer screen will display "Complete the calibration of the current sensor coordinates", and the menu button will display "Next", and the car computer screen will display the custom input box "Enter a custom name for the sensor", and the menu button will display "Save". After the user completes the input and the motor presses "Save", the car computer will display "Saved successfully".
[0069] Furthermore, in this application, the activity state of the target object includes active state, orientation requirement, interaction requirement, vehicle exterior observation requirement, sleep state, and discomfort state. It should be noted that the orientation requirement, interaction requirement, vehicle exterior observation requirement, sleep state, and discomfort state are judged only when the target object is judged to be in an active state.
[0070] Specifically, the determination of the active state includes:
[0071] If the position change rate of the sensing element per unit time is greater than a preset displacement change value, or the orientation change frequency of the sensing element per unit time is greater than a preset frequency change value, then the target object is determined to be in an active state;
[0072] If the position change rate of the sensing element within a plurality of consecutive unit times is not greater than a preset displacement change value, or the orientation change frequency of the sensing element within a unit time is not greater than a preset frequency change value, then it is determined that the target object is in a low activity state.
[0073] That is, if it is determined that the position or direction of the sensing element changes frequently within a unit time, the target object is determined to be in an active state; if the position or direction changes slightly within multiple unit times, the target object is determined to be in a low activity state.
[0074] Specifically, the direction requirements include up and down pitch direction requirements and front and back left and right direction requirements. That is, it includes two sets of default set directions, "up and down pitch" and "front and back left and right". The two sets of direction signals can be superimposed. In addition, the required direction can be customized and added through the vehicle computer.
[0075] Among them, the up and down pitch direction requirements are: if the sensing element is facing above the horizontal plane and the angle between it and the XY plane of the virtual three-dimensional coordinate system is greater than the set angle (for example, greater than 20 degrees), the target object is determined to be facing upward; if the sensing element is facing below the horizontal plane and the angle between it and the XY plane of the virtual three-dimensional coordinate system is greater than the set angle (for example, greater than 20 degrees), the target object is determined to be facing downward; if the angle between the sensing element and the XY plane of the virtual three-dimensional coordinate system is not greater than the set angle (for example, less than or equal to 20 degrees), the target object is determined to be facing horizontally;
[0076] The front, rear, left and right direction requirements are: if the sensing component is facing the front of the vehicle and the angle between it and the ZX plane of the virtual three-dimensional coordinate system is less than a preset angle (for example, less than 45 degrees), the target object is determined to be facing forward; if the sensing component is facing the rear of the vehicle and the angle between it and the ZX plane of the virtual three-dimensional coordinate system is less than a preset angle (for example, less than 45 degrees), the target object is determined to be facing backward; if the angle between the sensing component and the ZX plane of the virtual three-dimensional coordinate system is greater than a preset angle (for example, greater than 45 degrees), and the sensing component is facing the left or right direction of the vehicle, the target object is determined to be facing left or right; it should be noted that in the virtual three-dimensional coordinate system, the length direction of the vehicle is the X-axis, the width direction is the Y-axis, and the vertical direction is the Z-axis.
[0077] Furthermore, for the setting of custom direction, when the target object is wearing a sensor and the target object is moving in the cockpit, the user can adopt a sample of the current direction in the custom learning menu of the target object's required specific direction on the vehicle screen based on the target object's current behavior pattern, and set a custom direction group, or manually add / modify the required sample.
[0078] Specifically, when the sensing element is initially in the rear area of the vehicle, if it is detected that the sensing element has moved beyond the front boundary of the rear area and continues for a set time, and the orientation of the sensing element is horizontally ahead or upward, it is determined that the target object has an interaction need with the front environment, that is, it is determined that the target object currently wearing the sensing element has an interaction need with the front passenger or the front environment. At this time, the electric sliding / flipping platform carried by the front center console can be activated and extended backwards to facilitate the rear target object to lean over / cross over to the front armrest position through the platform. At the same time, the vehicle computer will start the pet interaction application on the corresponding side after calculation based on whether the vehicle is in non-parking or parking mode (i.e. N gear / P gear) at this time, and whether there are occupants in the main and co-pilot seats through the seat cushion pressure sensor, prompting the user to interact with the pet by language / action.
[0079] When the sensing element is initially in the non-driving area of the front row of the vehicle, if it is detected that the sensing element moves beyond the rear boundary of the front row area and continues for a set time, and the orientation of the sensing element is horizontally backward or upward, it is determined that the target object has an interaction need with the rear row environment. That is, when it is determined that the target object currently wearing the sensing element has an interaction need with the rear passengers or the rear row environment, if the pressure sensor under the rear seat cushion detects that there are no passengers in the rear seats, the electric sliding / flipping platform installed on the front center console is activated and extended backwards, so that the target object can lean over / cross over to the rear seat cushion area through the platform.
[0080] Furthermore, when the sensing element is initially in the rear area of the vehicle, if it is detected that the sensing element is facing upward to the left or upward to the right, it is determined that the target object has a need to look outside the vehicle, and the retractable electric platform mounted on the corresponding side door guard is deployed;
[0081] That is, if the sensing element is detected to be facing upward to the left or upward to the right and stays there for a certain period of time, it is determined that the target object currently wearing the sensing element has the need to lean upward to look outside the vehicle at the left / right window it is pointing to. At this time, the retractable electric platform mounted on the corresponding side door guard is activated to unfold it into a horizontal platform that is flush with or slightly higher than the vehicle's window sill line, making it convenient for the target object in the back row to jump onto the platform to rest and look at the scenery outside the window.
[0082] When the sensor is initially located in the front passenger area of the vehicle, if it is detected that the sensor is facing upward and not in the driving direction, it is determined that the target object has a need to look outside the vehicle, and the retractable electric platform mounted on the passenger side door guard is deployed;
[0083] For example, when the original position area of the target object wearing the sensor is in the passenger seat area of a left-hand drive vehicle, if the sensor is detected to be facing right and upward (that is, facing right and upward) and stays for a certain period of time, it is determined that the target object currently wearing the sensor has the need to lean up to look outside the vehicle at the passenger side window it is pointing to. At this time, if it is detected that there is no passenger in the passenger seat, the retractable electric platform mounted on the corresponding side door guard panel is activated to unfold it into a horizontal platform that is flush with or slightly higher than the vehicle's window sill line, making it convenient for the target object in the back row to jump onto the platform to rest and look at the scenery outside the window.
[0084] When the sensing element is in the upper cover area of the dashboard, it is determined that the target object has a need to observe the road in front of the vehicle. When the vehicle is in non-parking or parking mode, the electric air conditioner is started to automatically increase the air volume of the front windshield defogger outlet to drive the target object away. When the vehicle is in parking mode, no action is taken.
[0085] For example, when a target object wearing a sensor enters the upper cover area of the dashboard, it is determined that the target object currently wearing the sensor needs to observe the road in front of the vehicle. If the vehicle is in non-parking or parking mode (i.e., N gear or P gear), the target object is determined to be in an uncertain risk state. The vehicle computer starts the electric air conditioner to automatically increase the air volume of the front windshield defogger outlet to drive the pet away from the upper cover area of the dashboard; if the sensor matches the target object type of cat, the catnip pet fragrance installed at the rear air outlet of the air conditioner can be used to lure the feline pet to the rear of the vehicle and away from the front windshield area.
[0086] Furthermore, when the target object is determined to be in a low-activity state based on the position and orientation changes of the sensing element within a unit time, if the distance between the sensing element and the surface of the vehicle's internal parts assembly is determined to be less than a set distance and lasts for a first set time, the target object is determined to be in a sleeping or uncomfortable state (the uncomfortable state may be a motion sickness state), and an active confirmation prompt for the target object state is performed. When the target object is determined to be in a sleeping or uncomfortable state, the vehicle computer controls other navigation and multimedia volume in the vehicle to decrease, the air conditioner turns on the fresh air system mode, and the temperature in the vehicle is automatically adjusted to the target object's comfort zone. At the same time, the vehicle computer screen prompts the user in the vehicle through a virtual target object image, a window menu, or a low-volume voice prompt to confirm the target object's state as soon as possible.
[0087] The method for determining the activity state of a target object in a vehicle of the present application first establishes a virtual three-dimensional coordinate system through at least three ranging sensors arranged in the vehicle, matches one or more sensing parts, and completes the positioning of each sensing part in the vehicle through the position of each sensing part relative to each ranging sensor. The head and neck orientation of the target object wearing the sensing part is confirmed through the axial indication direction of the sensing part, and the needs of the target object are determined in coordination with the various areas of the vehicle passenger compartment defined in the virtual three-dimensional coordinate system. Based on the above needs judgment, the vehicle computer controls the various assembly components of the vehicle to complete the satisfaction of the needs of the target object. In addition, for specific target object behaviors, the user can use the vehicle computer to complete the behavioral needs correction of the corresponding sensing part using the target object.
[0088] In a second aspect, an embodiment of the present application also provides a device for determining the activity status of a target object in a vehicle.
[0089] In one embodiment, referring to Figure 2 , Figure 2 This is a functional module diagram of the device for determining the activity state of a target object in a vehicle according to the present application. Figure 2 As shown, the device for determining the activity state of a target object in a vehicle includes a sensing element, a control unit and a plurality of distance measuring sensors.
[0090] The sensing element is used to be set at the target object and keep consistent with the position and orientation of the target object; the ranging sensor is used to be arranged on the vehicle to establish a virtual three-dimensional coordinate system and measure the distance of the sensing element located in the vehicle; the control unit is used to calculate the relative position relationship between the sensing element and the ranging sensor based on the distance measurement data of the sensing element by the ranging sensor, so as to obtain the position and orientation information of the sensing element, and determine the activity state of the target object based on the change of the position and orientation of the sensing element in unit time.
[0091] In actual application, Figure 2As shown, the number of distance measuring sensors can be three, and the control unit can be a vehicle computer. The distance between the distance measuring sensor and the sensing element is sensed, so that the vehicle computer calculates the position and orientation information of the sensing element. Furthermore, the in-vehicle target object activity state determination device can also include an actuator, which is a movable platform, air conditioning, fragrance system, audio, etc. After the control unit determines the activity state of the target object, it controls the corresponding actuator to match the activity state of the target object.
[0092] The terms "including" and "having" and any variations thereof in the specification and claims of this application and the above-mentioned drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices. The terms "first", "second" and "third" are used to distinguish different objects, etc., and do not represent a sequence, nor do they limit "first", "second" and "third" to different types.
[0093] In the description of the embodiments of the present application, "exemplary", "for example" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary", "for example" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary", "for example" or "for example" is intended to present related concepts in a specific way.
[0094] In the description of the embodiments of the present application, unless otherwise specified, “ / ” means or, for example, A / B can mean A or B; the “and / or” in the text is merely a description of the association relationship of associated objects, indicating that three relationships may exist, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, “multiple” refers to two or more than two.
[0095] In some processes described in the embodiments of the present application, multiple operations or steps that appear in a specific order are included, but it should be understood that these operations or steps may not be executed in the order in which they appear in the embodiments of the present application or in parallel, and the sequence number of the operation is only used to distinguish the different operations, and the sequence number itself does not represent any execution order. In addition, these processes may include more or fewer operations, and these operations or steps may be executed in sequence or in parallel, and these operations or steps may be combined.
[0096] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, disk, CD) as described above, and includes a number of instructions for a terminal device to execute the methods described in each embodiment of the present application.
[0097] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.
Claims
1. A method for determining the activity state of a target object in a vehicle, characterized in that: The method for determining the activity state of a target object in a vehicle comprises: A virtual three-dimensional coordinate system is established by using a plurality of distance measuring sensors arranged on the vehicle, and a corresponding relationship between the sensing element arranged at the target object and the virtual three-dimensional coordinate system is established; Based on the relative position relationship between the sensing element and the distance measuring sensor, the position and orientation information of the sensing element is periodically obtained; The activity state of the target object is determined based on the changes in the position and orientation of the sensing element within a unit time.
2. A method for determining the activity state of a target object in a vehicle as claimed in claim 1, characterized in that: The virtual three-dimensional coordinate system is established by using a plurality of distance measuring sensors arranged on the vehicle, specifically including: Based on the three-point positioning principle, a distance measuring sensor is arranged at two symmetrical points of the vehicle parallel to the vehicle body floor, and a distance measuring sensor is arranged at a position higher than the vehicle body floor; A virtual three-dimensional coordinate system is constructed according to the position coordinates of three distance measuring sensors arranged on the vehicle; Wherein, the distance measuring sensor can measure the distance of the sensing element.
3. The method for determining the activity state of a target object in a vehicle according to claim 1, characterized in that: The sensing element is in the form of a collar structure with an axial dimension, and a plurality of signal transmitters with directional visual markings are arranged in a surrounding manner on the outer circumference of the sensing element; The signal transmitter comprises two signal transmitting points which are arranged at intervals and along the central axis direction of the induction element, and the signal transmitting points on the same side of the induction element have the same signal frequency band.
4. A method for determining the activity state of a target object in a vehicle as claimed in claim 3, characterized in that: The obtaining of the position and orientation information of the sensing element specifically includes: According to the distance information of the signal transmitting point in the signal transmitter relative to the distance measuring sensor, the position of the sensing element is calculated to obtain the position of the target object; According to the distance information of the two signal transmitting points in the signal transmitter relative to the distance measuring sensor, the direction of the line between the two signal transmitting points is calculated, and the direction of the sensing element is obtained to obtain the direction of the target object.
5. The method for determining the activity state of a target object in a vehicle according to claim 1, characterized in that: The activity status of the target object includes active status, orientation requirement, interaction requirement, outside vehicle observation requirement, sleeping status, and discomfort status.
6. A method for determining the activity state of a target object in a vehicle as claimed in claim 5, characterized in that: The determination of active status includes: If the position change rate of the sensing element per unit time is greater than a preset displacement change value, or the orientation change frequency of the sensing element per unit time is greater than a preset frequency change value, then the target object is determined to be in an active state; If the position change rate of the sensing element within a plurality of consecutive unit times is not greater than a preset displacement change value, or the orientation change frequency of the sensing element within a unit time is not greater than a preset frequency change value, then it is determined that the target object is in a low activity state.
7. The method for determining the activity state of a target object in a vehicle as claimed in claim 5, characterized in that: The orientation requirements include up and down pitch requirements and front and back, left and right requirements; The up and down pitch direction requirement is that if the sensing element is facing above the horizontal plane and the angle between it and the XY plane of the virtual three-dimensional coordinate system is greater than the set angle, the target object is determined to be facing upward; if the sensing element is facing below the horizontal plane and the angle between it and the XY plane of the virtual three-dimensional coordinate system is greater than the set angle, the target object is determined to be facing downward; if the angle between the sensing element and the XY plane of the virtual three-dimensional coordinate system is not greater than the set angle, the target object is determined to be facing horizontally; The front, rear, left, and right direction requirements are: if the sensing element is facing the front direction of the vehicle and the angle between it and the ZX plane of the virtual three-dimensional coordinate system is less than a preset angle, the target object is determined to be facing forward; if the sensing element is facing the rear direction of the vehicle and the angle between it and the ZX plane of the virtual three-dimensional coordinate system is less than a preset angle, the target object is determined to be facing backward; if the angle between the sensing element and the ZX plane of the virtual three-dimensional coordinate system is greater than a preset angle and the sensing element is facing the left or right direction of the vehicle, the target object is determined to be facing left or right; Among them, in the virtual three-dimensional coordinate system, the length direction of the vehicle is the X-axis, the width direction is the Y-axis, and the vertical direction is the Z-axis.
8. The method for determining the activity state of a target object in a vehicle as claimed in claim 5, characterized in that: When the sensing element is initially in the rear area of the vehicle, if it is detected that the sensing element moves beyond the front boundary of the rear area and continues for a set time, and the orientation of the sensing element is horizontally ahead or upward, it is determined that the target object has an interaction need with the front environment; When the sensing element is initially in the non-driving area of the front row of the vehicle, if it is detected that the sensing element has moved beyond the rear end boundary of the front area and continues for a set time, and the orientation of the sensing element is horizontally backward or upward, it is determined that there is a need for interaction between the target object and the rear environment.
9. The method for determining the activity state of a target object in a vehicle as claimed in claim 5, characterized in that: When the sensing element is initially in the rear area of the vehicle, if it is detected that the sensing element is facing upward to the left or upward to the right, it is determined that the target object has a need to look outside the vehicle, and the retractable electric platform mounted on the corresponding side door guard is deployed; When the sensor is initially located in the front passenger area of the vehicle, if it is detected that the sensor is facing upward and not in the driving direction, it is determined that the target object has a need to look outside the vehicle, and the retractable electric platform mounted on the passenger side door guard is deployed; When the sensing element is in the upper cover area of the instrument panel, it is determined that the target object has a need to observe the road ahead of the vehicle. When the vehicle is in non-parking or parking mode, the electric air conditioner is started to automatically increase the air volume of the front windshield defogger to drive the target object away. When the vehicle is in parking mode, no action is taken. When the target object is determined to be in a low-activity state based on the changes in the position and orientation of the sensing element within a unit time, if it is determined that the distance between the sensing element and the surface of the vehicle's internal parts assembly is less than a set distance and lasts for a first set time, the target object is determined to be in a sleeping or uncomfortable state, and an active confirmation prompt for the target object's state is given.
10. A device for determining the activity state of a target object in a vehicle, characterized in that: include: A sensing element, which is used to be arranged at the target object and keep consistent with the position and orientation of the target object; A plurality of distance measuring sensors arranged on the vehicle to establish a virtual three-dimensional coordinate system and to measure the distance of a sensing component located in the vehicle; The control unit is used to calculate the relative position relationship between the sensing element and the ranging sensor based on the distance measurement data of the ranging sensor to the sensing element, thereby obtaining the position and orientation information of the sensing element, and determine the activity state of the target object based on the position and orientation changes of the sensing element within a unit time.
Citation Information
Patent Citations
Method, device and system for monitoring animal state
CN106017468A
Laser positioning system
CN110109057A
Vehicle monitoring method and device
CN112785846A
In-car pet interaction method and device, car and storage medium
CN115193027A
Human body detection method and device, robot and computer readable storage medium
CN117746460A
