A window control method and device
By detecting the gaze point and lip movement of the personnel in the car in real-time images, the familiarity of the personnel outside the car is judged, and the window opening is automatically controlled, which solves the problems of cumbersome window operation and delayed response in the existing technology, and improves the user experience.
Patent Information
- Application Number
- CN202110918878.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-08-11
- Publication Date
- 2025-08-01
- Estimated Expiration
- 2041-08-11
AI Technical Summary
In the prior art, the operation of the windows is cumbersome and the response is delayed, and it is impossible to intelligently detect users' window opening needs, resulting in poor user experience.
Through real-time in-car images, the gaze point and lip movement of the personnel in the car are detected, the familiarity of the personnel outside the car is judged, and the windows are automatically controlled to open.
It realizes intelligent and humanized control of car windows, simplifies the operation process, and improves the user experience.
Smart Images

Figure HDA0003206705330000011 
Figure HDA0003206705330000021
Abstract
Description
Technical Field
[0001] The present invention relates to the control of in-vehicle devices, and particularly to a window control method and device. Background Art
[0002] In the prior art, when a user sees a familiar person outside the vehicle during driving, the user needs to first lower the window and then talk to the other person. The action of lowering the window needs to be performed manually by the user or by receiving the user's voice command, and the entire operation process is relatively slow, with a long reaction delay time and relatively cumbersome operation steps.
[0003] With the development of technologies such as artificial intelligence, the control of in-vehicle devices is becoming more user-friendly and intelligent. However, the above scenario obviously cannot well meet the user's window-opening needs, with cumbersome operations and lagging reactions, reducing the user's driving experience.
[0004] In order to overcome the above-mentioned defects existing in the prior art, there is an urgent need in the art for a window control method for intelligently detecting the user's window-opening needs so as to automatically control the window to open, simplifying the step flow of user operations, making window control more intelligent and user-friendly, and thus enhancing the user's driving experience. Summary of the Invention
[0005] The following gives a brief overview of one or more aspects to provide a basic understanding of these aspects. This overview is not an exhaustive survey of all contemplated aspects, and is neither intended to identify key or decisive elements of all aspects nor to attempt to define the scope of any or all aspects. Its sole purpose is to present some concepts of one or more aspects in a simplified form as a prelude to the more detailed description that follows.
[0006] In order to overcome the above-mentioned defects existing in the prior art, the present invention provides a window control method, including: performing gaze point detection on in-vehicle personnel based on real-time in-vehicle images; in response to detecting that an in-vehicle person is gazing out of the window, determining whether the familiarity of the person outside the vehicle corresponding to the window meets a preset condition based on the image of the person outside the vehicle; and in response to the familiarity of the person outside the vehicle meeting the preset condition, controlling the corresponding window to open.
[0007] In one embodiment, preferably, the window control method further includes: performing lip movement detection on in-vehicle personnel based on real-time in-vehicle images; and in response to an in-vehicle person gazing out of the window, the in-vehicle person making lip movements, and the familiarity of the person outside the vehicle corresponding to the window meeting the preset condition, controlling the corresponding window to open.
[0008] In one embodiment, preferably, determining whether the familiarity of the person outside the vehicle corresponding to the window meets a preset condition further includes: determining the familiarity of the person outside the vehicle based on the historical images of the person obtained by the vehicle.
[0009] In one embodiment, preferably, determining the familiarity of an out - vehicle person based on the historical images of the person obtained by the vehicle includes determining the familiarity of the person based on the frequency of different persons entering the vehicle or the residence time of different persons in the vehicle or whether an interaction behavior occurs.
[0010] Another aspect of the present invention provides a window control device, including: a memory; and a processor coupled to the memory, the processor being configured to implement the steps of the window control method of any one of the above.
[0011] The present invention also provides a computer - readable medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the window control method of any one of the above are implemented.
[0012] The window control method and device provided by the present invention automatically control the window to open by intelligently detecting the user's window - opening requirement, simplify the step - by - step process of the user operation, make the window control more intelligent and user - friendly, and thus improve the user's vehicle - using experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0013] After reading the detailed description of the embodiments of the present disclosure in conjunction with the following drawings, the above - mentioned features and advantages of the present invention can be better understood. In the drawings, the components are not necessarily drawn to scale, and components with similar related characteristics or features may have the same or similar reference numerals.
[0014] Figure 1 is a schematic flowchart of a window control method illustrated according to an embodiment of the present invention; and
[0015] Figure 2 is a device structure diagram of a window control device illustrated according to another aspect of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0016] The following specific embodiments illustrate the implementation manners of the present invention. Those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. Although the description of the present invention will be introduced in conjunction with the preferred embodiments, this does not mean that the features of this invention are limited to this implementation manner. On the contrary, the purpose of introducing the invention in conjunction with the implementation manner is to cover other alternatives or modifications that may be extended based on the claims of the present invention. In order to provide a deep understanding of the present invention, many specific details will be included in the following description. The present invention can also be implemented without these details. In addition, some specific details will be omitted in the description to avoid confusing or obscuring the focus of the present invention.
[0017] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be directly connected, or indirectly connected through an intermediate medium, and it can be the communication inside two components. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific situations.
[0018] In addition, the "upper", "lower", "left", "right", "top", "bottom", "horizontal", and "vertical" used in the following description should be understood as the orientations shown in this section and the relevant drawings. This relative term is only for convenience of description and does not represent that the device described needs to be manufactured or operated in a specific orientation, so it should not be understood as a limitation to the present invention.
[0019] It can be understood that although the terms "first", "second", "third", etc. can be used here to describe various components, regions, layers, and / or parts, these components, regions, layers, and / or parts should not be limited by these terms, and these terms are only used to distinguish different components, regions, layers, and / or parts. Therefore, the first component, region, layer, and / or part discussed below can be referred to as the second component, region, layer, and / or part without departing from some embodiments of the present invention.
[0020] In order to overcome the above-mentioned defects existing in the prior art, the present invention provides a window control method and device, which automatically controls the window to open by intelligently detecting the user's window opening requirement, simplifies the step flow of the user operation, makes the window control more intelligent and user-friendly, and thus improves the user's vehicle use experience.
[0021] Figure 1 It is a schematic flow chart of a window control method shown according to an embodiment of the present invention.
[0022] Please refer to Figure 1 , the window control method 100 provided by the present invention includes:
[0023] Step 101: Perform a fixation point detection on the occupants in the vehicle based on the real-time in-vehicle image.
[0024] In one embodiment, the real-time image in the vehicle is obtained through an in-vehicle camera device, and the fixation point of the occupants in the vehicle is detected based on the real-time image in the vehicle. The fixation point detection of the occupants in the vehicle can be implemented based on the working principle of the DMS (Driver Monitoring System).
[0025] The fixation point detection is realized by detecting the head pose and attention of the vehicle occupants based on an in-vehicle camera and an artificial intelligence algorithm. According to the head pose, biometric features such as pupils and corneas are further recognized, and the accurate line of sight direction is calculated based on the Purkinje spots, so that the fixation points of the vehicle occupants can be detected.
[0026] Please also refer to Figure 1 The window control method 100 provided by the present invention further includes:
[0027] Step 102: In response to detecting that a vehicle occupant is looking out of the window, determine whether the familiarity of the external vehicle occupant corresponding to the window satisfies a preset condition based on the image of the external vehicle occupant outside the corresponding window.
[0028] In an embodiment, determining whether the familiarity of the external vehicle occupant satisfies a preset condition based on the image of the external vehicle occupant outside the corresponding window includes: comparing the image of the external vehicle occupant outside the corresponding window with the pre-stored person image of the user. The pre-stored person image can be stored in the cloud, the storage device of the vehicle-mounted device, or the external device of the vehicle-mounted device. Judging the familiarity of the current external vehicle occupant means comparing the image of the current external vehicle occupant with the persons recorded in the pre-stored user images, and if the similarity of the comparison exceeds a certain threshold, it is judged as a familiar person.
[0029] In an embodiment, determining whether the familiarity of the external vehicle occupant satisfies a preset condition based on the image of the external vehicle occupant outside the corresponding window further includes: judging the familiarity of the external vehicle occupant through the historical person images obtained by the vehicle. The historical person images are the historical images captured by the camera devices on the vehicle, such as the driving recorder camera or the 360° camera. It can also be captured by other camera devices and transmitted to the vehicle computer, such as an external monitoring camera device. By comparing the external vehicle occupant with the historical images captured by the camera devices on the vehicle, the connection relationship between the external vehicle occupant and the vehicle can be established, so as to judge whether the external vehicle occupant is a familiar person.
[0030] In an embodiment, the historical person images include the images of the persons entering the vehicle. Judging the familiarity of the external vehicle occupant through the historical person images obtained by the vehicle further includes: extracting the facial features of the person for face recognition according to the historical person images; recording the frequencies of different persons entering the vehicle based on the results of face recognition; and judging whether the frequency of the external vehicle occupant entering the vehicle reaches a preset number of times.
[0031] The statistics of the frequency of entering the vehicle can be the frequency within a preset time period set by the user. In an embodiment, a familiar user list is established by recognizing the historical person images within each preset time period, and the users whose frequencies of appearance reach the preset number of times within this time period are added to the familiar user list, and then the familiar user list is updated every other time period. When judging whether the familiarity of the external vehicle occupant is satisfied, it is only necessary to judge whether the external vehicle occupant exists in the familiar user list.
[0032] In another embodiment, after the vehicle external camera device acquires the facial image of the current external vehicle personnel, the historical video of the personnel acquired by the vehicle within a preset time period is retrieved in real time, and the frequency of the external vehicle personnel appearing in the historical video is statistically calculated in real time, so as to determine whether the external vehicle personnel is a familiar person.
[0033] In addition to being able to judge familiarity based on the frequency of different personnel appearing in the vehicle, it is also possible to judge whether a person is a familiar person according to the residence time of different personnel in the vehicle. In one embodiment, the historical video of the personnel includes the video of the personnel entering the vehicle. Judging the familiarity of the external vehicle personnel through the historical video of the personnel acquired by the vehicle further includes: extracting the facial features of the personnel from the historical video of the personnel for face recognition; obtaining the residence time of different personnel in the vehicle based on the result of face recognition; and judging whether the residence time of the external vehicle personnel in the vehicle exceeds a preset duration.
[0034] In another embodiment, the user can preset the threshold conditions for familiarity, and combine the appearance frequency of different users within a preset time period and the residence time each time to comprehensively judge whether the familiarity of the personnel meets the conditions. For example, some people frequently appear in the vehicle, but the residence time each time is very short, while some people do not often appear in the vehicle, but whenever they appear, the residence time is very long.
[0035] Therefore, the consideration of a single appearance frequency or residence time cannot accurately evaluate the familiarity of personnel. It is necessary to combine the frequency and the residence time to obtain a more reasonable and accurate familiarity judgment result.
[0036] In one embodiment, the historical video of the personnel includes the video of the personnel entering the vehicle. Judging the familiarity of the external vehicle personnel through the historical video of the personnel acquired by the vehicle further includes: extracting the facial features of the personnel from the historical video of the personnel for face recognition; and identifying whether the personnel entering the vehicle have preset interaction behaviors based on the result of face recognition and the historical video of the personnel.
[0037] The familiarity association between personnel can be well established through the interaction behaviors of the vehicle interior personnel. If through the analysis and processing of the historical video of the personnel, it is detected that there are intimate interaction behaviors such as kissing and hugging between users, then there is a high probability that the users who have the interaction behaviors are familiar personnel. By analyzing and processing the historical video of the personnel and combining algorithms such as image processing and artificial intelligence to identify whether there are interaction behaviors, the social relationship map between different personnel can be well established, so as to give a more accurate familiarity judgment result.
[0038] In addition to obtaining the historical video of the behavior actions of the personnel entering the vehicle through the in-vehicle camera device, it is also possible to obtain the historical video of the personnel who have appeared near the vehicle through the camera device arranged outside the vehicle.
[0039] In one embodiment, the personnel historical images include the images of personnel near the vehicle. Judging the familiarity of the personnel outside the vehicle based on the personnel historical images obtained by the vehicle further includes: extracting the facial features of the personnel from the images of the personnel near the vehicle for face recognition; and judging whether the personnel outside the vehicle have appeared near the vehicle multiple times within a preset time period based on the face recognition result.
[0040] Similarly to the case of using in-vehicle images, it is possible to judge whether the personnel outside the vehicle meet the familiarity condition according to the preset condition of the appearance frequency.
[0041] Furthermore, in one embodiment, judging the familiarity of the personnel outside the vehicle based on the personnel historical images obtained by the vehicle further includes: extracting the facial features of the personnel from the images of the personnel near the vehicle for face recognition; obtaining the location information of the vehicle and associating the location information with the personnel images; and judging whether the personnel outside the vehicle have appeared near the vehicle at the same location multiple times within a preset time period.
[0042] For example, security guards who appear at the community access control multiple times, administrators in the building parking lot, staff at gas stations or toll stations, etc. Establish the personnel historical images related to the location, so as to judge whether the personnel outside the vehicle are familiar personnel. In the above scenarios, when the user has a communication need with the personnel outside the vehicle, the vehicle can automatically control the window to open according to the preset familiarity condition, greatly improving the user experience.
[0043] Those skilled in the art can understand that the above conditions for judging user familiarity are only used for exemplary illustration, aiming to better explain the application scenarios and implementation methods of the present invention, rather than limiting the protection scope of the present invention. Any method and means that can achieve a similar judgment of personnel familiarity to the present invention should fall within the protection scope of the present invention.
[0044] Please go back to Figure 1 , the window control method 100 provided by the present invention further includes:
[0045] Step 103: In response to the familiarity of the personnel outside the vehicle meeting the preset condition, control the corresponding window to open.
[0046] In the above scenario conditions, when it is judged that the familiarity of the personnel outside the vehicle meets the preset condition, the vehicle window is automatically controlled to open, enabling the vehicle control to have an active sensing function, being able to humanely understand the user's needs, and intelligently judge through the preset conditions, so as to accurately control the window to open automatically and improve the user experience.
[0047] In one embodiment, the window control method further includes: performing lip movement detection on the in-vehicle personnel based on the real-time in-vehicle images; and in response to the in-vehicle personnel looking out of the window, the in-vehicle personnel having lip movement, and the familiarity of the personnel outside the vehicle corresponding to the window meeting the preset condition, controlling the corresponding window to open.
[0048] Lip movement detection further adds the biometric feature of lip movement on the basis of real-time facial state detection of the vehicle occupants. Through lip movement detection, it is possible to more accurately know the communication needs of the vehicle occupants, making the automatic window control method more reliable.
[0049] Although the above methods are illustrated and described as a series of actions for simplicity of explanation, it should be understood and appreciated that these methods are not limited by the order of the actions, because according to one or more embodiments, some actions may occur in a different order and / or concurrently with other actions that are illustrated and described herein or that are not illustrated and described herein but are understandable to those skilled in the art.
[0050] Another aspect of the present invention further provides a window control device, including: a memory; and a processor coupled to the memory, the processor being configured to implement the steps of the window control method of any one of the above.
[0051] Figure 2 It is a device structure diagram of the window control device illustrated according to another aspect of the present invention.
[0052] Please refer to Figure 2 , in Figure 2 In the illustrated embodiment, the computer system / server 200 of the window control device provided by the present invention is presented in the form of a general computer device. The components of the computer system / server 200 may include one or more processors 202, a memory 201, and a bus 203 connecting different system components (including the memory 201 and the processor 202).
[0053] The bus 203 includes a data bus, an address bus, and a control bus. The product of the number of bits of the data bus and the operating frequency is proportional to the data transfer rate. The number of bits of the address bus determines the maximum addressable memory space. The control bus (read / write) indicates the type of the bus cycle and the time when the current input / output operation is completed. The processor 202 is connected to the memory 201 through the bus 203 and is configured to implement the vehicle control method provided by any one of the above embodiments.
[0054] The processor 32, as the operation and control core of the computer system / server 200 of the vehicle-mounted device control, is the final execution unit for information processing and program operation. All operations at the software layer in the computer system will ultimately be mapped to the operations of the processor 202 through the instruction set. The main functions of the processor 202 are to process instructions, execute operations, control time, and process data.
[0055] The memory 201 refers to various storage devices in a computer for storing programs and data. The memory 201 may include a computer system-readable medium in the form of volatile memory. For example, random access memory (RAM) 204 and / or cache memory 205.
[0056] Random access memory (RAM) 204 is an internal memory that directly exchanges data with the processor 202. It can be read and written at any time (except during refreshing), and it is very fast. Usually, it is used as a temporary data storage medium for the operating system or other running programs. Once the power is off, the data stored in it will be lost. Cache memory 205 is a primary memory between the main memory and the processor 202. Its capacity is relatively small, but its speed is much higher than that of the main memory, approaching the speed of the processor 202.
[0057] The computer system / server 200 may further include other removable / non-removable, volatile / non-volatile computer system storage media. In this embodiment, the storage system 206 can be used to read and write non-removable, non-volatile magnetic media.
[0058] The memory 201 may also include at least one set of program modules 207. The program modules 207 can be stored in the memory 201. The program modules 207 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include the implementation of a network environment. The program modules 207 generally execute the functions and / or methods in the embodiments described in the present invention.
[0059] The computer system / server 200 can also communicate with one or more external devices 208 (such as a keyboard, a pointing device, a display 209, etc.), can also communicate with one or more devices that enable a user to interact with the computer system / server 200, and / or can communicate with any device that enables the computer system / server 200 to communicate with one or more other computing devices (such as a network card, a modem, etc.). Such communication can be carried out through the input / output (I / O) interface 210.
[0060] The computer system / server 200 can also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through the network adapter 211. As Figure 2As shown, the network adapter 211 communicates with other modules of the computer system / server 200 via the bus 203. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the computer system / server 200, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.
[0061] The present invention also provides an embodiment of a computer-readable medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the window control method according to any one of the above are implemented.
[0062] Those skilled in the art will appreciate that information, signals, and data may be represented using any of a variety of different technologies and techniques. For example, the data, instructions, commands, information, signals, bits, symbols, and chips described throughout the above description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or optical particles, or any combination thereof.
[0063] Those skilled in the art will further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or a combination of both. To clearly illustrate this interchangeability of hardware and software, the various illustrative components, blocks, modules, circuits, and steps are described above in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and the design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
[0064] The processor described in this case may be implemented using electronic hardware, computer software, or any combination thereof. Whether such a processor is implemented as hardware or software will depend upon the particular application and the overall design constraints imposed on the system. By way of example, the processor, any part of the processor, or any combination of the processors presented in this disclosure may be implemented using a microprocessor, a microcontroller, a digital signal processor (DSP), a field programmable gate array (FPGA), a programmable logic device (PLD), a state machine, gated logic, discrete hardware circuits, and other suitable processing components configured to perform the various functions described throughout this disclosure. The functionality of the processor, any part of the processor, or any combination of the processors presented in this disclosure may be implemented using software executed by a microprocessor, a microcontroller, a DSP, or other suitable platform.
[0065] The steps of the methods or algorithms described in connection with the embodiments disclosed herein can be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
[0066] An exemplary storage medium is coupled to the processor to enable the processor to read from, and write to, the storage medium. In an alternative, the storage medium may be integrated into the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In an alternative, the processor and the storage medium may reside as discrete components in a user terminal.
[0067] In one or more exemplary embodiments, the described functionality may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software as a computer program product, the functions may be stored on or transmitted via a computer-readable medium as one or more instructions or code. The computer-readable medium includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another.
[0068] The storage medium can be any available medium that can be accessed by a computer. By way of example, and not limitation, such computer-readable media can include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer.
[0069] Any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a web site, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium.
[0070] As used herein, disk and disc include compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk, and Blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.
[0071] The previous description of the present disclosure is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to the present disclosure will be apparent to those skilled in the art, and the general principles defined herein can be applied to other variations without departing from the spirit or scope of the present disclosure. Thus, the present disclosure is not intended to be limited to the examples and designs described herein, but should be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A window control method, characterized in that, Including: Performing gaze point detection on the in-vehicle personnel based on real-time in-vehicle images; In response to detecting that the in-vehicle personnel are gazing out of the window, determining whether the familiarity of the out-of-vehicle personnel outside the corresponding window meets a preset condition based on the images of the out-of-vehicle personnel; And In response to the familiarity of the out-of-vehicle personnel meeting the preset condition, controlling the corresponding window to open; The window control method further includes: Performing lip movement detection on the in-vehicle personnel based on real-time in-vehicle images; And In response to the in-vehicle personnel gazing out of the window, the in-vehicle personnel having lip movement, and the familiarity of the out-of-vehicle personnel outside the corresponding window meeting the preset condition, controlling the corresponding window to open.
2. The window control method according to claim 1, wherein, Determining whether the familiarity of the out-of-vehicle personnel meets the preset condition based on the images of the out-of-vehicle personnel outside the corresponding window includes: Comparing the images of the out-of-vehicle personnel outside the corresponding window with the pre-stored personnel images of the user.
3. The window control method according to claim 1, wherein, Determining whether the familiarity of the out-of-vehicle personnel meets the preset condition based on the images of the out-of-vehicle personnel outside the corresponding window further includes: Judging the familiarity of the out-of-vehicle personnel based on the historical personnel images obtained by the vehicle.
4. The window control method according to claim 3, wherein, The historical personnel images include the images of the personnel entering the vehicle. Judging the familiarity of the out-of-vehicle personnel based on the historical personnel images obtained by the vehicle further includes: Extracting the facial features of the personnel from the historical personnel images for face recognition; Recording the frequencies of different personnel entering the vehicle based on the results of the face recognition; and Judging whether the frequency of the out-of-vehicle personnel entering the vehicle reaches a preset number of times.
5. The window control method according to claim 3, wherein, The historical personnel images include the images of the personnel entering the vehicle. Judging the familiarity of the out-of-vehicle personnel based on the historical personnel images obtained by the vehicle further includes: Extracting the facial features of the personnel from the historical personnel images for face recognition; Obtaining the residence time of different personnel in the vehicle based on the results of the face recognition; and Judging whether the residence time of the out-of-vehicle personnel in the vehicle exceeds a preset duration.
6. The window control method according to claim 3, wherein, The historical personnel images include the images of the personnel entering the vehicle. Judging the familiarity of the out-of-vehicle personnel based on the historical personnel images obtained by the vehicle further includes: Extracting the facial features of the personnel from the historical personnel images for face recognition; Identifying whether the personnel entering the vehicle have a preset interaction behavior based on the results of the face recognition and the historical personnel images.
7. The window control method according to claim 3, wherein, The historical personnel images include the images of the personnel near the vehicle. Judging the familiarity of the out-of-vehicle personnel based on the historical personnel images obtained by the vehicle further includes: Extracting the facial features of the personnel from the images of the personnel near the vehicle for face recognition; and Judging whether the out-of-vehicle personnel appear near the vehicle multiple times within a preset time period based on the results of the face recognition.
8. The window control method according to claim 7, wherein, The historical personnel images include the images of the personnel near the vehicle. Judging the familiarity of the out-of-vehicle personnel based on the historical personnel images obtained by the vehicle further includes: Extracting the facial features of the personnel from the images of the personnel near the vehicle for face recognition; Obtaining the location information of the vehicle and corresponding the location information with the personnel images; and Determine whether the person outside the vehicle appears near the vehicle at the same location multiple times within a preset time period.
9. A window control device, characterized in that, Including: A memory; And A processor coupled to the memory, the processor being configured to implement the steps of the window control method according to any one of claims 1 to 8.
10. A computer-readable medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the window control method according to any one of claims 1 to 8.
Citation Information
Patent Citations
Vehicle and gait recognition system
JP2020107145A
Driver assistance apparatus and method for controlling the same
US20170060234A1