System and method for controlling operation of additional vehicle sensors

Abstract

The present disclosure provides "systems and methods for controlling operation of additional vehicle sensors." A vehicle is disclosed that includes a transceiver, a vehicle control unit (VCU), and a processor. The transceiver can receive a user input, and the VCU can determine a vehicle operating parameter. The processor can determine that an additional sensor is connected to the vehicle, and an additional sensor location on the vehicle. The processor can also determine a preferred manner of controlling additional sensor operation based on the user input. The processor can additionally control the additional sensor operation based on the preferred manner, the vehicle operating parameter, and / or the additional sensor location.

Description

Technical Field

[0001] This disclosure relates to vehicles, and more specifically to a system and method for controlling the operation of additional vehicle sensors. Background Technology

[0002] Many users customize their vehicles and / or trailers with aftermarket auto parts or sensors to enhance vehicle performance or comfort. For example, many users install additional cameras, speakers, microphones, ultrasonic sensors, etc., on their vehicles to improve performance. For optimal vehicle operation and desired output, it is important that these additional sensors work effectively in conjunction with existing vehicle sensors. Summary of the Invention

[0003] This disclosure describes a vehicle that controls the operation of additional sensors based on user preferences. Additional sensors can refer to any sensor that the vehicle owner / operator can install on the vehicle as an aftermarket accessory. Examples of such additional sensors include, but are not limited to, cameras, radio detection and ranging (radar) sensors, light detection and ranging (LiDAR) sensors, microphones, ultrasonic sensors, speakers, etc.

[0004] To optimally control the operation of the additional sensor, the vehicle can first determine / confirm that the user has connected the additional sensor to the vehicle based on user input. The vehicle can also determine the location of the additional sensor on the vehicle via, for example, wireless signal triangulation methods, user input, or input obtained from existing pre-installed vehicle sensors (e.g., external and internal cameras). The vehicle can further determine the "preferred mode" of operation that the user might expect from the additional sensor based on user input. The vehicle can determine the preferred mode of controlling the operation of the additional sensor based on input or selection provided to the vehicle by the user. In an exemplary aspect, the preferred mode could be "alternating control" or "independent control." In this case, the user can provide a selection on the vehicle's human-machine interface (HMI) or user device regarding whether the user expects the additional sensor to operate in alternating or independent control, and the vehicle can obtain such selection from the HMI or user device. The vehicle can use this selection to determine the preferred mode of operation of the additional sensor that the user expects from the vehicle.

[0005] In response to determining a preferred mode of operation for the additional sensors, the vehicle can control the operation of the additional sensors based on the preferred mode, the determined location of the additional sensors, and / or one or more vehicle operating parameters. Vehicle operating parameters may include, for example, vehicle speed, vehicle direction of movement, the presence (or absence) of a trailer attached to the vehicle, current vehicle position, the presence and weight of external payloads on the vehicle, and the operating status of one or more vehicle components (e.g., power take-off (PTO), strobe lights, reversing alarm, vehicle radio, or infotainment system, etc.).

[0006] In an exemplary aspect, when the preferred approach is replacement control, the vehicle can control the operation of additional sensors based on the operation of one or more existing and similar vehicle sensors. In this case, in response to determining that the preferred approach for the operation of the additional sensors is replacement control, the vehicle can first determine the vehicle area where the additional sensors may be present based on the determined locations of the additional sensors (e.g., by using the 3D geometry of the vehicle that can be pre-stored in the vehicle's memory). The vehicle then determines one or more existing and similar vehicle sensors that may be located in the vehicle area (e.g., by using information associated with the location and type of existing vehicle sensors that can be pre-stored in the vehicle's memory). The vehicle can then control the operation of the additional sensors in the same manner as the operation of these existing similar vehicle sensors.

[0007] On the other hand, when the preferred method is independent control, the vehicle can control the operation of the additional sensors based on user input and vehicle operating parameters. As an example, in this case, if user input indicates that the user prefers the additional sensors to operate at vehicle speeds above 20 mph, the vehicle can activate the additional sensors when the vehicle speed exceeds 20 mph and deactivate them when the vehicle speed drops below 20 mph. Similarly, the vehicle can activate the additional sensors based on user input at a specific time of day, in a specific geographical location, or during predefined events.

[0008] In some aspects, in addition to controlling the activation and deactivation of additional sensors, the vehicle can also control the duration of recording / operation of additional sensors, the frequency at which data captured by additional sensors should be sent to a cloud repository / server for data management, and the duration for which data should be saved / overwritten, etc.

[0009] The vehicle can further facilitate optimal connection of additional sensors to the vehicle during the sensor installation process. Specifically, the vehicle can output one or more error notifications when it determines that the additional sensor is not correctly capturing data, is not configurable relative to existing vehicle sensors, may not operate optimally with existing vehicle sensors, or is improperly connected. As an example, in this scenario, the vehicle compares / matches the input from the additional sensor with readings from existing, similar vehicle sensors, and outputs an error notification indicating an inappropriate sensor connection when the input and readings substantially mismatch. The user can take remedial action in response to hearing / seeing such error notifications.

[0010] This disclosure describes a vehicle that ensures optimal operation of an additional sensor based on user preferences. When the additional sensor is not properly connected to the vehicle or is malfunctioning, the vehicle further alerts the user, enabling the user to take timely remedial action. The vehicle enhances the overall sensor output quality by providing feedback on sensor performance without requiring engineers or professionals to inspect the vehicle / additional sensor. The vehicle also provides a means for early detection of aftermarket parts that suppress sensor performance.

[0011] These and other advantages of this disclosure are provided in detail herein. Attached Figure Description

[0012] Specific embodiments are illustrated with reference to the accompanying drawings. The same reference numerals may be used to indicate similar or identical items. Various embodiments may utilize elements and / or components other than those shown in the drawings, and some elements and / or components may not be present in various embodiments. Elements and / or components in the drawings are not necessarily drawn to scale. Throughout this disclosure, singular and plural terms can be used interchangeably depending on the context.

[0013] Figure 1 A view of an example vehicle according to this disclosure is depicted.

[0014] Figure 2 A block diagram of a system for controlling the operation of additional vehicle sensors according to this disclosure is depicted.

[0015] Figure 3 A flowchart is depicted of an exemplary first method for configuring an additional sensor according to the present disclosure.

[0016] Figure 4 A flowchart is depicted of an exemplary second method for controlling the operation of an additional sensor according to the present disclosure. Detailed Implementation

[0017] The present disclosure will be described more fully below with reference to the accompanying drawings, which illustrate exemplary embodiments of the present disclosure and are not intended to be limiting.

[0018] Figure 1 A view of an example vehicle 100 according to this disclosure is depicted. Vehicle 100 can take the form of any passenger car or commercial vehicle, such as an automobile, work vehicle, crossover, truck, van, minivan, taxi, bus, etc. Vehicle 100 can be a manually driven vehicle or can be configured to operate in a partially / fully autonomous mode. Furthermore, vehicle 100 can include any powertrain system, such as a gasoline engine, one or more electric actuators, or a hybrid system.

[0019] Vehicle 100 may include multiple existing or pre-installed vehicle sensors or sensor kits (in Figure 2 The system is shown as a vehicle sensing system 230 and one or more additional sensors 102. As used in this disclosure, the term "additional sensor" can mean any sensor that the vehicle owner / operator can install on the vehicle 100 as an aftermarket accessory. In other words, the additional sensor 102 may not be incorporated into the vehicle 100 by the vehicle manufacturer during the manufacturing process, but may be added to the vehicle 100 by the vehicle operator during or after the purchase of the vehicle. Furthermore, if the vehicle is attached to a trailer, the term "vehicle" as used in this disclosure also means including the trailer (not shown). Therefore, when this disclosure states that the additional sensor 102 is attached to the vehicle 100, it can also be interpreted as meaning that the additional sensor 102 is attached to the trailer if the trailer is attached to the vehicle 100.

[0020] The additional sensor 102 may be, for example, a camera, a radio detection and ranging (radar) sensor, a light detection and ranging (LiDAR) sensor, a microphone, an ultrasonic sensor, a speaker, etc. Figure 1 The exemplary aspects depicted herein and the following description illustrate / describe aspects in which the additional sensor 102 is a rearview camera; however, such depictions and descriptions should not be construed as limiting. Without departing from the scope of this disclosure, the additional sensor 102 can be any type of sensor or accessory that a vehicle operator can attach to any location on the vehicle 100 to enhance vehicle performance and user comfort.

[0021] It is understandable that, for optimal vehicle performance and desired output, it is important that the additional sensor 102 integrates with the vehicle sensors and operates effectively according to user requirements / preferences. To enable the additional sensor 102 to operate effectively, the vehicle 100 may include a sensor control unit (in... Figure 2The sensor control unit (shown as sensor control unit 210) controls the operation of the additional sensor 102 based on vehicle operator / user preferences. The function of the vehicle's sensor control unit (“Unit”) is briefly described below, and will be discussed later in conjunction with… Figure 2 It is described in detail.

[0022] In an exemplary aspect, as a first step, when a user connects / attaches the additional sensor 102 to the vehicle 100, the unit can determine the presence of the additional sensor 102 on the vehicle 100. The user can connect the additional sensor 102 to the vehicle 100 via one or more brackets, magnetic attachments, adhesives, etc. In some aspects, the unit can determine the presence of the additional sensor on the vehicle 100 via user input, which the user can provide to the vehicle 100 via a user device and / or a vehicle human-machine interface (HMI) when connecting / installing the additional sensor 102 to the vehicle 100. In an exemplary aspect, the user input can indicate how the user expects the additional sensor 102 to operate (or the "preferred manner" in which the additional sensor 102 should operate), when to activate and deactivate the additional sensor 102, the duration of operation of the additional sensor 102, what data the additional sensor 102 should record or capture, how and where to output the additional sensor readings / data, etc.

[0023] In response to determining the presence of an additional sensor on vehicle 100, the unit can determine and / or estimate the location of the additional sensor 102 on vehicle 100. The unit can implement one or more different methods to determine the location of the additional sensor on vehicle 100. For example, the unit can determine the location of the additional sensor via wireless signal triangulation from the additional sensor 102 to vehicle 100. In some aspects, the additional sensor 102 can be connected to vehicle 100 via wired or wireless communication. For example, the unit can use signals obtained from the additional sensor 102 to estimate the location of the additional sensor via wireless signal triangulation. As another example, the unit can determine the location of the additional sensor via input obtained from an existing vehicle sensing system or sensor kit. For example, the unit can determine the location of the additional sensor based on images obtained from existing cameras on the vehicle (e.g., images of the installed additional sensor 102 or images captured when a user may be installing the additional sensor 102 on vehicle 100). As yet another example, the unit can determine the location of the additional sensor via user input that can be provided to vehicle 100 when the additional sensor 102 is installed / connected.

[0024] The unit can also control the operation of the additional sensor based on the user's preferred mode of operation of the additional sensor 102 (which may be part of the user input, as described above), the determined location of the additional sensor, and / or one or more vehicle operating parameters. Vehicle operating parameters may include, for example, vehicle speed, vehicle direction of movement, the presence (or absence) of a trailer attached to vehicle 100, current vehicle position, the presence and weight of external payloads on vehicle 100, and the operating status of one or more vehicle components (e.g., power take-off (PTO), strobe lights, reversing alarm, vehicle radio, or infotainment system, etc.).

[0025] In some aspects, the preferred mode of operation of the additional sensor as described above may be either "replacement control" or "independent control." In some aspects, the unit may determine the preferred mode of operation of the additional sensor 102 based on user input that can be provided to the vehicle 100 when or before / after the installation of the additional sensor 102. For example, when installing the additional sensor 102, the user may provide input on the vehicle's HMI or user device indicating that the user expects the additional sensor 102 to operate in either "replacement control" or "independent control" mode. The unit may obtain such input from the HMI or user device and determine the preferred mode of operation of the additional sensor 102 based on the obtained user input.

[0026] When a user indicates in user input that they prefer the additional sensor 102 to have replacement control, the unit can control the operation of the additional sensor based on the operation of one or more existing vehicle sensors. In this case, in response to determining that the preferred method for controlling the operation of the additional sensor is replacement control, the unit can first determine the vehicle area where the additional sensor 102 can be located based on the determined location of the additional sensor (e.g., by using the 3D geometry of the vehicle 100 that can be pre-stored in the vehicle memory). For example, when the location of the additional sensor indicates that the additional sensor 102 is connected to the rear part of the vehicle (such as... Figure 1When (as shown), the unit can determine that the additional sensor 102 is located in the rear external vehicle zone. Similarly, the unit can determine, based on the location of the additional sensor, that the additional sensor 102 may be located in the front vehicle zone, right vehicle zone, left vehicle zone, inner vehicle zone, outer vehicle zone, etc. In response to determining the vehicle zone where the additional sensor 102 may be present, the unit can determine one or more existing and similar vehicle sensors that may be located in said vehicle zone (e.g., by using information associated with the location and type of existing vehicle sensors that may be pre-stored in the vehicle's memory). For example, if the determined vehicle zone is the rear external vehicle zone and the additional sensor 102 is a camera, the unit can determine one or more existing rear cameras that may be located in the rear external vehicle zone. Thereafter, the unit can control the operation of the additional sensor in the same manner as the operation of these existing vehicle sensors.

[0027] For example, in the aspects described above, the unit can control the operation of the additional camera in the same manner as the operation of an existing rear vehicle camera. In this case, the unit can activate the additional rear camera while activating the existing rear vehicle camera, deactivate the additional rear camera while deactivating the existing rear vehicle camera, align the FOV of the additional rear camera in the same manner as the field of view (FOV) of the existing rear vehicle camera, output, record, and / or transmit images captured by the additional rear camera in a manner similar to how the existing rear vehicle camera performs these functions, and so on. As another example, if the existing rear vehicle camera is programmed to be activated and capture images when one of a predefined event occurs (when another vehicle gets too close to or touches vehicle 100), the unit can be programmed and controlled to operate the additional rear camera in a similar manner.

[0028] On the other hand, when the user indicates in user input that they prefer the additional sensor 102 to have independent control (or the preferred method for controlling the operation of the additional sensor 102 is independent control), the unit can control the operation of the additional sensor based on the user input and vehicle operating parameters. As an example, in this case, if the user input indicates that they prefer the additional sensor 102 to operate at vehicle speeds above 20 mph, the unit can activate the additional sensor 102 when the vehicle speed exceeds 20 mph and deactivate the additional sensor 102 when the vehicle speed drops below 20 mph. In this case, the unit controls the operation of the additional sensor from the vehicle control unit (in...). Figure 2The VCU (shown as VCU 208) obtains real-time vehicle operating parameters and controls the operation of additional sensors based on the obtained inputs. Additional examples of user inputs or preferences for additional sensor activation may include, but are not limited to, activating additional sensor 102 when vehicle 100 is connected to a trailer and vehicle 100 is reversing, activating additional sensor 102 only when vehicle 100 is in a specific geographic location (e.g., the user's home or office), activating additional sensor 102 only at a specific time (e.g., at night), activating additional sensor 102 when vehicle 100 is loaded (e.g., the payload is above a calibration threshold), activating additional sensor 102 when one or more vehicle components (e.g., PTO, strobe lights, reversing alarm, radio, etc.) are activated, activating additional sensor 102 only when vehicle 100 is traveling in a specific direction (e.g., forward or backward), and so on.

[0029] As another example of user input or preference activated by the additional sensor, the unit activates / operates the additional sensor 102 only when the unit determines that the user is performing a predetermined user-defined action or predefined action (e.g., gardening, house painting, recreational activities, etc.) near vehicle 100 (determined by the unit based on input obtained from the vehicle's sensing system). In this case, in an exemplary aspect, vehicle 100 may pre-store multiple images (or "stock images") of the user performing various predefined actions (e.g., gardening, house painting, recreational activities, etc.). Vehicle 100 may further obtain real-time images of the user performing activities near vehicle 100 using an external camera of the vehicle. Vehicle 100 may then compare the real-time images with the stock images to determine whether the user is likely performing one of the user-defined actions or predefined actions. When the real-time image substantially matches one of the stock images, vehicle 100 may determine that the user is likely performing a user-defined action or a predefined action. In response to this determination, vehicle 100 may control the operation of the additional sensor 102 based on the predefined action or the user-defined action. For example, in this case, in response to determining that the user is performing a predefined action or a user-defined action, the vehicle 100 can activate the additional sensor 102.

[0030] As another example, a user can provide audible input to vehicle 100 indicating the type of activity / action the user might be performing near vehicle 100, and the vehicle's microphone (which may be part of the vehicle's sensing system) can capture the audible input. In this case, vehicle 100 can determine the type of action the user might be performing based on the user's audible input and determine whether the action is the same as a user-defined or predefined action. In response to determining that the action is the same as a user-defined or predefined action, vehicle 100 can accordingly control the operation of additional sensor 102 (e.g., activate additional sensor 102).

[0031] In this way, the unit activates / controls the operation of the additional sensor based on user input / preferred operation method, the location of the additional sensor, and / or real-time vehicle operating parameters. In some aspects, in addition to controlling the activation and deactivation of the additional sensor, the unit can also (based on user input) control the duration of recording / operation of the additional sensor 102, the time and frequency at which data captured by the additional sensor 102 should be sent to a cloud repository / server for data management, the duration for which data should be saved / overwritten, what the additional sensor 102 should record (using image recognition, etc.), the areas of focus for the additional sensor 102, and how the output of the additional sensor should be transmitted to the user (visual, audio, etc.) (e.g., whether it should replace the display of another sensor on the HMI, the location of the display on the HMI, when audio should be transmitted, and what messages should be relayed, etc.). In this way, the unit controls the entire operation of the additional sensor 102 based on user preferences, thereby significantly enhancing user convenience.

[0032] The unit can also facilitate optimal connection of the additional sensor 102 by the user during the sensor installation process. Specifically, when the unit determines that the additional sensor 102 is not correctly capturing data, the additional sensor 102 is not configurable relative to existing vehicle sensors, the additional sensor 102 may not operate optimally with existing vehicle sensors, or the additional sensor 102 is not properly connected, the unit can output one or more error notifications on the user device and / or vehicle HMI. The user can perform remedial actions in response to seeing / hearing these error notifications, thereby enabling the user to effectively connect the additional sensor 102 to the vehicle 100. The following is in conjunction with... Figure 2 and Figure 3 The detailed process is described to facilitate optimal connection between the additional sensor 102 and the other vehicle 100 for the user.

[0033] Vehicle 100 shall implement and / or perform the operations described herein in accordance with the owner's manual and safety guidelines. Furthermore, any actions taken by the user based on notifications provided by Vehicle 100 shall comply with all rules specific to the location and operation of Vehicle 100 (e.g., federal, state, national, city, etc.). Notifications provided by Vehicle 100 shall be considered advice and shall be followed only in accordance with any rules specific to the location and operation of Vehicle 100.

[0034] Figure 2 A block diagram of a system 200 for controlling the operation of an additional sensor, according to this disclosure, is depicted. In the description... Figure 2 At that time, will refer to Figure 3 .

[0035] System 200 may include a vehicle 100, a user device 201, and one or more servers 202 (or servers 204) that can be communicatively coupled to each other via one or more networks 204. The user device 201 may be associated with a vehicle operator / user and may be, for example, a mobile phone, laptop computer, computer, tablet computer, smartwatch, or any other similar device with communication capabilities. Server 202 may be part of a cloud-based computing infrastructure and may be associated with and / or include a Telematics Service Delivery Network (SDN), which delivers services to vehicle 100 and other vehicles that may be part of a vehicle fleet. Figure 2 (Not shown) provides digital data services. In another aspect, server 202 can store, process, and / or analyze sensor data / readings obtained from sensors installed on multiple vehicles (including vehicle 100).

[0036] Network 204 illustrates exemplary communication infrastructure in which connected devices discussed in various embodiments of this disclosure can communicate. Network 204 may be and / or include the Internet, a private network, a public network, or other configurations operating using any one or more known communication protocols such as Transmission Control Protocol / Internet Protocol (TCP / IP), Bluetooth, etc. ® Bluetooth Low Energy (BLE), Wi-Fi based on the IEEE standard 802.11, Ultra Wideband (UWB), and cellular technologies such as Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), High-Speed ​​Packet Access (HSPDA), Long Term Evolution (LTE), Global System for Mobile Communications (GSM), and 5G, to name just a few.

[0037] Vehicle 100 may include multiple units, including but not limited to vehicle computer 206, vehicle control unit (VCU) 208, and sensor control unit 210 (or unit 210). VCU 208 may include multiple electronic control units (ECUs) 212 that communicate with vehicle computer 206.

[0038] In some respects, according to this disclosure, the vehicle computer 206 and / or unit 210 can be installed anywhere within the vehicle 100. Furthermore, the vehicle computer 206 can operate as a functional part of unit 210. The vehicle computer 206 can be or include an electronic vehicle controller having one or more processors 214 and memory 216. Additionally, unit 210 can be separate from the vehicle computer 206 (e.g., Figure 2 (as shown in the diagram), or it can be integrated as part of the vehicle computer 206.

[0039] Processor 214 can communicate with one or more memory devices (e.g., memory 216 and / or memory) of a corresponding computing system. Figure 2 The processor 214 may communicate with one or more external databases (not shown). The processor 214 may utilize the memory 216 to store programs in code form and / or store data to perform aspects of this disclosure. The memory 216 may be a non-transitory computer-readable medium or memory that stores sensor control program code. The memory 216 may include any or a combination of volatile memory elements (e.g., dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), etc.) and may include any one or more non-volatile memory elements (e.g., erasable programmable read-only memory (EPROM), flash memory, electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), etc.).

[0040] According to some aspects, VCU 208 can share a power bus with vehicle computer 206 and can be configured and / or programmed to coordinate the systems of vehicle 100, connected servers (e.g., server 202), user devices 201, and other vehicles operating as part of a vehicle fleet. Figure 2 Data between (not shown). The VCU 208 can also determine one or more vehicle operating parameters in real time. (The above has been combined with...) Figure 1 Examples of vehicle operating parameters are described.

[0041] VCU 208 may include any combination of or communicate with ECU 212, such as Body Control Module (BCM) 218, Engine Control Module (ECM) 220, Transmission Control Module (TCM) 222, Telematics Control Unit (TCU) 224, Driver Assist Technology (DAT) Controller 226, etc.

[0042] VCU 208 may also include and / or communicate with a vehicle perception system (VPS) 228, which has connectivity with and / or controls one or more vehicle sensing systems 230 (or “sensor units”). The vehicle sensing system 230 may include one or more vehicle sensors (e.g., pre-installed sensors), including but not limited to radio detection and ranging (radar) sensors, seating area latch sensors, seating area sensors, light detection and ranging (LiDAR) sensors, door sensors, proximity sensors, temperature sensors, wheel sensors, ambient weather sensors, ambient light sensors, vehicle interior and exterior cameras, one or more rain sensors, humidity sensors, tire pressure sensors, ultrasonic sensors, one or more microphones, etc., configured to detect and locate objects inside and outside the vehicle 100 using radio waves.

[0043] In some respects, VCU 208 can control vehicle operation aspects and implement one or more instruction sets received from user equipment 201, one or more instruction sets stored in memory 216, including instructions that operate as part of unit 210.

[0044] TCU 224 can provide vehicle connectivity to wireless computing systems on and outside the vehicle 100, and may include a navigation (NAV) receiver 232 for receiving and processing GPS signals, a BLE module (BLEM) 234, a Wi-Fi transceiver, a UWB transceiver, and / or other wireless transceivers that can be configured for wireless communication (including cellular communication) between the vehicle 100 and other systems (e.g., user device 201, key fob, NFC device, etc.), computers, and modules. Figure 2 (Not shown in the image). NAV receiver 232 can be configured to determine the real-time geographical location of the vehicle. TCU 224 can communicate with ECU 212 via bus.

[0045] ECU 212 can use inputs from the human driver, inputs from the autonomous vehicle controller, inputs from unit 210, and / or wireless signal inputs received from other connected devices (such as user device 201, server 202, etc.) via wireless connection to control various aspects of vehicle operation and communication.

[0046] The BCM 218 typically integrates sensors, vehicle performance indicators, and variable reactors associated with vehicle systems. It may also include processor-based power distribution circuitry that controls functions associated with the vehicle body, such as lights, windows, safety devices, cameras, fans, headlights, audio systems, speakers, wipers, door locks and entry controls, mirrors, and various comfort controls. The BCM 218 can also operate as a gateway for bus and network interfaces to communicate with remote ECUs ( Figure 2 Interact with (not shown in the image).

[0047] The DAT controller 226 can provide Level 1 to Level 3 automated driving and driver assistance functionality, which may include features such as active parking assist, vehicle reversing assist, and adaptive cruise control. The DAT controller 226 can also provide various aspects of user and environmental inputs that can be used for user authentication.

[0048] In some respects, the vehicle computer 206 may connect to the infotainment system 236 (or the vehicle human-machine interface (HMI) 236). The infotainment system 236 may include a touchscreen interface portion and may include voice recognition features, and the ability to identify users based on facial recognition, voice recognition, fingerprint recognition, or other biometric methods. In other respects, the infotainment system 236 may also receive user commands / inputs via the touchscreen interface portion, and / or display notifications / recommendations, navigation maps, etc., on the touchscreen interface portion.

[0049] The computing system architecture of the automotive computer 206, VCU 208, and / or unit 210 may omit certain computing modules. This should be easily understood. Figure 2 The computing environment depicted herein is an example of possible implementations according to this disclosure and should therefore not be considered restrictive or exclusive.

[0050] Depending on some aspects, unit 210 may be integrated with and / or performed as part of ECU 212. Unit 210 may include transceiver 238, processor 240, and computer-readable storage 242, whether it is integrated with vehicle computer 206 or ECU 212, or whether it operates as a stand-alone computing system in vehicle 100.

[0051] Transceiver 238 can receive information / input from one or more external devices or systems (e.g., user device 201, server 202, etc.) via network 204. For example, transceiver 238 can receive information / input from a user via user device 201. Figure 1The transceiver 238 describes the user input. Furthermore, it can transmit notifications / data / signals to external devices or systems. Additionally, it can receive information / input from vehicle 100 components (such as infotainment system 236, VCU 208, etc.). Furthermore, it can transmit notification / command signals to vehicle 100 components (such as VCU 208, infotainment system 236, BCM 218, etc.).

[0052] Processor 240 and memory 242 may be the same as or similar to processor 214 and memory 216, respectively. In some aspects, processor 240 may utilize memory 242 to store programs in code form and / or store data for execution of various aspects according to this disclosure. Memory 242 may be a non-transitory computer-readable medium or memory storing sensor control program code.

[0053] In operation, transceiver 238 can receive user input via user device 201 or infotainment system 236 indicating a preferred manner in which the user expects the vehicle 100 to control the operation of additional sensor 102. The user can provide this input while the additional sensor 102 is being installed / attached to the vehicle 100, or before or after the installation process. In some aspects, when additional sensor 102 can be installed / attached to the vehicle 100, it can draw power from the vehicle's battery, solar power, or its own built-in battery. Furthermore, when additional sensor 102 can be installed / attached to the vehicle 100, it can be communicatively coupled to the vehicle 100 / processor 240 via a wired or wireless connection.

[0054] After receiving user input from the user, transceiver 238 can transmit the user input to processor 240. In response to receiving the user input, processor 240 can determine / confirm that the additional sensor 102 is connected to vehicle 100. Processor 240 can then determine the location of the additional sensor on vehicle 100. As described above, processor 240 can determine / estimate the location of the additional sensor via wireless signal triangulation, user input (when the user specifies the location where the additional sensor 102 has been connected to vehicle 100), or input obtained from sensors included in vehicle sensing system 230 (e.g., images obtained from existing vehicle cameras).

[0055] As described above, the processor 240 can also determine a preferred manner for user control of the operation of the additional sensor 102 based on the obtained user input (which the user can provide to the vehicle 100 before, during, or after the installation of the additional sensor 102 onto the vehicle 100). As described above... Figure 1As described, the preferred method for controlling the operation of the additional sensor 102 can be either successive control or independent control of the additional sensor operation. The processor 240 can then control the operation of the additional sensor based on the preferred method, user input, the location of the additional sensor, and / or real-time vehicle operating parameters, as described below.

[0056] In an exemplary aspect, when the preferred mode of user control of the operation of the additional sensor 102 is independent control (e.g., determined based on user input / selection obtained from the user), the processor 240 can control the operation of the additional sensor based on the real-time vehicle operating parameters and the user input. In this case, the processor 240 can control the operation of the additional sensor independently and separately from the operation of other existing vehicle sensors. For example, if the user's preferred mode is independent control and the user input indicates that the user expects the additional sensor 102 to be activated whenever the vehicle speed exceeds 20 mph, then the processor 240 can activate the additional sensor 102 whenever the vehicle speed exceeds 20 mph (e.g., determined based on input obtained from VCU 208). The processor 240 can also record readings / data obtained from the additional sensor 102, publish its activation, and transmit the readings to the user device 201, infotainment system 236, and / or server 202 based on user preferences processed from the recorded data (e.g., indicated in the user input).

[0057] As another example, if user input indicates that the user expects the additional sensor 102 to be activated whenever vehicle 100 is reversing and attached to a trailer, then processor 240 can activate the additional sensor 102 whenever such vehicle conditions are met. As yet another example, if user input indicates that the user expects the additional sensor 102 to be activated whenever vehicle 100 is located at a specified geofence location (e.g., the user's home), then processor 240 can correlate the real-time vehicle location (determined based on input obtained from TCU 224) with the specified geofence location, and activate the additional sensor 102 whenever the real-time vehicle location matches the specified geofence location.

[0058] As another example, if user input indicates that the user expects the additional sensor 102 to be activated when vehicle 100 is loaded (e.g., when the payload is above a calibration threshold) or whenever one or more other vehicle components (e.g., PTO, radio, strobe lights, reversing alarm) are activated, processor 240 may activate the additional sensor 102 whenever such vehicle conditions are met. For example, if the additional sensor 102 is a speaker and user input indicates that the user expects the additional speaker to be activated whenever the user turns on the vehicle radio, then processor 240 may activate the additional speaker whenever the user turns on the vehicle radio.

[0059] As another example, if user input indicates that the user expects to activate the additional sensor 102 based on a specific vehicle movement direction (e.g., forward or backward) relative to the additional sensor 102, then the processor 240 may activate the additional sensor 102 whenever the vehicle 100 moves in the specified direction (determined based on input obtained from the VCU 208). As another example, if user input indicates that the user expects to activate the additional sensor 102 whenever the user is performing a predetermined user-defined action (e.g., gardening, lawn mowing, deck building / repair, house painting, recreational activities, exercise, RV ride, etc.) near the vehicle 100, then the processor 240 may activate the additional sensor 102 whenever the user is likely to be performing such an action near the vehicle 100. In this case, the processor 240 may first determine, based on input obtained from the vehicle sensing system 230, that the user is likely performing a predefined action near the vehicle 100, and then activate / control the operation of the additional sensor in response to identification and / or based on said predefined action.

[0060] In this case, as combined with the above Figure 1 As described, in one exemplary aspect, processor 240 may acquire real-time images of a user performing an activity / action near vehicle 100 via an external camera of the vehicle (which may be part of vehicle sensing system 230). Processor 240 may then compare the real-time images with a plurality of stock images that may be pre-stored in memory 242. When the real-time image substantially matches at least one stock image, processor 240 may determine that the user may be performing a predefined action or activity. Processor 240 may also activate (or control the operation of) additional sensor 102 in response to recognition and / or based on the predefined action being performed by the user. For example, if user input indicates that additional sensor 102 should be turned on for 5 minutes whenever the user is gardening near vehicle 100, processor 240 may activate additional sensor 102 for 5 minutes when processor 240 determines that the user is gardening (based on images of the user captured by the external camera of the vehicle).

[0061] As another example, as combined above Figure 1 As described, a user can indicate the type of action they are performing near vehicle 100 by audible messages that can be captured by the vehicle's microphone. In this case, processor 240 can determine whether the user is performing a predefined action / activity based on the audible messages and can control the operation of additional sensor 102 accordingly, as described above.

[0062] The examples of independent control over the operation of the additional sensor described above should not be construed as limiting. User input may indicate additional and / or different types of operation that the user may expect for the additional sensor 102, and the processor 240 may control the operation of the additional sensor accordingly without departing from the scope of this disclosure. Furthermore, user input may indicate not only when the additional sensor 102 should be activated, but also the duration for which the additional sensor 102 should be operated or when the additional sensor 102 should be deactivated, and how the readings / data obtained from the additional sensor 102 should be processed, stored, output, etc. Therefore, the processor 240 may not only control the activation of the additional sensor based on user input, but also control the deactivation or shutdown of the additional sensor 102 after a predefined duration, as well as the transfer of data obtained from the additional sensor 102 to the server 202, infotainment system 236, user device 201, and / or memory 242.

[0063] In some respects, when the preferred method for user control of the operation of the additional sensor 102 is alternative control (e.g., determined based on user input / selection obtained from the user), the processor 240 can control the operation of the additional sensor based on the location of the additional sensor on the vehicle 100 and control the operation of one or more existing and similar vehicle sensors (which may be part of the vehicle sensing system 230). In this case, as combined above... Figure 1 As described, processor 240 can first determine the vehicle zone where additional sensor 102 may be present based on the determined location of the additional sensor (e.g., by using the 3D geometry of vehicle 100 that can be pre-stored in memory 242). As an example, in this case, processor 240 can correlate the determined location of the additional sensor with the 3D geometry / map of vehicle 100 and determine the vehicle zone where additional sensor 102 may be present based on said correlation. Processor 240 can then identify / identify one or more existing and similar vehicle sensors that may be located in the vehicle zone (e.g., by using information associated with the location and type of different existing vehicle sensors that can be pre-stored in memory 242). For example, if the determined vehicle zone is a rear external vehicle zone and additional sensor 102 is a camera, processor 240 can use the stored information described above to identify one or more existing rear cameras that may be located in the rear external vehicle zone. Processor 240 can then control the operation of the additional sensor in the same manner as the operation of the identified existing similar vehicle sensors. The above has already been combined with... Figure 1 An example of controlling the operation of additional sensors based on the operation of existing vehicle sensors is described.

[0064] As briefly described above, processor 240 can also facilitate the user's optimal connection of the additional sensor 102 to vehicle 100 during the installation process. Specifically, when the additional sensor 102 may not be properly connected or its readings may not match those of other similar vehicle sensors, processor 240 can output one or more error notifications, allowing the user to correct the error. An exemplary process implemented by processor 240 to facilitate the user's optimal connection of the additional sensor 102 to vehicle 100 is described below.

[0065] In an exemplary aspect, when the additional sensor 102 is connected to the vehicle 100 and activated by the processor 240, the processor 240 may first obtain input from the additional sensor 102. The processor 240 may also obtain readings (or other known parameters, such as temperature, pressure, etc.) from existing and / or similar vehicle sensors and compare these readings with the input obtained from the additional sensor 102. For example, if a user attaches an additional camera, radar, or lidar sensor to the vehicle 100, the processor 240 may perform pattern matching between readings obtained from existing onboard vehicle sensors and the input obtained from the additional sensor. In an exemplary aspect, when the vehicle 100 is traveling in a straight line at a nominal speed, the processor 240 may perform this step, and then the processor 240 may identify any prominent patterns (e.g., curbs, poles, etc.) appearing in the readings from both the onboard sensor and the additional sensor, and calculate their relative positions.

[0066] When the difference between the input obtained from the additional sensor 102 and the reading obtained from the existing onboard vehicle sensor exceeds a predefined threshold, the processor 240 may output a first error notification on the user device 201 and / or the infotainment system 236. It is understood that a large difference may indicate that the additional sensor 102 and the existing similar vehicle sensor are "reading" or focusing on different aspects, areas, and / or FOVs, and therefore the additional sensor 102 may not be properly connected. In this case, the user can perform remedial action to properly connect the additional sensor 102 to the vehicle 100 in response to seeing / hearing the first error notification.

[0067] On the other hand, if the difference is small (e.g., less than a predefined threshold), the processor 240 may not output a first error notification and may instead determine that the additional sensor 102 can be connected to the vehicle 100 by the user in a likely correct manner.

[0068] Processor 240 can also determine whether additional sensor 102 is configurable based on input obtained from additional sensor 102 (e.g., whether the input is within permissible limits, whether it is of a similar type to existing readings, etc.). Processor 240 can output a second error notification on user device 201 and / or infotainment system 236 in response to determining that additional sensor 102 is not configurable. In a similar manner to the above, the user can perform remedial actions in response to hearing / seeing the second error notification. Alternatively, processor 240 can configure additional sensor 102 to operate together with existing similar vehicle sensors in response to determining that additional sensor 102 is configurable. Figure 3 An exemplary process 300 (or “first method”) implemented by processor 240 to configure additional sensor 102 is depicted and described below.

[0069] Process 300 may begin at step 302. At step 304, when the user connects the additional sensor 102 to vehicle 100, processor 240 may identify additional sensor parameters, such as FOV, voltage, measurement properties (temperature, pressure, etc.). At step 306, processor 240 may identify the additional sensor configuration and / or the vehicle area where the additional sensor 102 can be connected. At step 308, processor 240 may identify sensors assigned to or present in the vehicle area or connected to trailers / equipment where the additional sensor 102 can be connected. At step 310, processor 240 may read the output of the additional sensor and compare it with adjacent output or measurement information (e.g., temperature, pressure, etc.) to verify and accept it.

[0070] At step 312, processor 240 can determine whether the output from additional sensor 102 is within acceptable standards / ranges. If the output is not within acceptable ranges, at step 314, processor 240 can output an alarm or error notification (e.g., stating a measurement mismatch). The user can then perform remedial actions after seeing / hearing the alarm. After step 314, process 300 can move to step 316, where process 300 can stop.

[0071] On the other hand, if the output is within acceptable limits, at step 318, processor 240 can define the area location of the additional sensor and the affected area / zone / FOV. At step 320, processor 240 can determine whether the additional sensor 102 is an add-on part / equipment (e.g., an add-on camera to an existing camera). If the additional sensor 102 is not an add-on part / equipment, at step 322, processor 240 can notify the user about the new sensor (i.e., output a notification to the user). Process 300 can then proceed to step 316 after step 322.

[0072] On the other hand, if the additional sensor 102 is an add-on part / equipment, then at step 324, the processor 240 can determine the conditions for the operation of the additional sensor (if defined by the user). At step 326, the processor 240 can update the configuration of the relevant sensor to the corresponding additional sensor 102.

[0073] At step 328, processor 240 can determine whether additional sensor 102 is configurable and can still function (partially or fully) after step 326. If additional sensor 102 is not configurable or inoperable, at step 330, processor 240 can warn the user (via the alarm notification shown in step 314) and disable the system (or additional sensor 102). Furthermore, at step 330, processor 240 can ignore data from additional sensor 102 in relevant algorithms and use nearby sensor data to apply different weights and analyses.

[0074] On the other hand, if the additional sensor 102 is configurable or functional, the processor 240 can reconfigure the sensor properties at step 332. Specifically, at this step, the processor 240 can configure the FOV to follow (or not follow), ensuring that the additional sensor 102 remains in the system without sending error messages, etc. After step 332, process 300 moves to step 316, where process 300 stops.

[0075] Figure 4 A flowchart illustrating an exemplary second method 400 for controlling the operation of an additional sensor according to this disclosure is provided. Further description can be made with reference to the preceding figures. Figure 4 The following process is exemplary and is not limited to the steps described below. Furthermore, alternative embodiments may include more or fewer steps than shown or described herein, and may include these steps in a different order than that described in the following example embodiments.

[0076] Method 400 begins at step 402. At step 404, method 400 may include processor 240 determining that the additional sensor 102 is connected to vehicle 100. At step 406, method 400 may include processor 240 determining the location of the additional sensor on vehicle 100. At step 408, method 400 may include processor 240 determining a preferred manner for controlling the operation of the additional sensor based on user input. At step 410, method 400 may include processor 240 controlling the operation of the additional sensor based on the preferred manner, one or more vehicle operating parameters, and / or the location of the additional sensor.

[0077] At step 412, method 400 can stop.

[0078] In the foregoing disclosure, reference has been made to the accompanying drawings, which form a part of the foregoing disclosure, illustrating specific implementations in which the present disclosure may be practiced. It should be understood that other implementations and structural changes may be utilized without departing from the scope of the present disclosure. References to “an embodiment,” “embodiment,” “example embodiment,” etc., in this specification indicate that the described embodiment may include specific features, structures, or characteristics, but each embodiment may not necessarily include said specific features, structures, or characteristics. Furthermore, such phrases do not necessarily refer to the same embodiment. Moreover, when features, structures, or characteristics are described in connection with embodiments, those skilled in the art will recognize such features, structures, or characteristics in conjunction with other embodiments, whether explicitly described or not.

[0079] Furthermore, where appropriate, the functions described herein may be performed by one or more of the following: hardware, software, firmware, digital components, or analog components. For example, one or more application-specific integrated circuits (ASICs) may be programmed to perform one or more of the systems and programs described herein. Certain terms are used throughout the specification and claims to refer to specific system components. As those skilled in the art will appreciate, components may be referred to by different names. This document is not intended to distinguish between components with different names but identical functions.

[0080] It should also be understood that the word “example” as used herein is intended to be non-exclusive and non-restrictive in nature. More specifically, the word “example” as used herein refers to one of several examples, and it should be understood that there is no undue emphasis or preference for any particular example described.

[0081] Computer-readable media (also known as processor-readable media) include any non-transitory (e.g., tangible) medium that contributes to providing data (e.g., instructions) that can be read by a computer (e.g., by the computer's processor). Such media can take many forms, including but not limited to non-volatile and volatile media. Computing devices may include computer-executable instructions, wherein the instructions can be executed by one or more computing devices (such as those listed above) and stored on a computer-readable medium.

[0082] Regarding the processes, systems, methods, heuristics, etc., described herein, it should be understood that although the steps of such processes, etc., are described as occurring in a certain ordered order, such processes can be practiced by performing the described steps in a different order than that described herein. It should also be understood that some steps may be performed simultaneously, other steps may be added, or some steps described herein may be omitted. In other words, the description of processes herein is provided for the purpose of illustrating various embodiments and should in no way be construed as limiting the claims.

[0083] Therefore, it should be understood that the above description is intended to be illustrative rather than restrictive. Many embodiments and applications beyond the examples provided will become apparent upon reading the above description. The scope should not be determined by reference to the above description, but rather by reference to the appended claims and the full scope of their equivalents. Future developments in the techniques discussed herein are anticipated and expected, and the disclosed systems and methods will be incorporated into such future embodiments. In conclusion, it should be understood that modifications and changes are possible with this application.

[0084] Unless explicitly indicated otherwise herein, all terms used in the claims are intended to be given their ordinary meaning as understood by one skilled in the art as described herein. Specifically, unless the claims explicitly limit the recitation to the contrary, the use of singular articles such as “a,” “the,” or “the” should be interpreted as one or more of the elements indicated by the recitation. Unless otherwise specifically stated or otherwise understood in the context of use, conditional language such as, in particular, “can,” “may,” “may,” or “may” is generally intended to express that some embodiments may include certain features, elements, and / or steps, while other embodiments may not include certain features, elements, and / or steps. Therefore, such conditional language is generally not intended to imply that one or more embodiments require each feature, element, and / or step in any way.

[0085] In one aspect of the invention, controlling the operation of the additional sensor includes, when the preferred mode is independent control, controlling the operation of the additional sensor based on vehicle operating parameters and user input.

[0086] In one aspect of the invention, controlling the operation of the additional sensor includes, when preferably in the form of alternating control, controlling the operation of the additional sensor based on its position.

[0087] In one aspect of the invention, the method includes: determining a vehicle zone connected to the additional sensor based on the location; determining one or more existing vehicle sensors located in the vehicle zone; and controlling the operation of the additional sensor based on the operation of the one or more existing vehicle sensors.

[0088] In one aspect of the invention, the additional sensor is one of the following: a camera, a radio detection and ranging (radar) sensor, or a light detection and ranging (LiDAR) sensor, a microphone, an ultrasonic sensor, or a speaker.

[0089] According to the present invention, a non-transitory computer-readable storage medium is provided having instructions stored thereon, which, when executed by a processor, cause the processor to: determine that an additional sensor is connected to a vehicle; determine the location of the additional sensor on the vehicle; determine a preferred manner for controlling the operation of the additional sensor based on user input; and control the operation of the additional sensor based on at least one of the preferred manner and vehicle operating parameters or the location of the additional sensor.

Claims

1. A vehicle comprising: A transceiver configured to receive user input; A vehicle control unit configured to determine vehicle operating parameters; as well as Processor, the processor being configured to: It was determined that the additional sensors were connected to the vehicle; Determine the location of the additional sensor on the vehicle; The preferred method for controlling the operation of the additional sensor is determined based on the user input; and The operation of the additional sensor is controlled based on at least one of the preferred method and the vehicle operating parameters or the location of the additional sensor.

2. The vehicle as claimed in claim 1, wherein the preferred method is one of alternating control or independent control.

3. The vehicle of claim 2, wherein when the preferred mode is independent control, the processor controls the operation of the additional sensors based on the vehicle operating parameters and the user input.

4. The vehicle of claim 2, wherein when the preferred mode is the takeover control, the processor controls the operation of the additional sensor based on the position of the additional sensor.

5. The vehicle of claim 4, wherein the processor is further configured to: The vehicle zone connected to the additional sensor is determined based on the location; Identify one or more existing vehicle sensors located in the vehicle area; and The operation of the additional sensor is controlled based on the operation of the one or more existing vehicle sensors.

6. The vehicle of claim 5, wherein the additional sensor is communicatively coupled to the processor via a wired or wireless connection.

7. The vehicle of claim 6, wherein the processor is further configured to: When the additional sensor is activated, input is obtained from the additional sensor; Readings are obtained from one or more existing vehicle sensors; The input from the additional sensor is compared with the readings from the one or more existing vehicle sensors; and A first error notification is output when the difference between the input and the reading is greater than a predefined threshold.

8. The vehicle of claim 7, wherein the processor is further configured to: The input is used to determine whether the additional sensor is configurable; In response to determining that the additional sensor is unconfigurable, a second error notification is output; and In response to determining that the additional sensor is configurable, the additional sensor and the one or more existing vehicles are configured to operate together.

9. The vehicle of claim 1, wherein the vehicle operating parameters include one or more of the following: vehicle speed, vehicle direction of movement, presence of a trailer attached to the vehicle, current vehicle position, presence of an external load on the vehicle, or operating state of one or more vehicle components.

10. The vehicle of claim 1, wherein the processor is further configured to: It is determined that the user is performing a predefined action near the vehicle; and The operation of the additional sensor is controlled based on the predefined actions.

11. The vehicle of claim 1, wherein the processor determines the location of the additional sensor via at least one of: wireless signal triangulation from the additional sensor to the vehicle, input obtained from a sensor system included in the vehicle control unit, or the user input.

12. The vehicle of claim 1, wherein the additional sensor is one of the following: a camera, a radio detection and ranging (radar) sensor, a light detection and ranging (LiDAR) sensor, a microphone, an ultrasonic sensor, or a speaker.

13. The vehicle of claim 1, wherein, in order to control the operation of the additional sensor, the processor activates the additional sensor, transmits data obtained from the additional sensor to a server or a vehicle infotainment system, or deactivates the additional sensor after a predefined duration.

14. A method comprising: The processor determines that additional sensors are connected to the vehicle; The processor determines the location of the additional sensor on the vehicle; The processor determines the preferred method for controlling the operation of the additional sensor based on user input; as well as The processor controls the operation of the additional sensor based on at least one of the preferred method and vehicle operating parameters or the location of the additional sensor.

15. The method of claim 14, wherein the preferred mode is one of replacement control or independent control.

Images