Vehicle Control for User Safety and Experience

Abstract

A vehicle control system and method for user safety and experience is provided. The system receives sensory information related to a first vehicle, detects the state of the first vehicle, and determines the actions of a person or a second vehicle near the first vehicle. Such actions are determined based on the sensory information. The system triggers an action based on whether the determined actions are dangerous to the first vehicle in the detected state or to a user of the first vehicle. The system controls a device associated with the first vehicle based on the triggered action. The device includes a light-based projector device controlled to directly project a visual alert included in the triggered action onto a physical surface. The physical surface can be a window of the first vehicle or a physical structure external to and separate from the first vehicle.

Description

[Technical Field]

[0001] Cross-reference to related applications / incorporation by reference This application claims priority to U.S. Provisional Patent Application Serial No. 63 / 089416, filed October 8, 2020, the contents of which are incorporated herein by reference in their entirety.

[0002] Various embodiments of the present disclosure relate to vehicle and user safety, and more particularly, to vehicle control systems and methods for user safety and experience. [Background technology]

[0003] Advances in automotive technology have led to the development of various devices and technologies that can utilize information from vehicle sensors to ensure user and vehicle safety. Most of these devices and technologies may be limited to personalizing seat position adjustments, mirror position adjustments, key-based immobilization, or other adjustments related to the vehicle. While such devices and technologies may help to improve the user experience within the vehicle, they may not necessarily help to ensure the safety of the user outside the vehicle or the safety of others around the vehicle. Summary of the Invention [Problem to be solved by the invention]

[0004] The limitations and disadvantages of conventional approaches will become apparent to those skilled in the art by comparing the described system with certain aspects of the present disclosure illustrated in the remainder of this application and with reference to the drawings. [Means for solving the problem]

[0005] A vehicle control system and method for user safety and experience is provided substantially as hereinbefore described in and / or with reference to at least one of the figures, and more fully as set forth in the claims.

[0006] These and other features and advantages of the present disclosure will become apparent from a consideration of the following detailed description of the disclosure when taken in conjunction with the accompanying drawings, in which like reference characters refer to like elements throughout. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a block diagram illustrating an exemplary vehicle control environment for user safety and experience, according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a block diagram of the example system of FIG. 1 in accordance with an embodiment of the present disclosure. [Figure 3A] 3B is a block diagram illustrating exemplary vehicle control operations for user safety and experience according to an embodiment of the present disclosure. [Figure 3B] 3B is a block diagram illustrating exemplary vehicle control operations for user safety and experience in conjunction with FIG. 3A according to an embodiment of the present disclosure. [Figure 4A] FIG. 1 illustrates an exemplary vehicle control scenario for user safety when the vehicle is in park, according to an embodiment of the present disclosure. [Figure 4B] FIG. 1 illustrates an exemplary vehicle control scenario for user safety when the vehicle is in park, according to an embodiment of the present disclosure. [Figure 4C] FIG. 1 illustrates an exemplary vehicle control scenario for user safety when the vehicle is in park, according to an embodiment of the present disclosure. [Figure 5A] FIG. 1 illustrates an exemplary vehicle control scenario for user safety when the vehicle is in an unparked state, according to an embodiment of the present disclosure. [Figure 5B] FIG. 1 illustrates an exemplary vehicle control scenario for user safety when the vehicle is in an unparked state, according to an embodiment of the present disclosure. [Figure 5C] FIG. 1 illustrates an exemplary vehicle control scenario for user safety when the vehicle is in an unparked state, according to an embodiment of the present disclosure. [Figure 6] FIG. 1 illustrates an exemplary vehicle control scenario for a user experience, according to an embodiment of the present disclosure. [Figure 7] 1 is a flowchart illustrating an exemplary vehicle control method for user safety and experience, according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0008] The disclosed system and method for vehicle control for user safety and experience can be implemented as described below. Exemplary aspects of the present disclosure provide a system that can provide a vehicle control method for user safety and experience. The system can be implemented in, for example, a smartphone, an edge computing device, a vehicle (or a vehicle control system), an Internet of Things (IoT) device, and a passenger drone.

[0009] The system can be configured to receive sensory information related to a first vehicle at any time. The sensory information can be obtained from sensors on the first vehicle or other sensor devices in the vicinity of the first vehicle. The sensory information can include, for example, raw sensor data, inferred results based on analysis of the raw sensor data, and post-processed sensor data. Based on the sensory information, the system can be configured to detect a state of the first vehicle as one of a parked state (e.g., stationary) or an unparked state (e.g., moving). Based on the sensory information, the system can be further configured to determine one or more actions of a person or a second vehicle in the vicinity of the first vehicle.

[0010] The system may be configured to trigger one or more actions (such as projecting a visual alert on a physical surface or sending a notification to a user device) based on whether the determined one or more actions are dangerous to the first vehicle in the detected state or one or more users of the first vehicle in the detected state. The system may be configured to control one or more devices associated with the first vehicle (such as a light-based projector device, an interior lighting system, an exterior lighting system, an automotive audio / video system, or a door lock system) based on the triggered one or more actions. For example, the system may control a light-based projector device to project a visual alert directly onto a physical surface. The visual alert may be included in the triggered one or more actions, and the physical surface may be a window of the first vehicle or a physical structure external to and distant from the first vehicle (e.g., a portion of a road near the first vehicle or the body of another vehicle).

[0011] Compared to traditional in-vehicle safety features, the disclosed system can determine various types of dangerous activities in the vicinity of the vehicle and take different forms of preemptive and / or countermeasures to ensure that the user of the vehicle remains safe in all situations. Such actions can be performed by the user and / or by devices associated with the vehicle. Preemptive measures (or actions) can help to notify the user in advance about dangerous activities at the vehicle's location or in the nearby area, while countermeasures (or actions) can help to prevent people from performing dangerous activities involving the vehicle or other objects (such as other vehicles) in the nearby area of ​​the vehicle.

[0012] FIG. 1 is a block diagram illustrating an exemplary vehicle control environment for user safety and experience, according to an embodiment of the present disclosure. A diagram of a network environment 100 is shown in FIG. 1. The network environment 100 can include a system 102, a first vehicle 104, a person 106, a second vehicle 108, one or more devices 110, a server 112, and a user device 114. The system 102 can be coupled to the first vehicle 104 and the server 112 via a communication network 116. Also shown is a user 118, which can be associated with the user device 114.

[0013] The system 102 may include suitable logic, circuitry, code, and / or interfaces that may be configured to control one or more devices 110 associated with the first vehicle 104. The one or more devices 110 may be controlled based on one or more actions that may be triggered based on the actions of a person 106 or a second vehicle 108 in the vicinity of the first vehicle 104. By way of example and not limitation, the one or more devices 110 may be controlled to project information (e.g., in the form of visual alert(s)) onto a physical surface, which may be a window portion of the first vehicle 104 or a physical structure external to and separate from the first vehicle 104.

[0014] In some embodiments, the system 102 may be external to (i.e., not integrated into) the first vehicle 104. In such embodiments, the system 102 may remotely control one or more devices 110 via the communications network 116. In other embodiments, the system 102 may be internal to (i.e., integrated into) the first vehicle 104. Exemplary implementations of the system 102 may include, but are not limited to, one or more of the following: an imaging device (e.g., a camera), a roadside unit (e.g., a Dedicated Short-Range Communications (DSRC) RSU), a vehicle-to-everything (V2X) device, a cellular V2X device, a smartphone or mobile phone, a wearable or head-mounted electronic device (e.g., an extended reality (XR) headset), a gaming device, a mainframe machine, a server, a computer workstation, an edge computing device, a passenger transport drone assistance system, and a consumer electronics (CE) device.

[0015] Vehicles (such as first vehicle 104 and second vehicle 108) may be autonomous, semi-autonomous, or non-autonomous, for example, as defined using SAE (Society of Automotive Engineers) automation levels (0, 1, 2, 3, 4, and 5). Examples of vehicles may include, but are not limited to, a four-wheeled car, a two-wheeled motorcycle, a micromobility vehicle, a three-wheeled vehicle, a vehicle with five or more wheels (such as a truck), or any land vehicle. A description of such vehicles is omitted from this disclosure for the sake of brevity.

[0016] Those skilled in the art will appreciate that the scope of the present disclosure may not be limited to the implementation of first vehicle 104 and system 102 as two separate entities. In some embodiments, the functionality of system 102 may be incorporated, in whole or at least in part, into first vehicle 104 without departing from the scope of the present disclosure.

[0017] Each device of the one or more devices 110 may include suitable logic, circuitry, code, and / or interfaces that can be configured to function based on control instructions from the system 102. Such instructions may be communicated to the one or more devices 110 based on one or more actions. Such actions may be triggered based on whether the actions of a person or another vehicle in the vicinity of the first vehicle 104 pose a danger to the first vehicle 104 or one or more users of the first vehicle 104. In some embodiments, the one or more devices 110 may be integrated into the first vehicle 104 as an internal component of the first vehicle 104. In other embodiments, the one or more devices 110 may be coupled to the first vehicle 104 as an external component(s). In such implementations, the one or more devices 110 may be mounted, for example, to an exterior window portion or a body portion (such as, but not limited to, an AB pillar, a fender, or a trunk) of the first vehicle 104. Examples of the one or more devices 110 may include, but are not limited to, a light-based projector device 110A, an interior lighting system, an exterior lighting system, an automotive audio-video system, or a door lock system.

[0018] The light-based projector device 110A can be configured to project information (such as an image, a light-based pattern, or a sign) by illuminating a light signal onto a physical surface. Examples of the light-based projector device 110A can include, but are not limited to, a laser-based projector (e.g., using a solid-state laser), a digital light processing (DLP) projector, a liquid crystal display (LCD) projector, or a liquid crystal on silicon (LCoS) projector.

[0019] Server 112 may include suitable logic, circuits, interfaces, and / or code that can be configured to collect information from various data sources, such as crime records, location databases, sensor data acquisition systems (that allow public data access), or other sources. The collected information may be distributed to various devices or systems, such as system 102, and may include, for example, incident data, location-based crime logs, third-party information about the environment in which first vehicle 104 may be located, sensor data for all vehicles within a geofence (e.g., within a 100-foot radius around first vehicle 104), and information about where first vehicle 104 may be parked or detected in motion. In one embodiment, server 112 is implemented as a cloud server and may perform operations through web applications, cloud applications, HTTP requests, repository operations, file transfers, and the like. Other implementations of server 112 may include, but are not limited to, a database server, a file server, a web server, a media server, an application server, a mainframe server, or a cloud computing server. In at least one embodiment, server 112 may be implemented as multiple distributed cloud-based resources using techniques known to those skilled in the art. Those skilled in the art will appreciate that the scope of the present disclosure may not be limited to the implementation of server 112 and system 102 as two separate entities. In some embodiments, the functionality of server 112 may be incorporated, in whole or at least in part, into system 102 without departing from the scope of the present disclosure.

[0020] The user device 114 may include suitable logic, circuitry, code, and / or interfaces that may be configured to receive notifications or alerts (in different forms, such as visual, auditory, textual, tactile, or a combination thereof) from the system 102. The user device 114 may be associated with one or more users (e.g., user 118) of the first vehicle 104. Examples of the user device 114 may include, but are not limited to, a mobile phone, a smartphone, a tablet device, a personal computer, a gaming console, a media player, a sound system, a smart watch, an infotainment system of the first vehicle 104, a multi-information display (MID) of the first vehicle 104, a smart audio device, or a camera.

[0021] Those skilled in the art will appreciate that the scope of the present disclosure may not be limited to the implementation of one or more of devices 110, user devices 114, and system 102 as separate entities. In some embodiments, the functionality of one or more of devices 110 and user devices 114 may be incorporated, in whole or at least in part, into system 102 without departing from the scope of the present disclosure.

[0022] The communication network 116 may include any communication medium that enables the system 102 to communicate with the server 112 and other devices omitted from this disclosure for brevity. The communication network 116 may include wired connections, wireless connections, or a combination thereof. Examples of the communication network 116 may include, but are not limited to, the Internet, a cloud network, a Wireless Fidelity (Wi-Fi) network, a satellite communication network (such as using a Global Navigation Satellite System (GNSS) constellation), a cellular or mobile wireless network (such as 4th Generation Long Term Evolution (LTE) or 5th Generation New Radio (NR)), a personal area network (PAN), a local area network (LAN), or a metropolitan area network (MAN). Various devices in the network environment 100 may be configured to connect to the communication network 116 according to various wired and wireless communication protocols. Examples of such wired and wireless communication protocols include, but are not limited to, at least one of Transmission Control Protocol and Internet Protocol (TCP / IP), User Datagram Protocol (UDP), Hypertext Transfer Protocol (HTTP), File Transfer Protocol (FTP), ZigBee, EDGE, IEEE802.11, Light Fidelity (Li-Fi), 802.16, IEEE802.11s, IEEE802.11g, multi-hop communication, wireless access point (AP), device-to-device communication, cellular communication protocols, satellite communication protocols, and Bluetooth (BT) communication protocols.

[0023] During operation, a series of sensors (not shown) associated with the first vehicle 104 may generate a series of sensor data. In some embodiments, such sensors may be part of a sensor system of the first vehicle 104. In other embodiments, at least one of such sensors may be integrated into electronic devices in the vicinity of the first vehicle 104. For example, such sensors may include vehicle cameras, contact or collision sensors, parking sensors / cameras, volume sensors, LiDAR, RADAR, position sensors, proximity sensors, light sensors, temperature sensors, traffic or street cameras, traffic signal systems, traffic rule violation detection systems, user devices (e.g., phones), other vehicles (having vehicle-to-vehicle (V2V) communication capabilities), and the like.

[0024] In some embodiments, the set of sensor data can be multimodal data. In a multimodal form, the set of sensor data can include outputs from different types of sensors associated with the first vehicle 104. For example, the set of sensor data can include images (from one or more viewpoints), audio data, motion data, location data, point cloud data, object distance values, and proximity data. The server 112 (or the electronic control unit (ECU) of the first vehicle 104) can receive the set of sensor data as input and generate a set of inferences using machine learning models based on the received set of sensor data. Such inferences can include, for example, facial recognition data, semantic segmentation data (from images of the first vehicle's 104's surrounding environment), object detection data, lane detection data, parking location data, collision or accident prediction data, location-based tags, traffic violations, and risky behaviors associated with vehicles or people near the first vehicle 104.

[0025] In some embodiments, the first vehicle 104 can transmit at least a portion of the set of sensor data and the set of inferences to the system 102 as sensory information. The system 102 can receive the sensory information related to the first vehicle 104. By way of example and not limitation, the sensory information can include a geographic location of the first vehicle 104, a plurality of objects (such as the person 106 or the second vehicle 108) in a physical space 122 surrounding the first vehicle 104, and one or more labels indicating a state or activity of each of the plurality of objects. The physical space 122 can represent a type of environment in which the first vehicle 104 may be present. For example, the physical space can be a parking space, a road segment, a garage, a roadway, or any area available for parking or driving a vehicle.

[0026] At any point in time, the system 102 can detect the state of the first vehicle 104 as either a parked state or an unparked state (or a moving state) based on the detection information. The system 102 can then determine one or more actions of a person 106 or a second vehicle 108 in the vicinity of the first vehicle 104 based on the detection information. For example, the person 106 can be two feet away from the parked first vehicle 104, or the second vehicle 108 can be running closely behind the first vehicle 104. Details of the one or more actions that are determined are shown, for example, in Figures 3A and 3B.

[0027] 3A and 3B , the system 102 can trigger one or more actions based on whether the determined one or more actions are dangerous to the detected first vehicle 104 or one or more users (e.g., user 118) of the detected first vehicle 104. The system 102 can control one or more devices 110 associated with the first vehicle 104 based on the triggered one or more actions. The one or more devices 110 can include a light-based projector device 110A that can be controlled to project a visual alert included in the triggered one or more actions directly onto a physical surface. The physical surface can be a window portion 120 of the first vehicle 104 or a physical structure external to and separate from the first vehicle 104. For example, the physical structure can be a road surface, a pavement, a vehicle exterior, a wall structure, or any structure visible in the immediate vicinity of the first vehicle 104. By way of example and not limitation, when the first vehicle 104 is in a parked state, the visual alert may include a sign or warning to alert one or more users (such as user 118) to one or more dangerous activities near the first vehicle 104. In some cases, the visual alert may be projected to deter a person 106 or a second vehicle 108 near the first vehicle 104 from dangerous activities.

[0028] Figure 2 is a block diagram of the example system of Figure 1, in accordance with an embodiment of the present disclosure. The description of Figure 2 is provided with reference to elements of Figure 1. Figure 2 shows a block diagram 200 of system 102. System 102 may include circuitry 202, memory 204, input / output (I / O) devices 206, and a network interface 208. Circuitry 202 may be communicatively coupled to memory 204, I / O devices 206, and network interface 208. I / O devices 206 may include, for example, a display device 210.

[0029] Circuitry 202 may include suitable logic, circuits, and / or interfaces that can be configured to execute program instructions associated with different operations to be performed by system 102. Circuitry 202 may include one or more specialized processing units that may be implemented as an integrated processor or a collection of processors that collectively perform the functions of one or more specialized processing units. Circuitry 202 may be implemented based on multiple processor technologies known in the art. Example implementations of circuitry 202 may be an X86-based processor, a graphics processing unit (GPU), a reduced instruction set computing (RISC) processor, an application specific integrated circuit (ASIC) processor, a complex instruction set computing (CISC) processor, a microcontroller, a central processing unit (CPU), and / or other computing circuitry.

[0030] Memory 204 may include suitable logic, circuitry, and / or interfaces that may be configured to store program instructions to be executed by circuit 202. In at least one embodiment, memory 204 may be configured to store information related to the detected state of first vehicle 104, the determined behavior(s), the triggered behavior(s), and the visual alert(s). Example implementations of memory 204 may include, but are not limited to, random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), hard disk drive (HDD), solid-state drive (SSD), CPU cache, and / or secure digital (SD) card.

[0031] The I / O device(s) 206 may include suitable logic, circuitry, interfaces, and / or code that may be configured to receive input and provide output based on the received input. The I / O device(s) 206 may include a variety of input and output devices that may be configured to communicate with the circuitry 202. For example, the system 102 may receive user input via the I / O device(s) 206 to initiate a distress call to one or more mobile devices or emergency services. The system 102 may then communicate to one or more devices 110 associated with the first vehicle 104 to take action. Examples of the I / O device(s) 206 may include, but are not limited to, a touch screen, a keyboard, a mouse, a joystick, a display device (e.g., display device 210), a microphone, or a speaker.

[0032] The display device 210 may include suitable logic, circuitry, and / or interfaces that may be configured to display user interface elements. In one embodiment, the display device 210 may be a touch-enabled device that may be configured to receive user input from the user 118 via the display device 210. The display device 210 may include a display device that may be implemented through a number of known technologies, such as, but not limited to, at least one of a liquid crystal display (LCD) display, a light-emitting diode (LED) display, a plasma display, or an organic LED (OLED) display technology, or other display devices. According to an embodiment, the display unit of the display device 210 may refer to a display screen of a head-mounted device (HMD), a smart glasses device, a see-through display, a projection display, an electrochromic display, or a transparent display.

[0033] The network interface 208 may include suitable logic, circuits, interfaces, and / or code that may be configured to facilitate the circuit 202 communicating with the first vehicle 104 and / or other communication devices over the communications network 116. The network interface 208 may be implemented using various known technologies that support wireless communication of the computer system 102 over the communications network 112. The network interface 208 may include, for example, an antenna, a radio frequency (RF) transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a coder-decoder (CODEC) chipset, a subscriber identity module (SIM) card, local buffer circuitry, etc.

[0034] The network interface 208 may be configured to communicate via wireless communication with a network, such as the Internet, an intranet, a wireless network, a cellular telephone network, a wireless local area network (LAN), or a metropolitan area network (MAN). The wireless communication may be configured to use one or more of a number of communication standards, protocols, and technologies, such as Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), Wideband Code Division Multiple Access (W-CDMA), Long Term Evolution (LTE), 5G NR, Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), satellite communications (e.g., using the Global Navigation Satellite System (GNSS) constellation), Bluetooth, Wireless Fidelity (WiFi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, or IEEE 802.11n), Voice over Internet Protocol (VoIP), Light Fidelity (Li-Fi), or Worldwide Interoperability for Microwave Access (Wi-MAX).

[0035] The functions or operations performed by system 102 as described in Figure 1 may be performed by circuitry 202. Operations performed by circuitry 202 are described in detail, for example, in Figures 3A and 3B, 4A, 4B and 4C, 5A, 5B and 5C, and 6.

[0036] Figures 3A and 3B collectively illustrate block diagrams illustrating exemplary vehicle control operations for user safety and experience, according to embodiments of the present disclosure. The descriptions of Figures 3A and 3B are provided with reference to elements in Figures 1 and 2. Figures 3A and 3B illustrate block diagram 300 illustrating exemplary operations 302-314 as described herein. The exemplary operations illustrated in block diagram 300 may begin at 302 and may be performed by any computer system, apparatus, or device, such as system 102 of Figures 1 or 2. While the exemplary operations associated with one or more blocks in block diagram 300 are illustrated as discrete blocks, they may be divided into additional blocks, combined into fewer blocks, or eliminated depending on the implementation of the exemplary operations.

[0037] At 302, sensory information may be received. In one embodiment, the circuit 202 may receive sensory information related to the first vehicle 104. In one embodiment, the sensory information may be received from a first data source, which may be, for example, persistent storage on the first vehicle 104, a cloud server (which may be managed, for example, by an information technology (IT) provider or an automobile manufacturer), a nearby electronic device (such as a DSRC RSU, an edge computing device, a V2X system (such as a V2V system that allows other vehicles in the vicinity of the first vehicle 104 to communicate with each other), etc.). In another embodiment, the sensory information may be received directly (in raw form) from a set of sensors on the first vehicle 104. In another embodiment, the sensory information is received from the first vehicle 104 and may include data from the first data source and the set of sensors on the first vehicle 104. The received sensory information may include, for example, raw sensor data, inferences based on an analysis of the raw sensor data, post-processed sensor data, etc.

[0038] At 304, a state of the first vehicle 104 may be detected. In some embodiments, the circuit 202 may be configured to detect the state of the first vehicle 104 as one of a parked state or an unparked state based on the sensed information. In addition to detecting the state of the first vehicle 104, the circuit 202 may determine contextual information associated with the detected state. For example, the contextual information may include location data, data regarding whether the vehicle is locked, data regarding whether the engine is on, data regarding whether any occupants are present in the vehicle, and data regarding whether the set of sensors is powered. The location data may include a geolocation value (e.g., in terms of coordinates) and a location identifier (e.g., the ABC Hotel parking lot) of the physical space 122 in which the first vehicle 104 may be located.

[0039] At 306, one or more actions may be determined. In some embodiments, the circuitry 202 may be configured to determine one or more actions of the person 106 or the second vehicle 108 in the vicinity of the first vehicle 104 based on the sensed information. In some embodiments, the circuitry 202 may be configured to determine the one or more actions based on determining that the person 106 or the second vehicle 108 is within a threshold distance (e.g., 10 feet) from the first vehicle 104. The person 106 may be, for example, a pedestrian in the vicinity of the first vehicle, a malicious person (e.g., a thief or robber), or a user of another vehicle (different from the first vehicle 104 and the second vehicle 108). Similarly, a second vehicle 108 in the vicinity of the first vehicle 104 may be, for example, a vehicle that may be parked close to the first vehicle 104, a vehicle behind, in front of, or closely following the first vehicle 104, and a vehicle at a conflict point at an intersection.

[0040] In one embodiment, the circuit 202 can identify first features based on the sensing information, such as, but not limited to, a distance between the person 106 and the first vehicle 104, a direction the person 106 is facing, a posture of the person 106, an object the person 106 is carrying (e.g., a phone, a stone, a knife, a gun, etc.), facial features (for face / emotion recognition), an action or attitude (e.g., a fighting attitude, a jumping attitude, a hiding attitude, a crawling attitude, etc.), and a movement pattern (based on gait characteristics). The circuit 202 can determine one or more actions of the person 106 based on the first features. Examples of such actions by the person 106 may include, but are not limited to, actions indicating the person 106 hiding behind the first vehicle 104, actions indicating the person 106 standing near the first vehicle 104, actions indicating the person 106 touching or attempting to touch the first vehicle 104, actions indicating the person 106 attempting to damage, damage, or trespass the first vehicle 104 or another nearby vehicle (such as the second vehicle 108), and traffic violations or violations (such as crossing the road, obstructing traffic, or walking against oncoming traffic).

[0041] In another embodiment, the circuitry 202 may identify a second characteristic based on the sensed information, such as, but not limited to, a distance between the second vehicle 108 and the first vehicle 104, a direction in which the second vehicle 108 may be parked or moved, a speed or acceleration of the second vehicle 108, a driving pattern associated with the second vehicle 108, a state of an occupant of the second vehicle 108 (e.g., intoxicated, agitated, etc.), and a traffic violation or violation. The circuitry 202 may determine one or more actions of the second vehicle 108 based on the second characteristic. Examples of the one or more actions of the second vehicle 108 may include, but are not limited to, tailgating, speeding, overtaking, tailgating, an attempt to impede traffic, a parking maneuver, a turning maneuver, and a stopping maneuver.

[0042] At 308, it may be determined whether the determined one or more actions are dangerous to the first vehicle 104 in the detected state or to one or more users of the first vehicle 104 in the detected state. In some embodiments, the circuit 202 may be configured to determine whether the one or more actions are dangerous. If the one or more actions are determined to be dangerous, control may proceed to 310. Otherwise, control may proceed to 316.

[0043] By way of example and not limitation, at a given location, an activity may be determined to be unsafe if it violates the laws and regulations applicable to that location. Such regulations or laws may be established by local governments, private entities (which have property rights in the location), vehicle owners or users, or regulatory agencies. In one embodiment, the system 102 (or server 112) may store a database of unsafe activities associated with vehicles or persons on roads or other locations (such as parking spaces or sidewalks). One or more determined activities may be determined to be unsafe based on a comparison of such activities with records in the stored database. For example, an action may be dangerous if a person suspiciously hides behind a first vehicle 104 (which is parked), if a person suspiciously stands near the first vehicle 104, if a person suspiciously touches the first vehicle 104, if a person damages or trespasses on the first vehicle 104 or the second vehicle 108, or if a vehicle follows closely behind or makes a dangerous overtake of the first vehicle 104 or the second vehicle 108.

[0044] In another embodiment, circuitry 202 can be configured to interrogate an electronic control system of first vehicle 104 to determine whether one or more actions are unsafe. Based on the interrogation, circuitry 202 can receive and analyze logs (which may include, for example, incidents or alerts) generated by the electronic control system. By way of example and not limitation, the electronic control system can be one of an advanced driver assistance system (ADAS) or an autonomous driving (AD) system.

[0045] At 310, one or more actions may be triggered. In some embodiments, circuitry 202 may be configured to trigger one or more actions based on whether the determined one or more actions are dangerous to the detected first vehicle 104 or one or more users (e.g., user 118) of the detected first vehicle 104. Such actions may include preemptive measures, countermeasures, or a combination of both preemptive and countermeasures to ensure that the user 118 of the first vehicle 104 and / or the first vehicle 104 remain safe. Each triggered action may require the activation or control of a user device and / or one or more devices 110 associated with the first vehicle 104.

[0046] In some embodiments, the system 102 (or server 112) may include a database of action-behavior data. In such a database, for a given state of a vehicle (e.g., the first vehicle 104) or location of a user 118, each risky behavior may be mapped to one or more actions. As an example, if a behavior is detected before or during an attempt by a person in the vicinity of the first vehicle 104 to enter the first vehicle 104 (which may be parked), a visual alert may be projected onto a physical surface (e.g., a road surface that may be immediately outside the first vehicle 104) to alert the user 118 (who may be outside or approaching the first vehicle 104) of the detected behavior. Other examples of the one or more actions may include, but are not limited to, one or more signals that activate an interior lighting system, an exterior lighting system, an automotive audio / video system, an alarm system, or a door lock system.

[0047] At 312, one or more devices 110 may be controlled. In some embodiments, circuitry 202 may be configured to control one or more devices 110 associated with first vehicle 104 based on the one or more triggered actions. One or more devices 110 may include a light-based projector device (such as light-based projector device 110A) that may be controlled to project a visual alert (included in the one or more triggered actions) directly onto a physical surface. The projected visual alert may include a first sign 312A that may warn or alert a user 118 in the vicinity of first vehicle 104, for example, as illustrated in FIG. 4A .

[0048] The physical surface may be a window portion (such as window portion 120) of the first vehicle 104, or a physical structure that is external to and separate from the first vehicle 104. For example, the physical structure may be a road surface, a pavement, a vehicle exterior, a wall structure, or any structure that is visible in the immediate vicinity of the first vehicle 104.

[0049] In some embodiments, the circuitry 202 may select a physical structure for projection based on factors such as the direction of vehicle travel, the location of the user, the location of a person (potentially associated with dangerous activity), or a combination thereof. In these or other embodiments, the circuitry 202 may determine a location and direction at which a visual alert can be projected relative to the location of the first vehicle 104. For example, if the physical structure is a portion of a road or a portion of pavement, the location of the physical structure for projection may be selected based on the determined location and direction. In this case, the first vehicle 104 may include multiple light-based projector devices to cover multiple directions of projection.

[0050] At 314, the user device 314A may be controlled. In one embodiment, the circuit 202 may be configured to control the user device 314A associated with the user 118 of the first vehicle 104 to display a visual alert. The visual alert may include first information that may alert the user 118 in the vicinity of the first vehicle 104. For example, the first information may be a danger sign, a text-based sign, or a graphic symbol that alerts the user 118 to unsafe behavior associated with the first vehicle 104 or another nearby vehicle. Details of the control of the user device 314A are shown, for example, in FIGS. 4A and 4B.

[0051] At 316, one or more devices 110 may be controlled. In some embodiments, circuitry 202 may be configured to control one or more devices 110 associated with first vehicle 104. One or more devices 110 may include a light-based projector device (such as light-based projector device 110A) that may be controlled to project a visual alert. The projected visual alert may include a second sign 316A, as illustrated in FIG. 4C , that may inform one or more users (such as user 118) in the vicinity of first vehicle 104 about a safety level associated with the area surrounding first vehicle 104.

[0052] Figure 4A illustrates an exemplary vehicle control scenario for user safety when the vehicle is in a parked state, according to an embodiment of the present disclosure. Figure 4A is described in conjunction with elements of Figures 1, 2, 3A, and 3B. Figure 4A illustrates an exemplary scenario 400A showing a first vehicle 402. Also shown is a light-based projector device 404 and a second vehicle 406. Figures 4A, 4B, and 4C further illustrate a user 410 of the first vehicle 104. The user 410 is shown external to the first vehicle 402. Also shown is a user device 412 associated with the user 410.

[0053] The circuit 202 may be configured to receive, at any time, detection information related to the first vehicle 402. The circuit 202 may be configured to detect the state of the first vehicle 402 as a parked state based on the detection information. The circuit 202 may be configured to determine one or more actions of a person 408 in the vicinity of the first vehicle 402 based on the detection information. For example, as shown, the determined one or more actions may indicate that the person 408 is suspiciously hiding behind or standing near the first vehicle 402 while the first vehicle 402 is detected to be in a parked state. The circuit 202 may be configured to trigger one or more actions based on a determination that the one or more actions are dangerous to the first vehicle 402 in a parked state or to a user 410 of the first vehicle 402.

[0054] Based on the triggered action(s), circuitry 202 can be configured to control one or more devices (such as light-based projector device 404) associated with first vehicle 402. Light-based projector device 404 can be controlled to project a visual alert directly onto a physical surface. For example, the physical surface can be a portion of a roadway one to two feet from the rear of first vehicle 402.

[0055] In one embodiment, the projected visual alert may include a first sign that cautions or alerts one or more users (e.g., user 410) in the vicinity of first vehicle 402. The visual alert may also include directional information that informs one or more users 410 as to the direction in which person 408 is believed to be located. FIG. 4A shows a first sign (e.g., hazard sign 416) projected directly onto a physical surface (e.g., a portion of a road). The physical surface may be external to and separate from first vehicle 402, yet still within or immediately surrounding physical space 122 of first vehicle 402. In this case, physical space 122 may be a parking space containing one or more parked vehicles.

[0056] In one embodiment, circuitry 202 can be configured to control a user device 412 associated with user 410. User device 412 can display a visual alert. The visual alert can include first information 412A that alerts one or more users in the vicinity of first vehicle 402 to one or more determined actions (dangerous or unsafe). In FIG. 4A , first information 412A displays a warning message on user device 412 that reads, "Caution! Presence of vehicle detected nearby."

[0057] The user device 412 can display a user interface (UI) element 414 as a panic button. Based on a user selection of the panic button (i.e., UI element 414), the user device 412 can send a message, which may include a distress call, to one or more mobile devices and / or emergency services. The user device 412 can also signal one or more devices (e.g., one or more devices 110) associated with the first vehicle 402 to act. As an example, the user device 412 can send a danger or warning message to a law enforcement mobile digital computer (i.e., a mobile device), emergency services (e.g., a call to an ambulance or fire department), or a mobile phone associated with the user's family or friends. The danger or warning message can be sent to notify the user 410 that they may be in danger and may need help to ensure their safety. The disclosed system can enhance user safety in all situations where the user 410 is likely to be in danger while the first vehicle 402 is in a parked state.

[0058] FIG. 4B illustrates an example vehicle control scenario for user safety when a vehicle is in a parked state, according to an embodiment of the present disclosure. FIG. 4B is described with reference to elements in FIGS. 1, 2, 3A, 3B, and 4A. FIG. 4B illustrates a scenario 400B in which a person 408 is not associated with one or more users (e.g., user 410) of a first vehicle 402, and the determined one or more actions can include a unilateral interaction of the person 408 with the first vehicle 402. In scenario 400B, the first vehicle 402 can be detected as being in a parked state. The unilateral interaction can include an instance in which the person 408 may have touched or damaged the first vehicle 402. For example, the person 408 may have attempted to touch, damage, break into, or hack the first vehicle 402 while it is in a parked state. Alternatively, a second vehicle 406 may have unintentionally or intentionally collided with the first vehicle 402 while it is in a parked state.

[0059] The circuitry 202 can be configured to determine damage to the first vehicle 402 based on the determined one or more actions. One or more actions can then be triggered based on the determined damage. In one embodiment, the circuitry 202 can be configured to control the light-based projector device 404 to project a visual alert that can include a third sign 418. The third sign 418 can inform one or more users (e.g., user 410) in the vicinity of the first vehicle 402 about the damage to the first vehicle 402. As shown, the third sign 418 can be projected directly onto a physical surface (e.g., a road). The physical surface can be seen to be external to and distant from the first vehicle 402, but within the immediate vicinity of the first vehicle 402.

[0060] In one embodiment, the circuitry 202 can control a user device 412 associated with the user 410 to alert the user 410 of damage to the first vehicle 402. Because the user 410 is informed of the damage in advance (i.e., before the user 410 enters the first vehicle 402), the disclosed system 102 can ensure that the user 410 remains safe even if the first vehicle 402 is damaged or sabotaged. As shown in FIG. 4B , the user device 412 can display a visual alert. The visual alert can include first information 412A, such as an alert message that reads, "Caution! Your vehicle has been hit. Check for damage."

[0061] In one embodiment, circuitry 202 can be configured to determine an indication as to whether an area within a threshold distance from first vehicle 402 is safe while the detected state of first vehicle 402 is parked. The threshold distance from first vehicle 402 can include, for example, a 10-foot distance, a 50-foot distance, a 100-foot distance, a 200-foot distance, and a 500-foot distance. In one embodiment, circuitry 202 can be configured to receive user input via user device 412 or an I / O device (such as I / O device 206) to set the threshold distance. The indication can be determined based on the detection information, the determined one or more activities, and information regarding unsafe activities in a location near first vehicle 402. For example, if the first vehicle 402 is parked in an outdoor parking space (next to a hotel) and a robbery incident (i.e., risky activity) is detected in a nearby location (e.g., 100 yards from the outdoor parking space), an indication can be determined that it is risky to park or even remain in the first vehicle 402 in an area within 100 yards of the outdoor parking space. In such a case, the detection information can include, for example, information related to the geographic location of the first vehicle 402, the current time, and some news about recent incidents in the area surrounding the geographic location. One or more actions can be triggered based on such an indication. For example, the circuit 202 can alert the user 410 about risky activity in a location nearby the first vehicle 402. The user 410 can be alerted in advance and move the first vehicle 402 out of the outdoor parking space and park it in a safer location. In one embodiment, the circuitry 202 can control the user device 412 to recommend another parking space in a different location (that is deemed safer compared to the current location of the first vehicle 402).

[0062] FIG. 4C illustrates an exemplary vehicle control scenario for user safety when the vehicle is parked, according to an embodiment of the present disclosure. FIG. 4C will be described with reference to elements in FIGS. 1, 2, 3A, 3B, 4A, and 4B. FIG. 4C illustrates a scenario 400C in which a user 410 is notified about a safety level associated with an area surrounding a first vehicle 402. The circuit 202 can be configured to control the light-based projector device 404 to project a visual alert. The visual alert can include a second sign 420 that can inform one or more users (e.g., the user 410) in the vicinity of the first vehicle 402 about a safety level associated with the area surrounding the first vehicle 402. For example, as shown, the second sign 420 (e.g., a smiley face) can be projected directly onto a physical surface (e.g., on a road or pavement) to indicate that it is considered safe to approach the first vehicle 402. The physical surface can be external to and distant from the first vehicle 402. The projection can be based on the detection information, the determined one or more activities, and information about dangerous activities in locations near the first vehicle 402 .

[0063] In some embodiments, user device 412 may also display a visual alert. For example, the visual alert may include first information 412A as a "Welcome home! All is well" message informing one or more users (such as user 410) that it is deemed safe to approach first vehicle 402. In Figures 4A, 4B, and 4C, the physical surfaces and visual alerts 416, 418, and 420 are shown by way of example only and should not be construed as limiting the present disclosure. The present disclosure is applicable to other types of physical surfaces (or any window portions of first vehicle 402) and other types of visual alerts outside first vehicle 402 without departing from its scope.

[0064] Figure 5A illustrates an exemplary vehicle control scenario for user safety when a vehicle is in an unparked state, according to an embodiment of the present disclosure. Figure 5A is described in relation to elements in Figures 1, 2, 3A, 3B, 4A, 4B, and 4C. Figure 5A illustrates an exemplary scenario 500A showing a first vehicle 502. Also shown is a light-based projector device 504 mounted on the first vehicle 502 and a second vehicle 506. Figure 5A also illustrates a person 510 moving toward the first vehicle 502.

[0065] The circuit 202 can be configured to receive sensing information related to the first vehicle 502. The circuit 202 can be configured to detect the status of the first vehicle 502 as an unparked state based on the sensing information. Details of retrieving the sensing information and determining the status of the first vehicle 502 are shown, for example, in Figures 3A and 3B.

[0066] In one embodiment, the determined one or more actions may include the driver of the first vehicle 502 backing the first vehicle 502 out of a parking lot. Based on the determined one or more actions, the circuit 202 may be configured to select a physical surface on the ground in a direction in which the first vehicle 502 is expected to move while backing out of the parking lot. A visual alert may be projected onto the selected projection surface, which may include a fourth sign (such as an arrow 508) indicating a direction in which the first vehicle 502 is expected to continue moving. As an example, the first vehicle 502 may transition from a parked state to an unparked state. The first vehicle 502 may perform a reverse maneuver out of the parking spot during the transition. A direction associated with the movement of the first vehicle 502 may be projected to alert a person 510 in the vicinity of the first vehicle 502.

[0067]

[0023] Figure 5B illustrates an example vehicle control scenario for user safety when the vehicle is in an unparked state, according to an embodiment of the present disclosure. Figure 5B is described with reference to elements of Figures 1, 2, 3A, 3B, 4A, 4B, 4C, and 5A. Figure 5B illustrates an example scenario 500B in which a first vehicle 502 appears to be moving toward an intersection on a road.

[0068] In one embodiment, the circuit 202 can be configured to detect a direction in which a first vehicle 502 in a moving state (i.e., not parked state) is about to turn on a road. The direction can be determined based on the sensing information. The circuit 202 can be configured to determine a third vehicle 514 behind the first vehicle 502. The third vehicle 514 can be determined based on the sensing information.

[0069] The circuitry 202 can control the light-based projector device 110A to project a visual alert onto a physical surface (e.g., a portion of a road surface or pavement) to alert a third vehicle 514. The physical surface can be in the immediate vicinity of the first vehicle 502. The visual alert can include a turn sign indicating the direction the first vehicle 502 intends to turn. The turn sign can alert a second vehicle 506 and a third vehicle 514 in the vicinity of the first vehicle 502. For example, as shown, the turn sign is an arrow 512 indicating the driver of the first vehicle 502's intent to turn on the road. In FIGS. 5A and 5B, the projected visual alerts 508 and 512 are shown by way of example only and should not be construed as limiting the present disclosure. The present disclosure is applicable to other forms of visual alerts without departing from its scope.

[0070] Figure 5C illustrates an example vehicle control scenario for user safety when the vehicle is in an unparked state, according to an embodiment of the present disclosure. Figure 5C is described with reference to elements of Figures 1, 2, 3A, 3B, 4A, 4B, 4C, 5A, and 5B. Figure 5C illustrates an example scenario 500C in which a second vehicle 506 is following a first vehicle 502.

[0071] In some embodiments, the one or more determined actions may include the second vehicle 506 tailgating the first vehicle 502 while the first vehicle 502 is detected as moving. As an example, the circuit 202 may determine whether the distance between the second vehicle 506 and the first vehicle 502 is within a threshold. The threshold may be a minimum distance the two vehicles must maintain to avoid a collision. The circuit 202 may be configured to determine a first set of projection parameters based on the sensing information and the determined one or more actions. The circuit 202 may then be configured to control the light-based projector device 504 to project a visual alert directly onto a physical surface, such as a window portion 516 of the first vehicle 502. The visual alert may include a warning to prevent the second vehicle 506 from tailgating the first vehicle 502. The projection may be based on the determined first set of projection parameters. Examples of such projection parameters include, but are not limited to, the size of the projection, the color values ​​to be used for the projection, and the intensity (light intensity) of the projection. As shown, for example, the visual alert includes first information 518 as a warning message on a window portion 516 of the first vehicle 502 saying "Too close! Keep distance."

[0072] In one embodiment, the circuitry 202 can be configured to determine a second set of projection parameters based on the sensing information and a direction in which a vehicle or person may be moving relative to the first vehicle 502. The second set of projection parameters can include, for example, a selection of a physical surface on the road in a direction in which a vehicle or person may be moving relative to the first vehicle 502. As an example, if the second vehicle 506 is to the right of the first vehicle 502, a visual alert can be projected onto a physical surface to the right of the first vehicle 502. The projection surface can be a window portion of the right door of the first vehicle 502 or a physical structure (such as a portion of the road or pavement) to the right of the first vehicle 502.

[0073] In some scenarios, the driver or the first vehicle 502 may be a student or an elderly person. In such scenarios, a visual alert may be projected to a second vehicle 506 in the vicinity of the first vehicle 502 to remind the second vehicle 506 to keep a distance from the first vehicle 502. For example, the visual alert may include first information as a warning message such as "Student driver! Keep a distance" or "Elderly person. Keep a distance."

[0074] In some other scenarios, while the first vehicle 502 is in an unparked state, the circuit 202 may receive detection information that may indicate the presence of a child within the first vehicle 502. In such a scenario, a visual alert may be projected, for example, on the rear window of the first vehicle 502 to remind the second vehicle 506 (in the vicinity of the first vehicle 502) to keep distance from the first vehicle 502. For example, the first information may include a warning message in the window portion 516 of the first vehicle 502 that reads, "BABY IN VEHICLE. KEEP AWAY."

[0075] In other scenarios, while parking the first vehicle 502, the circuit 202 may receive detection information indicating that the first vehicle 502 is about to be parked near a fire hydrant or a no parking sign. In such a scenario, a visual alert may be projected on the dashboard of the first vehicle 502 to alert the driver of the first vehicle 502 about the fire hydrant. For example, the visual alert may include the first information as a warning message such as, "Fire hydrant here! Do not park here" or "No parking. Do not park here."

[0076] In some other scenarios, while a user is exiting a parked first vehicle 502, the circuitry 202 may receive sensing information that may indicate a very local location (such as a gas station or store) where the user plans to go after exiting the first vehicle. In such a scenario, a visual alert may be projected onto a portion of the ground next to the door of the first vehicle 502 (through which the user will exit the first vehicle 502). The visual alert may include a directional sign informing the user which direction the user needs to travel to get to the very local location.

[0077] Figure 6 illustrates an exemplary vehicle control scenario for a user experience, according to an embodiment of the present disclosure. Figure 6 is described with reference to elements of Figures 1, 2, 3A, 3B, 3C, 4A, 4B, 4C, 5A, 5B, and 5C. Figure 6 illustrates a scenario 600 depicting a first vehicle 602 and an environment in which the first vehicle 602 resides (e.g., mountains 604 and hills). Also shown is a user 606 approaching the first vehicle 602.

[0078] The circuit 202 may be configured to detect, at any point in time, the first vehicle 602 in a parked state. The circuit 202 may be further configured to detect the movement of one or more users (such as user 606) toward the parked first vehicle 602. This movement may be detected based on the sensed information. For example, the sensed information may include the location of the first vehicle 602, a list of objects or landmarks (such as mountain 604) near the location of the first vehicle 602, the current ambient temperature, daytime information, traffic conditions in the area surrounding the location of the first vehicle 602, and weather information. The circuit 202 may be further configured to activate a second device of the one or more devices associated with the first vehicle 602 based on the detected movement and the sensed information. The second device may be one of an interior lighting system 608, an exterior lighting system, an automotive audio / video system 610, or a door lock system 612. By way of example and not limitation, the interior lighting system 608 may adjust the color and intensity of light in a seating area of ​​the first vehicle 602 based on daytime information related to the location of the first vehicle 602. The heating, ventilation, and air conditioning (HVAC) system of the first vehicle 602 may adjust the temperature of the first vehicle 602 based on the ambient temperature. The automotive audio-video system 610 may turn on the infotainment system and deactivate the door lock system 612 based on detected movement of the user 606 towards the first vehicle 602.

[0079] In one scenario, the first vehicle 602 may be parked in a national park just before sunset on a cold winter's day. Table 1 below shows data points for the sensing information. TIFF0007787170000001.tif21137 Table 1: Detection information

[0080] In such a scenario, the circuitry 202 may control one or more devices associated with the first vehicle 602 to adjust the temperature, lighting, displays, and audio-video playback within the passenger compartment of the first vehicle 602 based on the first setting. Table 2 below shows an example of the first setting. TIFF0007787170000002.tif21137 Table 2: First setting

[0081] In another scenario, the first vehicle 602 may be parked along the beach during the night on a hot day. Table 3 below shows the data points for the sensing information. TIFF0007787170000003.tif21137 Table 3: Detection Information

[0082] In such a scenario, the circuitry 202 may control one or more devices associated with the first vehicle 602 to adjust the temperature, lighting, displays, and audio-video playback within the passenger compartment of the first vehicle 602 based on the second settings. Table 4 below shows examples of the second settings. TIFF0007787170000004.tif31140 Table 4: Secondary settings

[0083] In one embodiment, the circuitry 202 may receive a current ambient temperature as 60 degrees Fahrenheit and luminosity information as a categorical variable (e.g., dim or low light) or a deterministic value (e.g., 800 lumens). The circuitry 202 may be configured to control the HVAC to increase the temperature within the passenger compartment of the first vehicle 602 to 80 degrees Fahrenheit and may turn on the interior lighting system 608 based on the received current ambient temperature and luminosity information.

[0084] Figure 7 is a flowchart illustrating an exemplary vehicle control method for user safety and experience, according to an embodiment of the present disclosure. Figure 7 is described with reference to elements in Figures 1, 2, 3A, 3B, 4A, 4B, 4C, 5A, 5B, 5C, and 6. Figure 7 illustrates a flowchart 700. The operations of flowchart 700 may be performed by any computer system, such as system 102 or circuit 202. Operations may begin at 702 and proceed to 704.

[0085] At 704, the sensing information can be received. In one or more embodiments, the circuit 202 can be configured to receive the sensing information associated with the first vehicle, for example, as described in Figures 3A and 3B.

[0086] At 706, a state of the first vehicle (e.g., first vehicle 104) may be detected. In one or more embodiments, the circuit 202 may be configured to detect the state of the first vehicle 104 as one of a parked state or an unparked state, for example, as described in Figures 3A and 3B.

[0087] One or more actions may be determined at 708. In one or more embodiments, the circuitry 202 may be configured to determine one or more actions of a person (e.g., person 106) or a second vehicle (e.g., second vehicle 108) in proximity to the first vehicle 104 based on the sensed information, for example, as described in Figures 3A and 3B.

[0088] One or more actions may be triggered at 710. In one or more embodiments, as described in Figures 3A and 3B, for example, circuitry 202 may be configured to trigger one or more actions based on whether the determined one or more actions are dangerous to first vehicle 104 in the detected state or one or more users (e.g., user 118) of first vehicle 104 in the detected state.

[0089] At 712, one or more devices (e.g., one or more devices 110) may be controlled. In one or more embodiments, circuit 202 may be configured to control one or more devices 110 associated with first vehicle 104 based on the one or more triggered actions. One or more devices 110 may include a light-based projector device (e.g., light-based projector device 110A) that is controlled to project a visual alert included in the one or more triggered actions directly onto a physical surface, the physical surface being a window portion 120 of first vehicle 104 or a physical structure external to and separate from first vehicle 104. Details of controlling one or more devices are described, for example, in FIGS. 3A and 3B. Control may proceed to an end.

[0090] Although flowchart 700 has been described as discrete operations such as 702, 704, 706, 708, 710, and 712, the disclosure is not so limited. Thus, in some embodiments, such discrete operations may be further divided into additional operations, combined into fewer operations, or eliminated depending on the particular implementation without departing from the essence of the disclosed embodiments.

[0091] Various embodiments of the present disclosure may provide a non-transitory computer-readable medium and / or storage medium having stored thereon computer-executable instructions executable by a machine and / or computer (e.g., system 102). The computer-executable instructions may cause a machine and / or computer (e.g., system 102) to perform an action and may further include retrieving sensed information related to the first vehicle 104. The action may include detecting a state of the first vehicle 104 as one of a parked state or an unparked state based on the sensed information. The action may include determining one or more actions of a person 106 or a second vehicle 108 in the vicinity of the first vehicle 104 based on the sensed information. The action may include triggering one or more actions based on whether the determined one or more actions are dangerous to the first vehicle 104 in the detected state or one or more users (e.g., user 118) of the first vehicle 104 in the detected state. The operation may include controlling one or more devices 110 associated with the first vehicle 104 based on the one or more triggered actions. The one or more devices 110 may include a light-based projector device 110A controlled to project a visual alert included in the one or more triggered actions directly onto a physical surface, the physical surface being a window portion 120 of the first vehicle or a physical structure external to and separate from the first vehicle.

[0092] An example aspect of the present disclosure may include a system (e.g., system 102) that may include a circuit (e.g., circuit 202). Circuit 202 may be configured to receive sensed information related to a first vehicle 104. Circuit 202 may be configured to detect a state of first vehicle 104 as one of a parked state or an unparked state based on the sensed information. Circuit 202 may be configured to determine one or more actions of a person 106 or a second vehicle 108 in the vicinity of first vehicle 104 based on the sensed information. Circuit 202 may be configured to trigger one or more actions based on whether the determined one or more actions are dangerous to first vehicle 104 in the detected state or one or more users of first vehicle 104 in the detected state. Circuit 202 may be configured to control one or more devices 110 associated with first vehicle 104 based on the triggered one or more actions. The one or more devices 110 include a light-based projector device 110A that is controlled to project a visual alert contained in the one or more triggered actions directly onto a physical surface, the physical surface being a window portion 120 of the first vehicle 104 or a physical structure external to and separate from the first vehicle.

[0093] According to one embodiment, the one or more actions determined may indicate that the person 408 is suspiciously hiding behind or standing near the first vehicle 402 while the first vehicle 402 is detected to be in a parked state.

[0094] According to one embodiment, the projected visual alert includes a first sign that warns or alerts one or more users (such as user 410) in the vicinity of first vehicle 402 and directional information that informs one or more users 410 of the direction in which person 408 is located.

[0095] According to an embodiment, the circuitry 202 may be further configured to determine, while the detected state of the first vehicle 402 is a parked state, an indication of whether an area within a threshold distance from the first vehicle 402 is safe. The indication may be determined based on the detection information, the determined one or more activities, and information regarding unsafe activities in locations near the first vehicle 402, and one or more actions are triggered further based on the determined indication.

[0096] According to one embodiment, the projected visual alert may include a second sign informing one or more users 410 in the vicinity of the first vehicle 402 about the safety level associated with the area surrounding the first vehicle 402.

[0097] According to an embodiment, the circuitry 202 can be further configured to control a user device 412 to display a visual alert including first information to alert one or more users 410 in the vicinity of the first vehicle 402. The user device 412 can be further controlled to display a user interface (UI) element 414 as a panic button. Based on a user selection of the panic button, the user device 412 can send a message including a distress call to one or more mobile devices, instructing one or more devices associated with the first vehicle to activate.

[0098] According to an embodiment, the one or more actions determined may include one-sided interactions of one or more non-user-associated persons 408 with the first vehicle 402 .

[0099] According to an embodiment, the circuitry 202 may be further configured to determine damage to the first vehicle 402 based on the determined one or more actions while the detected state of the first vehicle 402 is the parked state. One or more actions may be further triggered based on the determined damage.

[0100] According to one embodiment, the projected visual alert may include a third sign that notifies one or more users 410 in the vicinity of the first vehicle of the damage to the first vehicle 402 .

[0101] According to one embodiment, the one or more actions determined may include the second vehicle 506 following closely behind the first vehicle 502 while the first vehicle 502 is detected to be in a moving state.

[0102] According to an embodiment, the circuitry 202 can be further configured to determine a first set of projection parameters based on the sensing information and the determined one or more actions. The visual alert can include a warning to prevent the second vehicle 506 from tailgating the first vehicle 502 and can be projected further based on the determined first set of projection parameters.

[0103] According to some embodiments, the one or more actions that are triggered can further include one or more signals that activate a second one of the one or more devices, which can be one of an interior lighting system, an exterior lighting system, an automotive audio / video system, or a door lock system.

[0104] The present disclosure can be implemented in hardware or a combination of hardware and software. The present disclosure can be implemented in a centralized manner in at least one computer system, or in a distributed manner where different elements can be distributed across several interconnected computer systems. Any computer system or other device adapted to perform the methods described herein can be suitable. The combination of hardware and software can be a general-purpose computer system that includes a computer program that, when loaded and executed, can control the computer system to perform the methods described herein. The present disclosure can be implemented in hardware, including portions of integrated circuits that also perform other functions.

[0105] The present disclosure may also be embodied in a computer program product, which includes all features that enable the implementation of the methods described herein and which is capable of executing these methods when loaded into a computer system. A computer program in this context means any expression, in any language, code or notation, of a set of instructions intended to cause a system having information processing capabilities to perform a particular function, either directly, or after a) conversion into another language, code or notation, or b) reproduction in a different content form, or both.

[0106] While the present disclosure has been described with reference to several embodiments, those skilled in the art will recognize that various modifications may be made and equivalents may be substituted without departing from the scope of the disclosure. Additionally, many modifications may be made to adapt a particular situation or material to the teachings of the disclosure without departing from the scope of the disclosure. Therefore, it is not intended that the disclosure be limited to the particular embodiments disclosed, but rather, it is intended to include all embodiments falling within the scope of the appended claims. [Explanation of symbols]

[0107] 100 Network Environment 102 System 104 First car 106 People 108 Second vehicle 110 One or more devices 110A Light-based projector device 112 servers 114 User Device 116 Communication Network 118 users 120 Window part 122 Physical space

Claims

1. receiving, as detection information, sensor data from a sensor mounted on a first vehicle or sensor data from a sensor located in the vicinity of the first vehicle; Detecting a state of the first vehicle as either a parked state or a non-parked state based on the detection information; determining, based on the detection information, one or more actions of a person near the first vehicle or one or more actions of a second vehicle near the first vehicle, wherein the determined one or more actions indicate that the person is suspiciously hiding behind the parked first vehicle or standing near the first vehicle; The one or more actions of the second vehicle that are determined include an action of the second vehicle following closely behind the first vehicle while the first vehicle is in the unparked state; triggering one or more actions based on the determined one or more actions being dangerous to the first vehicle in the detected condition or one or more users of the first vehicle in the detected condition; controlling one or more devices associated with the first vehicle based on the one or more triggered actions, and controlling a user device to display user interface (UI) elements; a circuit configured as follows: the user device communicating, based on a user selection of the user interface element, to operate the one or more devices associated with the first vehicle; the one or more devices include a light-based projector device controlled to project a visual alert included in the triggered one or more actions directly onto a physical surface based on a signal received from the user device; The projected visual alert comprises: a graphical symbol or danger sign alerting the one or more users to a person suspiciously hiding behind or standing near the first vehicle; and direction information informing the one or more users of the first vehicle of a direction in which the person is located; and a first signature including the physical surface is one of a window portion of the first vehicle or a physical structure external to and separate from the first vehicle; A system characterized by:

2. the circuit determines an indication of whether an area within a threshold distance from the first vehicle is safe based on the detected state of the first vehicle being the parked state; the instruction is determined based on the detection information, the determined one or more activities, and information about dangerous activities at locations near the first vehicle; Triggering the one or more actions based on the determined instructions. It is configured as follows: The system of claim 1 .

3. the projected visual alert further includes a second sign informing the one or more users in the vicinity of the first vehicle about a safety level associated with the area around the first vehicle. The system of claim 2 .

4. the determined one or more actions include unsolicited interactions with the first vehicle by a person unrelated to the one or more users; The system of claim 1 .

5. the circuitry is further configured to: determine damage to the first vehicle based on the detected state of the first vehicle being the parked state and the determined one or more actions; triggering the one or more actions based on the determined damage; The system of claim 4.

6. the projected visual alert further includes a third sign informing the one or more users in the vicinity of the first vehicle of the damage to the first vehicle. The system of claim 5.

7. the circuitry is further configured to determine a first set of projection parameters based on the sensed information and the determined one or more actions; the projected visual alert further comprises a warning to prevent the second vehicle from tailgating the first vehicle; the visual alert is projected based on the determined first set of projection parameters. The system of claim 6.

8. the one or more triggered actions further include one or more signals that activate a second device of the one or more devices, the second device being one of an interior lighting system, an exterior lighting system, an automotive audio / video system, or a door lock system; The system of claim 1 .

9. A vehicle control system receiving sensor data from a sensor mounted on a first vehicle or from a sensor located near the first vehicle as detection information; Detecting a state of the first vehicle as one of a parked state and a non-parked state based on the detection information; Based on the detection information, determining one or more actions of a person near the first vehicle or one or more actions of a second vehicle near the first vehicle, wherein the determined one or more actions indicate that the person is suspiciously hiding behind the first vehicle or standing near the first vehicle while the first vehicle is detected to be in the parked state; triggering one or more actions based on whether the determined one or more actions are dangerous to a first vehicle in the detected condition or one or more users of the first vehicle in the detected condition; controlling one or more devices associated with the first vehicle and controlling a user device to display user interface (UI) elements based on the triggered one or more actions; Including, The one or more actions of the second vehicle that are determined include an action of the second vehicle following closely behind the first vehicle while the first vehicle is in the unparked state; the user device communicating, based on a user selection of the user interface element, to operate the one or more devices associated with the first vehicle; the one or more devices include a light-based projector device controlled to project a visual alert included in the triggered one or more actions directly onto a physical surface based on a signal received from the user device; The projected visual alert comprises: a graphical symbol or danger sign alerting the one or more users to a person suspiciously hiding behind or standing near the first vehicle; and direction information informing the one or more users of the first vehicle of a direction in which the person is located; and a first signature including the physical surface is a window portion of the first vehicle or a physical structure external to and separate from the first vehicle; A method characterized by:

10. The vehicle control system, determining an indication of whether an area within a threshold distance from the first vehicle is safe based on the detected state of the first vehicle being the parked state; the instruction is determined based on the detection information, the determined one or more activities, and information about dangerous activities at locations near the first vehicle; triggering the one or more actions based on the determined instructions.

10. The method of claim 9.

11. the projected visual alert includes a second sign informing the one or more users in the vicinity of the first vehicle about a safety level associated with the area around the first vehicle. The method of claim 10.

12. the determined one or more actions include unsolicited interactions with the first vehicle by a person unrelated to the one or more users; 10. The method of claim 9.

13. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed by a system, cause the system to: receiving sensor data from a sensor mounted on a first vehicle or from a sensor located near the first vehicle as detection information; Detecting a state of the first vehicle as one of a parked state and a non-parked state based on the detection information; Based on the detection information, determining one or more actions of a person near the first vehicle or one or more actions of a second vehicle near the first vehicle, and determining that the determined one or more actions indicate that the person is suspiciously hiding behind the parked first vehicle or standing near the first vehicle; The one or more actions of the second vehicle that are determined include an action of the second vehicle following closely behind the first vehicle while the first vehicle is in the unparked state; triggering one or more actions based on the determined one or more actions being dangerous to a first vehicle in the detected condition or one or more users of the first vehicle in the detected condition; controlling one or more devices associated with the first vehicle and controlling a user device to display user interface (UI) elements based on the triggered one or more actions; Execute an operation including the user device communicating, based on a user selection of the user interface element, to operate the one or more devices associated with the first vehicle; the one or more devices include a light-based projector device controlled to project a visual alert included in the triggered one or more actions directly onto a physical surface based on a signal received from the user device; The projected visual alert comprises: a graphical symbol or danger sign alerting the one or more users to a person suspiciously hiding behind or standing near the first vehicle; and direction information informing the one or more users of the first vehicle of a direction in which the person is located; and a first signature including the physical surface is one of a window portion of the first vehicle or a physical structure external to and separate from the first vehicle; 1. A non-transitory computer-readable medium comprising:

Images