System and method for vision-based communication and plant grouping

Abstract

The present disclosure provides a system and method for vision-based communication and plant grouping. A method includes determining a current state associated with a vehicle; and outputting, via a lighting element of the vehicle, an indication corresponding to the current state associated with the vehicle. The method also includes receiving one or more grouping commands based on the indication, and initiating one or more actions in response to receiving the one or more grouping commands.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to marshalling vehicles. More specifically, the present disclosure relates to using vision-based communication to marshal vehicles. BACKGROUND

[0002] The statements in this section merely provide background information related to the present disclosure and can not constitute prior art.

[0003] The use of vehicle exterior lighting is increasingly being used for more than just illuminating the path of the vehicle. For example, vehicle exterior lighting can be used for vision-based communication from a server to on-line / off-line on a vehicle in a marshalling setup. However, there can be inaccuracies in the identification of a particular vehicle in a vehicle fleet when vehicle exterior lighting is used to convey messages, and / or limitations as to the messages that can be conveyed by vehicle exterior lighting. The present disclosure addresses these and other issues related to vision-based communication associated with vehicle exterior lighting of a vehicle. SUMMARY

[0004] This section provides a general summary of the present disclosure and is not a comprehensive disclosure of its full scope or all of its features.

[0005] The present disclosure provides a method comprising: determining a current status associated with a vehicle; outputting, via a lighting element of the vehicle, a first indication corresponding to the current status associated with the vehicle; receiving one or more marshalling commands based on the first indication; and initiating one or more actions in response to receiving the one or more marshalling commands; wherein the vehicle is a partially assembled vehicle configured to be marshalled through a manufacturing environment, and wherein the lighting element is permanently integrated within a body of the vehicle or temporarily attached to the body of the vehicle; wherein the manufacturing environment comprises one or more workstations equipped with electronic devices, and wherein the electronic devices are configured to output a second indication, and further wherein the second indication is a visual cue corresponding to a step of a manufacturing process, a destination of the vehicle, a corresponding location associated with the vehicle, a delay in the manufacturing process associated with the vehicle, a delay in a marshalling process associated with the vehicle, a duration of a stop of the vehicle, or a combination thereof; wherein the first indication and the second indication comprise a light color output, a light output sequence, or a combination thereof; wherein the first indication is output by different portions of the lighting element corresponding to different vehicle systems, and wherein the first indication is a visual cue corresponding to a location associated with a configuration of the vehicle that needs repair, a location associated with the configuration of the vehicle that needs inspection, a fault associated with the vehicle, a trajectory associated with a current movement of the vehicle, a predicted future location associated with the vehicle, one or more vehicle options, or a combination thereof; wherein a frequency and a duration of the output of the first indication varies based on global positioning system coordinates of the vehicle and one or more characteristics associated with the vehicle, wherein the one or more characteristics comprise a state of charge of a battery, a manufacturing process, a key fob, a phone key functionality, a Bluetooth ® low power wireless communication, cellular-based wireless communication, wireless fidelity-based wireless communication, or a combination thereof; and wherein the one or more actions comprise marshalling the vehicle to a repair bay, a parking location, or a future location.

[0006] The present disclosure provides a system comprising: a vehicle system configured to: determine a current status associated with a vehicle; output, via a lighting element of the vehicle, a first indication corresponding to the current status associated with the vehicle; receive one or more marshalling commands based on the first indication; and initiate one or more actions in response to receiving the one or more marshalling commands; and an infrastructure system configured to: observe the first indication, and transmit the one or more marshalling commands based on the observation of the first indication; wherein the vehicle is a partially assembled vehicle configured to be marshalled through a manufacturing environment, and wherein the lighting element is permanently integrated within a body of the vehicle or temporarily attached to the body of the vehicle; wherein the manufacturing environment comprises one or more workstations equipped with electronic devices, and wherein the electronic devices are configured to output a second indication, and further wherein the second indication is a visual cue corresponding to a step of a manufacturing process, a destination of the vehicle, a corresponding location associated with the vehicle, a delay in the manufacturing process associated with the vehicle, a delay in a marshalling process associated with the vehicle, a duration of a stop of the vehicle, or a combination thereof; wherein the first indication and the second indication comprise a light color output, a light output sequence, or a combination thereof; wherein the first indication is output by the lighting element corresponding to different parts of different vehicle systems, and wherein the first indication is a visual cue corresponding to a location associated with a configuration of the vehicle that needs repair, a location associated with the configuration of the vehicle that needs inspection, a malfunction associated with the vehicle, a trajectory associated with a current movement of the vehicle, a predicted future location associated with the vehicle, one or more vehicle options, or a combination thereof; wherein a frequency and duration of the output of the first indication varies based on global positioning system coordinates of the vehicle and one or more characteristics associated with the vehicle, wherein the one or more characteristics comprise a state of charge of a battery, a manufacturing process, a key fob, a phone key functionality, a Bluetooth ® low power wireless communication, cellular-based wireless communication, wireless fidelity-based wireless communication, or a combination thereof; and wherein the one or more actions comprise marshalling the vehicle to a repair bay, a parking location, or a future location.

[0007] The present disclosure provides one or more non-transitory computer-readable media storing processor-executable instructions that, when executed by at least one processor, cause the at least one processor to: determine a current status associated with a vehicle; output, via a lighting element of the vehicle, a first indication corresponding to the current status associated with the vehicle; receive one or more grouping commands based on the first indication; and initiate one or more actions in response to receiving the one or more grouping commands, wherein the one or more actions comprise grouping the vehicle to a repair bay, a parking location, or a future location; wherein the vehicle is a partially assembled vehicle configured to be grouped through a manufacturing environment, and wherein the lighting element is permanently integrated within a body of the vehicle or temporarily attached to the body of the vehicle; wherein the manufacturing environment comprises one or more workstations equipped with electronic devices, and wherein the electronic devices are configured to output a second indication, and further wherein the second indication is a visual cue corresponding to a step of a manufacturing process, a destination of the vehicle, a corresponding location associated with the vehicle, a delay in the manufacturing process associated with the vehicle, a delay in a grouping process associated with the vehicle, a duration of a stop of the vehicle, or a combination thereof; wherein the first indication and the second indication comprise a light color output, a light output sequence, or a combination thereof; wherein the first indication is output by different portions of the lighting element corresponding to different vehicle systems, and wherein the first indication is a visual cue corresponding to a location associated with a configuration of the vehicle that requires repair, a location associated with the configuration of the vehicle that requires inspection, a fault associated with the vehicle, a trajectory associated with a current movement of the vehicle, a predicted future location associated with the vehicle, one or more vehicle options, or a combination thereof; and wherein a frequency and duration of the output of the first indication varies based on global positioning system coordinates of the vehicle and one or more characteristics associated with the vehicle, wherein the one or more characteristics comprise a state of charge of a battery, a manufacturing process, a key fob, a phone-as-a-key functionality, a Bluetooth ® wireless communication based on Bluetooth Low Energy, wireless communication based on cellular, wireless communication based on wireless fidelity, or a combination thereof.

[0008] Additional areas of applicability will become apparent from the description provided herein. It should be understood that the description and specific examples are intended for purposes of illustration only and are not intended to limit the scope of the present disclosure. BRIEF DESCRIPTION OF DRAWINGS

[0009] So that the disclosure can be well understood, various forms thereof will now be described by way of example with reference to the drawings in which: Figure 1A system for automated vehicle grouping according to one or more embodiments of the present disclosure is shown; Figure 2 A display depicting a grouping environment according to one or more embodiments of the present disclosure is shown; Figures 3A to 3D Different lighting displays emitted from lighting elements of a vehicle according to one or more embodiments of the present disclosure are shown; Figure 4 This is a flowchart illustrating an exemplary method for grouping vehicles and / or communicating with vehicles based on vision, according to one or more embodiments of this disclosure; and Figure 5 This is a block diagram illustrating an exemplary computer system according to one or more embodiments of the present disclosure.

[0010] The accompanying drawings described herein are for illustrative purposes only and are not intended to limit the scope of this disclosure in any way. Detailed Implementation

[0011] The following description is merely exemplary in nature and is not intended to limit this disclosure, its application, or its uses. It should be understood that throughout the accompanying drawings, corresponding reference numerals indicate the same or corresponding parts and features.

[0012] The one or more examples described herein provide a means for grouping vehicles and / or for vision-based communication with vehicles. In one or more embodiments, as the vehicle moves through the manufacturing process, it may output one or more visual cues indicating the vehicle's status. However, it should be understood that the vehicle may also output one or more visual cues at any time and outside the manufacturing process. It should also be understood that the one or more visual cues may indicate the location associated with a vehicle's repair-required structure (e.g., a component located internally and / or externally related to the vehicle), the location associated with a vehicle's inspection-required structure, a vehicle-related fault, a trajectory associated with the vehicle's current movement, a predicted future location associated with the vehicle, one or more vehicle options, or a combination thereof, etc.

[0013] refer to Figure 1 The diagram illustrates a schematic block diagram of an automated vehicle grouping (AVM) system 100. In one or more examples, the AVM system 100 groups one or more vehicles (e.g., vehicle 102) that are traveling at low speeds. However, it should be understood that the AVM system 100 can group one or more vehicles that are traveling at any speed. It should also be understood that the AVM system 100 can group semi-autonomous vehicles and / or fully autonomous vehicles.

[0014] AVM system 100 typically includes vehicle 102, central server 104, system operator 106, cloud system 108, and infrastructure system 110. Central server 104 operates as the central communication point associated with AVM system 100 and manages and / or facilitates any manufacturing processes associated with vehicle 102. For example, central server 104 facilitates the grouping of one or more vehicles, enabling one or more vehicles to travel through (e.g., traverse) a grouping environment (e.g., a factory floor or parking lot).

[0015] Central server 104 is configured to communicate directly and wirelessly with each of the components of AVM system 100 (e.g., vehicle 102, system operator 106, cloud system 108, and infrastructure system 110), and may include infrastructure-side AVM algorithm 112. Central server 104 is also configured to provide vehicle 102 with logical interface information received from infrastructure system 110. Additionally, central server 104 is configured to calculate one or more maneuvers (e.g., movement) associated with vehicle 102.

[0016] The infrastructure-side AVM algorithm 112 processes state information associated with at least one or more vehicles 102. It should be understood that the infrastructure-side AVM algorithm 112 processes state information associated with each of the one or more vehicles. The central server 104 is configured to utilize the infrastructure-side AVM algorithm 112 to transmit one or more instructions and / or process information received from each of the components of the AVM system 100 (e.g., vehicle 102, system operator 106, cloud system 108, and infrastructure system 110). For example, the received information may relate to, but is not limited to, grouping vehicles 102 and / or vision-based communication with vehicles 102.

[0017] Specifically, based on direct communication with one or more vehicles, the central server 104 is also configured to cause one or more vehicles to start, stop, or pause their forward movement through the formation environment. The central server 104 is also configured to control the formation speed of one or more vehicles as they travel through the formation environment.

[0018] Vehicle 102, grouped through a grouping environment, can be a partially assembled vehicle, such as a vehicle roof or vehicle base. However, it should be understood that vehicle 102 can also be fully assembled. Vehicle 102 includes a vehicle-side AVM algorithm 114 and lighting elements 116. In one or more embodiments, vehicle 102 utilizes the vehicle-side AVM algorithm 114 to process and transmit information collected by one or more components associated with the construction of vehicle 102, such as components located internally and / or externally associated with vehicle 102. For example, although not shown, components associated with the construction of vehicle 102 may include a wireless transmission module, a vehicle central gateway module, a vehicle infotainment system, one or more vehicle sensors, a vehicle battery, a vehicle global navigation satellite (e.g., GNSS), a vehicle navigation map system, and / or a controller area network (CAN) vehicle bus. It should be understood that by utilizing any of the one or more components associated with the construction of vehicle 102, vehicle 102 is equipped with a system for automated vehicle grouping operations.

[0019] In one or more embodiments, vehicle-side AVM algorithm 114 is configured to determine state information associated with vehicle 102. In another one or more embodiments, vehicle-side AVM algorithm 114 is further configured to cause lighting element 116 to output an indication corresponding to the state information associated with vehicle 102. In one or more embodiments, as a supplement to or alternative to vehicle-side AVM algorithm 114, infrastructure-side AVM algorithm 112 may determine the state information associated with vehicle 102 based on processed state information. Additionally, infrastructure-side AVM algorithm 112 may also be configured to cause lighting element 116 to output an indication corresponding to the state information associated with vehicle 102 based on the transmission of one or more instructions from infrastructure system 110 to vehicle 102.

[0020] The lighting element 116 may include an array of lamps attached to the vehicle 102. However, it should be understood that the lighting element 116 may also be a single lamp. In one or more embodiments, the lighting element 116 may be permanently integrated into the body of the vehicle 102. In another one or more embodiments, the lighting element 116 may be temporarily attached to the body of the vehicle 102. As an example, the lighting element 116 may be a decorative strip of red, green, and blue (e.g., RGB) light-emitting diodes (e.g., LEDs) configured to turn on and off in a certain pattern to provide visual cues. As another example, one or more visual cues may correspond to a specific state of the vehicle 102 and / or indicate a specific location associated with a component of the vehicle 102 requiring repair, a location associated with a component of the vehicle 102 requiring inspection, a fault associated with the vehicle 102, a trajectory associated with the current movement of the vehicle 102, a predicted future location associated with the vehicle 102, one or more vehicle options, or a combination thereof, etc. However, it should be understood that one or more visual cues may correspond to any state of the vehicle 102 and / or any other relevant information associated with the vehicle 102. It should also be understood that the lighting element 116 can be any other type of lighting device, and is not limited to LED lighting devices.

[0021] One or more visual cues may include light color output, a sequence of light outputs, or a combination thereof. However, it should be understood that one or more visual cues may include any other light-based communication means. For example, one or more visual cues may be output by different portions of illumination element 116, thereby enabling the display of different colors associated with different vehicle systems. As another example, the pattern may vary based on a specific state of vehicle 102, and the illumination sequence of illumination element 116 may be altered, the brightness of illumination element 116 may be changed, and / or any changes may be made to illumination element 116 in relation to indicating a specific state of vehicle 102. As yet another example, the pattern may also indicate one or more options and / or whether certain equipment should be installed on vehicle 102 (e.g., or each vehicle in a fleet).

[0022] In one or more embodiments, the frequency and / or duration of the output of one or more visual cues may vary based on the vehicle's GPS coordinates and / or one or more characteristics associated with the vehicle, wherein one or more characteristics include the battery's state of charge, manufacturing process steps, key fob, mobile phone as key functionality, Bluetooth-based... ®Low-power wireless communication, cellular-based wireless communication, wireless fidelity-based wireless communication, or combinations thereof. However, it should be understood that one or more features may include any other communication-based features associated with vehicle 102. For example, the frequency and / or duration of the output of one or more visual cues may be varied to conserve power associated with vehicle 102 and / or lighting element 116.

[0023] Central server 104 is configured to cause infrastructure system 110 to monitor the forward movement of one or more vehicles as they move through a grouping environment. In one or more embodiments, one or more vehicles are grouped through the grouping environment as part of a zero-fault forwarding process. For example, by implementing a zero-fault forwarding process, diagnostic tools that are typically plugged into and / or wirelessly connected to one or more vehicles can be replaced. Electronic devices may include, for example, cellular phones, smartphones, tablets, or laptops. Central server 104 is also configured to cause infrastructure system 110 to capture visual cues output from lighting elements 116 of vehicle 102. Infrastructure system 110 includes sensor components 118 and wireless communication components 120. For example, wireless communication component 120 may utilize GPS, Wi-Fi, satellite, 3G / 4G / 5G, and / or Bluetooth. TM To communicate with one or more vehicles. It should be understood that, by utilizing either sensor component 118 and / or wireless communication component 120, infrastructure system 110 is configured to perform one or more positioning functions associated with the grouping of vehicles 102, such as, but not limited to, perception, path planning, detection, control, response, or combinations thereof of vehicles 102.

[0024] Wireless communication component 120 communicates with sensor component 118, which is configured to manage one or more of, such as cameras, lidar, radar, and / or ultrasonic devices. When one or more vehicles are grouped through a grouped environment, sensor component 118 monitors the movement of one or more vehicles. Additionally, sensor component 118 receives visual cues output from illumination elements 116 of one or more vehicles 102. It should be understood that infrastructure system 110 may forward (e.g., transmit) the acquired (e.g., captured) visual cues to central server 104. It should also be understood that central server 104 is configured to process the received one or more visual cues and determine what indication the visual cues correspond to relative to the state of one or more vehicles 102.

[0025] System operator 106 may be a human operator responsible for monitoring one or more grouped vehicles by communicating with cloud system 108. In one or more embodiments, system operator 106 communicates with cloud system 108 and / or monitors one or more vehicles via user device (not shown) and / or the human eye of a human operator. However, it should be understood that system operator 106 may also be a non-human operator, such as a mainframe controller, a machine learning-based control system, or any neural network. It should also be understood that the task of system operator 106 is to manage and / or supervise the operation of vehicles 102 during automated grouping, the online process, and / or at various locations (e.g., via in-facility interfaces). System operator 106 is able to receive instructions from central server 104 and forward these instructions to one or more vehicles via cloud system 108. For example, the instructions received from central server 104 may be one or more grouping commands that can cause one or more vehicles to drive to a vehicle repair shop, a parking location, a future location, or any other location. As another example, instructions may be based on one or more processed visual cues.

[0026] In addition to visual monitoring of one or more visual cues, system operator 106 can also obtain other information from cloud system 108 related to corresponding instructions associated with one or more visual cues. It should be understood that cloud system 108 is a backend system that may represent the original equipment manufacturer's cloud system responsible for the remote engagement and / or disengagement of AVM applications (including the registration and / or deregistration of vehicle 102 from AVM system 100).

[0027] As an example, other information obtained may be displayed on the user device. For example, one or more vehicles may report any of the instructions to the cloud system 108. As another example, in response to receiving a reported instruction, the cloud system 108 may determine a repair plan to address an instruction that may correspond to a repairable problem related to one or more vehicles. As yet another example, in response to receiving a reported instruction, the cloud system 108 may also report the instruction to the central server 104 via system operator 106, so that the central server 104 may group one or more vehicles to a repair facility or any other location. As yet another example, in response to receiving a reported instruction, the cloud system 108 may also cause one or more vehicles to emit a specific light pattern indicating the future location of the vehicle (e.g., via infrastructure system 110 and / or system operator 106). For example, a specific color may correspond to a specific parking location or a specific repair shop. It should be understood that the cloud system 108 may utilize various software applications to determine repair plans, report instructions, and / or cause the emission of light patterns. As yet another example, a specific color may also indicate how long one or more vehicles have been stopped or how long one or more vehicles have been idle.

[0028] While the user device may be a tablet computer used by system operator 106, the tablet computer (or any other suitable electronic device) may also be used at one or more workstations distributed throughout the grouping environment. As an example, and as... Figure 2 As shown, the user device can depict a virtual representation (e.g., a digital twin) of the manufacturing facility on display 200, the virtual representation being color-coded so that status information associated with vehicle 102 can be easily noticed and / or a particular vehicle can be highlighted among numerous vehicles. In one or more embodiments, and when lighting element 116 is not attached to vehicle 102, the user device can display a virtual lighting system that can be viewed by system operator 106 via an augmented reality system, which may correspond to the virtual representation of the manufacturing facility.

[0029] Figures 3A to 3D Examples of different embodiments are shown that utilize illumination element 116 to communicate status information associated with vehicle 102 to at least infrastructure system 110 and / or system operator 106. Without requiring vehicle 102 to be grouped and / or participate in grouping setup (e.g., or process), illumination element 116 can output one or more visual signals indicating the status of vehicle 102 and / or a specific location associated with a component of vehicle 102 requiring repair, a location associated with a component of vehicle 102 requiring inspection, a fault associated with vehicle 102, a trajectory associated with the current movement of vehicle 102, a predicted future location associated with vehicle 102, one or more vehicle options, or a combination thereof. For example, and in other words, a repair facility may be able to determine any corresponding indication associated with one or more visual cues based on the output of illumination element 116 of a manually operated vehicle. It should be understood that one or more visual cues may correspond to any status of vehicle 102 and / or any other relevant information associated with vehicle 102.

[0030] For example, Figure 3A The activation of the entire lighting element 116 of vehicle 102, extending along the entire body of vehicle 102, is illustrated. It should be understood that full activation of the entire lighting element 116 of vehicle 102 can indicate the starting of vehicle 102. It should also be understood that full activation of the entire lighting element 116 of vehicle 102 during vehicle 102 starting can indicate full operation of the lighting element 116. However, it should be understood that full activation of the entire lighting element 116 of vehicle 102 can represent any other indication of the functions associated with the lighting element 116 and / or vehicle 102.

[0031] As another example, Figure 3BThe activation of the lighting element 116 corresponding to the area relative to the front bumper of vehicle 102 is shown. It should be understood that the activation of the lighting element 116 corresponding to the area relative to the front bumper of vehicle 102 can indicate the status information of vehicle 102 and / or the need for repair of the front bumper of vehicle 102, the need for inspection of the front bumper of vehicle 102, the trajectory associated with the current movement of vehicle 102, the predicted future position associated with vehicle 102, one or more vehicle options or combinations thereof, etc. However, it should be understood that the activation of the lighting element 116 corresponding to the area relative to the front bumper of vehicle 102 can correspond to any status of vehicle 102 and / or any other relevant information associated with vehicle 102.

[0032] As another example, Figure 3C The activation of different portions of the lighting element 116, mounted on the side of a partially assembled version of vehicle 102 (e.g., a roof version of vehicle 102), is shown. As yet another example, Figure 3D The activation of different portions of the lighting element 116 mounted on the side of a fully assembled version of vehicle 102 is shown. It should be understood that, although... Figure 3C and Figure 3D The lighting element 116 is depicted as being mounted on one side of the vehicle 102, but the lighting element 116 may be mounted (e.g., attached) anywhere on the vehicle 102, including the other side, front, rear, or top of the vehicle 102. It should also be understood that activation of different portions of the lighting element 116 may indicate status information associated with the vehicle 102 or any other information associated with the vehicle 102. It should also be understood that different lighting elements attached to the vehicle 102 may each output different patterns or visual cues, and it is not required that each lighting element output the same pattern or visual cues.

[0033] Figure 4 This is a flowchart illustrating an exemplary method 400 for grouping vehicles (e.g., vehicle 102) and / or for vision-based communication with vehicles. At operation 402, the current state associated with the vehicle is determined. For example, the current state associated with the vehicle is determined by a vehicle-side algorithm (e.g., vehicle-side AVM algorithm 114). As another example, the vehicle is a partially assembled vehicle configured to be grouped through a manufacturing environment. As yet another example, the manufacturing environment includes one or more workstations equipped with electronics.

[0034] At operation 404, a first indication corresponding to the current state associated with the vehicle is output. For example, the first indication is output via a vehicle lighting element (e.g., lighting element 116). As another example, the first indication is output via the vehicle lighting element to an infrastructure system (e.g., infrastructure system 110) or one or more human operators (e.g., system operator 106). It should be understood that the first indication may be output via the vehicle lighting element to another vehicle or any other receiver or system that can perceive (e.g., process and / or capture) the first indication. In one or more embodiments, the lighting element is permanently integrated into the vehicle body. In another one or more embodiments, the lighting element is temporarily attached to the vehicle body. In yet another example, the first indication is output by a different part of the lighting element corresponding to a different vehicle system. In yet another example, the first indication is a visual cue corresponding to the location of a vehicle structure requiring repair (e.g., vehicle-related components located inside and / or outside), the location of a vehicle structure requiring inspection, a vehicle-related fault, a trajectory associated with the vehicle's current movement, a predicted future location associated with the vehicle, one or more vehicle options, or a combination thereof. As another example, the first instruction is also a visual cue, which is used to assign a specific operator from one or more human operators to investigate vehicle-related issues.

[0035] For example, the frequency and duration of the first indication vary based on the vehicle's GPS coordinates and one or more characteristics associated with the vehicle, including the battery's state of charge, manufacturing process steps, key fob, mobile phone as key functionality, and Bluetooth-based features. ® Low-power wireless communication, cellular-based wireless communication, wireless fidelity-based wireless communication, or combinations thereof. As another example, the electronic device is configured to output a second indication. As yet another example, the second indication is a visual cue corresponding to a step in the manufacturing process, the vehicle's destination, a corresponding location associated with the vehicle, a delay in the manufacturing process associated with the vehicle, a delay in the grouping process associated with the vehicle, the duration of the vehicle's stop, or combinations thereof. As yet another example, the first and second indications include light color output, a light output sequence, or combinations thereof.

[0036] At operation 406, one or more grouping commands are received. In one or more embodiments, one or more grouping commands are received from an infrastructure system. In another or more embodiments, one or more grouping commands are received from user input from one or more human operators. However, it should be understood that one or more grouping commands are received from both the infrastructure system and user input. As yet another example, the one or more grouping commands are received based on the first instruction. At operation 408, one or more actions are initiated in response to receiving one or more grouping commands. For example, said one or more actions include grouping the vehicle to a repair shop, parking location, or future location.

[0037] Figure 5 An operating environment facilitating the execution of one or more systems and methods described herein is illustrated. More specifically, the systems and methods described herein may be implemented using computing device 502. For example, computing device 502 may be a personal computer, desktop computer, laptop computer, tablet computer, handheld computer, server, workstation, mainframe, wearable computer, supercomputer, or a combination thereof. However, it should be understood that the foregoing examples of computing device 502 are not exhaustive, and computing device 502 may be any type of processing or computing device. Computing device 502 typically includes a processor 504, a display adapter 506, one or more input / output ports 508, one or more input / output components 510, a network adapter 512, a power supply 514, and memory 516. However, it should be understood that computing device 502 may include any of the listed components, and is not required to include any of them.

[0038] Processor 504 is configured to provide instructions to computing device 502, enabling computing device 502 to perform one or more tasks, including implementing software programs to perform one or more operations as described in more detail herein. It should also be understood that computing device 502 may include any number of processors 504. Display adapter 506 may be a graphics card or video board that provides computing device 502 with the ability to display content on display device 518. For example, display device 518 may be any screen, monitor, and / or light-emitting component associated with any of a personal computer, desktop computer, laptop computer, tablet computer, handheld computer, server, workstation, mainframe, wearable computer, supercomputer, or a combination thereof. However, it should be understood that the foregoing examples of display device 518 are not exhaustive, and display device 518 may be any type of device capable of providing visual display.

[0039] Input / output port 508 provides multiple interfaces (e.g., jacks) for one or more cables to connect to computing device 502. It should be understood that any number of input / output ports 508 may be present on computing device 502. For example, input / output port 508 provides computing device 502 with a means to receive signals and / or data from external devices connected to computing device 502 via one or more cables. As another example, input / output port 508 provides computing device 502 with a means to transmit signals and / or data to external devices connected to computing device 502 via one or more cables. Input / output component 510 may include one or more components supporting input / output port 508, such as, but not limited to, switches, buttons, pressure pads, float switches, keyboards, radio receivers, or combinations thereof.

[0040] Network adapter 512 can be any type of network interface controller configured to provide means for communicating with another computing device (such as remote computing device 522) via network 520. For example, remote computing device 522 can be a user device such as a cellular phone, smartphone, tablet computer, laptop computer, or a combination thereof. Power supply 514 is configured to convert alternating high-voltage current (e.g., AC) into direct current (e.g., DC) to provide power to other components of computing device 502 (e.g., processor 504, display adapter 506, one or more input / output ports 508, one or more input / output components 510, network adapter 512, and memory 516).

[0041] Additionally, memory 516 may be a mass storage device and / or system memory, such as a hard disk drive, memory card, solid-state drive, random access memory (RAM), or a combination thereof. Memory 516 is configured to provide storage for instructions and data associated with the operation of computing device 502. Memory 516 may typically include operating system 524, detection software 526, and detection data 528. For example, operating system 524 is configured to manage and / or process any of the data and / or instructions associated with detection software 526 and / or detection data 528, as described in more detail herein.

[0042] Furthermore, a system bus 530 is also included within the computing device 502, configured to couple each of the various components of the computing device 502 (e.g., processor 504, display adapter 506, one or more input / output ports 508, one or more input / output components 510, network adapter 512, power supply 514, and memory 516). It should also be understood that the functions associated with each component of the computing device 502 and with each component of the computing device 502 can be implemented within a remote computing device 522. AlthoughFigure 5 The operating environment shown herein depicts a specific configuration associated with at least computing device 502, network 520, and remote computing device 522; however, it should be understood that the operating environment can be configured in any manner.

[0043] Therefore, one or more examples of this disclosure provide a means for vision-based communication in at least a grouping configuration, wherein a vehicle is able to diagnose itself and convey status information (e.g., or any other information) via an output of a changing illumination pattern displayed on the vehicle's illumination elements.

[0044] Unless otherwise expressly indicated herein, all numerical values ​​indicating mechanical / thermal properties, percentage of composition, dimensions and / or tolerances or other characteristics should be understood as being modified by the words “about” or “approximately” when describing the scope of this disclosure. Such modification is desired for various reasons, including: industrial practice; material, manufacturing and assembly tolerances; and testing capabilities.

[0045] As used herein, the phrases A, B, and C at least one should be interpreted as representing logic (A or B or C) using the non-exclusive logic "or", and should not be interpreted as representing "at least one of A, at least one of B, and at least one of C".

[0046] In this application, the terms “controller” and / or “module” may refer to, be part of, or include the following: application-specific integrated circuit (ASIC); digital, analog, or mixed analog / digital discrete circuit; digital, analog, or mixed analog / digital integrated circuit; composable logic circuit; field-programmable gate array (FPGA); processor circuitry (shared, dedicated, or grouped) that executes code; memory circuitry (shared, dedicated, or grouped) that stores code executed by the processor circuitry; other suitable hardware components that provide the described functionality; or combinations of some or all of the foregoing, such as in a system-on-a-chip.

[0047] The term memory is a subset of the term computer-readable medium. As used herein, the term computer-readable medium does not cover transient electrical or electromagnetic signals propagated through a medium (such as on a carrier wave); therefore, the term computer-readable medium can be considered tangible and non-transient. Non-limiting examples of non-transient tangible computer-readable media include non-volatile memory circuits (such as flash memory circuits, erasable programmable read-only memory circuits, or mask read-only circuits), volatile memory circuits (such as static random access memory circuits or dynamic random access memory circuits), magnetic storage media (such as analog magnetic tape or digital magnetic tape or hard disk drives), and optical storage media (such as CDs, DVDs, or Blu-ray discs).

[0048] The apparatus and methods described in this application can be implemented, in part or in whole, by a dedicated computer created by configuring a general-purpose computer to perform one or more specific functions embodied in a computer program. Function blocks, flowchart components, and other elements described above serve as software specifications that can be translated into computer programs through the routine work of a technician or programmer.

[0049] The description in this disclosure is merely exemplary in nature, and therefore, variations without departing from the spirit and scope of this disclosure are intended to be made within its scope. Such variations should not be considered as departing from the spirit and scope of this disclosure.

[0050] According to the present invention, one or more non-transitory computer-readable media storing processor-executable instructions, which, when executed by at least one processor, cause the at least one processor to: determine a current state associated with a vehicle; output a first indication corresponding to the current state associated with the vehicle via a lighting element of the vehicle; receive one or more grouping commands based on the first indication; and initiate one or more actions in response to receiving the one or more grouping commands, wherein the one or more actions include grouping the vehicle to a repair shop, a parking location, or a future location.

[0051] According to one embodiment, the vehicle is configured to be partially assembled in a manufacturing environment, and the lighting element is permanently integrated into the vehicle body or temporarily attached to the vehicle body.

[0052] According to one embodiment, the manufacturing environment includes one or more workstations equipped with electronic devices, wherein the electronic devices are configured to output a second instruction, and further, wherein the second instruction is a visual cue corresponding to a step in the manufacturing process, the destination of the vehicle, a corresponding location associated with the vehicle, a delay in the manufacturing process associated with the vehicle, a delay in the grouping process associated with the vehicle, the duration of the vehicle's stop, or a combination thereof.

[0053] According to one embodiment, the first indication and the second indication include light color output, light output sequence, or a combination thereof.

[0054] According to one embodiment, the first indication is output by the lighting element corresponding to different parts of different vehicle systems, and wherein the first indication is a visual cue corresponding to the location of a component of the vehicle that needs repair, the location of a component of the vehicle that needs inspection, a fault associated with the vehicle, a trajectory associated with the current movement of the vehicle, a predicted future location associated with the vehicle, one or more vehicle options, or a combination thereof.

[0055] According to one embodiment, the frequency and duration of the output of the first indication vary based on the vehicle's GPS coordinates and one or more characteristics associated with the vehicle, wherein the one or more characteristics include the battery's state of charge, manufacturing process steps, key fob, mobile phone as key functionality, Bluetooth-based... ® Low-power wireless communication, cellular-based wireless communication, wireless fidelity-based wireless communication, or combinations thereof.

Claims

1. A method comprising: determining a current status associated with a vehicle; outputting, via a lighting element of the vehicle, a first indication corresponding to the current status associated with the vehicle; receiving one or more marshalling commands based on the first indication; and initiating one or more actions in response to receiving the one or more marshalling commands.

2. The method of claim 1, wherein the vehicle is a partially assembled vehicle configured to be marshalled through a manufacturing environment.

3. The method of claim 2, wherein the manufacturing environment comprises one or more workstations equipped with electronic devices, and wherein the electronic devices are configured to output a second indication, and further wherein the second indication is a visual cue corresponding to a step of a manufacturing process, a destination of the vehicle, a corresponding location associated with the vehicle, a delay in the manufacturing process associated with the vehicle, a delay in a marshalling process associated with the vehicle, a duration of a stop of the vehicle, or a combination thereof.

4. The method of claim 3, wherein the first indication and the second indication comprise a light color output, a light output sequence, or a combination thereof.

5. The method of claim 1, wherein the lighting element is permanently integrated within a body of the vehicle or temporarily attached to the body of the vehicle.

6. The method of claim 1, wherein the first indication is output by the lighting element corresponding to different portions of different vehicle systems, and wherein the first indication is a visual cue corresponding to a location associated with a configuration of the vehicle that needs repair, a location associated with the configuration of the vehicle that needs inspection, a fault associated with the vehicle, a trajectory associated with a current movement of the vehicle, a predicted future location associated with the vehicle, one or more vehicle options, or a combination thereof.

8. The method of claim 1, wherein the one or more actions comprise marshalling the vehicle to a repair bay, a parking location, or a future location.

7. The method of claim 1, wherein the output of the first indication varies in frequency and duration based on global positioning system coordinates of the vehicle and one or more characteristics associated with the vehicle, wherein the one or more characteristics include a state of charge of a battery, a step of a manufacturing process, a key fob, a phone-as-a-key function, a Bluetooth ® wireless communication, cellular-based wireless communication, wireless fidelity-based wireless communication, or a combination thereof.

9. A system comprising: a vehicle system configured to: determine a current status associated with a vehicle; output, via a lighting element of the vehicle, a first indication corresponding to the current status associated with the vehicle; receive one or more marshalling commands based on the first indication; and initiate one or more actions in response to receiving the one or more marshalling commands; and an infrastructure system configured to: observe the first indication, and transmit the one or more marshalling commands based on the observation of the first indication.

10. The system of claim 9, wherein the vehicle is a partially assembled vehicle configured to be marshalled through a manufacturing environment, and wherein the lighting element is permanently integrated within a body of the vehicle or temporarily attached to the body of the vehicle. ​ ​ 11. The system of claim 10, wherein the manufacturing environment comprises one or more workstations equipped with electronic devices, and wherein the electronic devices are configured to output a second indication, and further wherein the second indication is a visual cue corresponding to a step of a manufacturing process, a destination of the vehicle, a corresponding location associated with the vehicle, a delay in the manufacturing process associated with the vehicle, a delay in a marshalling process associated with the vehicle, a duration of a stop of the vehicle, or a combination thereof.

12. The system of claim 11, wherein the first indication and the second indication comprise a light color output, a sequence of light outputs, or a combination thereof.

13. The system of claim 9, wherein the first indication is output by different portions of the lighting element corresponding to different vehicle systems, and wherein the first indication is a visual cue corresponding to a location associated with a configuration of the vehicle that needs repair, a location associated with the configuration of the vehicle that needs inspection, a fault associated with the vehicle, a trajectory associated with a current movement of the vehicle, a predicted future location associated with the vehicle, one or more vehicle options, or a combination thereof.

14. The system of claim 9, wherein a frequency and duration of the output of the first indication varies based on global positioning system coordinates of the vehicle and one or more characteristics associated with the vehicle, wherein the one or more characteristics include a state of charge of a battery, a step of a manufacturing process, a key fob, a phone-as-a-key function, a Bluetooth ® low power wireless communication, cellular-based wireless communication, wireless fidelity-based wireless communication, or a combination thereof.

15. The system of claim 9, wherein the one or more actions comprise marshalling the vehicle to a repair bay, a parking location, or a future location.

Images