Method for monitoring indoor state and vehicle having an indoor state monitoring device
Through the image photographer and analysis and processing device, the identification of wear and failures in the vehicle interior room is solved, and the problem of high-cost manual inspection in the complex vehicle interior room is realized, and the automated status monitoring and maintenance of the vehicle interior room is realized, thereby reducing maintenance costs.
Patent Information
- Application Number
- CN202411339595.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2019-01-14
- Filing Date
- 2019-01-30
- Publication Date
- 2024-11-22
AI Technical Summary
In complex vehicle interiors, inspections of multiple maintenance targets require the participation of specific training maintenance personnel, resulting in high cost and difficulty in automation, affecting the efficiency of preventive maintenance.
The image photographer and analysis and processing device are used to monitor the vehicle interior room in real time through image analysis and processing algorithms, identify and compare the deviations between image data and reference data, automatically identify wear and functional failures of maintenance targets, and reduce or cancel manual inspection activities.
It reduces maintenance costs, improves maintenance efficiency, reduces the need for manual inspection, and realizes real-time monitoring and automated maintenance of vehicle interior status.
Smart Images

Figure CN118991838A_ABST
Abstract
Description
Technical Field
[0001] The invention relates to a method for monitoring an interior condition of a vehicle and a vehicle having an interior condition monitoring device. Background Art
[0002] The general trend in the industry is to move away from preventive maintenance towards condition-oriented maintenance of vehicles.
[0003] Preventive maintenance is understood in particular to mean maintenance measures which are carried out at planned intervals or according to prescribed standards, even if the maintenance object does not absolutely require maintenance.
[0004] In contrast to preventive maintenance, condition-based maintenance checks the condition of maintenance objects at regular intervals, with possible maintenance measures being implemented only when necessary.
[0005] Further definitions of the term appear in the standard "DIN EN 13306-Instandhaltung: Begriffeder Instandhaltung".
[0006] The purpose of condition-oriented maintenance is to reduce maintenance costs, since maintenance objects are only repaired when necessary.
[0007] However, the inspection of the maintenance object, the so-called check, generally requires the assistance of specially trained maintenance personnel who check the condition of the maintenance object and, if necessary, carry out maintenance measures.
[0008] Especially in the case of complex technical products such as vehicles, the costs for inspection by maintenance personnel account for a large part of the repair costs.
[0009] In particular in view of the increasing automation of vehicles, it is advantageous to make the inspection of maintenance objects as technical as possible in order to reduce the maintenance costs.
[0010] There are a number of maintenance targets in vehicle interiors, such as in the vehicle interiors of rail vehicles. The maintenance targets in the vehicle interiors are usually interior equipment objects. The interior equipment objects are in need of maintenance, ie, are worn and / or may have functional faults.
[0011] Due to the presence and complexity of multiple interior device objects, the inspection costs are considerable. Summary of the invention
[0012] The object of the present invention is to provide a method for monitoring the condition of an interior and a vehicle having a device for monitoring the condition of an interior which minimizes manual inspection activities of the vehicle interior by maintenance personnel or makes them completely unnecessary.
[0013] The invention advantageously results in a reduction in the economic costs for repairs, which is of great significance to the vehicle owner.
[0014] This object is achieved according to the invention by the features of independent claims 1 and 11 .
[0015] Advantageous embodiments of the method and of the vehicle are the subject matter of the dependent claims cited herewith.
[0016] A vehicle usually has a vehicle interior, which is particularly used for transporting passengers and / or transporting goods. The vehicle interior is equipped with an interior device object, referred to as a device object. Here, the device object can be a common seat, for example.
[0017] In the case of small and / or simplified vehicles, the vehicle interior may be equipped with only one device object, such as a seat.
[0018] The device object may also be a door, a step, a handrail, a panel, a shelf for objects or the like, as are typically present today in vehicles for transporting passengers and / or transporting goods.
[0019] Vehicles, such as rail vehicles, are often equipped with image sensors that are used to monitor the vehicle interior, in particular passengers and / or objects located therein.
[0020] Smaller vehicles, such as cars, are often equipped with only one image sensor.
[0021] It should be noted that the invention is by no means restricted to use in rail vehicles, although this is particularly preferred. The invention can also be used in automobiles, aircraft or similar transport vehicles, wherein the above list is not exhaustive.
[0022] Preferably, the image data of the aforementioned image recording device are transmitted to a display device in the immediate vicinity of the vehicle driver and / or in an operations center and displayed.
[0023] Due to the display, the vehicle driver and / or the operations center receives information about the state of the vehicle interior, so-called status information. However, the term "status information" is not limited to displays about the state of the vehicle interior. Rather, status information is understood to be information that enables the vehicle driver and / or the operations center to assess the state of the vehicle and / or the surroundings of the vehicle. Thus, the status information may also include specific process parameters of the vehicle, such as the speed of the vehicle, the external temperature, the position, etc.
[0024] Operation centers (also called operation control desks) are devices that are often found in the field of mass transit solutions. In addition, the operation center is responsible for the control and / or operation of large traffic networks and the vehicles located in the traffic network. Preferably, the operation center is fixed in place.
[0025] However, the operating center may also be a maintenance center which is responsible in particular for the coordination of maintenance personnel and / or for the implementation of maintenance work.
[0026] The image recording devices are preferably a plurality of video cameras which in particular record the entire vehicle interior, but also at least parts of the vehicle interior.
[0027] In areas of the vehicle interior, such as in a restroom of a rail vehicle, where the privacy of the passengers must be ensured, these areas can be excluded from the range captured by the image capturer.
[0028] The display means is preferably any type of device for illustrating and / or displaying changing information.
[0029] In order to be able to wirelessly transmit status information about the vehicle interior and / or the vehicle and / or the surroundings of the vehicle to an operating center, at least one communication means for wireless communication must be present in the vehicle.
[0030] The communication means preferably communicates based on conventional mobile communication technologies and / or other radio-based communication technologies.
[0031] However, the communication itself is preferably not limited to the exchange of status information. Any other data of any type can also be exchanged between the vehicle and the operations center. It is important to emphasize here that the transmission preferably takes place from the communication device of the vehicle to the communication device of the operations center, but it can also take place from the communication device of the operations center to the communication device of the vehicle. Bilateral communication is particularly preferred.
[0032] The vehicle further comprises a device for evaluating image data, referred to as evaluation device for short, which is designed in such a way that it can receive and evaluate image data from an image capture device in the vehicle interior.
[0033] The evaluation device is preferably an electronic data processing device, for example a computer.
[0034] Image data is understood here to mean digitized image information of the vehicle interior which is captured by an image capturer.
[0035] The evaluation itself here includes evaluating certain existing features of the image data with the aid of an image evaluation algorithm.
[0036] Preferably, the evaluation also includes the recognition and / or evaluation of features in the image data, such as contrast, shape and / or color. Such recognition and / or evaluation is preferably performed in an evaluation unit configured for this purpose in the evaluation device.
[0037] A further algorithm, which is preferably also implemented in the evaluation unit, identifies the maintenance target and its condition at the time of the evaluation based on the features. Preferably, the evaluation and / or identification is performed in real time.
[0038] The target state of the interior arrangement object is present in the evaluation unit in the form of reference data and / or certain reference signatures which are stored in a memory unit of the evaluation unit.
[0039] Using the algorithm described above, the features in the reference data are evaluated, wherein reference features are thus not required.
[0040] The reference data are preferably image data used as a reference for the algorithm. The reference features are the features mentioned above.
[0041] In an alternative, but particularly preferred, embodiment, the image data and reference data from a storage unit are superimposed in a comparison unit provided for this purpose, so that negative information is generated which contains only the deviations between the image data of the image capture device and the reference data.
[0042] By evaluating features in the negative image information, such as contrast, shape and / or color, the condition of the maintenance object can be detected with the aid of an algorithm, wherein the condition deviation between the target condition and the actual state is directly involved.
[0043] This particularly preferred embodiment makes it possible to carry out the identification within the evaluation device in a particularly computationally efficient manner.
[0044] Based on the aforementioned approach, the evaluation device can determine the actual state of the interior arrangement object with reference to the image data and compare this actual state with a target state.
[0045] In the event of a deviation between the actual state and the target state of the interior arrangement object, the evaluation device determines this deviation.
[0046] The actual state of the interior arrangement object is understood to be, in particular, a state which is sensed and / or present at the time of the evaluation.
[0047] By contrast, a target state of an interior arrangement object is understood in particular to be a state that should be present at the time of the evaluation and that is predetermined in particular by reference data and / or reference states in a memory unit.
[0048] Interior device objects are differentiated into conventional, non-functional device objects and device objects with functions, so-called functional device objects.
[0049] Since the functional device object is situated in the vehicle interior, the designation “functional interior device object” may also be used.
[0050] The expression "function" indicates only the technical function of the interior equipment object and not the structural design or the use function.
[0051] For example, commonly used seats or armrests are considered to be non-functional interior furniture objects.
[0052] A functional interior device object is a device object that has at least one technical function. This can be, for example, a tiltable seat or an automatic door.
[0053] Non-functional interior equipment objects are particularly wear-prone. Thus, for example, the surface of a seat can have wear phenomena caused by mechanical stresses applied by passengers and / or transported goods.
[0054] In this context, however, wear is not only to be understood as a permanent loss of material, but also as a widespread change in the surface which is due to the destruction or damage of the surface of the interior fitting object.
[0055] The evaluation device can thus determine the deviation.
[0056] Functional device objects have extended technical functions.
[0057] This function can often be realized by using mechanical and / or electrical components which are built into the interior device object. Wear phenomena on the mechanical and / or electrical components of the functional device object ultimately lead to a loss of functionality.
[0058] Regardless of whether the object is a non-functional interior fitting object or a functional interior fitting object, the object requires repair due to the wear phenomenon and / or the malfunction.
[0059] Preferably, there are also controllable device objects in the vehicle interior. Such interior device objects are functional interior device objects which are provided with mechanical and / or electrical components which enable the execution of predetermined functions.
[0060] The execution of the function is preferably triggered and / or controlled by the evaluation device. The evaluation device detects, with reference to the evaluation of the image data, that the triggering of the function is necessary if certain criteria are to be met.
[0061] This is the case, for example, when a passenger approaches a passage door in order to pass through it, wherein the passage door is a controllable passage door.
[0062] If such a function is triggered and / or controlled by an evaluation device, then individual sensors and / or all sensors in the controllable functional interior device object can preferably be omitted. The evaluation device is particularly designed in such a way that it can replace certain sensors in the device object.
[0063] It is therefore possible to dispense with a proximity sensor, which would otherwise have to be provided for triggering the function, specifically in the case of access doors.
[0064] The evaluation device may be designed in such a way that it can distinguish in the vehicle interior at least three different types of interior device objects, namely non-functional, functional and controllable functional interior device objects.
[0065] The requirements placed on the evaluation device, in particular on the evaluation algorithm provided, are extremely important, since, depending on the type of interior furniture object, specific error images occur which are suitable for distinguishing and identifying the interior furniture object.
[0066] Thus, for example, a non-functional interior furnishing object cannot have a technical function, since it is regarded as non-functional.
[0067] The evaluation device must also be able to distinguish between typically occurring operating deviations and deviations between target and actual states in the case of malfunctions.
[0068] Operating deviations are, for example, those which are caused by the interaction of passengers and / or transported goods with interior equipment objects.
[0069] Passengers and / or transported goods can, for example, cover parts of the interior equipment object. In this case, it is a common and operationally determined deviation between the theoretical state and the actual state, wherein the analysis device should not infer an undesirable deviation or the existence of a deviation worth checking.
[0070] The image capture device is preferably a known and customary video camera which is used in a customary manner for monitoring the interior of a vehicle, in particular for monitoring people, and has a medium to high resolution.
[0071] The resolution is preferably sufficient for sensing objects which are small per se with a precision sufficient for the purpose of the application.
[0072] If the evaluation device determines a deviation between the setpoint state and the actual state, a notification is preferably displayed on a display device and / or multiple display devices for displaying status information. The process is triggered by the evaluation device. The content of the notification, more precisely the message contained, is also determined by the evaluation device.
[0073] This notification is shown, for example, on a display device in the immediate vicinity of the vehicle driver.
[0074] However, it is particularly preferred that the notification is displayed on another display device located in the vehicle interior. Here, it can be a fixed, non-moving display device that is arranged in the vehicle interior.
[0075] Alternatively, however, it may be a movable display device which is located in the vehicle interior or which is brought into the vehicle interior by maintenance personnel. In particular, it may be a mobile device.
[0076] Preferably, the notification contains information about the type of deviation. The type of deviation is understood to be, in particular, a detailed description of the deviation, for example, that the functional device object has a malfunction and what type of malfunction this is.
[0077] Furthermore, the notification preferably displays an identification mark and / or a position of the device object in the vehicle interior.
[0078] An identification is understood to mean, for example, an alphanumeric assignment of an interior fitting object.
[0079] An identical assignment is preferably used for the position of the device object in the vehicle interior.
[0080] This is particularly advantageous when it comes to vehicles with a large number of interior device objects, which, for example in the case of rail vehicles, are distributed over a large volume in the vehicle interior. In addition, a processing instruction is preferably displayed that shows how deviations, in particular malfunctions, can be eliminated.
[0081] It is also preferred that the evaluation device sends information to the operating center when relevant deviations between the target state and the actual state are determined. Preferably, the included information is determined by the evaluation device.
[0082] For this purpose, information is transmitted wirelessly between the vehicle and the operating center.
[0083] The information includes a vehicle identification, wherein each vehicle has its own, individual identification, which is, for example, alphanumeric. The information also includes the vehicle position, wherein the vehicle position is acquired at the time of determining the deviation. The vehicle position is acquired in particular by means of a position determination device, such as a GPS. However, other means for position determination may also be used.
[0084] The device can be based on wireless triangulation technology (Triangulation) or on real-time RFID (radio-frequency identification) technology. In addition, the information includes, for example, an identification mark and / or the position of the interior device object in the vehicle interior.
[0085] Preferably, the vehicle interior is used only for the transport of passengers and / or transport goods.
[0086] However, it is particularly preferably a passenger compartment which is typically present in rail vehicles.
[0087] The preceding description relates both to the claimed method and to the claimed vehicle.
[0088] Preferably, the evaluation device is permanently activated. This means that the state of the vehicle interior is monitored both during operation of the vehicle and outside of operation, for example during overnight parking of the vehicle.
[0089] However, it is particularly preferred that the evaluation unit is only active during operation of the vehicle.
[0090] This has the advantage that the energy consumption of the vehicle is reduced.
[0091] Particularly during parking times at night, the vehicle interior lighting must be activated, since conventional video cameras, which are also used for monitoring personnel, are generally not suitable in the dark.
[0092] If the evaluation device is inactive, the claimed method for monitoring an interior is not activated.
[0093] The preceding description relates not only to the claimed method but also to the claimed vehicle.
[0094] Furthermore, the evaluation device may be arranged outside the vehicle. The external evaluation device may be, for example, an application based on cloud computing.
[0095] For this purpose, image data from an image capture device in the vehicle interior are transmitted to the external device for evaluation and are evaluated by the external device in accordance with the above-described specific embodiments. BRIEF DESCRIPTION OF THE DRAWINGS
[0096] Further embodiments and advantages of the invention will become apparent from the following description with reference to the drawings.
[0097] Here, the accompanying drawings show:
[0098] Figure 1 : A vehicle having an interior room state monitoring device according to a preferred embodiment of the present invention.
[0099] Figure 2 : Schematic illustration of a device for analyzing and processing image data.
[0100] Figure 3 : Schematic illustration of a device for displaying status information.
[0101] Figure 4 : Schematic illustration of a message telegram for transmitting information about the status of an interior compartment to an operations center.
[0102] Figure 5 : Schematic illustration of a flow chart for detecting deviations of an interior device object according to a preferred embodiment of the present invention.
[0103] The same reference numerals below indicate elements having the same or similar technical features. DETAILED DESCRIPTION
[0104] Figure 1 A vehicle 1 is shown with an interior condition monitoring device according to a preferred embodiment of the invention. The vehicle 1 is arranged in a vehicle complex, as is typically found in rail vehicles, in particular track vehicles. In this exemplary embodiment, the vehicle complex consists of a first vehicle 1 and a second vehicle 1 '. The first vehicle 1 and the second vehicle 1 ' are equipped with the same evaluation device 9. This is indicated by the prime character "'" in the reference numerals.
[0105] The vehicle 1 has a vehicle interior 3 which is used for the accommodation of passengers and / or the transportation of transport goods.
[0106] The vehicle interior 3 is equipped with a plurality of interior device objects 2 , 21 , 22 .
[0107] Some of the interior equipment objects 2, 21, 22 are seats, such as ordinary seats 2, or chairs (not shown). Other interior equipment objects 2, 21, 22 are functional seats, such as flip seats 21 and / or other functional equipment objects, such as doors 22.
[0108] Furthermore, a camera 4 is arranged in the vehicle interior 3 , which serves to monitor persons.
[0109] Furthermore, a multifunctional camera 41 is used which is able to perform additional functions, such as measuring the vehicle interior temperature.
[0110] The vehicle 1 is equipped with a plurality of display means 5 , 51 . The display means 5 , 51 are also located in the driver's console and are designed in the form of a driver display 5 , wherein the driver display is used to display information for a driver 6 of the vehicle.
[0111] The vehicle interior 3 also has a display device 5, 51 implemented in the form of a monitor. The monitor 51 is used as a display device 5, 51 for displaying passenger information. However, it is also possible to display process and / or status information of the vehicle 1 and / or status information of the vehicle interior 3 on the monitor 51 during inspection work by maintenance personnel.
[0112] The maintenance personnel can also bring a mobile device (not shown) into the vehicle interior 3 , which displays information about the state of the vehicle interior 3 and / or further process and / or state information of the vehicle 1 to the maintenance personnel.
[0113] Furthermore, the vehicle 1 has a multifunctional transmitting and receiving device 7 . The multifunctional transmitting and receiving device is used for wireless data transmission 71 to an operating center 8 , wherein status information is transmitted.
[0114] The multifunctional transmitting and receiving device 7 is also designed in such a way that it receives the position signal 111 of the global navigation satellite system 11 .
[0115] The vehicle 1 is also equipped with an evaluation device 9 according to the invention.
[0116] A plurality of the above-described components are connected to a communication bus system 10, wherein a plurality of the components exchange data and / or control signals via the communication bus 10. In this case, the door 22, the image capture devices 4, 41, the display devices 5, 51, the communication device 7 and the evaluation device 9 are communicatively connected to one another via the communication bus system 10, so that at least these components exchange data and / or control signals.
[0117] The communication bus system 10 is a communication network having a plurality of subnetworks (not shown) which are aggregated to a specific node 102 .
[0118] Furthermore, such a subnetwork is formed in order to separate a safety-critical communication network (not shown) from a non-safety-critical communication network.
[0119] The communication network and / or subnetwork from the first vehicle 1 is also connected to the communication network of the second vehicle 1 ′ via corresponding connecting devices 101 , which enables the exchange of data and / or control signals between the vehicles 1 , 1 ′ of the vehicle assembly.
[0120] Non-functional seats 2 , 21 are incorporated into vehicles, in particular vehicles for transporting passengers and / or goods.
[0121] Nevertheless, at least parts of the seat 2 , 21 have movable elements, as is the case in the case of a tiltable seat 21 .
[0122] A further interior device object 2 , 21 , 22 is a door 22 which separates the vehicle interior 3 from other areas, such as a toilet (not shown).
[0123] The door has a mechanism which opens and / or closes the door 22 .
[0124] The mechanism for opening and / or closing the door 22 is activated by an operating mechanism, such as a switch. Once a passenger approaches the door, the door 22 also opens automatically, and once a passenger passes through the door 22, the door closes.
[0125] The aforementioned mechanisms are subject to wear, which can lead to malfunctions whereby the door does not fully open and / or close.
[0126] With the exception of certain interior areas, the entire vehicle interior 3 is captured by means of the cameras 4 , 41 .
[0127] Areas, such as restrooms, are not equipped with cameras. Nevertheless, it is possible that once the door is fully opened, the camera senses these areas or senses at least parts of these areas.
[0128] This enables status sensing of these areas even if no camera 4 , 41 is arranged in this specific area.
[0129] The image data of cameras 4 , 41 are transmitted via communication bus system 10 to other bus members, for example to evaluation device 9 .
[0130] The image data are sent to a video recorder (not shown) and / or to the driver display 5 .
[0131] It is also possible for the operation center 8 to consult the image data of the cameras 4, 41 via the wireless data transmission 71 and the communication bus system 10. In addition, the image data of the cameras 4, 41 are transmitted directly to the operation center.
[0132] exist Figure 2 FIG. 4 schematically shows a device according to the invention for evaluating image data.
[0133] The evaluation device 9 is composed of a communication unit 91 for receiving and sending data from a communication bus. In addition, the evaluation device has a storage unit 92, which contains reference data about the vehicle interior 3. In addition, there is a comparison unit 93, which compares the image data of the camera 4, 41 with the reference data of the storage unit 92.
[0134] An evaluation unit 94 is also provided, which is designed such that deviations are determined between the image data and the reference data of the cameras 4, 41. Furthermore, an event unit 95 is used which carries out a number of reactions if a deviation is determined.
[0135] The aforementioned subunits 91 , 92 , 93 , 94 , 95 are designed in such a way that they interact with each other and form the device 9 .
[0136] The evaluation device 9 is connected to the communication bus system 10 via a communication unit 91. The communication unit receives the image data from the cameras 4, 41 and processes them accordingly. The image data are provided with a time stamp and are buffered.
[0137] The communication unit has a buffer (not shown). This buffer is required for temporarily buffering incoming image data from a plurality of cameras before further processing of these image data. Further units, in particular the comparison unit 93, consult this buffer.
[0138] The memory unit 92 contains reference data about the vehicle interior 3 , which are stored in a non-volatile memory. These reference data are essentially image data and other data representing the target state of the vehicle interior 3 and / or the interior device objects 2 , 21 , 22 .
[0139] A target state is understood to be a vehicle interior 3 and / or an interior device object 2 , 21 , 22 which has neither wear symptoms nor malfunctions.
[0140] The reference data are generated during the commissioning of vehicle 1 , in which an image photograph of vehicle interior 3 is stored in memory unit 92 together with other required data.
[0141] The comparison unit 93 refers to the image data of the cameras 4 , 41 from the buffer of the communication unit 91 and compares the image data with the reference data from the storage unit 92 .
[0142] For this purpose, a typical superposition method belonging to the prior art is used. The result of this superposition is negative image information, which only contains the sum of the deviations. For the superposition method, it should also be emphasized here that multiple cameras 4, 41 capture image portions of the same area of the vehicle interior 3.
[0143] The comparison unit 93 has the necessary functionality to produce a composite overall image from a plurality of different images of the same imaged area.
[0144] Similar methods exist in a number of currently commonly used image capture devices, such as digital SLR cameras.
[0145] The evaluation unit 94 evaluates the negative image information of the comparison unit 93 .
[0146] The result of this analysis is whether there is a relevant deviation between the theoretical state and the actual state of the interior equipment object 2, 21, 22. Here, the analysis unit 94 distinguishes whether the deviation is an operationally induced deviation or a deviation attributable to wear and / or malfunction of the interior equipment object 2, 21, 22.
[0147] Operation-related deviations are in particular those caused by the passengers and their interaction with interior furnishing objects 2, 21, 22. If passengers cover parts of interior furnishing objects 2, 21, 22, this leads to a deviation between the target state and the actual state during the detection.
[0148] This state is to be expected under normal operating conditions and does not lead to an erroneous interpretation between the setpoint state and the actual state in the event of a certain deviation. The evaluation unit 94 has the necessary functionality for distinguishing between these states.
[0149] In addition, the evaluation unit 94 has a function for recognizing the movement or movement profile of the passenger. This movement profile is used to recognize whether the passenger approaches the door 22 to pass through the door.
[0150] The event unit 95 carries out possible reactions based on the results of the evaluation unit 94 .
[0151] If relevant deviations are detected, the event unit 95 sends a message to the driver display 5 or the operating center 8 via the communication bus system 10. Events occurring on the monitor 51 in the interior 3 of the vehicle 1 can also be accessed by maintenance personnel.
[0152] If it is determined on the basis of the movement profile that the passenger wishes to change to another area and therefore approaches door 22 , event unit 95 sends a control command to the mechanism of door 22 .
[0153] Figure 3 The schematic illustration shows means for displaying status information, in particular driver display 5 .
[0154] The driver display 5 is divided into two display areas 52 , 53 .
[0155] A first display area 52 is provided for displaying process data of the vehicle, and a second display area 53 is provided for displaying status information.
[0156] The display device is also equipped with an input device 54, such as a mechanical keyboard or a touch sensitive area.
[0157] Relevant process data of the vehicle 1 , such as the vehicle speed, are displayed in the first display area 52 . The second display area 53 is used to display status information about the vehicle 1 and / or its surroundings. This status information is not limited to status information about the vehicle interior 3 .
[0158] However, if a relevant deviation has been determined by the evaluation device 9 , this deviation is communicated to the vehicle driver 6 in the display area provided for this purpose for the status information 53 .
[0159] This information contains at least the type of the determined deviation, ie which interior fitting object 2 , 3 , 22 or which function of the interior fitting object 2 , 3 , 22 does not correspond to the target state.
[0160] Furthermore, identification marks of interior fitting objects 2 , 21 , 22 and / or positions of interior fitting objects 2 , 21 , 22 in vehicle interior 3 are shown, wherein the vehicle 1 , 1 ′ in the vehicle assembly is also listed.
[0161] An identification is understood to be an unmistakable label and assignment of an interior fitting object 2 , 21 , 22 . If the deviation can also be corrected by the vehicle driver 6 or maintenance personnel, the information also contains instructions for correcting the deviation.
[0162] Obviously, this indication can also be read on another display device 5 , 51 or a mobile device (not shown) in the vehicle interior 3 , in order to enable maintenance personnel to carry out a time-saving identification of the interior device objects 2 , 21 , 22 that are subject to deviations.
[0163] Figure 4 A schematic illustration of a message telegram 72 for transmitting status information of vehicle interior 3 to operating center 8 is shown.
[0164] The multifunctional transmitting and receiving device 7 of the vehicle 1 , like a transmitting and receiving device of a communicating partner (not shown), has all the layers of the conventional OSI model.
[0165] The structure of the message will be examined in more detail below in order to show which information is sent to the operations center 8 .
[0166] The message telegram 72 has the form of a message telegram 72 typically suitable for wireless communication.
[0167] The message telegram 72 consists of a preamble 73 for synchronization, followed by a so-called starting frame delimiter 74, which signals the start of the following packet element. The telegram also contains identifications of a receiver 75 and a sender 76. The receiver of such a message is the operations center 8, wherein, if there are a plurality of operations centers, the message is sent to the preferred operations center.
[0168] Furthermore, the type field 77 defines which type of message is involved. If the communication is not limited to messages about the status of interior device objects 2, 21, 22, then the type field specifies that a message type different from the preferred message type is involved and contains additional data that are not the starting point of the evaluation device 9.
[0169] The so-called usage data follows the type field 77. The usage data segment 78 in turn consists of a plurality of subsegments 781 to 786.
[0170] The usage data segment 78 contains at least a vehicle identification mark 781, a vehicle position 782, an identification mark 783 of an interior device object 2, 21, 22, a position 784 of the interior device object 2, 21, 22 in the vehicle interior 3, a timestamp of an event 785, and additional data 786 which are not described in detail.
[0171] In this case, particular emphasis is placed on vehicle position 782 , which is detected with the aid of position signal 111 and multifunctional transmitting and receiving device 7 .
[0172] If a relevant deviation between the setpoint state and the actual state has been detected, the information about the identification mark 783 and the position 784 of the interior fitting object 2 , 21 , 22 corresponds to the information shown on the driver display 5 .
[0173] The message telegram 72 has at its end an area for a cyclic redundancy check, CRC 79 for short.
[0174] Figure 5 A schematic illustration of a flow chart is shown which illustrates how deviations of interior fitting objects 2 , 21 , 22 are detected based on a method according to one embodiment of the invention.
[0175] As soon as the vehicle 1 is put into operation, the implementation of the method for monitoring the vehicle interior 3 automatically begins 961. When the vehicle 1 stops operating, the method ends 969.
[0176] After monitoring starts 961, the evaluation device 9 receives image data from the camera 4, 41 via the communication bus system 10 and compares 962 the image data with reference data representing the desired state of the vehicle interior 3 and / or of the interior device objects 2, 21, 22 of the vehicle interior. The comparison is performed repeatedly until the subsequent evaluation 963 determines the relevant deviation between the desired state and the actual state of the interior device objects 2, 21, 22.
[0177] If a relevant deviation has been determined, an event 965 is triggered by the evaluation device 9 , which leads to a display 966 of information on the driver display 5 of the vehicle driver 6 and / or to the sending 967 of a message to the operating center 8 .
[0178] The execution of the method does not terminate with the triggering of an event. Rather, all entities that can contribute to eliminating the deviation are informed of the deviation.
[0179] The entity is both the vehicle driver 6 and the operation center 8 and / or maintenance personnel (not shown).
[0180] After displaying 966 , 968 and / or after sending 967 the information to the operating center 8 , the method continues with a comparison 962 of the image data.
Claims
1. A method for monitoring the interior state of a vehicle (1), comprising the following features: - at least one interior device object (2, 21, 22), wherein The interior device object is arranged in the interior of a vehicle (3), at least one image sensor (4, 41) for monitoring the vehicle interior (3), wherein the image sensor (4, 41) is arranged in the vehicle interior (3), - an evaluation device (9) for evaluating the image data of the image capture device (4, 41), wherein the evaluation device (9) receives the image data of the image capture device (4, 41), The evaluation comprises the evaluation device (9) detecting an actual state of the interior device object (2, 21, 22) with the aid of the image data, comparing the actual state with a theoretical state of the interior device object (2, 21, 22) and determining the deviation if a deviation exists. The interior equipment objects (2, 21, 22) include doors, and the analysis and processing device (9) can control the door to open when it is recognized that a passenger is approaching the door based on the analysis and processing of the image data.
2. The method according to claim 1, characterized in that In a contrast unit (93) of an analysis and processing device (9), image data and reference data from a storage unit (92) of the analysis and processing device (9) are superimposed to generate negative image information, which contains only the deviation between the image data and the reference data. By analyzing features in the negative image information, including contrast, shape and / or color, the deviation between a theoretical state and an actual state is sensed.
3. The method according to claim 2, characterized in that The analysis device (9) is capable of distinguishing, based on the analysis result of the negative image information, operating deviations that do not constitute functional failures, deviations due to wear of the interior device objects (2, 21, 22) and / or deviations due to functional failures of the interior device objects (2, 21, 22).
4. The method according to any one of claims 1 to 3, characterized in that The analysis device (9) is provided with an analysis unit (94) for determining a deviation between the image data and reference data, wherein the analysis unit (94) is configured to be able to identify a movement profile of a passenger for identifying whether the passenger approaches a door to pass through the door; The evaluation device (9) is also provided with an event unit (95) which sends a control command to open the door if it is detected by means of the movement profile that a passenger approaches the door in order to pass through the door.
5. The method according to claim 1, characterized in that: The interior fitting objects (2, 21, 22) are functional interior fitting objects (21, 22) which are subject to wear and / or may have functional faults.
6. The method according to claim 1, characterized in that The controllable functional interior device object (22) is controlled exclusively by the evaluation device (9) for evaluating the image data.
7. The method according to claim 1, characterized in that The method for monitoring the interior state is carried out during operation of the vehicle (1) or only during operation of the vehicle (1).
8. The method according to claim 1, characterized in that When a deviation from the target state is determined, a message appears on a display device (5, 51) for displaying state information.
9. The method according to claim 8, characterized in that The notification shall contain at least the following information: - the type of deviation; - an identification mark of the interior device object (2, 21, 22) and / or a position in the vehicle interior (3); - instructions for eliminating said deviation.
10. The method according to claim 1, characterized in that If a deviation is detected, information is sent to the operating center (8).
11. The method according to claim 10, characterized in that The message about the deviation contains at least the following characteristics: - Vehicle identification mark; - vehicle location; - an identification of the interior device object (2, 21, 22) and / or a position in the vehicle interior (3).
12. The method according to claim 1, characterized in that The vehicle interior (3) is a passenger interior.
13. The method according to claim 1, characterized in that The image capture device (4, 41) in the vehicle interior (3) is a video camera which is used to monitor persons.
14. A vehicle (1) having an interior state monitoring device, comprising: at least one interior equipment object (2, 21, 22), wherein the interior equipment object (2, 21, 22) is arranged in the interior of a vehicle (3), at least one image sensor (4, 41) for monitoring the vehicle interior (3), wherein the image sensor (4, 41) is arranged in the vehicle interior (3), - an evaluation device (9) for evaluating image data of the image capture device (4, 41), wherein the evaluation device (9) receives the image data from the image capture device (4, 41), wherein the evaluation device (9) is configured to determine an actual state of the interior device object (2, 21, 22) using the image data, to compare the actual state with a target state of the interior device object (2, 21, 22) and, if a deviation exists, to determine the deviation. The interior equipment objects (2, 21, 22) include doors, and the analysis and processing device (9) can control the door to open when it is recognized that a passenger is approaching the door based on the analysis and processing of the image data.
15. The vehicle (1) according to claim 14, characterized in that In a contrast unit (93) of an analysis and processing device (9), image data and reference data from a storage unit (92) of the analysis and processing device (9) are superimposed to generate negative image information, which contains only the deviation between the image data and the reference data. By analyzing features in the negative image information, including contrast, shape and / or color, the deviation between a theoretical state and an actual state is sensed.
16. The vehicle (1) according to claim 14, characterized in that The analysis device (9) is capable of distinguishing, based on the analysis result of the negative image information, operating deviations that do not constitute functional failures, deviations due to wear of the interior device objects (2, 21, 22) and / or deviations due to functional failures of the interior device objects (2, 21, 22).
17. The vehicle (1) according to any one of claims 14 to 16, characterized in that The analysis device (9) is provided with an analysis unit (94) for determining a deviation between the image data and reference data, wherein the analysis unit (94) is configured to be able to identify a movement profile of a passenger for identifying whether the passenger approaches a door to pass through the door; The evaluation device (9) is also provided with an event unit (95) which sends a control command to open the door if it is detected by means of the movement profile that a passenger approaches the door in order to pass through the door.
18. The vehicle (1) according to claim 14, characterized in that The evaluation device (9) is active during operation of the vehicle or is active only during operation of the vehicle.
19. The vehicle (1) according to claim 14, characterized in that The interior fitting objects (2, 21, 22) are functional interior fitting objects (21, 22) which are subject to wear and / or may have functional faults.
20. The vehicle (1) according to claim 19, characterized in that The controllable functional interior device object (22) is controlled exclusively by the evaluation device (9) for evaluating the image data.
21. The vehicle (1) according to any one of claims 14-16, 18-20, characterized in that The vehicle interior (3) is a passenger interior.
22. The vehicle (1) according to any one of claims 14-16, 18-20, characterized in that The vehicle is a rail vehicle.
23. The vehicle (1) according to any one of claims 14-16, 18-20, characterized in that The image capture device (4, 41) in the vehicle interior (3) is a video camera which is used to monitor persons.
Citation Information
Patent Citations
Method for diagnosing error with component of rail vehicle, involves detecting error of component of rail vehicle by diagnostic device
DE102009012919A1
Automatic door device
JP2006225874A
Monitoring and controlling apparatus
JP2008182341A
Partition door opening / closing control device for rail vehicles
KR2019960014215U
Method and arrangement for monitoring current collectors and horizontal and vertical contact wire position on vehicle combinations
US20120274759A1
