Information processing system integrating vehicle image

Abstract

The utility model relates to an information processing system integrating vehicle machine images. The information processing system comprises driving recording equipment and central control equipment, the driving recording equipment is provided with a camera shooting unit, a display unit, a first transmission interface, a second transmission interface and a first processing unit, and the first processing unit is connected to the camera shooting unit, the display unit, the first transmission interface and the second transmission interface; the central control device is provided with a third transmission interface, a fourth transmission interface and a second processing unit, the second processing unit is connected to the positioning unit, the third transmission interface is connected to the first transmission interface, the fourth transmission interface is connected to the expansion device, and the second processing unit receives external information of the expansion device. The second processing unit transmits external information to the driving recording equipment; the first processing unit stacks the external information on the driving image.

Description

TECHNICAL FIELD

[0001] The present application relates to an information processing system of an electronic device, and more particularly to an information processing system integrating vehicle camera images. BACKGROUND

[0002] With the rapid development of technology, the size of digital image capturing devices can be more miniaturized, and the image quality captured can be improved. Therefore, more manufacturers apply the image capturing devices to vehicle recording. During the driving process, the vehicle images are recorded in real time and stored in the image capturing device. Storing the vehicle images in a single location cannot meet the requirements of off-site backup. When a vehicle accident occurs, the image capturing device may be damaged, thereby failing to successfully obtain the images of the accident. SUMMARY

[0003] Therefore, in an embodiment, the information processing system integrating vehicle camera images includes a vehicle recording device and a central control device. The vehicle recording device has an image capturing unit, a display unit, a first transmission interface, a second transmission interface, and a first processing unit. The first processing unit is connected to the image capturing unit, the display unit, the first transmission interface, and the second transmission interface. The image capturing unit captures vehicle images. The central control device has a third transmission interface, at least one fourth transmission interface, and a second processing unit. The second processing unit is connected to the third transmission interface and the fourth transmission interface. The third transmission interface is connected to the first transmission interface. The fourth transmission interface is connected to an expansion device. The second processing unit receives external information of the expansion device through the fourth transmission interface. The second processing unit transmits the external information to the vehicle recording device through the third transmission interface. The first processing unit superimposes the external information on the vehicle images.

[0004] The information processing system integrating vehicle camera images integrates other expansion devices carried by the vehicle carrier into the vehicle recording device through the central control device, so that the vehicle recording device can display the external information of the expansion device while recording the vehicle images. For the driver, in addition to being able to view the relevant information of each expansion device in real time, the relevant information of the vehicle carrier and the expansion device during the driving process can also be recorded.

[0005] In an embodiment, the central control device further includes a positioning unit. The second processing unit is connected to the positioning unit. The positioning unit obtains position information.

[0006] In an embodiment, the second processing unit transmits the position information to the vehicle recording device through the third transmission interface.

[0007] In an embodiment, the first processing unit selects the external information, the position information, or a combination thereof, and superimposes the selected information on the vehicle images to generate a composite image. The first processing unit drives the display unit to display the composite image.

[0008] In an embodiment, the second processing unit acquires the plurality of pieces of position information or the plurality of pieces of external information of the preset time frame, and generates compressed information according to the acquired position information or external information.

[0009] In an embodiment, the mobile communication device is connected to the second transmission interface of the driving record device and the fifth transmission interface of the central control device, the mobile communication device is connected to the first server according to the second transmission interface, the mobile communication device is connected to the second server according to the fifth transmission interface, the mobile communication device transmits the driving video to the first server, and the mobile communication device transmits the position information to the second server.

[0010] In an embodiment, the second processing unit acquires the plurality of pieces of position information or the plurality of pieces of external information of the preset time frame, and generates compressed information according to the acquired position information or external information, and the second processing unit transmits the compressed information to the second server through the fifth transmission interface and the mobile communication device.

[0011] In an embodiment, the first transmission interface matches the third transmission interface, the first transmission interface is RS-232 protocol, RS-423 protocol, RS-449 protocol, RS-485 protocol or control area network protocol, the second transmission interface is universal serial bus protocol, the fourth transmission interface is RS-232 protocol, RS-423 protocol, RS-449 protocol or RS-485 protocol, and the fifth transmission interface is universal asynchronous receiver-transmitter protocol or integrated circuit circuit protocol.

[0012] In an embodiment, the extension device is a temperature measuring device, a throttle detection device, a light detection device, a wiper detection device or a door and window detection device.

[0013] The information processing system for integrating driving video provides a processing system for integrating driving video and external information, so that the driver can watch the synthesized image of the driving video and the external information in real time during driving. In addition, the processing system can upload the synthesized image to a designated server for a third-party client to watch the synthesized image. BRIEF DESCRIPTION OF DRAWINGS

[0014] Figure 1 The scene schematic diagram of the information processing system for integrating driving video of an embodiment;

[0015] Figure 2 The schematic diagram of the information processing system for integrating driving video of an embodiment;

[0016] Figure 3 The flowchart of the information processing method for integrating driving video of an embodiment;

[0017] Figure 4 FIG. 1 is a schematic diagram of a vehicle image, external information, and a synthesized image according to an embodiment;

[0018] Figure 5 FIG. 2 is a schematic diagram of a vehicle image and external information according to an embodiment;

[0019] Figure 6 FIG. 3 is a schematic diagram of a vehicle image, external information, and a synthesized image according to another embodiment;

[0020] Figure 7 FIG. 4 is a schematic diagram of an information processing system that integrates a vehicle image according to another embodiment;

[0021] Figure 8 FIG. 5 is a schematic diagram of an interval time and a preset time frame according to an embodiment.

[0022]

Symbol Description

[0023] 100: processing system

[0024] 110: vehicle recording device

[0025] 111: image capturing unit

[0026] 112: display unit

[0027] 113: first transmission interface

[0028] 114: second transmission interface

[0029] 115: first processing unit

[0030] 120: central control device

[0031] 121: third transmission interface

[0032] 122: fourth transmission interface

[0033] 123: second processing unit

[0034] 124: positioning unit

[0035] 125: fifth transmission interface

[0036] 130: expansion device

[0037] 140: vehicle carrier

[0038] 151: vehicle image

[0039] 152: synthesized image

[0040] 153: external information

[0041] 154: position information

[0042] 155: compressed information

[0043] 160: mobile communication device

[0044] 171: first server

[0045] 172: second server

[0046] 611: refrigeration device

[0047] 612: temperature measuring device

[0048] t: interval time

[0049] T: preset time frame

[0050] S310, S320, S330, S340: step DETAILED DESCRIPTION

[0051] Reference is made to Figure 1 with Figure 2 Fig. 1 shows a scene diagram of an embodiment of an integrated vehicle image information processing system 100 and Fig. 2 shows a diagram of an embodiment of the integrated vehicle image information processing system 100. The integrated vehicle image information processing system 100 (referred to as processing system 100) can be configured in a vehicle carrier 140, such as a car, truck, or motorcycle. The processing system 100 includes a driving record device 110, a central control device 120, and an extension device 130. The central control device 120 is electrically connected to the driving record device 110 and the extension device 130.

[0052] The driving record device 110 has a camera unit 111, a display unit 112, a first transmission interface 113, a second transmission interface 114, and a first processing unit 115. The first processing unit 115 is connected to the camera unit 111, the display unit 112, the first transmission interface 113, and the second transmission interface 114. The camera unit 111 is used to capture driving images 151 of the vehicle carrier 140. The driving images 151 refer to digital images recorded by the vehicle carrier 140 in an operating state, including states such as the vehicle carrier 140 traveling or pausing. The type of the first transmission interface 113 can be, but is not limited to, RS-485, RS-422, Inter-Integrated Circuit (I2C), Controller Area Network (CAN), or Serial Peripheral Interface (SPI). The type of the second transmission interface 114 is Universal Serial Bus (USB). The second transmission interface 114 is used to connect external electronic devices.

[0053] For the vehicle recording device 110 with multiple camera units 111, different camera units 111 can be configured at different locations of the vehicle carrier 140 to capture digital images of different parts of the vehicle carrier 140. For the convenience of explanation, a single camera unit 111 is used for illustration and is configured to capture images of the front of the vehicle carrier 140. In practice, the images captured by the single camera unit 111 can be applied to the implementation of the multiple camera units 111. The display unit 112 is configured to display the driving images 151 captured by the camera unit 111 or other information.

[0054] The central control device 120 receives information related to the vehicle recording device 110 and the expansion device 130, and the central control device 120 can also control the operation of the expansion device 130. The central control device 120 has a third transmission interface 121, at least one fourth transmission interface 122, and a second processing unit 123. The second processing unit 123 is connected to the third transmission interface 121 and the fourth transmission interface 122. The third transmission interface 121 is connected to the first transmission interface 113 of the vehicle recording device 110. The second processing unit 123 receives information related to the vehicle recording device 110 through the third transmission interface 121, and can also send operation requirements to the vehicle recording device 110 to obtain corresponding operation results.

[0055] The third transmission interface 121 matches the first transmission interface 113. The fourth transmission interface 122 is connected to the expansion device 130. The type of the fourth transmission interface 122 is RS-485 or RS-422. The expansion device 130 can be an electronic device carried by the vehicle carrier 140 or an external electronic device. The type of the expansion device 130 can be, but is not limited to, a temperature measuring device 612, a throttle detection device, a light detection device, a wiper detection device, or a door and window detection device. The second processing unit 123 can obtain information related to the expansion device 130 through the fourth transmission interface 122, and the information returned by the expansion device 130 is collectively referred to as external information 153.

[0056] For the convenience of explanation of the operation flow of the processing system 100, please refer to Figure 3 for a flowchart of an embodiment of an integrated vehicle image information processing method. The integrated vehicle image information processing method includes the following steps:

[0057] Step S310: The vehicle recording device captures driving images;

[0058] Step S320: The central control device receives external information of the expansion device;

[0059] Step S330: The central control device sends external information to the vehicle recording device; and

[0060] Step S340: The driving recorder superimposes the external information on the driving video.

[0061] When the vehicle 140 is in operation, the driving recorder 110 and the central control device 120 are enabled. When the driving recorder 110 is in operation, the camera unit 111 captures the driving video 151 (corresponding to step S310), and the display unit 112 displays the driving video 151. At the same time, the central control device 120 receives the external information 153 of each of the extension devices 130 (corresponding to step S320).

[0062] The central control device 120 sends the external information 153 to the driving recorder 110 through the third transmission interface 121 (corresponding to step S330). The external information 153 can be the speed, the gear display, the fuel consumption information, the instantaneous fuel consumption / average fuel consumption, the cruising range, the mileage, the tire pressure monitoring, the hand brake status, the door status, the engine water temperature, the battery voltage, the oil pressure, the remaining oil life, the engine operation time, the vehicle load status, the engine running time, the cruise control, the adaptive cruise control, the driving mode, the automatic brake system, the headlight status, the fog lamp switch, the turn signal / warning light, the interior light, the power window status, the sunroof status, the wiper status, the vehicle fault code, the battery health, the spark plug status, the transmission temperature, the turbo pressure, or the catalytic converter temperature, etc.

[0063] After the driving recorder 110 acquires the external information 153, the first processing unit 115 superimposes the external information 153 on the driving video 151, and forms a composite video 152 after superimposition (corresponding to step S340). Please refer to Figure 4 and Figure 5 , which are a schematic diagram of the driving video 151, the external information 153, and the composite video 152 of an embodiment, and a schematic diagram of superimposing the external information 153 and the driving video 151 of an embodiment. It is assumed that the central control device 120 acquires the information of the turn signal, the speed, and the positioning system of the vehicle 140 as the external information 153. In Figure 4 , the driving recorder 110 captures the image of the vehicle in front of the vehicle 140 (i.e., the driving video 151).

[0064] Then, the central control device 120 sends the external information 153 to the driving recorder 110. The first processing unit 115 superimposes the external information 153 on the driving video 151, please refer to Figure 5 . The first processing unit 115 generates the composite video 152 according to the external information 153 and the driving video 151, and drives the display unit 112 to display the composite video 152, please refer to Figure 4 . Figure 4The composite image 152 contains location information 154 including "driving image", "left turn" light, "vehicle speed" and "GPS".

[0065] Apart from Figure 4 In addition to the content of the composite image 152, the external information 153 can also be the temperature measuring device 612 or other peripheral electronic devices. Please refer to... Figure 6 This is a schematic diagram of another composite image 152 according to one embodiment. Assume the vehicle 140 is further equipped with a refrigeration unit 611, and multiple temperature measuring devices 612 (i.e., expansion devices 130) are arranged around the refrigeration unit 611. The central control unit 120 is connected to the temperature measuring devices 612 via a fourth transmission interface 122. The central control unit 120 can poll each temperature measuring device 612 to obtain the temperature detected by each device (corresponding to external information 153). The central control unit 120 transmits the external information 153 to the driving recorder 110, causing the display unit 112 of the driving recorder 110 to play the external information 153. Furthermore, the first processing unit 115 can also overlay the external information 153 with the driving image 151 to generate a composite image 152.

[0066] Figure 6 The composite image 152 shows the driving image 151 captured by the camera unit 111 above and external information 153 below. The display unit 112 displays the temperature detected by each temperature measuring device 612. Assuming that the "temperature measuring device 612_3" does not transmit external information 153, the "external information 153" for the "temperature measuring device 612_3" in the composite image 152 is indicated by "----" to indicate no information, thereby alerting the driver that the temperature at that location is abnormal. If the central control device 120 does not receive the "external information 153" from the "temperature measuring device 612_3" after a preset time, the first processing unit 115 can send a warning signal to the driving recorder 110 via the third transmission interface 121. The first processing unit 115 then drives the display unit 112 to play corresponding prompt information based on the warning signal.

[0067] In some embodiments, the central control device 120 further includes a positioning unit 124. Please refer to [reference needed]. Figure 7 The second processing unit 123 is connected to the positioning unit 124. The positioning unit 124 can obtain the location information 154 of the vehicle 140 through Global Positioning System (GPS). The second processing unit 123 sends the location information 154 to the driving recorder 110 through the third transmission interface 121. The first processing unit 115 can select external information 153, location information 154, or a combination thereof, and overlay the selected information onto the driving image 151. Please refer to [reference needed]. Figure 4In other words, the first processing unit 115 can select either the external information 153 or the location information 154, or both.

[0068] In some embodiments, the control device 120 encapsulates and generates the compressed information 155 by the second processing unit 123 based on the location information 154 or the external information 153 obtained during a preset time frame T. The control device 120 obtains the external information 153 from each of the expansion devices 130 in a polling manner, and obtains the external information 153 from the expansion devices 130 after each polling. The interval time t of the polling is less than the length of the preset time frame T. Therefore, there is at least one polling to obtain the external information 153 in the preset time frame T.

[0069] Please refer to Figure 8 , in Figure 8 , the upper part of the time axis is the interval time t at which the external information 153 is obtained, and the lower part of the time axis is the length of the preset time frame T. It is assumed that one preset time frame T corresponds to six interval times. Therefore, the second processing unit 123 encapsulates six external information 153 as the compressed information 155 after each preset time frame T. Further, the second processing unit 123 also counts the corresponding interval time t and the preset time frame T when polling each of the expansion devices 130. Different expansion devices 130 can have the same length of interval time t, or different lengths of interval time t.

[0070] After the second processing unit 123 obtains a corresponding number of external information 153, the second processing unit 123 encapsulates the external information 153 as the compressed information 155. For example, the second processing unit 123 can encapsulate the external information 153 as the compressed information 155 in the JSON (JavaScript Object Notation) format, or in the XML (Extensible Markup Language) format. Alternatively, the second processing unit 123 can encapsulate the external information 153 as the compressed information 155 by the ZIP compression protocol.

[0071] In some embodiments, the control device 120 further includes a fifth transmission interface 125, and the processing system 100 further includes a mobile communication device 160, please refer to Figure 7The second processing unit 123 is connected to a fifth transmission interface 125. The mobile communication device 160 is connected to the second transmission interface 114 and the fifth transmission interface 125. The fifth transmission interface 125 is a universal asynchronous receiver / transmitter (UART) or an inter-integrated circuit (I2C) protocol. The mobile communication device 160 can be, but is not limited to, a global system for mobile communications (GSM), a satellite communication, or a wireless network. The mobile communication device 160 is connected to the first server 171 and the second server 172 via a network.

[0072] The mobile communication device 160 determines whether to send the received data to the first server 171 or the second server 172 according to the control device 120 and the vehicle recording device 110. The vehicle recording device 110 can send the vehicle image 151 or the synthesized image 152 to the mobile communication device 160 via the second transmission interface 114. The mobile communication device 160 sends the vehicle image 151 or the synthesized image 152 to the first server 171. For external clients, the clients can be connected to the first server 171 via a network and download the synthesized image 152 or stream the synthesized image 152 from the first server 171.

[0073] The control host sends the external information 153 or the compressed information 155 to the mobile communication device 160, and the mobile communication device 160 sends the external information 153 or the compressed information 155 to the second server 172. In addition to storing the external information 153 and the compressed information 155, the second server 172 can decompose the compressed information 155 to restore the plurality of pieces of external information 153. Then, the second server 172 sends the restored external information 153 to the first server 171. The first server 171 can store the synthesized image 152 and the time information of the external information 153 according to the recording time of the synthesized image 152 and the time information of the external information 153, thereby providing the clients with the synthesized image 152 and the corresponding vehicle information during the driving process.

[0074] The integrated vehicle image information processing system 100 and method provide an integrated vehicle image information processing system 100 that integrates the vehicle image 151 and the external information 153, so that the driver can immediately view the synthesized image 152 of the vehicle image 151 and the external information 153 during the driving process. In addition, the processing system 100 can upload the synthesized image 152 to a designated server for viewing by third-party clients.

Claims

1. An information processing system integrating vehicle-mounted video, characterized in that, include: A vehicle recording device includes a camera unit, a display unit, a first transmission interface, a second transmission interface, and a first processing unit. The first processing unit is connected to the camera unit, the display unit, the first transmission interface, and the second transmission interface. The camera unit captures images of a vehicle. A central control device has a third transmission interface, at least one fourth transmission interface, and a second processing unit. The second processing unit is connected to the third transmission interface and the fourth transmission interface. The third transmission interface is connected to the first transmission interface. The fourth transmission interface is connected to an expansion device. The second processing unit receives external information from the expansion device through the fourth transmission interface and transmits the external information to the vehicle recording device through the third transmission interface. The first processing unit overlays the external information onto the driving image.

2. The information processing system integrating vehicle-mounted imaging as described in claim 1, characterized in that, The central control device also includes a positioning unit, and the second processing unit is connected to the positioning unit, which acquires location information.

3. The information processing system integrating vehicle-mounted imaging as described in claim 2, characterized in that, The second processing unit transmits the location information to the vehicle recording device through the third transmission interface.

4. The information processing system integrating vehicle-mounted imaging as described in claim 3, characterized in that, The first processing unit selects the external information, the location information, or a combination thereof, and overlays the selected information onto the driving image to generate a composite image. The first processing unit then drives the display unit to display the composite image.

5. The information processing system integrating vehicle-mounted imaging as described in claim 2, characterized in that, The second processing unit acquires multiple pieces of the location information or multiple pieces of the external information within a preset time frame, and generates compressed information based on the acquired location information or external information.

6. The information processing system integrating vehicle-mounted imaging as described in claim 2, characterized in that, It also includes a mobile communication device connected to the second transmission interface of the driving recorder and a fifth transmission interface of the central control device. The mobile communication device is connected to a first server via the second transmission interface and to a second server via the fifth transmission interface. The mobile communication device transmits the driving image to the first server and transmits the location information to the second server.

7. The information processing system integrating vehicle-mounted imaging as described in claim 6, characterized in that, The second processing unit acquires multiple pieces of the location information or multiple pieces of the external information within a preset time frame. The second processing unit generates compressed information based on the acquired location information or external information. The second processing unit transmits the compressed information to the second server via the fifth transmission interface and the mobile communication device.

8. The information processing system integrating vehicle-mounted imaging as described in claim 6, characterized in that, The type of the first transmission interface matches the type of the third transmission interface. The first transmission interface is an RS-232 protocol, RS-423 protocol, RS-449 protocol, RS-485 protocol, or control area network protocol. The second transmission interface is a general serial bus protocol. The fourth transmission interface is an RS-232 protocol, RS-423 protocol, RS-449 protocol, or RS-485 protocol. The fifth transmission interface is a general asynchronous transceiver protocol or an integrated circuit circuit protocol.

9. The information processing system integrating vehicle-mounted imaging as described in claim 1, characterized in that, The types of expanded equipment include temperature measuring equipment, throttle detection equipment, light detection equipment, windshield wiper detection equipment, or door and window detection equipment.

Images