Multimedia system for a scalable infotainment system of a motor vehicle

The multimedia system addresses the inflexibility of existing automotive surveillance systems by allowing aftermarket cameras to be wirelessly integrated into the vehicle's infotainment system, providing enhanced driver awareness and vehicle control through flexible camera placement and customizable views.

DE102022127213B4Active Publication Date: 2024-11-21GM GLOBAL TECHNOLOGY OPERATIONS LLC
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
DE102022127213
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Priority Date
2022-06-24
Filing Date
2022-10-18
Publication Date
2024-11-21
Estimated Expiration
2042-10-18

AI Technical Summary

Technical Problem

Existing automotive video surveillance systems are limited by permanently installed cameras that do not allow for flexible placement of aftermarket cameras, restricting the ability to capture desired views for the driver.

Method used

A multimedia system that includes a detachable camera system with a media player and computer, capable of wirelessly connecting to aftermarket cameras using various streaming protocols, allowing for flexible camera placement and integration with the vehicle's infotainment system.

Benefits of technology

Enables the use of aftermarket cameras to provide diverse views and functionalities, enhancing driver awareness and vehicle control through a scalable and customizable infotainment system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Multimedia system (104) for a scalable infotainment system (102) of a motor vehicle (100), wherein the scalable infotainment system (102) includes a camera (110) that is detachably mounted on the motor vehicle (100) and is not native to the multimedia system (104), and the camera (110) supports several camera software components for generating a media signal associated with a media stream in response to the camera (110) capturing an image and / or video, and the multimedia system (104) comprises the following: a media playback device (106) attached to the motor vehicle (100); and a computer (108) attached to the motor vehicle (100) and containing the following: at least one processor (168) that communicates electrically with the media playback device (106); and a non-transitory computer-readable storage medium (170) that stores several playback device software components comprising several streaming protocols, wherein the non-transitory computer-readable storage medium (170) further stores instructions such that the at least one processor (168) is programmed to wireless connection to the camera (110); Generating a playback device configuration signal containing data associated with the playback device software components; Sending the playback device configuration signal to the camera (110), wherein the camera (110) determines a common of the streaming protocols supported by the media playback device (106) and the camera (110), and the camera (110) generates the media signal using the common of the streaming protocols; Receiving the media signal from the camera (110) using the commonality of the streaming protocols and Sending the media signal to the media playback device (106), wherein the media playback device (106) plays back the media stream using the common features of the streaming protocols.
Need to check novelty before this filing date? Find Prior Art

Description

INTRODUCTION

[0001] The present disclosure relates to motor vehicle infotainment systems, and more particularly to a multimedia system for a scalable infotainment system, the multimedia system having a media playback device for playing a media stream generated by a camera that is removably mounted on the motor vehicle and is not native to the multimedia system.

[0002] Automotive manufacturers are continually developing monitoring systems that enhance driver alertness. These monitoring systems typically include video display devices electrically connected to multiple cameras native to the motor vehicle and the monitoring systems. The cameras are integrated into various sections of the motor vehicle. As just one example, a heavy-duty truck may include cameras integrated into a front-end structure, a rear-end structure, a driver-side structure, and a passenger-side structure. These cameras capture video frames, and a video processor can stitch the video frames together to create an aerial view of the truck. This aerial view can assist the driver in accurately parking a vehicle, such as a large heavy-duty truck, in a tight parking space.In another example, certain luxury vehicles may include a camera mounted to a rear structure and facing rearward, with a rearview mirror display device displaying video captured by the camera. This rearview mirror display device displays a rearward view of the vehicle without certain obstructions blocking the view, such as headrests of two rows of seats, a low roofline, and / or a bicycle rack attached to the vehicle. In these examples, the cameras are permanently installed portions of vehicle systems and components, installed exclusively by the OEM. The cameras do not need to be moved to other portions of the vehicle to capture video of additional views that may be of interest to the driver.Accordingly, these systems need not allow aftermarket third-party cameras to be positioned at desired locations around the motor vehicle, with a vehicle video display device displaying video captured by the cameras.

[0003] Thus, while existing automotive video surveillance systems can achieve their intended purpose, there is a need for a new and improved scalable infotainment system that addresses these issues.

[0004] US 9 307 217 B1 discloses a portable video camera including a video security function, wherein the video security function transmits a video file in response to an event. The event may be pressing a "panic button" or removing the video camera from a video camera mounting location. SUMMARY

[0005] According to several aspects of the present disclosure, a multimedia system for a scalable infotainment system of a motor vehicle is provided. The scalable infotainment system includes a camera that is removably attachable to the motor vehicle and is not native to the multimedia system. The camera supports a plurality of camera software components for generating a media signal associated with a media stream in response to the camera capturing an image and / or video. The multimedia system includes a media playback device and a computer mounted on the motor vehicle. The computer includes one or more processors in electrical communication with the media playback device. The computer further includes a non-transitory computer-readable storage medium ("CRM") storing a plurality of player software components that include a plurality of streaming protocols.The CRM further stores instructions such that the processor is programmed to establish a wireless connection with the camera. The processor is further programmed to generate a player configuration signal containing data associated with the player software components. The processor is further programmed to send the player configuration signal to the camera, wherein the camera determines a common one of the streaming protocols supported by the media player and the camera. The camera generates the media stream using the common one of the streaming protocols. The processor is further programmed to receive the media signal from the camera using the common one of the streaming protocols.The processor is further programmed to send the media signal to the media playback device such that the media playback device plays the media stream using the common streaming protocol.

[0006] In one aspect, the processor generates the player configuration signal including data further associated with: a service set identifier (SSID), a password, a uniform streaming resource locator (streaming URL), a camera identifier, a resolution, a frame rate, a device type, a field of view parameter, and / or a vehicle stabilization feature parameter.

[0007] In another aspect, the processor is wirelessly connectable to the camera via a first network, the first network capable of supporting a first capacity of connected devices and having a first bandwidth. The processor transmits data associated with the player software components to the camera via the first network.

[0008] In another aspect, the media playback device includes a human-machine interface (HMI) touchscreen display device for generating an input signal in response to the HMI touchscreen display device receiving input from a user. In response to the processor receiving the input signal from the HMI touchscreen display device, the processor generates an instruction signal and sends the instruction signal to the camera via the first network. In response to the camera receiving the instruction signal from the processor, the camera performs a predetermined function.

[0009] In another aspect, the media player is configured to display a machine-readable optical label associated with the player software components and configured to be captured by the camera. The camera determines the player software components based on the machine-readable optical label.

[0010] In another aspect, the processor is further wirelessly connectable to the camera via a second network. The second network supports a second connected device capacity that is greater than the first connected device capacity associated with the first network. The second network has a second bandwidth that is greater than the first bandwidth associated with the first network. The processor receives the media signal from the camera via the second network.

[0011] According to several aspects of the present disclosure, a scalable infotainment system for a motor vehicle includes one or more cameras removably mountable on the motor vehicle. The camera captures an image and / or a video. The camera supports multiple camera software components for generating a media signal associated with a media stream in response to the camera capturing the image and / or the video. The scalable infotainment system further includes a multimedia system integrated with the motor vehicle. The multimedia system includes a media playback device and a computer mounted on the motor vehicle. The computer includes one or more processors in electrical communication with the media playback device.The computer further includes a non-transitory computer-readable storage medium (CRM) storing a plurality of player software components including a plurality of streaming protocols. The CRM further stores instructions such that the processor is programmed to establish a wireless connection with the camera. The processor is further programmed to generate a player configuration signal including data associated with the player software components. The processor is further programmed to send the player configuration signal to the associated camera, wherein the camera determines a common one of the streaming protocols supported by the media player and the camera. The camera generates the media signal using the common streaming protocol.The processor is further programmed to receive the media signal from the associated camera using the common streaming protocol. The processor is further programmed to send the media signal to the media playback device, where the media playback device plays the media stream using the common streaming protocol. The camera is not native to the multimedia system.

[0012] In one aspect, the processor generates the player configuration signal including data further associated with: a service set identifier (SSID), a password, a uniform streaming resource locator (streaming URL), a camera identifier, a resolution, a frame rate, a device type, a field of view parameter, and / or a vehicle stabilization feature parameter.

[0013] In another aspect, each of the cameras includes a controller for receiving the player configuration signal from the processor. The controller determines the common streaming protocol supported by the media playback device and the camera in response to the controller receiving the player configuration signal from the processor of the computer for the multimedia system.

[0014] In another aspect, the processor is wirelessly connectable to the associated camera via a first network. The first network has a first bandwidth and a first capacity of connected devices, and the processor sends data associated with the player software components to the associated camera via the first network.

[0015] In another aspect, the media playback device includes an HMI touchscreen display device for generating an input signal in response to the HMI touchscreen display device receiving input from a user. In response to the processor receiving the input signal from the HMI touchscreen display device, the processor generates an instruction signal and sends the instruction signal to the camera via the first network. In response to the camera receiving the instruction signal from the processor, the camera performs a predetermined function.

[0016] In another aspect, the associated camera includes an access point for connecting to a second network, and the associated camera is configured to perform the predetermined function. The predetermined function includes the associated camera being in a power-saving sleep mode, enabling the access point, and / or disabling the access point.

[0017] In another aspect, the media player is configured to display a machine-readable optical label associated with the player software components and configured to be captured by the camera. The camera determines the player software components based on the machine-readable optical label.

[0018] In another aspect, the processor is further wirelessly connectable to the camera via a second network. The second network can support a second capacity of connected devices that is greater than the first capacity of connected devices associated with the first network. The second network further has a second bandwidth that is greater than the first bandwidth associated with the first network. The processor receives the media signal from the camera via the second network.

[0019] In another aspect, the multimedia system further includes one or more remote servers for storing data associated with the player software components, and the associated camera includes a built-in cellular module. The built-in cellular module is configured to use a cellular network to connect the controller to the remote server, such that the controller receives the data associated with the player software components from the remote server.

[0020] According to several aspects of the present disclosure, a method of operating a multimedia system for a scalable infotainment system of a motor vehicle is provided. The scalable infotainment system includes one or more cameras and a multimedia system. The multimedia system includes a media player and a computer mounted on the motor vehicle. The computer includes one or more processors and a non-transitory computer-readable storage medium (CRM) storing a plurality of player software components including a plurality of streaming protocols. The method includes removably mounting the camera on the motor vehicle. The method further includes wirelessly connecting the processor to an associated one of the cameras.The method further comprises generating, using one or more remote servers and the processor, a player configuration signal containing data associated with the player software components. The method further comprises sending, using the remote server and the processor, the player configuration signal to the associated camera. The method further comprises determining, using the at least one camera, a common one of the streaming protocols supported by the media playback device and the at least one camera in response to the at least one camera receiving the player configuration signal. The method further comprises wirelessly connecting, using the processor, to the associated camera via a second network.The method further comprises capturing, using an image sensor of the camera, an image and / or a video. The method further comprises generating, using the camera, a media signal associated with a media stream using the common one of the streaming protocols in response to the image sensor capturing the image and / or the video. The method further comprises receiving, using the processor, via the second network, the media signal from the associated camera. The method further comprises transmitting, using the processor, the media signal to the media playback device. The method further comprises playing, using the media playback device, the media stream using the common streaming protocol.

[0021] In one aspect, the method further comprises generating, using the remote server or the processor, the player configuration signal, wherein the player configuration signal includes data further associated with: a service set identifier (SSID), a password, a uniform streaming resource locator (streaming URL), a camera identifier, a resolution, a frame rate, a device type, a field of view parameter, and / or a vehicle stabilization feature parameter. The method further comprises scanning, using a controller, the camera via the second network in response to the controller receiving the data from the remote server and / or the processor.

[0022] In another aspect, the method further comprises registering the camera using a controller of the camera by creating a camera-side device file in a camera operating system of the camera. The method further comprises sending, using the controller, a request signal to the processor. The method further comprises registering, using the processor, the camera by creating a vehicle-side device file in a vehicle operating system in response to the processor receiving the request signal from the camera. The method further comprises writing, using the controller, data to the camera-side device file in response to the camera capturing the image and / or video. The method further comprises sending, using the controller of the camera, the media signal to the processor.The method further comprises generating, using the controller of the camera, the media signal associated with the media stream.

[0023] In another aspect, the method further comprises registering the camera using a controller of the camera by creating a camera-side device file in a camera operating system of the camera. The method further comprises sending, using the controller, a request signal to the processor, wherein the request signal includes data associated with at least one device type and traffic information. The method further comprises registering, using the processor, the camera by creating a vehicle-side device file in a vehicle operating system in response to the processor receiving the request signal from the camera. The method further comprises capturing, using an image sensor of the camera, at least one of the image and the video.The method further comprises generating, using the controller of the camera, the media stream in response to the controller processing data associated with the image and / or the video. The method further comprises writing, using the controller of the media stream, to the camera-side device file. The method further comprises writing, using the processor, the media stream to the vehicle-side device file in response to the processor receiving the media signal from the controller of the camera. The method further comprises playing, using the media player, the media stream in response to the processor processing data associated with the media stream.

[0024] In another aspect, the method further comprises sending, using a vehicle-side user application of the processor, the common streaming protocol from the controller of the camera to a wireless streaming protocol adapter of the processor, wherein the wireless streaming protocol adapter is a core functionality. The method further comprises processing, using the wireless streaming protocol adapter, the media stream by at least one of: decoding the media stream; rendering the media stream; removing, using the wireless streaming protocol adapter, a plurality of headers associated with a TCP / IP communication of the media stream; and using a camera identifier to convey traffic to a user-space application.

[0025] Further areas of applicability will become apparent from the description provided herein. It should be understood that the description and specific examples are intended for illustrative purposes only and are not intended to limit the scope of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The drawings described herein are for illustrative purposes only and are not intended to limit the scope of the present disclosure in any way. Fig. 1 is a schematic diagram of an example of a motor vehicle having a scalable infotainment system with a multimedia system for wirelessly connecting to third-party cameras and displaying customized in-vehicle interior and exterior views. Fig. 2 is an enlarged view of a section of the scalable infotainment system of Fig. 1, illustrating the multimedia system having a media player and a computer for connecting to the cameras via a first network to determine a common streaming protocol supported by the media player and the camera, and further for connecting to the cameras via a second network for sending a media signal from the camera to the media player. Fig. 3 is an enlarged view of a section of the scalable infotainment system of Fig. 1, which illustrates the multimedia system having a media player for displaying a machine-readable optical label configured to be captured by the cameras such that the cameras can determine a common streaming protocol supported by the media player and the camera. Fig. 4 is an enlarged view of a section of the scalable infotainment system of Fig. 1, which illustrates the scalable infotainment system that includes a remote server operated by a streaming configuration management service provider that sends data associated with multiple player software components of the media playback device to the camera. Fig. 5 is an enlarged view of a portion of the scalable infotainment system of Fig. 1, which illustrates the scalable infotainment system including first and second remote servers operated by an associate of a first and second streaming configuration management service provider, wherein the first remote server sends data associated with the player software components of the media playback device to the cameras and the second remote server sends data associated with the camera software components of the cameras to the multimedia system. Fig. 6 is a flowchart of an example of a process for operating the multimedia system of Fig. 1. DETAILED DESCRIPTION

[0027] The following description is merely exemplary in nature and is not intended to limit the present disclosure, application, or uses.

[0028] With reference to Fig. 1, an example of a motor vehicle 100 includes a scalable infotainment system 102 with a multimedia system 104 integrated within the motor vehicle 100. The multimedia system 104 has a media playback device 106 (e.g., an infotainment head unit) and a computer 108 (e.g., a vehicle control unit), as described in detail below. The scalable infotainment system 102 further includes one or more cameras 110 that wirelessly communicate with the multimedia system 104 and are mountable to any portion of the motor vehicle 100 such that the media playback device 106 can display in-vehicle interior and exterior views. The cameras 110 may be standalone third-party cameras that are not native to the multimedia system 104 or the motor vehicle 100.In further examples, the cameras 110 may be removably mountable on a trailer 112 or a residential building, and / or the cameras 110 may be integrated into portable handheld devices (e.g., built into smartphones, computer tablets, internet cameras, etc.). Each of the cameras 110 includes an image sensor 114 (. Fig. 2) for capturing an image and / or a video. Each of the cameras 110 further includes a controller 116 ( Fig. 2) for wirelessly connecting to the media playback device 106. Each of the cameras 110 further includes a memory 118 ( Fig. 2) for storing a plurality of camera software components in response to the image sensor 114 capturing the image and / or video. The camera software components include a plurality of streaming protocols for generating a media signal associated with a media stream in response to the image sensor 114 capturing the image and / or video. The cameras 110 can connect to the computer 108 and wirelessly stream the camera view to the media player 106. The scalable infotainment system 102 allows a user to use their own aftermarket camera to stream media to the media player, rather than purchasing an exclusively OEM-designed camera.In some non-limiting examples, detailed below, the multimedia system 104 may wirelessly connect to the cameras 110 using BLUETOOTH, NFC, QR code, and cloud-based service connections without the use of a mobile phone to wirelessly connect the multimedia system 104 and the cameras 110. However, it is contemplated that further non-limiting examples of the scalable infotainment system may include a mobile phone to wirelessly connect the camera to the multimedia system. The multimedia system 104 provides a universal wireless streaming protocol adapter to accommodate various streaming software components used in various commercial brands of third-party WIFI-enabled cameras 110, including virtual input / output, direct video content delivery, and WIFI MAC layer information element-based SDP display.

[0029] As in Fig. 1, the motor vehicle 100 has a passenger cabin 120 with a surface 122 disposed therein, a front side structure 124 positioned forward of the passenger cabin 120, a rear side structure 126 positioned rearward of the passenger cabin 120, a driver side structure 128 positioned proximate a first side 130 of the passenger cabin 120, and a passenger side structure 132 positioned proximate a second side 134 of the passenger cabin 120 opposite the first side 130. Non-limiting examples of the motor vehicle include a land vehicle such as a sedan, a light truck, a heavy-duty truck, an SUV, a van, a motor home, a motorcycle, a recreational vehicle, or other suitable vehicles. The motor vehicle is an autonomous vehicle, a semi-autonomous vehicle, or a non-autonomous (manual) vehicle.However, it is envisaged that further examples of the motor vehicle may include an aircraft, a watercraft or other suitable vehicles.

[0030] Non-limiting examples of cameras 110 may include action cameras 135a-135d, such as Wi-Fi-enabled GOPRO cameras, LOGITECH MEVO STARTER cameras, INSTA360 cameras, and the like. In further non-limiting examples, cameras 110 may be built-in components of suitable devices such as smartphone cameras, tablet cameras, or camera traps with motion sensors. These cameras 135a-135d may be attached to any suitable surface 122 disposed within passenger cabin 120, front-side structure 124, rear-side structure 126, driver-side structure 128, and / or passenger-side structure 132 using any suitable mounting hardware (e.g., suction cups, magnets, clips, brackets, straps, clamps, etc.). It is also envisaged that the cameras can be separated from the vehicle and positioned in an area for communication with the multimedia system.

[0031] In one non-limiting example, the cameras 110 may further include a child monitoring camera 136a mounted to a surface 122 in the passenger cabin 120, such as a surface of a second-row seat 140, for capturing video of a rear-facing child safety seat 140 for infants or toddlers. In another non-limiting example, the cameras 110 may include one or more forward-facing cameras 110 mounted to the front-end structure 124, the driver-side structure 128, and / or the passenger-side structure 132 for capturing video of one or more angles of attack associated with off-road driving or a racing line associated with amateur racing, autocross, or another motorsport. In yet another non-limiting example, the cameras 110 may include a monitoring camera 136b (e.g.,The cameras 110 may include a camera (e.g., a Wi-Fi-enabled motion-activated camera or the like) positioned in the passenger cabin 120 for capturing video of the passenger cabin of the motor vehicle 100, e.g., a battery electric vehicle. In yet another non-limiting example, the cameras 110 may include a rear-facing camera 136c for capturing video of a trailer 112 attached to the motor vehicle 100. In another non-limiting example, the cameras 110 may include a hitch camera 136d mounted on a hitch 142 of the trailer 112 and facing forward to capture video to assist a driver in positioning the motor vehicle 100 for mounting a trailer hitch 144 extending from the motor vehicle to the hitch 142 of the trailer 112.In yet another non-limiting example, the cameras 110 may include a trailer monitoring camera 136e mounted on the trailer 112 (e.g., a cargo trailer, a horse trailer, or the like) for monitoring an interior 146 of the trailer 112 and cargo 148 or livestock 150 being transported in the trailer 112. In another non-limiting example, the cameras 110 may include one or more external trailer cameras 136f mounted on a rear end of the trailer 112, a driver's side of the trailer 112, and / or a passenger side of the trailer 112.In yet another example, cameras 110 may include four wide-angle cameras 137a-137d mounted on a respective one of the front structure 124, the rear structure 126, the driver-side structure 128, and the passenger-side structure 132 to capture video that assists the driver in accurately maneuvering the motor vehicle 100 into narrow spaces, such as an empty parking space between two occupied parking spaces. In yet another example, cameras 110 may include a garage camera 136f mounted on a parking structure 152 to capture video of the motor vehicle 100 approaching a parking space in the garage, a doorbell camera 136g mounted on a residence, and / or a home security camera 136h positioned within a residential building 154. In yet another example, the cameras 110 may include, on a remotely operated vehicle 156 such asmounted on or incorporated into a flying drone 158a, a remotely controlled motor vehicle 158b and / or a remotely controlled watercraft 158c.

[0032] With further reference to Fig. 1, the multimedia system 104 includes a media playback device 106 mounted on and integrated with the motor vehicle 100. In one non-limiting example, the media playback device 106 may be an infotainment head unit (IHU) with a human-machine interface (HMI) touchscreen display device 160a for generating an input signal in response to the HMI touchscreen display device 160a receiving input from a user. Furthermore, in this non-limiting example, the HMI display device 160a is integrated into a center console of an instrument panel 162 of the motor vehicle 100.The media player 106 may further include two HMI touchscreen display devices 160b, 160c integrated into a rear side of a driver seat 164 and a rear side of a front passenger seat 166, such that vehicle occupants in the second row 138 may view the image and / or video captured by the associated cameras and operate the HMI touchscreen display devices 160b, 160c to control the associated cameras 110. It is contemplated that the media player may include any number of HMI touchscreen display devices integrated into any portion of the vehicle or removably mounted on the motor vehicle. As described in more detail below, user input may trigger a predetermined function through one or more cameras 110.

[0033] The multimedia system 104 further includes a computer 108 mounted on the motor vehicle 100. The computer 108 includes one or more processors 168 that electrically communicate with the media player 106 and are wirelessly connectable to the cameras 110, for example, through a first network such as a personal area network (PAN) (e.g., a BLUETOOTH connection, a ZIGBEE connection, or the like). The first network has a first bandwidth and supports a first capacity of connected devices. In further non-limiting examples, the first network may be a wireless local area network (WLAN) without using the PAN. The computer 108 further includes a non-transitory computer-readable storage medium (CRM) 170 that stores a plurality of player software components including a plurality of streaming protocols.The CRM 170 further stores instructions such that the processor 168 is programmed to wirelessly connect to one or more cameras 110. The multimedia system 104 and the associated cameras 110 can determine a common streaming protocol supported by the multimedia system 104 and the cameras 110. The processor 168 sends data associated with the player software components to the associated camera 110 via the first network. In particular, the processor 168 is programmed to generate a player configuration signal and send the player configuration signal to the cameras 110.The player signal may include data associated with the player software components, a service set identifier (SSID), a password, a uniform streaming resource locator (streaming URL), a camera identifier, a resolution, a frame rate, a device type, a field of view parameter, and / or a vehicle stability feature parameter. Each of the cameras 110 includes a controller 116 that receives the player configuration signal from the processor 168, and the controller 116 determines the common streaming protocol supported by the media playback device 106 and the associated camera 110 in response to the controller 116 receiving the player configuration signal from the processor 168 of the computer 108. The controller 116 of the associated camera 110 generates the media signal associated with the media stream using the common streaming protocol.

[0034] The processor 168 is further wirelessly connectable to the camera 110 via a second network, such as a Wi-Fi wireless local area network (WIFI) connection. In this non-limiting example, the second network may be capable of supporting a second capacity of connected devices that is greater than the first capacity of connected devices supported by the first network. Furthermore, the second network has a second bandwidth that is greater than the first bandwidth associated with the first network. The processor 168 receives the media signal from the controller 116 of the camera 110, for example, via the second network. The processor 168 is further programmed to send the media signal to the media playback device 106 such that the media playback device 106 plays the media stream using the common streaming protocol.

[0035] Furthermore, the processor 168 generates a command signal and sends the command signal to the camera 110 via the first network in response to the processor 168 receiving the input signal from the HMI touchscreen display device 160. The camera 110 performs the predetermined function in response to the camera 110 receiving the command signal from the processor 168. Each of the cameras 110 includes an access point for connecting to the second network. Each of the cameras 110 is configured to perform a predetermined function, which may include placing the camera 110 into a power-saving sleep mode, enabling the access point, and disabling the access point in response to the associated camera 110 receiving the command signal from the processor 168 via the first network.

[0036] With reference to Fig. 3, the multimedia system 104 is further configured to use a machine-readable optical label 172 (e.g., a linear barcode, a 2D barcode such as a QR code, etc.) to determine the common streaming protocol supported by the media playback device 106 and the associated camera 110. Specifically, the media playback device 106 is configured to display the machine-readable optical label 172 associated with the player software components. The machine-readable optical label 172 is configured to be picked up by the cameras 110 such that the controller 116 of the associated cameras 110 can determine the player software components based on the machine-readable optical label 172 and the data associated with a plurality of camera software components stored in the memory 118 of the associated camera 110.Controller 116 generates the media signal associated with the media stream using the common streaming protocol. Processor 168 receives the media signal from camera 110 via the second network, and processor 168 is programmed to send the media signal to media playback device 106. Media playback device 106 plays the media stream using the common streaming protocol supported by the associated camera 110 and media playback device 106.

[0037] With reference to Fig. 4, the scalable infotainment system 102 further includes one or more remote servers 174 that store data associated with the player software components supported by the media playback device 106 and data associated with the camera software components supported by the associated camera 110. Specifically, in this non-limiting example, the data associated with the multimedia system 104 (e.g., the player software components supported by the media playback device 106, the SSID, the password, the streaming URL, the camera identifier, the resolution, the frame rate, the device type, the field of view parameters, and / or the vehicle stabilization feature parameters) is registered in a remote server 174 operated by a streaming configuration management service provider. Accordingly, the data associated with the camera 110 (e.g.,The camera software components (e.g., the camera software components supported by the camera 110, the SSID, the password, the streaming URL, the resolution, the frame rate, the device type, the field of view parameters, and / or the vehicle stabilization feature parameters) are registered in the same remote server 174. The camera 110 includes a built-in cellular module, wherein the built-in cellular module is configured to use a cellular network to wirelessly connect the camera's controller 116 to the remote server 174. The controller 116 receives the data associated with the multimedia system (e.g., the player software components, etc.) from the remote server 174. The controller 116 of the associated camera 110 can determine the player software components based on the data received from the remote server 174.The controller 116 further determines the common streaming protocol based on the player software components and the camera software components stored in the memory 118 of the camera 110. The controller 116 generates the media signal associated with the media stream using the common streaming protocol. The processor 168 receives the media signal from the camera 110 via the second network and is programmed to send the media signal to the media playback device 106. The media playback device 106 plays the media stream using the common streaming protocol.

[0038] With reference to Fig. 5 is another non-limiting example of a scalable infotainment system 202 similar to the scalable infotainment system 102 of Fig. 4 and has the same components, increased by 100. However, while the scalable infotainment system 102 includes a single remote server 174 operated by a streaming configuration management service provider, the scalable infotainment system 202 includes first and second remote servers 274a, 274b operated by an associate of a first and second streaming configuration management service provider. In this non-limiting example, the data associated with the multimedia system 204 (e.g., the player software components supported by the media playback device 206, the SSID, the password, the streaming URL, the camera identifier such as a media access control (MAC) address, the resolution, the frame rate, the device type, the field of view parameter, and / or the vehicle stabilization feature parameter) is registered in the first remote server 274a.The data associated with the camera 210 (e.g., the camera software components supported by the camera 210, the SSID, the password, the streaming URL, the resolution, the frame rate, the device type, the field of view parameters, and / or the vehicle stabilization feature parameters) are registered in the second remote server 274b.

[0039] With reference to Fig. 6 is a non-limiting example of a method 300 for operating the multimedia system 104 for the scalable infotainment system 102 of Fig. 1. The method 300 begins in block 302 with registering, using the controller 116 of the camera 110, the camera 110 by creating a camera-side device file in a camera operating system of the camera 110. The method 300 includes wirelessly connecting the processor 168 to the cameras 110, e.g., via the first network. The method 300 further includes synchronizing, using the controller 116 of the camera 110, a system clock of the camera operating system of the camera with a system clock of a vehicle operating system. The method 300 further includes registering, using the processor 168 of the camera 110, by creating a vehicle-side device file in the vehicle operating system of the computer 108.

[0040] In block 304, the method 300 further includes sending, using the controller 116 via the first network, a request signal to the processor 168 of the computer 108 for the multimedia system 104. The request signal may indicate a request by the camera for the camera software components and other multimedia system parameters from the multimedia system. However, in further non-limiting examples, where the HMI display device 160 displays the machine-readable optical label 172 associated with the player software components and other multimedia system parameters, the method may not include the controller 116 generating the request signal and / or sending the request signal to the processor 168 of the computer 108. For example, as in Fig.3, the camera 110 captures the image of the machine-readable optical label 172, which is associated with data directed to the player software components and other multimedia system parameters.

[0041] At block 306, the method 300 includes generating, using the remote server 174 and / or the processor 168, the player configuration signal in response to the remote server 174 and / or the processor 168 receiving the request signal from the controller 116. The player configuration signal is associated with data directed to the player software components, the service set identifier (SSID), the password, the uniform streaming resource locator (streaming URL), the camera identifier (e.g., the MAC address), the resolution, the frame rate, the device type, the field of view parameter, and / or the vehicle stabilization feature parameter. The method 300 further includes transmitting, using the remote server 174 and / or the processor 168, the player configuration signal to the associated camera 110.The method 300 further includes determining, using the controller 116 of the associated camera 110, the common streaming protocol supported by the camera 110 and the media player 106 in response to the controller 116 receiving the player configuration signal from the remote server 174 and / or the processor 168. However, in further non-limiting examples, the remote server 174 and / or the processor 168 need not generate the player configuration signal and send the player configuration signal to the controller 116 to determine the common streaming protocol. Continuing the previous non-limiting example, the camera may capture the image of the machine-readable optical label 172 associated with the player software components and other multimedia system parameters.The controller 116 may determine the common streaming protocol based on the data directed to the player software components and other multimedia system parameters, and further based on the data directed to the camera software components and other camera parameters stored in the memory 118 of the camera 110.

[0042] At block 308, the method 300 further includes removably attaching one or more cameras 110 to the motor vehicle 100, the trailer 112, the residential structure 154, and / or the remotely operated vehicle 156. In further non-limiting examples, the camera may be a handheld camera or a component built into a smartphone, a computer tablet, a laptop computer, and the like. Each of the cameras 110 supports camera software components including multiple streaming protocols for generating the media signal associated with the media stream in response to the associated camera 110 capturing the image and / or video.

[0043] At block 310, the method 300 includes searching, using the controller 116, the camera 110 of the processor 168 using the second network in response to the controller 116 receiving the data from the remote server 174 and / or the processor 168. The method 300 further includes wirelessly connecting, using the second network, the processor 168 to the associated camera 110 based on the data. However, as previously stated for further non-limiting examples, the controller 116 may determine the data from the memory 118 based on the image of the machine-readable optical label 172 captured by the camera 110.

[0044] At block 312, the method 300 further includes capturing, using the image sensor 114 of the camera 110, the image and / or the video. The method 300 further includes generating, using the controller 116 of the camera 110, the media signal associated with the media stream in response to the image sensor 114 capturing the image and / or the video and the controller 116 processing the data (e.g., data directed to the image and / or the video) using the common streaming protocol. The method 300 further includes writing, using the controller 116, data directed to the media stream to the camera-side device file. The method 300 further includes sending, using the controller 116, the media signal from the controller 116 of the camera 110 to the processor 168 of the multimedia system 104.

[0045] In block 314, the method 300 further includes writing, using the processor 168, the media stream to the on-vehicle device file in response to the processor 168 receiving the media signal from the controller 116 of the camera 110.

[0046] At block 316, the method 300 includes sending, using a vehicle-side user application of the processor 168, the common streaming protocol from the controller 116 of the camera 110 to a wireless streaming protocol adapter 176 of the processor 168, wherein the wireless streaming protocol adapter is a core functionality. The method 300 further includes processing, using the wireless streaming protocol adapter 176, the media stream by: decoding the media stream; rendering the media stream; removing, using the wireless streaming protocol adapter, multiple headers associated with a TCP / IP communication from the media stream; and using a camera identifier or a MAC address to convey traffic to a user-space application.

[0047] In block 318, the method 300 includes transmitting, using the processor 168, the media signal from the processor 168 to the media playback device 106 in response to the processor 168 processing data associated with the media stream.

[0048] In block 320, the method 300 includes playing back, using the media playback device 106, the media stream using the common streaming protocol supported by the associated camera 110 and the media playback device 106.

[0049] The processors may refer to or be part of an electronic circuit, a combinational logic circuit, a field-programmable gate array (FPGA), a processor (shared, dedicated, or group) that executes code, or a combination of some or all of the above, such as in a system on a chip. Additionally, the processors may be microprocessor-based, such as a computer having at least one processor, memory (RAM and / or ROM), and associated input and output buses. The processor may operate under the control of an operating system located in memory. The operating system may manage computer resources such that computer program code embodied as one or more computer software applications, such as an application located in memory, may execute instructions by the processor.In an alternative embodiment, the processor may execute the application directly, in which case the operating system may be omitted.

[0050] The description of the present disclosure is merely exemplary in nature, and variations that do not depart from the gist of the present disclosure are intended to be within the scope of the present disclosure. Such variations should not be considered a departure from the spirit and scope of the present disclosure.

Claims

[1] A multimedia system (104) for a scalable infotainment system (102) of a motor vehicle (100), wherein the scalable infotainment system (102) includes a camera (110) that is removably attachable to the motor vehicle (100) and is not native to the multimedia system (104), and the camera (110) supports a plurality of camera software components for generating a media signal associated with a media stream in response to the camera (110) capturing an image and / or a video, and the multimedia system (104) comprises: a media playback device (106) mounted on the motor vehicle (100); and a computer (108) mounted on the motor vehicle (100) and containing: at least one processor (168) that electrically communicates with the media playback device (106); and a non-transitory computer-readable storage medium (170) storing a plurality of player software components comprising a plurality of streaming protocols, wherein the non-transitory computer-readable storage medium (170) further stores instructions such that the at least one processor (168) is programmed to wireless connection to the camera (110); Generating a player configuration signal containing data associated with the player software components; Sending the player configuration signal to the camera (110), wherein the camera (110) determines a common one of the streaming protocols supported by the media playback device (106) and the camera (110), and the camera (110) generates the media signal using the common one of the streaming protocols; Receiving the media signal from the camera (110) using the common of the streaming protocols and Sending the media signal to the media playback device (106), wherein the media playback device (106) plays the media stream using the common one of the streaming protocols. [2] The multimedia system (104) of claim 1, wherein the at least one processor (168) generates the player configuration signal including data further associated with: a service set identifier (SSID), a password, a uniform streaming resource locator (streaming URL), a camera identifier, a resolution, a frame rate, a device type, a field of view parameter, and / or a vehicle stabilization feature parameter. [3] The multimedia system (104) of claim 2, wherein the at least one processor (168) is wirelessly connectable to the camera (110) via a first network, the first network capable of supporting a first capacity of connected devices and having a first bandwidth, and the at least one processor (168) transmits data associated with the player software components to the camera (110) via the first network. [4] The multimedia system (104) of claim 3, wherein the media playback device (106) comprises a human-machine interface (HMI) touchscreen display device (160a) for generating an input signal in response to the HMI touchscreen display device (160a) receiving input from a user, the at least one processor (168) generating an instruction signal and transmitting the instruction signal to the camera (110) via the first network in response to the at least one processor (168) receiving the input signal from the HMI touchscreen display device (160a), and the camera (110) performing a predetermined function in response to the camera (110) receiving the instruction signal from the at least one processor (168). [5] The multimedia system (104) of claim 4, wherein the media playback device (106) is configured to display a machine-readable optical label (172) associated with the player software components and configured to be captured by the camera (110) such that the camera (110) determines the player software components based on the machine-readable optical label (172). [6] The multimedia system (104) of claim 5, wherein the at least one processor (168) is further wirelessly connectable to the camera (110) via a second network, the second network capable of supporting a second connected device capacity greater than the first connected device capacity associated with the first network, the second network further having a second bandwidth greater than the first bandwidth associated with the first network, and the at least one processor (168) receives the media signal from the camera (110) via the second network. [7] A scalable infotainment system (102) for a motor vehicle (100), the scalable infotainment system (102) comprising: at least one camera (110) removably mountable on the motor vehicle (100), wherein the at least one camera (110) captures an image and / or a video, and the at least one camera (110) supports a plurality of camera software components for generating a media signal associated with a media stream in response to the at least one camera (110) capturing an image and / or a video; and a multimedia system (104) integrated in the motor vehicle (100), the multimedia system (104) comprising: a media playback device (106) mounted on the motor vehicle (100); and a computer (108) mounted on the motor vehicle (100) and including at least one processor (168) that electrically communicates with the media playback device (106), wherein the computer (108) further includes a non-transitory computer-readable storage medium (170) that stores a plurality of player software components that include a plurality of streaming protocols, and the non-transitory computer-readable storage medium (170) further stores instructions such that the at least one processor (168) is programmed to wirelessly connecting to the at least one camera (110); Generating a player configuration signal containing data associated with the player software components; Sending the player configuration signal to the at least one camera (110), wherein the at least one camera (110) determines a common one of the streaming protocols supported by the media playback device (106) and the at least one camera (110), and the at least one camera (110) generates the media signal using the common one of the streaming protocols; Receiving the media signal from the at least one camera (110) using the common one of the streaming protocols and Sending the media signal to the media playback device (106), wherein the media playback device (106) plays the media stream using the common one of the streaming protocols, wherein the at least one camera (110) is not native to the multimedia system (104). [8] The scalable infotainment system (102) of claim 7, wherein the at least one processor (168) generates the player configuration signal including data further associated with: a service set identifier (SSID) and / or a password and / or a uniform streaming resource locator (streaming URL) and / or a camera identifier and / or a resolution and / or a frame rate and / or a device type and / or a field of view parameter and / or a vehicle stabilization feature parameter. [9] The scalable infotainment system (102) of claim 8, wherein the associated camera (110) includes a controller (116) that receives the player configuration signal from the at least one processor (168), and the controller (116) determines the commonality of the streaming protocols in response to the controller (116) receiving the player configuration signal from the at least one processor (168) of the computer (108). [10] The scalable infotainment system (102) of claim 9, wherein the at least one processor (168) is connectable to the associated camera (110) via a first network, the first network capable of supporting a first capacity of connected devices and having a first bandwidth, and the at least one processor (168) sends data associated with the player software components to the associated camera (110) via the first network.

Citation Information

Patent Citations

  • Portable video camera / recorder having video security feature

    US9307217B1