Intelligent cockpit multi-view area control method and system, and vehicle

Abstract

The application provides a kind of intelligent cockpit multi-view area control method, system and vehicle.It includes: in response to display instruction, determine the target view area corresponding to the display instruction;According to the association between the target view area and camera, determine each target camera corresponding to the target view area;The video data of each target camera is displayed on the display interface of the vehicle.The purpose is to uniformly manage the camera configured to the vehicle, so that users can have a better user experience.

Description

Technical Field

[0001] This invention relates to the field of field of view display technology, and in particular to a control method, system and vehicle for a multi-view area in an intelligent cockpit. Background Technology

[0002] Currently, as vehicles become increasingly intelligent, they are equipped with more and more image acquisition devices. When users want to view video data collected by various image acquisition devices, they need to open the camera in each application to view the video data, which is complicated and results in messy video data. Summary of the Invention

[0003] In view of this, embodiments of the present invention provide a control method, system and vehicle for multi-view zones in a smart cockpit, which aims to manage the cameras configured in the vehicle in a unified manner, thereby providing users with a better user experience.

[0004] The first aspect of this invention provides a control method for multiple view zones in an intelligent cockpit, the method comprising:

[0005] In response to a display command, determine the target view area corresponding to the display command;

[0006] Based on the relationship between the target view area and the camera, determine each target camera corresponding to the target view area;

[0007] The video data from each target camera is displayed on the vehicle's display interface.

[0008] Optionally, the method further includes:

[0009] Based on the cameras configured in the vehicle, multiple initial view areas are constructed on the vehicle's display interface;

[0010] Based on the location of the cameras, the cameras are associated with the corresponding initial view areas to obtain multiple view areas.

[0011] Optionally, the method further includes:

[0012] In response to editing commands, edit the attribute information of the corresponding viewport;

[0013] When displayed in the viewport, the information is based on the edited attribute information.

[0014] Optionally, if the initial custom view area is included among the multiple initial view areas constructed in the vehicle display interface, the method further includes:

[0015] In response to a control command, the camera identification information in the control command is determined;

[0016] Based on the camera identification information, the corresponding camera is associated with the initial custom view area to obtain the custom view area;

[0017] In response to the second instruction, video data from the camera in the custom view area is acquired and displayed.

[0018] Optionally, the step of associating the camera with a corresponding initial viewing area based on the camera's location to obtain multiple viewing areas includes:

[0019] Based on the location of each camera, determine the initial field of view of each camera;

[0020] Create a number of SurfaceViews corresponding to the number of cameras in the initial viewport;

[0021] Each camera corresponding to the initial viewport is associated with the surfaceview of that initial viewport to obtain multiple viewports.

[0022] Optionally, before associating the corresponding camera with the initial custom view area based on the camera identification information to obtain the custom view area, the method further includes:

[0023] Create a preset number of initial custom viewports for surfaceviews;

[0024] The step of associating the corresponding camera with the initial custom view area based on the camera identification information to obtain the custom view area includes:

[0025] Based on the camera identification information, the corresponding camera is associated with the surfaceview of the initial custom view area to obtain the custom view area.

[0026] Optionally, the method further includes:

[0027] Create databases corresponding to each viewport;

[0028] Video data captured by cameras within the same field of view is stored in the corresponding database.

[0029] Optionally, storing the video data captured by cameras within the same field of view into a corresponding database includes:

[0030] Obtain camera identification information from the video data captured by the camera;

[0031] The view area corresponding to the video data is determined based on the camera identification information and the association between the camera and the view area;

[0032] The video data is stored in the database corresponding to the view area.

[0033] Optionally, storing the video data captured by cameras within the same field of view into a corresponding database includes:

[0034] Based on the relationship between the camera and the view area, add corresponding view area identifiers to the video data collected by the camera;

[0035] Based on the view area identifier, the video data is stored in the corresponding database.

[0036] Optionally, displaying the video data from each of the target cameras on the vehicle's display interface includes:

[0037] Determine the target cockpit location corresponding to the target field of view;

[0038] The video data from each of the target cameras is displayed on the display interface corresponding to the target cockpit.

[0039] Optionally, the method further includes:

[0040] Based on the triggering rules of the video data of the target view area, a display triggering instruction for the associated view area corresponding to the target view area is generated;

[0041] According to the display trigger command, the video data of the associated view area is displayed on the vehicle's display interface.

[0042] The embodiments of the present invention have the following advantages:

[0043] This invention provides a multi-view control method for intelligent cockpits. In response to a display command, the method determines the target view area corresponding to the display command; based on the association between the target view area and cameras, it determines each target camera corresponding to the target view area; and it displays the video data of each target camera on the vehicle's display interface. Therefore, for a large number of cameras configured in a vehicle, this invention allows for unified multi-view management of the cameras, enabling users to selectively view cameras in real-time on a per-view-area basis, thus providing a better user experience.

[0044] A second aspect of this invention provides a control system for a multi-viewpoint intelligent cockpit, the system comprising:

[0045] A target view area determination module is used to determine the target view area corresponding to the display command in response to the display command;

[0046] The target camera determination module is used to determine each target camera corresponding to the target view area based on the correlation between the target view area and the camera;

[0047] The data display module is used to display the video data from each target camera on the vehicle's display interface.

[0048] A third aspect of the present invention provides a vehicle, the vehicle including a smart cockpit multi-view control system as described in the second aspect of the present invention, for executing the steps in the smart cockpit multi-view control method described in the first aspect. Attached Figure Description

[0049] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0050] Figure 1 This is a flowchart illustrating a multi-view control method for an intelligent cockpit according to an embodiment of the present invention;

[0051] Figure 2 This is a schematic diagram illustrating a multi-view control method for an intelligent cockpit according to an embodiment of the present invention;

[0052] Figure 3 This is another schematic diagram illustrating a multi-view control method for an intelligent cockpit according to an embodiment of the present invention;

[0053] Figure 4 This is a schematic diagram of the structure of a multi-view control method for an intelligent cockpit according to an embodiment of the present invention;

[0054] Figure 5 This is a schematic diagram of a multi-view control system for an intelligent cockpit, as shown in an embodiment of the present invention. Detailed Implementation

[0055] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0056] Figure 1 This is a flowchart illustrating a multi-view control method for an intelligent cockpit according to an embodiment of the present invention. (Refer to...) Figure 1 The present invention provides a multi-view control method for an intelligent cockpit, comprising:

[0057] Step S11: In response to a display command, determine the target viewing area corresponding to the display command;

[0058] Step S12: Based on the correlation between the target view area and the camera, determine each target camera corresponding to the target view area;

[0059] Step S13: Display the video data from each target camera on the vehicle's display interface.

[0060] In an embodiment of the present invention, in response to a display command issued by a user, the target viewing area to be displayed, as indicated by the display command, is determined. After determining the target viewing area to be displayed, each target camera associated with the target viewing area is determined according to a pre-created association relationship between cameras and viewing areas. After determining each target camera associated with the target viewing area, the current real-time video data of each target camera is retrieved and displayed under the target viewing area category on the vehicle's display interface, thereby enabling simultaneous observation of all cameras belonging to the same viewing area category.

[0061] In an embodiment of the present invention, the user may include multiple target viewing areas in the display command issued at the same time. When displaying the cameras in the multiple target viewing areas, the real-time video data of the cameras will be displayed on the vehicle's display interface based on the viewing area as the classification criterion.

[0062] For example, such as Figure 2 As shown, when the user's display command indicates displaying the chassis view area, based on the pre-created association between cameras and view areas, the target cameras associated with this chassis view area are determined to be Camera 1, Camera 2, and Camera 3. Then, the current real-time video data of Camera 1, Camera 2, and Camera 3 is retrieved and displayed under the chassis view area category in the vehicle's display interface. For example... Figure 3 As shown, when the user's display command indicates the display of the chassis view area and the front view area, based on the pre-created association between cameras and view areas, the target cameras associated with the chassis view area are identified as Camera 1, Camera 2, and Camera 3, and the target cameras associated with the front view area are identified as Camera 4 and Camera 5. Then, the current real-time video data of Camera 1, Camera 2, and Camera 3 is retrieved and displayed under the chassis view area category in the vehicle's display interface, and Camera 4 and Camera 5 are retrieved and displayed under the front view area category in the vehicle's display interface. Specifically, as follows... Figure 3 As shown.

[0063] In this system, user-issued display commands can be generated by buttons corresponding to various viewpoints on the display interface. Clicking a button for a specific viewpoint generates the corresponding display command; for example, clicking the button for the "chassis viewpoint" generates a command to display the chassis viewpoint. However, manually issuing display commands while driving poses a high risk. Therefore, to improve driving safety, user-issued display commands can also be linked to corresponding voice shortcuts. When a user issues a voice shortcut, a display command corresponding to that shortcut is generated. For instance, the voice shortcut "I want to see the chassis viewpoint" can be linked to the chassis viewpoint display command; when the user issues the voice shortcut "I want to see the chassis viewpoint," a corresponding display command to display the chassis viewpoint is generated.

[0064] This invention provides a multi-view control method for intelligent cockpits. In response to a display command, the method determines the target view area corresponding to the display command; based on the association between the target view area and cameras, it determines each target camera corresponding to the target view area; and it displays the video data of each target camera on the vehicle's display interface. Therefore, for a large number of cameras configured in a vehicle, this invention allows for unified multi-view management of the cameras, enabling users to selectively view cameras in real-time on a per-view-area basis, thus providing a better user experience.

[0065] In this invention, the method further includes: constructing multiple initial viewing areas on the vehicle's display interface based on the cameras configured in the vehicle; and associating the cameras with the corresponding initial viewing areas based on the positions of the cameras to obtain multiple viewing areas.

[0066] In an embodiment of the present invention, before displaying each target camera in the target viewing area corresponding to the display command in real time on the vehicle's display interface according to the viewing area category in response to the display command, it is necessary to construct multiple viewing areas in advance.

[0067] Specifically, based on the positions captured by the numerous cameras installed in the vehicle, the initial view areas that can be subsequently displayed on the vehicle's display interface are determined. For example, if multiple cameras are installed inside the vehicle, allowing the user to see the front and rear seats, an initial front view area category and an initial rear view area category are determined. If multiple cameras are installed outside the vehicle, allowing the user to see the rear, front, and chassis of the vehicle, an initial exterior rear view area category, an initial exterior front view area category, and an initial chassis view area category are determined. It should be understood that the above examples are merely illustrative of one method for determining the initial view area category and are not intended to limit the invention. The invention can also construct other displayable initial view area categories on the vehicle's display interface based on the positions captured by the vehicle's cameras, and is not limited to initial front view area category, initial rear view area category, initial exterior rear view area category, initial exterior front view area category, initial chassis view area category, etc.

[0068] After constructing multiple initial view zones that can be displayed on the vehicle's display interface, these initial view zone categories are initially empty and not yet associated with any cameras. Therefore, real-time video data from the cameras cannot be displayed using these view zone categories. Thus, after establishing the initial view zones that can be displayed on the vehicle's display interface, each camera is associated with its corresponding initial view zone based on the location of the vehicle's cameras. This completes the display of all view zones that can be displayed on the vehicle's display interface, such as front row view zone categories, rear row view zone categories, exterior rear view zone categories, exterior front view zone categories, and chassis view zone categories.

[0069] For example, camera 1, camera 2, and camera 3, all cameras in the vehicle configuration, are positioned under the vehicle's chassis. Therefore, cameras 1, 2, and 3 are all associated with an initial chassis view area to obtain a complete chassis view area that can be displayed on the vehicle's display interface. When the user issues a display command to show the chassis view area, cameras 1, 2, and 3 within that chassis view area will display their video data in real time under the chassis view area category, such as... Figure 2 and Figure 3 As shown; among all the cameras configured in the vehicle, cameras 4 and 5 are located in the front row of the vehicle's interior. Therefore, cameras 4 and 5 are associated with the initial front view area to obtain a complete front view area that can be displayed on the vehicle's display interface. When the user issues a corresponding display command to display the front view area of ​​the vehicle, cameras 4 and 5 in that front view area will display their own video data in real time under the front view area category, such as... Figure 3As shown. It should be understood that the implementation method for establishing associations between other initial view areas and corresponding cameras to construct a complete view area that can be displayed on the vehicle's display interface is the same as the implementation method described above, and will not be repeated here.

[0070] In embodiments of the present invention, the constructed multiple viewing zones include an interior viewing zone and an exterior viewing zone, divided by the interior and exterior of the vehicle. The interior viewing zone further includes a front viewing zone and a rear viewing zone; the exterior viewing zone further includes a chassis viewing zone, a front exterior viewing zone, a rear exterior viewing zone, a left exterior viewing zone, and a right exterior viewing zone. When a user issues a display command to display the interior viewing zone, all cameras under the interior viewing zone category are displayed on the vehicle's display interface for that category; when a user issues a display command to display the exterior viewing zone, all cameras under the exterior viewing zone category are displayed on the vehicle's display interface for that category. A single camera can appear in multiple viewing zone categories simultaneously; for example, a camera in the front viewing zone category may also be in the interior viewing zone category, or a camera in the chassis viewing zone category may also be in the exterior viewing zone category.

[0071] In this invention, the method further includes: in response to an editing instruction, editing the attribute information of the corresponding view area; and displaying the view area based on the edited attribute information when the view area is being displayed.

[0072] In embodiments of the present invention, due to differences in user viewing and usage habits, the names of the view areas created by the present invention can be edited and modified to better match user usage and operation habits; when multiple view areas are displayed on the vehicle's display interface, the display order of these multiple view areas can be adjusted, such as... Figure 3 The simultaneous display of the chassis view area and the front view area allows for modification of their display order, changing it to display the front view area first and the chassis view area second; it also allows for editing and modifying the camera names, etc.

[0073] In embodiments of the present invention, after the name of a viewport is edited and modified, if the generation of a display command issued by the user refers to associating each viewport with a corresponding voice shortcut command, and generating a display command corresponding to that voice shortcut command when the user issues a voice shortcut command, then the voice shortcut command controlling the display of that viewport is modified accordingly based on the edited and modified name of that viewport. Similarly, after the name of a camera is edited and modified, if the generation of a display command issued by the user refers to associating each camera with a corresponding voice shortcut command, and generating a display command corresponding to that voice shortcut command when the user issues a voice shortcut command, then the voice shortcut command controlling the display of that camera is modified accordingly based on the edited and modified name of that camera.

[0074] For example, when the view area is named "Chassis View Area", the associated voice shortcut is "I want to see the chassis view area". When the user issues the voice shortcut "I want to see the chassis view area", a corresponding display command to display the chassis view area is generated based on the voice shortcut. When the view area name is edited and changed from "Chassis View Area" to "Exterior Chassis View Area", the associated voice shortcut "I want to see the chassis view area" will be edited and changed to "I want to see the exterior chassis view area". When the user issues the voice shortcut "I want to see the exterior chassis view area", a corresponding display command to display the exterior chassis view area is generated based on the voice shortcut.

[0075] When the camera is named "Camera A", the associated voice shortcut is "I want to see the image captured by Camera A". When the user issues the voice shortcut "I want to see the image captured by Camera A", a corresponding display command is generated to display the image captured by Camera A. When the camera name is changed from "Camera A" to "Camera A1", the associated voice shortcut "I want to see the image captured by Camera A" will be changed to "I want to see the image captured by Camera A1". When the user issues the voice shortcut "I want to see the image captured by Camera A1", a corresponding display command is generated to display the image captured by Camera A1.

[0076] Specifically, the user performs corresponding editing operations on the corresponding viewing area and / or camera on the vehicle's display interface. Based on these operations, corresponding editing instructions are generated. In response to these instructions, the attribute information of the corresponding viewing area and / or camera is modified, such as adjusting the display order of the viewing area and / or camera, or editing the name of the viewing area and / or camera. After the attribute information of the viewing area and / or camera is edited, it is displayed based on the edited attribute information when that viewing area and / or camera is displayed.

[0077] In this invention, when an initial custom view area is included among the multiple initial view areas constructed in the vehicle display interface, the method further includes: in response to a control command, determining camera identification information in the control command; associating the corresponding camera with the initial custom view area according to the camera identification information to obtain a custom view area; and in response to a second command, acquiring and displaying video data of the camera in the custom view area.

[0078] In embodiments of the present invention, as a vehicle's usage time increases, certain components become more prone to damage, leading to reduced driving safety. To improve driving safety, the present invention, while constructing multiple initial view zones that can be displayed on the vehicle's display interface, simultaneously constructs initial custom view zones. These initial custom view zones are user-defined, and associated with specific cameras. This allows cameras capable of capturing images of easily damaged components to be associated with the initial custom view zone, thus constructing a custom view zone. Furthermore, once it is determined that after replacing certain components, damage will no longer occur frequently, the cameras capable of capturing images of those specific components and associated with the custom view zone are removed from the custom view zone.

[0079] Specifically, by acquiring vehicle maintenance data from 4S dealerships, the system identifies components prone to failure and determines which cameras can capture images of these components. A control command is sent via the display interface to associate these cameras with an initial custom viewport. The vehicle's infotainment system responds to this command, identifying the camera identification information to determine which cameras need to be associated with the initial custom viewport. Based on the acquired camera identification information, the corresponding cameras are associated with the initial custom viewport to construct a complete custom viewport. In response to a second user command, the system determines the custom viewport indicated by that command. Then, based on the pre-established association between cameras and custom viewports, the system identifies the cameras associated with that custom viewport. After identifying the cameras associated with the custom viewport, the system retrieves and displays the current real-time video data from each camera under the custom viewport category on the vehicle's display interface, thereby enabling simultaneous monitoring of the vehicle's prone-to-failure components.

[0080] In this invention, the step of associating cameras with corresponding initial view areas based on the camera placement positions to obtain multiple view areas includes: determining the initial view area to which each camera belongs based on the placement positions of each camera; creating a corresponding number of surfaceviews for the initial view area based on the number of cameras corresponding to the initial view area; and associating each camera corresponding to the initial view area with the surfaceview of the initial view area to obtain multiple view areas.

[0081] In an embodiment of the present invention, based on the camera's location, the cameras are associated with corresponding initial view areas to obtain multiple view areas. Specifically, this includes: first, determining the initial view area to which each camera belongs based on its location, thereby determining the number of cameras included in each initial view area. Then, based on the number of cameras included in each initial view area, creating a corresponding number of surfaceviews for that initial view area, where a surfaceview represents a small window that will be displayed under that initial view area category on the vehicle's display interface. Next, associating each camera belonging to an initial view area with the surfaceviews under that initial view area, after completing the association of all cameras belonging to that initial view area with the surfaceviews under that initial view area, obtaining a complete view area that can be displayed on the vehicle's display interface.

[0082] For example, the vehicle is equipped with cameras a1, a2, a3, a4, a5, a6, a7, and a8. Initial viewports are created as initial viewport 1, initial viewport 2, and initial viewport 3. Based on the camera placement, cameras a1, a2, and a3 belong to initial viewport 1 (3 cameras in total); cameras a4 and a5 belong to initial viewport 2 (2 cameras in total); and cameras a6, a7, and a8 belong to initial viewport 3 (3 cameras in total). Based on the number of cameras (3) in initial viewport 1, 3 SurfaceViews are created; based on the number of cameras (2) in initial viewport 2, 2 SurfaceViews are created; and based on the number of cameras (3) in initial viewport 3, 3 SurfaceViews are created. Then, cameras a1, a2, and a3 are associated with the three surfaceviews of the initial view area 1 to obtain the corresponding complete view area 1 that can be displayed on the vehicle's display interface; cameras a4 and a5 are associated with the two surfaceviews of the initial view area 2 to obtain the corresponding complete view area 2 that can be displayed on the vehicle's display interface; cameras a6, a7, and a8 are associated with the three surfaceviews of the initial view area 3 to obtain the corresponding complete view area 3 that can be displayed on the vehicle's display interface.

[0083] In this invention, before associating the corresponding camera with the initial custom view area according to the camera identification information to obtain the custom view area, the method further includes: creating a preset number of surfaceviews for the initial custom view areas; associating the corresponding camera with the initial custom view area according to the camera identification information to obtain the custom view area includes: associating the corresponding camera with the surfaceview of the initial custom view area according to the camera identification information to obtain the custom view area.

[0084] In embodiments of the present invention, since the initial custom viewport is not a pre-built complete viewport, but rather an initial viewport that needs to be customized by the user according to actual usage requirements, the number of cameras associated with the initial custom viewport is uncertain. The present invention directly creates a preset number of SurfaceViews for the initial custom viewport. Based on the camera identification information in the control command, each camera corresponding to that camera identification information is associated with the SurfaceView of the initial custom viewport to obtain the custom viewport. Simultaneously, the present invention can also send a deassociation control command, based on the camera identification information in the deassociation control command, to deassociate the camera corresponding to that camera identification information from the custom viewport.

[0085] One optional method for determining the preset quantity is to use a specified percentage of the total number of cameras installed in the vehicle as the preset quantity. For example, if the vehicle has 20 cameras, the preset quantity is determined by 80% of the total number, which is 16 cameras. It should be understood that this is only a preferred embodiment of the preset quantity determination in this invention, and the preset quantity can also be determined in other ways, which are not specifically limited here.

[0086] In this invention, the method further includes: creating databases corresponding to each view zone; and storing video data captured by cameras within the same view zone into the corresponding databases.

[0087] In an embodiment of the present invention, the intelligent cockpit multi-view control method further includes: creating a corresponding database for each view zone. Video data collected by cameras belonging to the same view zone are stored in the database corresponding to that view zone, so that during later vehicle maintenance, video data within the same location range around the vehicle can be quickly retrieved, thereby enabling faster troubleshooting.

[0088] In this invention, storing video data collected by cameras within the same viewing area into a corresponding database includes: obtaining camera identification information of the video data collected by the cameras; determining the viewing area corresponding to the video data based on the camera identification information and the association between the camera and the viewing area; and storing the video data into the database corresponding to the viewing area.

[0089] In an embodiment of the present invention, one implementation of storing video data collected by cameras within the same view area into a corresponding database involves obtaining camera identification information included in the video data during storage. Since there is a correlation between cameras and view areas, the camera to which the video data belongs can be determined based on the camera identification information. Simultaneously, based on the correlation between cameras and view areas, view areas associated with the camera to which the video data belongs can be determined, thus identifying the view area to which the video data belongs. After determining the view area to which the video data belongs, the video data is stored in the database corresponding to that view area. This allows each video data to be stored in the database corresponding to its respective view area, enabling unified management of video data collected by cameras at the CameraService module level, even if various cameras have hardware differences.

[0090] In this invention, storing video data collected by cameras within the same viewing area into a corresponding database includes: adding a corresponding viewing area identifier to the video data collected by the camera according to the association between the camera and the viewing area; and storing the video data into the corresponding database according to the viewing area identifier.

[0091] In an embodiment of the present invention, one implementation of storing video data collected by cameras within the same view area into a corresponding database involves adding a corresponding view area identifier to the video data collected by the camera after the camera collects the video data, based on the association between the camera and the view area. When storing the video data, the view area to which the video data belongs is determined by obtaining the view area identifier from the video data, and then the video data is stored in the database corresponding to the view area to which the video data belongs. Another implementation of adding a corresponding view area identifier to the video data collected by the camera involves saving the video data as an Exif (Exchangeable Image File Format). During saving, data information can be inserted into the header of the video data, and this data information includes at least the view area identifier.

[0092] In this invention, displaying the video data of each of the target cameras on the vehicle's display interface includes: determining the target cabin position corresponding to the target viewing area; and displaying the video data of each of the target cameras on the display interface corresponding to the target cabin position.

[0093] In embodiments of the present invention, due to the rapid development of automotive technology and the increasing intelligence of automobiles, the privacy of the driving space has received more and more attention. Therefore, when constructing the view area, the present invention also constructs the view area based on the position of the cabin inside the vehicle, so that a user in a cabin position can only see the video data belonging to that cabin position's view area.

[0094] Specifically, a driver's cabin observation area is created corresponding to the driver's cabin position; a passenger's cabin observation area is created corresponding to the passenger's cabin position; a rear left-side cabin observation area is created corresponding to the rear left-side cabin position; a rear right-side cabin observation area is created corresponding to the rear right-side cabin position; a front-side cabin observation area is created corresponding to the front-side cabin position; and a rear-side cabin observation area is created corresponding to the rear-side cabin position. The association between the cameras and the corresponding observation areas for each cabin position can be established by the vehicle developers or customized by users with editing permissions. For example, the driver, being in the driver's seat, needs to have a complete view of the area surrounding the vehicle to ensure driving safety. Therefore, the vehicle developers or users with editing privileges can customize the association between all cameras capturing images of the outside of the vehicle and the driver's view area, allowing the driver to have a complete view of the outside. To protect the privacy of rear passengers, the cameras capturing images of the rear seats can be left unassociated with the driver's view area. Furthermore, to enable rear passengers to promptly detect whether the driver is driving safely, the vehicle developers or users with editing privileges can customize the association between the cameras capturing images of the front seats and the rear seats, allowing passengers to promptly detect whether the driver is engaging in any proactive dangerous driving behavior or is in a passively dangerous driving state (such as fatigued driving).

[0095] In an embodiment of the present invention, when the display instruction represents a display instruction for an observation field of view corresponding to the cockpit position, the target field of view corresponding to the display instruction is determined, the target cockpit position corresponding to the target field of view is determined according to the correlation between the cameras in the target field of view, and each target camera corresponding to the target field of view is determined, and the video data of each target camera is displayed on the display interface corresponding to the target cockpit position.

[0096] For example, when a user is detected in the rear passenger compartment, a display command is sent to the vehicle's infotainment system to show the corresponding rear passenger compartment viewing area. In response to this display command, the corresponding rear passenger compartment viewing area is determined as the target viewing area. Then, based on the association between the rear passenger compartment viewing area and the cameras, each target camera belonging to that rear passenger compartment viewing area is identified. The video data from each target camera is then displayed on the screen in the vehicle's rear passenger compartment.

[0097] In this invention, the method further includes: generating a display trigger instruction for an associated view area corresponding to the target view area according to the triggering rules of the video data of the target view area; and controlling the video data of the associated view area to be displayed on the vehicle's display interface according to the display trigger instruction.

[0098] In embodiments of the present invention, to improve driving safety, while displaying the target viewing area, the present invention generates a display trigger instruction for an associated viewing area corresponding to the target viewing area according to the triggering rules during the display process, and triggers the display of the associated viewing area according to the display trigger instruction. The associated viewing area associated with the target viewing area includes at least one, for example, for the front viewing area outside the vehicle, the associated viewing areas may include the adjacent left-side viewing area, right-side viewing area, chassis viewing area, etc. The associated viewing area in the display trigger instruction for generating the associated viewing area corresponding to the target viewing area according to the triggering rules during the display process includes at least one, for example, for the front viewing area outside the vehicle, a display trigger instruction can be generated to simultaneously trigger the display of multiple associated viewing areas such as the left-side and right-side viewing areas.

[0099] In embodiments of the present invention, a triggering rule for video data in the target viewing area is predefined. This triggering rule indicates that when the video data in the displayed target viewing area meets a set condition, a display triggering command corresponding to that set condition is generated. For example, when the target viewing area is the front-view area outside the vehicle, by analyzing the video data in the front-view area outside the vehicle, it is determined that a pothole section appears starting from in front of the vehicle. At this time, the video data meets the set condition of detecting a pothole section, and a display triggering command corresponding to that set condition is generated. This display triggering command will trigger the display of the chassis viewing area corresponding to the set condition on the vehicle's display interface, so that the user can observe whether the vehicle chassis is at risk of touching the road. For example, when the target viewing area is the front view area outside the vehicle, by analyzing the video data of the front view area outside the vehicle, it is determined that there is an obstacle on the right side in front of the vehicle. However, the obstacle is not complete. At this time, the video data meets the set condition that an obstacle is detected on the right side of the vehicle and the obstacle is incomplete. Then, a display trigger command corresponding to the set condition is generated. The display trigger command will trigger the right view area outside the vehicle corresponding to the set condition to be displayed on the vehicle's display interface, so that the user can fully observe the obstacle on the right side of the vehicle, thereby improving safer driving.

[0100] In an embodiment of the present invention, Figure 4 This is a schematic diagram illustrating the structure of a multi-view control method for an intelligent cockpit according to an embodiment of the present invention, as shown below. Figure 4 As shown, each camera in the vehicle is named and its captured video data is labeled with a corresponding viewport identifier through the CameraService module. During rendering, each camera is rendered onto a different VirtualDisplay. By associating the camera's VirtualDisplay with the SurfaceView of the initial viewport of the display interface, the camera's real-time video data is ultimately displayed within the specified viewport of the display interface.

[0101] Based on the same inventive concept, a second aspect of this invention provides a control system for a multi-viewpoint intelligent cockpit. For example... Figure 5 As shown, the system 500 includes:

[0102] A target view area determination module is used to determine the target view area corresponding to the display command in response to the display command;

[0103] The target camera determination module is used to determine each target camera corresponding to the target view area based on the correlation between the target view area and the camera;

[0104] The data display module is used to display the video data from each target camera on the vehicle's display interface.

[0105] Optionally, the system further includes:

[0106] The initial view area construction module is used to construct multiple initial view areas on the vehicle's display interface based on the cameras configured in the vehicle.

[0107] The view area construction module is used to associate cameras with corresponding initial view areas based on the camera placement positions, thereby obtaining multiple view areas.

[0108] Optionally, the system further includes:

[0109] The attribute information editing module is used to edit the attribute information of the corresponding view area in response to editing commands;

[0110] The first display module is used to display based on the edited attribute information when displaying in the view area.

[0111] Optionally, if the system includes an initial custom view area among the multiple initial view areas constructed in the vehicle display interface, the system further includes:

[0112] A camera identification information determination module is used to determine the camera identification information in the control command in response to the control command;

[0113] A custom view area construction module is used to associate the corresponding camera with the initial custom view area based on the camera identification information to obtain a custom view area;

[0114] The second display module is used to acquire and display video data from the camera in the custom view area in response to the second instruction.

[0115] Optionally, the view region construction module includes:

[0116] The initial view area determination module is used to determine the initial view area of ​​each camera based on the location of each camera.

[0117] The surfaceview creation module is used to create a number of surfaceviews corresponding to the number of cameras in the initial viewport.

[0118] The viewport construction submodule is used to associate each camera corresponding to the initial viewport with the surfaceview of the initial viewport to obtain multiple viewports.

[0119] Optionally, the system further includes:

[0120] The SurfaceView creation submodule is used to create a preset number of initial custom viewports for SurfaceViews.

[0121] The custom viewport construction module includes:

[0122] The custom view area construction submodule is used to associate the corresponding camera with the surfaceview of the initial custom view area based on the camera identification information, so as to obtain the custom view area.

[0123] Optionally, the system further includes:

[0124] The database creation module is used to create databases corresponding to each viewport.

[0125] The video data storage module is used to store the video data captured by cameras within the same field of view into the corresponding database.

[0126] Optionally, the video data storage module includes:

[0127] The camera identification information acquisition module is used to acquire camera identification information from the video data captured by the camera.

[0128] The video data corresponding view area determination module is used to determine the view area corresponding to the video data based on the camera identification information and the association between the camera and the view area;

[0129] The first video data storage submodule is used to store the video data in the database corresponding to the view area.

[0130] Optionally, the video data storage module includes:

[0131] The view area identifier setting module is used to add corresponding view area identifiers to the video data captured by the camera based on the relationship between the camera and the view area;

[0132] The second video data storage submodule is used to store video data into the corresponding database according to the view area identifier.

[0133] A third aspect of the present invention provides a vehicle comprising a multi-view control system for a smart cockpit as described in the first aspect of the present invention, for executing the steps of the multi-view control method for a smart cockpit as described in the second aspect of the present invention.

[0134] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other.

[0135] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or terminal device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or terminal device. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or terminal device that includes said element.

[0136] The above provides a detailed description of the intelligent cockpit multi-view control method, system, and vehicle provided by the present invention. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A control method for multiple view zones in an intelligent cockpit, characterized in that, The method includes: In response to a display command, determine the target view area corresponding to the display command; Based on the relationship between the target view area and the camera, determine each target camera corresponding to the target view area; The video data from each of the target cameras is displayed on the vehicle's display interface; The method further includes: Based on the cameras configured in the vehicle, multiple initial view zones are constructed on the vehicle's display interface; In the case where the initial custom view area is included among the multiple initial view areas constructed in the vehicle display interface, Obtain the vehicle's maintenance data at the 4S store, identify the various components of the vehicle that are prone to failure, and based on the various components that are prone to failure, identify the various cameras that can capture images of the components. In response to a control command, the camera identification information in the control command is determined; Based on the camera identification information, the corresponding camera is associated with the initial custom view area to obtain the custom view area.

2. The control method for multiple view zones in an intelligent cockpit according to claim 1, characterized in that, The method further includes: Based on the location of the cameras, the cameras are associated with the corresponding initial view areas to obtain multiple view areas.

3. The control method for multiple view zones in an intelligent cockpit according to claim 2, characterized in that, The method further includes: In response to editing commands, edit the attribute information of the corresponding viewport; When displayed in the viewport, the information is based on the edited attribute information.

4. The control method for multiple viewpoints in an intelligent cockpit according to claim 2, characterized in that, The method further includes: In response to the second instruction, video data from the camera in the custom view area is acquired and displayed.

5. The control method for multiple view zones in an intelligent cockpit according to claim 2, characterized in that, The step of associating cameras with corresponding initial view areas based on their placement to obtain multiple view areas includes: Based on the location of each camera, determine the initial field of view of each camera; Create a number of SurfaceViews corresponding to the number of cameras in the initial viewport; Each camera corresponding to the initial viewport is associated with the surfaceview of that initial viewport to obtain multiple viewports.

6. The control method for multiple view zones in an intelligent cockpit according to claim 4, characterized in that, Before associating the corresponding camera with the initial custom view area based on the camera identification information to obtain the custom view area, the method further includes: Create a preset number of initial custom viewports for surfaceviews; The step of associating the corresponding camera with the initial custom view area based on the camera identification information to obtain the custom view area includes: Based on the camera identification information, the corresponding camera is associated with the surfaceview of the initial custom view area to obtain the custom view area.

7. The control method for multiple view zones in an intelligent cockpit according to claim 2, characterized in that, The method further includes: Create databases corresponding to each viewport; Video data captured by cameras within the same field of view is stored in the corresponding database.

8. The control method for multiple view zones in an intelligent cockpit according to claim 7, characterized in that, The step of storing video data captured by cameras within the same field of view into a corresponding database includes: Obtain camera identification information from the video data captured by the camera; The view area corresponding to the video data is determined based on the camera identification information and the association between the camera and the view area; The video data is stored in the database corresponding to the view area.

9. The control method for multiple view zones in an intelligent cockpit according to claim 7, characterized in that, The step of storing video data captured by cameras within the same field of view into a corresponding database includes: Based on the relationship between the camera and the view area, add corresponding view area identifiers to the video data collected by the camera; Based on the view area identifier, the video data is stored in the corresponding database.

10. The control method for multiple view zones in an intelligent cockpit according to claim 1, characterized in that, The step of displaying the video data from each of the target cameras on the vehicle's display interface includes: Determine the target cockpit location corresponding to the target field of view; The video data from each of the target cameras is displayed on the display interface corresponding to the target cockpit.

11. The control method for multiple view zones in an intelligent cockpit according to claim 1, characterized in that, The method further includes: Based on the triggering rules of the video data of the target view area, a display triggering instruction for the associated view area corresponding to the target view area is generated; According to the display trigger command, the video data of the associated view area is displayed on the vehicle's display interface.

12. A vehicle, characterized in that, The steps are used to perform the control method for the multi-view area of ​​the smart cockpit as described in any one of claims 1-11.

Images