Video stream display method and device, electronic equipment and vehicle

Abstract

Embodiments of the present application provide a video stream display method and device, electronic equipment and vehicle. The method comprises: in response to a passenger in the vehicle initiating an access request for a monitoring video stream of a target camera, verifying whether the passenger has video access authority based on a preset identity verification rule; in the case that the passenger has video access authority, obtaining position information of the passenger in the vehicle; generating a corresponding video display strategy according to the position information; and displaying the monitoring video stream to different regions in a vehicle display interface according to the video display strategy. The method can realize video access control and display control matching the authority and position of different passengers, thereby improving the video access security, in-vehicle privacy protection effect and display safety during driving in the vehicle-home video linkage scenario.

Description

Technical Field

[0001] This application relates to the field of vehicle intelligent cockpit technology, and in particular to a video stream display method, device, electronic device, and vehicle. Background Technology

[0002] In the integration of smart cockpits and smart homes, in-vehicle terminals are typically used to receive and display home surveillance video streams to meet the need for viewing home security information from inside the vehicle.

[0003] However, existing solutions mostly focus on video access or general display control, lacking detailed management for in-vehicle usage scenarios, making it difficult to effectively distinguish the video visibility range between different occupants; at the same time, there is a lack of coordinated constraints between vehicle operating status and video presentation, which can easily lead to limitations in privacy protection, driving safety and transmission reliability in practical applications.

[0004] Therefore, how to balance video access security, in-vehicle privacy protection, and display security during driving in a vehicle-home video linkage scenario has become a technical problem that needs to be solved. Summary of the Invention

[0005] The video stream display method, apparatus, electronic device, and vehicle provided in this application embodiment are used to manage the access and display of video streams in an integrated manner, thereby taking into account video access security, in-vehicle privacy protection, and display security in vehicle scenarios.

[0006] In a first aspect, embodiments of this application provide a video stream display method, including:

[0007] In response to a vehicle occupant's request to access the surveillance video stream from the target camera, the system verifies whether the occupant has video access rights based on preset authentication rules.

[0008] If the occupant has video access rights, obtain the occupant's location information in the vehicle;

[0009] A corresponding video display strategy is generated based on the location information;

[0010] According to the video display strategy, the monitoring video stream is displayed in different areas of the vehicle display interface in a differentiated manner.

[0011] In one possible implementation, generating a corresponding video display strategy based on the location information includes:

[0012] Based on the location information, a target display area corresponding to the occupant is determined in the vehicle display interface;

[0013] Differentiated configurations are made for the first display parameters corresponding to the target display area and the second display parameters corresponding to the non-target display area in the vehicle display interface.

[0014] In one possible implementation, the differentiated configuration of the first display parameters corresponding to the target display area and the second display parameters corresponding to the non-target display areas in the vehicle display interface includes:

[0015] When the target display area is the driver's area, the first display parameter is configured to a preset standard value, and the first display parameter includes sharpness, brightness and contrast.

[0016] The second display parameter is configured to a preset abnormal value, and the second display parameter includes at least one of sharpness, brightness and contrast.

[0017] In one possible implementation, the method further includes:

[0018] The motion state of the vehicle is detected, including a stationary state and a moving state;

[0019] When the vehicle is in the driving state, the monitoring video stream is prohibited from being displayed on the vehicle display interface;

[0020] When the vehicle is stationary, the monitoring video stream is displayed on the in-vehicle display interface.

[0021] In one possible implementation, the method further includes: when the vehicle is in the driving state and the occupant is the driver, controlling at least one vehicle speaker to output audio based on the audio signal in the monitoring video stream.

[0022] In one possible implementation, controlling at least one vehicle speaker to output audio based on the audio signal in the monitored video stream includes:

[0023] Based on the occupant's location information, a target speaker and a non-target speaker are identified among at least one vehicle-mounted speaker. The distance between the target speaker and the driver is less than or equal to a preset distance threshold, and the distance between the non-target speaker and the driver is greater than the preset distance threshold.

[0024] The first volume of the target speaker and the second volume of the non-target speaker are configured differently;

[0025] Based on the first volume after differential configuration, the target speaker is controlled to output audio, and based on the second volume after differential configuration, the non-target speaker is controlled to output audio.

[0026] In one possible implementation, before displaying the surveillance video stream in different areas of the vehicle display interface, the method further includes: obtaining the encrypted surveillance video stream from the cloud; and decrypting the encrypted video stream based on a preset decryption algorithm.

[0027] Secondly, embodiments of this application provide a video stream display device, comprising:

[0028] The verification module is used to respond to a request from a vehicle occupant to access the surveillance video stream of the target camera, and to verify whether the occupant has video access rights based on a preset authentication rule.

[0029] The acquisition module is used to acquire the occupant's location information in the vehicle when the occupant has video access rights;

[0030] The generation module is used to generate a corresponding video display strategy based on the location information;

[0031] The display module is used to differentiate the display of the monitoring video stream to different areas of the vehicle display interface according to the video display strategy.

[0032] Thirdly, embodiments of this application provide an electronic device, including: a memory and a processor;

[0033] The memory stores computer-executed instructions;

[0034] The processor executes computer execution instructions stored in the memory, causing the processor to perform the first aspect and / or various possible implementations of the first aspect as described above.

[0035] Fourthly, embodiments of this application provide a vehicle, including a vehicle body and electronic devices as described above mounted on the vehicle body.

[0036] The video stream display method, device, electronic device, and vehicle provided in this application, when responding to an occupant's access request for a target camera monitoring video stream, verify whether the occupant has video access rights based on preset authentication rules. If the occupant has video access rights, the method obtains the occupant's location information in the vehicle, generates a corresponding video display strategy based on the location information, and displays the monitoring video stream in a differentiated manner to different areas of the in-vehicle display interface according to the video display strategy. This enables video access control and display management that matches the permissions and location of different occupants, thereby improving video access security, in-vehicle privacy protection, and display security during driving in vehicle-home video linkage scenarios. Attached Figure Description

[0037] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0038] Figure 1 This is a schematic diagram of the video stream display method provided in this application;

[0039] Figure 2 A flowchart of a video stream display method provided in another embodiment of this application;

[0040] Figure 3 A flowchart of an audio output control method provided in an embodiment of this application;

[0041] Figure 4 This is a schematic diagram of the overall process of the video stream display method provided in the embodiments of this application;

[0042] Figure 5 A schematic diagram of the video stream display device provided in this application;

[0043] Figure 6 A schematic diagram of the structure of the electronic device provided in this application.

[0044] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0045] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0046] As vehicles become more intelligent, in-vehicle terminals are becoming increasingly sophisticated. For example, users can install apps on in-vehicle terminals to remotely monitor video playback. This allows for the integration of smart cockpits and smart homes. A typical application scenario involves the in-vehicle display receiving video streams from home cameras, allowing passengers to view real-time footage of their front door, living room, garage, and yard while traveling or parked.

[0047] In practical deployment, this involves home-side video acquisition equipment, network transmission links, in-vehicle terminals, and in-vehicle display interfaces. Passengers can initiate access requests to target cameras via the central control screen or other in-vehicle display interfaces to obtain feedback on home security information. For example, while waiting in their vehicle, car owners might want to check if there are visitors at their doorstep, or temporarily check the status of their pets, doors, windows, and the surrounding environment after leaving home. Since a car typically carries more than one passenger—the driver, front passenger, and rear passengers—displaying the same video stream in the car involves not only the video access itself but also more granular usage requirements such as who can view it, from which position, and how different areas should be displayed. Especially in family cars, shared cars, or when friends and family are traveling together, home surveillance videos often have strong privacy attributes. Traditional in-vehicle displays lack a display control mechanism that integrates the location and access rights of in-vehicle occupants, making it easy to leak user privacy when playing surveillance videos.

[0048] To address the problems of traditional in-vehicle displays, this application provides a video stream display method, device, electronic device, and vehicle. When responding to an occupant's access request for a target camera's monitoring video stream, the method verifies whether the occupant has video access rights based on preset authentication rules. If the occupant has video access rights, the method obtains the occupant's location information within the vehicle and generates a corresponding video display strategy based on the location information. The monitoring video stream is then displayed in a differentiated manner to different areas of the in-vehicle display interface according to the video display strategy. This enables video access control and display management tailored to different occupants' permissions and locations, thereby improving video access security, in-vehicle privacy protection, and display safety during driving in vehicle-home video linkage scenarios.

[0049] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.

[0050] Figure 1 This is a schematic flowchart of the video stream display method provided in this application. The subject executing this method can be an electronic device in a vehicle, such as an in-vehicle display screen. Figure 1 As shown, the method includes:

[0051] Step 110: In response to an occupant's request to access the surveillance video stream from the target camera, verify whether the occupant has video access rights based on preset authentication rules;

[0052] Step 120: If the occupant has video access rights, obtain the occupant's location information in the vehicle;

[0053] Step 130: Generate the corresponding video display strategy based on the location information;

[0054] Step 140: According to the video display strategy, display the monitoring video stream in different areas of the vehicle display interface.

[0055] In step 110 above, the target camera is used to capture video, which serves as the video source when an occupant initiates an access request. For example, the target camera could be a front door camera, living room camera, garage camera, yard camera, or other indoor security camera.

[0056] Surveillance video streams are video data captured by target cameras and transmitted to the vehicle via home gateways, cloud platforms, or point-to-point links. They can be real-time video or video clips transmitted in real-time.

[0057] Passengers in the vehicle can enter the application interface by clicking the application icon on the in-vehicle display screen, and then use the controls in the application interface to initiate access requests to the monitoring video stream.

[0058] Authentication rules are a set of rules used to determine whether the occupant initiating the request has video access rights. For example, the rule set may include user account information, vehicle owner binding relationship, biometric matching relationship, mobile terminal token information, vehicle local permission table, and cloud authorization results.

[0059] Video access permissions are access control settings for surveillance video streams, used to restrict whether occupants can continue to view the corresponding surveillance footage.

[0060] In this embodiment, the vehicle's in-vehicle terminal can continuously monitor operation events from the central control screen, rear entertainment screen, voice interaction module, steering wheel buttons, and in-vehicle application entry points. When the in-vehicle terminal detects that an occupant selects a viewing entry point for a target camera, issues a voice command to view home surveillance, clicks on a specific screen in a home security application, or triggers the monitoring viewing function through a quick scene, it can determine that an access request for the monitoring video stream of the target camera has been received.

[0061] The access request can include the camera identifier, request time, request initiation location, request terminal identifier, and request associated user identifier for subsequent authentication and log retention.

[0062] In order to identify the occupant corresponding to the access request, the vehicle terminal can call the in-vehicle camera, facial recognition module, seat occupancy sensor, Bluetooth key recognition module, car key icon, mobile phone account login status or vehicle system account session information to establish a correspondence between the request action and the specific occupant.

[0063] In one possible embodiment, if the driver clicks on the door camera card via the central control screen, the vehicle terminal can integrate the current seating information, the vehicle login account, and the driver's facial recognition result to determine the identity of the request initiator. In another exemplary embodiment, if a rear passenger initiates access via the rear screen, the vehicle device can also combine the rear screen hardware number and the rear seat occupancy result to limit the request to a specific rear passenger.

[0064] After receiving the access request, the vehicle terminal or the cloud authentication service connected to it verifies the occupant according to the preset identity verification rules.

[0065] The verification process can include single-factor verification or multi-factor joint verification. Single-factor verification can be based on the binding relationship between the currently logged-in account of the vehicle infotainment system and the authorized account of the home monitoring system. If a pre-registered correspondence exists, the verification is considered successful. Multi-factor joint verification can further combine conditions such as whether the facial recognition features match the locally stored authorized facial templates, whether the encrypted token of the occupant's mobile terminal is valid, whether the vehicle is in a trusted network environment, and whether the current request meets the time limit.

[0066] In addition, for family member accounts with tiered permissions, the authentication rules can also distinguish between full access, limited access, and no access. Full access corresponds to viewing the complete and clear screen, while limited access allows entry into the subsequent display process, but its subsequent display strategy can be restricted to displaying only some areas clearly or displaying the entire screen as blurry.

[0067] Regarding step 120 above, the location information is data used to characterize the location of the occupant in the vehicle. It can be directly represented as the driver's seat, front passenger seat, left rear seat, right rear seat, middle rear seat, etc., or it can be represented as the spatial relationship relative to the in-vehicle display interface, such as being close to the left side of the central control screen, close to the right side of the central control screen, located in the front center observation range, or located in the rear side observation range.

[0068] The accuracy of the location information can be set to seat level, area level, or viewpoint level according to the vehicle's hardware conditions, as long as it can support the generation of subsequent video display strategies.

[0069] In this embodiment, the vehicle side can obtain the occupant's location information through multi-source sensing: (1) using seat occupancy sensors, seat pressure sensors, seat belt buckle status, and seat memory information to identify whether there are occupants in each seat and the seat number corresponding to the occupants; (2) using in-vehicle cameras to collect occupant images, and using human key point recognition, face position detection, head posture estimation, or eye movement direction estimation to determine the relative positional relationship between the occupants and each display screen; (3) using ultra-wideband positioning modules, Bluetooth positioning modules, millimeter-wave radar, or infrared sensors to obtain the spatial coordinates of the occupants in the vehicle to achieve more precise position judgment; (4) combining the mapping relationship between the request initiating terminal and the seat area established in the previous step, using the operation device number that initiated the request as an auxiliary basis. For example, if the access request is initiated by the entertainment screen in front of the passenger seat, the passenger seat can be directly used as the initial location information, and then combined with the in-vehicle camera to confirm whether there are actually occupants in the seat and whether the occupants are facing the screen.

[0070] Furthermore, to improve the stability of location determination, the vehicle-mounted terminal can fuse the results returned by multiple sensors and output the final location information using methods such as majority decision within a time window, confidence weighting, or prior rule correction. If the recognition results from the in-vehicle camera and the seat sensor results are inconsistent, the vehicle-mounted terminal can determine the location of the requesting occupant based on the most recent valid identity recognition result and the current interaction device affiliation, and continue to update the location information in the background.

[0071] In one possible embodiment, the location information may include not only the location of the occupant who initiated the access request, but also the location distribution of other occupants in the vehicle, to support blurring of unauthorized directions during subsequent differentiated display. For example, when the in-vehicle terminal identifies that the driver has access rights and that there are other occupants in the front passenger seat and rear seats, it can set the driver's area as the primary viewing area and include the front passenger seat and rear seat viewing directions within the privacy protection scope.

[0072] In another exemplary embodiment, if the vehicle is equipped with multiple displays, the location information can also be used to determine which display best matches the viewing path of the occupant with video access rights, thereby providing a basis for selecting the target display interface when generating a display strategy.

[0073] After acquiring the location information, the vehicle terminal can record the location information as a standardized data structure, such as fields including seat number, relative screen angle, distance from the screen, and confidence value, and send it to the video display strategy generation module.

[0074] Regarding step 130 above, the video display strategy is a set of strategies used to control how the surveillance video stream is presented. Specifically, it may include display area division, target display area selection, non-target display area determination, display clarity setting, image blur level setting, display brightness setting, display contrast setting, color saturation setting, viewing angle limitation parameter configuration, local masking parameter configuration, and whether to enable anti-spyware processing. The video display strategy does not merely determine whether video is displayed, but rather determines the differentiated display method of video in different viewing directions and different interface areas.

[0075] In this embodiment, the vehicle terminal can pre-store a vehicle cabin layout model, a display interface area mapping table, and a rule table corresponding to occupant positions and display parameters.

[0076] The cockpit layout model describes the positional relationship between the seats and the display screen; the display interface area mapping table represents the display areas that can be divided for the central control screen, instrument panel screen, passenger entertainment screen, or rear screen; and the correspondence rule table between occupant position and display parameters specifies the display strategies to be adopted under different occupant positions.

[0077] For example, when the location information indicates that the authorized occupant is in the driver's seat, the vehicle terminal can set the area of ​​the central control screen that is biased towards the driver's side as the target display area. In this area, the monitoring video stream is displayed with high definition, standard brightness and standard contrast. At the same time, the edge area on the passenger side or the sensitive observation area on the opposite side of the screen is set as a non-target display area. In the non-target display area, Gaussian blur, pixelation, contrast reduction, brightness reduction or partial masking processing are applied to the same video stream.

[0078] Additionally, when the location information indicates that the authorized occupant is in the front passenger seat, the video display strategy generation module can switch the clear display area to the side of the screen closer to the front passenger seat or switch it directly to the front passenger's dedicated display screen.

[0079] Regarding step 140 above, the in-vehicle display interface is used to display the monitoring video stream, and can specifically be a central control display screen, instrument display screen, passenger entertainment screen, rear display screen, or a combination interface composed of multiple display screens.

[0080] Differentiated display refers to displaying the same surveillance video stream using different display parameters in different areas of the interface, rather than simply playing the video in a uniform manner across the entire interface.

[0081] In this embodiment, the vehicle-mounted terminal first establishes a link for receiving and decoding the monitoring video stream. If the video stream originates from a home gateway or cloud platform, the vehicle-mounted terminal can retrieve video data from the target camera via a cellular communication link or a wireless LAN link, and perform session key negotiation, data decryption, buffer control, and encoding / decoding processing as needed. The decoded video frames are then sent to the image processing pipeline, where the rendering module reads the video display strategy generated in the previous step and applies corresponding image processing operations to different areas.

[0082] For example, the original or higher resolution image content is preserved in the target display area, and normal brightness and contrast are maintained; in the non-target display area, blur convolution, pixelation resampling, brightness attenuation, contrast compression, edge weakening, transparent mask overlay, or local mosaic processing are performed on the same video frame.

[0083] In addition, if multiple areas are defined in the video display strategy, the vehicle terminal can use different parameters for the first, second, and third areas respectively, so that the area closest to the authorized occupant's line of sight is the clearest, while the area away from the authorized occupant's line of sight gradually loses its recognizability.

[0084] Furthermore, when the vehicle is equipped with multi-screen collaboration capabilities, differentiated displays can also be implemented across screens. For example, when the driver has access, the driver's side area of ​​the central control screen displays the complete monitoring screen, while the passenger's screen does not display or only displays a blurred thumbnail preview; when rear passengers have access, the complete screen can be projected to the corresponding rear screen, while the central control screen only retains the access status prompt.

[0085] In addition, when passengers change seats, turn their bodies significantly, or new passengers enter the field of vision, the above position information can be updated and the video display strategy can be regenerated. This allows the vehicle terminal to switch the region division and processing parameters in the next frame or the next set of frames to maintain the display control consistent with the actual observation conditions inside the vehicle.

[0086] The video stream display method provided in this application integrates access request identification, authentication, location acquisition, policy generation, and differentiated display by region into a complete processing link. This allows home surveillance video to complete authorization judgment before entering the vehicle display interface. After authorization is established, the display method is determined based on the actual cabin position of the occupant. This enables the same video stream to be presented in a form that adapts to the occupant's position on the vehicle display interface. This effectively solves the privacy leakage problem that is easily caused by the unified playback of home surveillance video when multiple people are riding in the car. At the same time, it ensures that occupants with access rights can still view the monitoring screen corresponding to the target camera in a timely and accurate manner.

[0087] In some embodiments, a video display strategy can be generated through the following steps: Step (1) Determine the target display area corresponding to the occupant in the vehicle display interface based on the location information; Step (2) Differentiate the first display parameters corresponding to the target display area and the second display parameters corresponding to the non-target display area in the vehicle display interface.

[0088] In this embodiment, the target display area refers to the area in the vehicle display interface that corresponds to the position of the occupant and is used to carry the main display content of the monitoring video; the first display parameter refers to the video display parameter applied to the target display area, which is used to control the video presentation effect of the area.

[0089] In addition, the non-target display area can refer to other display areas in the vehicle display interface besides the target display area, or it can be an area corresponding to the location of other occupants. The second display parameter refers to the video display parameters applied to the non-target display area, used to create a different display control effect for the non-target area compared to the target display area.

[0090] In this embodiment, after receiving the occupant's location information, the vehicle terminal can match the location information with the preset area mapping relationship of the vehicle display interface to determine the target display area.

[0091] For example, the in-vehicle display interface can be divided into a driver's side display area, a passenger side display area, and a rear seat display area. When an occupant is detected to be in the driver's seat, the corresponding area is determined as the target display area; when an occupant is detected to be in the passenger side or the rear seat, the corresponding area is determined as the target display area.

[0092] The first and second display parameters can be set to different levels of clarity, brightness, contrast, or display intensity. The first display parameter uses a preset standard value, while the second display parameter uses a preset outlier value, ensuring that video content within the target display area remains recognizable, while video content outside the target display area is displayed in a weakened or restricted state.

[0093] This application's embodiments combine location information with the regional division of the in-vehicle display interface, enabling the establishment of a correspondence between occupant positions and display areas during the same video stream display process. Different display parameters are applied to different areas, ensuring that video content is effectively presented within the target display area while reducing the discernibility of non-target display areas. This satisfies the viewing needs of occupants in different positions, enhances the display control capabilities of surveillance video in an in-vehicle environment, and reduces the risk of privacy leaks due to multiple passengers traveling together.

[0094] Furthermore, based on the above embodiments, in some embodiments, when the target display area is the driver's area, the first display parameter can be configured to a preset standard value; and the second display parameter can be configured to a preset abnormal value.

[0095] The first display parameter includes sharpness, brightness, and contrast, and the second display parameter includes at least one of sharpness, brightness, and contrast.

[0096] In this embodiment, the driver's area refers to the display area in the vehicle display interface corresponding to the location of the driver. It is used to carry the main viewing content of the home surveillance video, so that the driver can clearly view the target screen without affecting the normal operation of the vehicle.

[0097] Among them, sharpness is used to characterize the recognizability of image details, brightness is used to characterize the brightness of the image, and contrast is used to characterize the strength of the difference between brightness and darkness in the image. These parameters together determine the visibility and recognition effect of the area.

[0098] In practice, after determining that the target display area is located in the driver's area, the vehicle terminal can map the first display parameters to the standard display configuration file of the display engine, so that the clarity, brightness and contrast are maintained within the threshold range that meets normal viewing, thereby ensuring that the monitoring screen in the driver's area has a stable display effect.

[0099] The non-target display area in the vehicle display interface is handled by the display control module using abnormal display configuration. Abnormal values ​​can be manifested as any one or more of the following: reduced clarity, reduced brightness, or reduced contrast, so that the non-target display area is visually significantly different from the driver's area.

[0100] This application embodiment differentiates the configuration of the first display parameter and the second display parameter, enabling the driver's area to maintain a clear display state required for normal viewing, while the non-target display area presents a different display state than the driver's area. This ensures the driver's viewing convenience while reducing the ability of other occupants in the vehicle to identify the target video content, reducing the range of home surveillance information transmission in the vehicle, and improving the privacy protection effect in the in-vehicle display scenario.

[0101] Figure 2 A flowchart of a video stream display method provided in another embodiment of this application is shown below. Figure 2 As shown, the method includes:

[0102] Step 210: Detect the vehicle's motion state; where motion state includes stationary state and moving state;

[0103] Step 220: When the vehicle is in motion, the monitoring video stream must not be displayed on the in-vehicle display interface;

[0104] Step 230: When the vehicle is stationary, display the monitoring video stream on the in-vehicle display interface.

[0105] In this embodiment, the vehicle's motion state is used to characterize whether the vehicle is currently in an operating condition where the monitoring video stream can be viewed.

[0106] The vehicle status can be determined based on at least one of the vehicle speed signal, gear signal, parking signal, and wheel speed signal, and the determination result can be divided into stationary state and driving state.

[0107] The stationary state indicates that the vehicle has not moved or is parked and stationary, in which case the monitoring video stream can be output to the in-vehicle display interface; the moving state indicates that the vehicle is moving, in which case the monitoring video stream cannot be output to the in-vehicle display interface to avoid the displayed content affecting the driver's attention.

[0108] In this embodiment, the monitoring video stream can be a real-time image data stream generated after the target camera is connected, and the vehicle display interface can be any display terminal among the central control display screen, instrument display screen or rear display screen. The system controls the output permissions of the display terminal according to the motion state.

[0109] The vehicle terminal can obtain the current vehicle speed, gear shift position and braking status from the vehicle communication bus. When the vehicle speed is greater than the threshold or the vehicle is in a moving gear such as forward or reverse, the vehicle's motion state is identified as driving state; when the vehicle speed is zero and the parking conditions are met, the vehicle's motion state is identified as stationary state.

[0110] After identifying the driving state, the vehicle terminal sends a display suppression command to the video rendering module to turn off the output of the monitoring video stream, pause decoding and playback, or switch to a placeholder interface; after identifying the stationary state, it resumes video decoding and image rendering, so that the monitoring video stream is displayed again on the vehicle display interface.

[0111] This application embodiment links the display of the surveillance video stream with the vehicle's movement status, automatically suppressing video display when the vehicle is moving and restoring video display when the vehicle is stationary, thus balancing driving safety with the needs of passengers to view home surveillance information. Because the display permissions dynamically switch according to the vehicle's status, visual interference during driving is reduced, and the adaptability of home security videos in in-vehicle scenarios is improved.

[0112] Furthermore, based on the above embodiments, in some embodiments, when the vehicle is in motion and the occupant is the driver, at least one vehicle speaker is controlled to output audio based on the audio signal in the monitoring video stream.

[0113] In this embodiment, the audio signal is a signal that characterizes the sound content in the monitoring video stream. It may include voice, ambient sound, doorbell sound, or other collectable sound information, and is used to drive the vehicle speaker to output the corresponding sound.

[0114] Vehicle speakers are speakers used inside a vehicle to play audio. They can include center console speakers, front door speakers, rear door speakers, or other sound-generating units that are electrically connected to the vehicle audio system.

[0115] In this embodiment, when the vehicle is detected to be in motion, to ensure driving safety and prevent driver inattention, the vehicle terminal no longer displays the monitoring video stream on the vehicle display interface. Instead, it decodes, denoises, normalizes the volume, or converts the format of the audio signal in the monitoring video stream before outputting it to the vehicle amplifier module, which then plays it through at least one vehicle speaker. This way, even if the driver cannot view the video footage, they can still be informed of calls, alarms, or environmental changes at home through sound information, thus providing an alternative presentation of monitoring information.

[0116] In addition, the audio output can be linked to the vehicle's current speed, gear status, and entertainment system operating status to avoid visual distraction and improve the continuity of information acquisition during driving.

[0117] This application embodiment replaces video output with sound while the vehicle is in motion, which not only meets driving safety requirements but also ensures that information from the surveillance video stream can be continuously transmitted to the driver inside the vehicle. By directly mapping the audio signal to the speaker output, the occupation of in-vehicle display resources can be reduced, and the risk of attention distraction caused by video display can be lowered, while maintaining the ability to perceive home surveillance information in real time.

[0118] Furthermore, Figure 3 A flowchart of the audio output control method provided in the embodiments of this application is shown below. Figure 3 As shown, the method includes:

[0119] Step 310: Based on the occupant's location information, determine the target speaker and non-target speaker among at least one vehicle-mounted speaker; wherein the distance between the target speaker and the driver is less than or equal to a preset distance threshold, and the distance between the non-target speaker and the driver is greater than the preset distance threshold;

[0120] Step 320: Differentiate the first volume of the target speaker and the second volume of the non-target speaker;

[0121] Step 330: Based on the first volume after differential configuration, control the target speaker to output audio, and based on the second volume after differential configuration, control the non-target speaker to output audio.

[0122] In this embodiment, as mentioned above, the occupant's location information is used to characterize the occupant's spatial position in the vehicle cabin. The vehicle terminal can determine the occupant's location based on the seat area, head position, or occupant identification results.

[0123] In addition, the target speaker corresponds to the speaker that is close to the driver's position, and the non-target speaker corresponds to the other speakers. The preset distance threshold is used to divide the boundary between near-field output and far-field output in order to form zoned audio broadcasting.

[0124] In the specific implementation of this embodiment, the vehicle speakers may include driver-side speakers, passenger-side speakers, and rear speakers. The vehicle terminal calculates the spatial distance between each speaker and the driver based on the driver's position information, and determines speakers with a distance less than or equal to a preset distance threshold as target speakers, and speakers with a distance greater than the preset distance threshold as non-target speakers.

[0125] In addition, the first volume and the second volume correspond to the output gain of different speakers. The vehicle terminal can configure them differently based on the amplitude range of the audio signal, the cabin noise level, and the driver's position. For example, the first volume can be set to a higher value than the second volume to ensure that the driver has a stable perception of the audio content output from the speaker.

[0126] During audio output, the in-vehicle terminal maps the audio signals extracted from the monitoring video stream to target and non-target speakers respectively, and controls playback according to the differentiated first and second volume settings. This ensures that the speaker closer to the driver receives the primary output, while the speaker farther away receives the secondary output. This method improves auditory consistency in different areas of the vehicle without affecting the integrity of the audio content and reduces the diffusion of ineffective sound pressure away from the driver.

[0127] The audio output control method provided in this application enables the vehicle speaker to create a spatially layered audio output effect based on the driver's position, making it easier for the driver to clearly receive voice or ambient sound in the monitoring video stream, while reducing interference to other seating areas. This solution also improves audio directivity and cabin auditory comfort in multi-occupant scenarios, thereby enhancing the user experience in video-linked scenarios.

[0128] Furthermore, in some embodiments, before the video stream is displayed, the vehicle terminal can also obtain an encrypted monitoring video stream from the cloud; then, based on a preset decryption algorithm, the encrypted video stream is decrypted.

[0129] In this embodiment, the cloud acts as a remote source node for the home-side surveillance video stream, enabling it to forward the video content captured by the home camera to the vehicle terminal via a network link and encrypt and protect the video content during transmission.

[0130] The encrypted surveillance video stream refers to the video stream data obtained after encryption processing. It can be sent using a streaming encapsulation method compatible with the vehicle terminal to reduce the risk of being intercepted or tampered with during transmission.

[0131] The preset decryption algorithm refers to the recovery algorithm that matches the encryption method. After receiving the video stream, the vehicle-mounted side restores the video content according to the algorithm parameters or key information to obtain the original image frame sequence that can be used for display processing.

[0132] During the process of the vehicle terminal acquiring the monitoring video stream from the cloud, the vehicle terminal can first establish an authenticated communication channel with the cloud, then receive video stream data packets carrying encryption identifiers, and extract parameters such as algorithm identifiers, key indexes or initialization vectors required for decryption while receiving the data in the buffer. Then, it calls the preset decryption algorithm to decrypt the video frames one by one or by bit stream unit.

[0133] The decrypted surveillance video stream then enters the subsequent display strategy processing, so that the same video content can be displayed differently in different areas of the vehicle display interface according to the occupant's location.

[0134] This application embodiment encrypts the surveillance video stream in the cloud, maintaining its encrypted state during cloud transmission. This enhances the security of home surveillance content during cross-network transmission. Decryption is performed on the vehicle side before display, ensuring the availability and continuity of video data used for subsequent differentiated displays. This prevents encrypted data from directly participating in rendering, which could cause display anomalies or information distortion. Therefore, while allowing vehicle occupants to view home surveillance footage, it also ensures both secure video transmission and stable display control.

[0135] The following is a detailed description of this solution through a complete embodiment.

[0136] Figure 4 This is a schematic diagram of the overall process of the video stream display method provided in the embodiments of this application, as shown below. Figure 4 As shown, the method includes:

[0137] Step 410: Permission verification.

[0138] This step, by setting permission verification, allows only passengers with family accounts to view the camera. That is, when a passenger uses a family account to initiate a request to view the monitoring video stream, they can pass the identity verification.

[0139] Step 420: Video stream privacy display.

[0140] For example, when the target display area is the driver's side area, the video stream corresponding to the driver's side area can be displayed normally and clearly; while the video streams corresponding to the passenger side or other areas can use strategies such as Gaussian blur, reduced brightness or contrast suppression to avoid leakage of screen content.

[0141] Step 430: Driving safety control.

[0142] For example, when the vehicle speed is greater than zero, the video feed can be disabled, and only the voice broadcast can be retained; when the vehicle stops or is in P gear, the video display can be restored.

[0143] Step 440: Secure video transmission.

[0144] The video stream is encrypted and relayed in the cloud, and the vehicle terminal is not directly connected to the camera to prevent hijacking.

[0145] Example: (1) After parking, the car owner checks the camera at the door → the driver's side view is clear, but the passenger side view is blurry; (2) When the vehicle starts moving → the camera automatically turns off, and only the voice prompt "No one is at the door".

[0146] Figure 5 This is a schematic diagram of the structure of the video stream display device provided in this application, such as... Figure 5 As shown, the video stream display device 50 provided in this embodiment includes:

[0147] The verification module 510 is used to respond to a request from a passenger in the vehicle to access the monitoring video stream of the target camera, and to verify whether the passenger has video access rights based on preset authentication rules.

[0148] The acquisition module 520 is used to acquire the occupant's location information in the vehicle when the occupant has video access rights;

[0149] The generation module 530 is used to generate a corresponding video display strategy based on the location information;

[0150] Display module 540 is used to differentiate the display of the monitoring video stream to different areas of the vehicle display interface according to the video display strategy.

[0151] In one possible implementation, the generation module can be specifically used to: determine the target display area corresponding to the occupant in the vehicle display interface based on the location information; and to perform differentiated configuration of the first display parameters corresponding to the target display area and the second display parameters corresponding to the non-target display areas in the vehicle display interface.

[0152] In one possible implementation, the generation module can be specifically used to: configure a first display parameter to a preset standard value when the target display area is the driver's area, the first display parameter including sharpness, brightness and contrast; and configure a second display parameter to a preset abnormal value, the second display parameter including at least one of sharpness, brightness and contrast.

[0153] In one possible implementation, the video stream display device further includes a status detection module for detecting the vehicle's motion status, which includes a stationary state and a moving state; when the vehicle is in motion, the monitoring video stream is prevented from being displayed on the vehicle display interface; when the vehicle is stationary, the monitoring video stream is displayed on the vehicle display interface.

[0154] In one possible implementation, the video stream display device further includes an audio output module for controlling at least one vehicle speaker to output audio based on the audio signal in the monitored video stream when the vehicle is in motion and the occupant is the driver.

[0155] In one possible implementation, the audio output module is used for:

[0156] Based on the occupant's location information, a target speaker and a non-target speaker are identified among at least one vehicle-mounted speaker. The distance between the target speaker and the driver is less than or equal to a preset distance threshold, and the distance between the non-target speaker and the driver is greater than the preset distance threshold.

[0157] Differentiate the first volume of the target speaker and the second volume of the non-target speaker;

[0158] Based on the first volume after differential configuration, control the target speaker to output audio, and based on the second volume after differential configuration, control the non-target speaker to output audio.

[0159] In one possible implementation, the video stream display device also includes a decryption module for obtaining the encrypted surveillance video stream from the cloud and decrypting the encrypted video stream based on a preset decryption algorithm.

[0160] The video stream display device provided in this embodiment can execute the method provided in the above method embodiment. Its implementation principle and technical effect are similar, and will not be described in detail here.

[0161] Figure 6 A schematic diagram of the structure of the electronic device provided in this application. Figure 6 As shown, the electronic device 60 provided in this embodiment includes at least one processor 601 and a memory 602. Optionally, the electronic device 60 further includes a communication component 603. The processor 601, memory 602, and communication component 603 are connected via a bus.

[0162] In a specific implementation, at least one processor 601 executes computer execution instructions stored in memory 602, causing at least one processor 601 to perform the above-described method.

[0163] The specific implementation process of processor 601 can be found in the above method embodiments, and its implementation principle and technical effect are similar. It will not be repeated here.

[0164] In the above embodiments, it should be understood that the processor can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in this invention can be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules within the processor.

[0165] The memory may include random access memory (RAM) and may also include non-volatile memory (NVM), such as at least one disk storage device.

[0166] The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of illustration, the buses shown in the accompanying drawings are not limited to a single bus or a single type of bus.

[0167] This application also provides a vehicle, which includes a vehicle body and the aforementioned electronic equipment disposed in the vehicle body.

[0168] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the above-described method.

[0169] This application also provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the above-described method.

[0170] The aforementioned readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The readable storage medium can be any available medium accessible to a general-purpose or special-purpose computer.

[0171] An exemplary readable storage medium is coupled to a processor, enabling the processor to read information from and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can reside in an Application Specific Integrated Circuit (ASIC). Alternatively, the processor and the readable storage medium can exist as discrete components in the device.

[0172] The division of units is merely a logical functional division; in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces, devices, or units, and may be electrical, mechanical, or other forms.

[0173] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0174] In addition, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0175] If a function is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0176] Those skilled in the art will understand that all or part of the steps of the above-described method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments; and the aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0177] Finally, it should be noted that other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein, and is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of the invention is limited only by the appended claims.

Claims

1. A method for displaying a video stream, characterized in that, include: In response to a vehicle occupant's request to access the surveillance video stream from the target camera, the system verifies whether the occupant has video access rights based on preset authentication rules. If the occupant has video access rights, obtain the occupant's location information in the vehicle; A corresponding video display strategy is generated based on the location information; According to the video display strategy, the monitoring video stream is displayed in different areas of the vehicle display interface in a differentiated manner.

2. The method according to claim 1, characterized in that, The step of generating a corresponding video display strategy based on the location information includes: Based on the location information, a target display area corresponding to the occupant is determined in the vehicle display interface; Differentiated configurations are made for the first display parameters corresponding to the target display area and the second display parameters corresponding to the non-target display area in the vehicle display interface.

3. The method according to claim 2, characterized in that, The differentiated configuration of the first display parameters corresponding to the target display area and the second display parameters corresponding to the non-target display areas in the vehicle display interface includes: When the target display area is the driver's area, the first display parameter is configured to a preset standard value, and the first display parameter includes sharpness, brightness and contrast. The second display parameter is configured to a preset abnormal value, and the second display parameter includes at least one of sharpness, brightness and contrast.

4. The method according to claim 1, characterized in that, The method further includes: The motion state of the vehicle is detected, including a stationary state and a moving state; When the vehicle is in the driving state, the monitoring video stream is prohibited from being displayed on the vehicle display interface; When the vehicle is stationary, the monitoring video stream is displayed on the in-vehicle display interface.

5. The method according to claim 4, characterized in that, The method further includes: When the vehicle is in motion and the occupant is the driver, at least one vehicle speaker is controlled to output audio based on the audio signal in the monitoring video stream.

6. The method according to claim 5, characterized in that, The step of controlling at least one vehicle speaker to output audio based on the audio signal in the monitored video stream includes: Based on the occupant's location information, a target speaker and a non-target speaker are identified among at least one vehicle-mounted speaker. The distance between the target speaker and the driver is less than or equal to a preset distance threshold, and the distance between the non-target speaker and the driver is greater than the preset distance threshold. The first volume of the target speaker and the second volume of the non-target speaker are configured differently; Based on the first volume after differential configuration, the target speaker is controlled to output audio, and based on the second volume after differential configuration, the non-target speaker is controlled to output audio.

7. The method according to claim 1, characterized in that, Before displaying the surveillance video stream differently in different areas of the vehicle display interface, the method further includes: Retrieve encrypted surveillance video streams from the cloud; The encrypted video stream is decrypted based on a preset decryption algorithm.

8. A video stream display device, characterized in that, include: The verification module is used to respond to a request from a vehicle occupant to access the surveillance video stream of the target camera, and to verify whether the occupant has video access rights based on a preset authentication rule. The acquisition module is used to acquire the occupant's location information in the vehicle when the occupant has video access rights; The generation module is used to generate a corresponding video display strategy based on the location information; The display module is used to differentiate the display of the monitoring video stream to different areas of the vehicle display interface according to the video display strategy.

9. An electronic device, characterized in that, include: Memory, processor; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory, causing the processor to perform the method as described in any one of claims 1-7.

10. A vehicle, characterized in that, It includes the vehicle body and the electronic equipment as described in claim 9 mounted on the vehicle body.

Images