Data processing method and device, electronic equipment and storage medium

Abstract

The invention relates to a data processing method and device, electronic equipment and a storage medium, and the method comprises the steps: displaying the vehicle information of a target vehicle on a display screen in a process that a target user remotely controls and drives the target vehicle; determining the sight direction of the target user watching the display screen; based on the line-of-sight direction, respectively displaying video pictures with different coding qualities in a target area of a display screen and a non-target area different from the target area; wherein the target area corresponds to the sight line direction, and the coding quality of the video picture corresponding to the target area is higher than the coding quality of the video picture corresponding to the non-target area. Through the method, the picture with high coding quality can be displayed in the target area corresponding to the sight line defense line of the driver, and the picture with low coding quality can be displayed in the non-target area, so that the picture definition of the attention range of the driver is ensured, the bandwidth occupied by the whole video is reduced, and the remote driving efficiency is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of vertical industries, and in particular, to a data processing method, apparatus, electronic device, and storage medium. Background Art

[0002] With the development of technology, remote driving applications are becoming more and more widespread, such as logistics transportation, mining, etc. A remote driving system generally consists of a vehicle, a remote cockpit, and a network. Multiple cameras are installed around the vehicle body, and the video information collected by the cameras is transmitted to the remote cockpit for display through channels such as 4G or 5G.

[0003] In the related art, when transmitting remote driving videos, if multiple camera images are displayed simultaneously, such as displaying 8 videos, the video bandwidth will be consumed multiplicatively. If multiple vehicles need to be remotely controlled simultaneously, then the video transmission service will occupy most of the total network bandwidth resources, thereby squeezing the network resources of other services such as data monitoring, positioning services, or voice calls, resulting in limited total service capacity and low remote driving efficiency. Summary of the Invention

[0004] The present disclosure provides a data processing method, apparatus, electronic device, and storage medium.

[0005] According to a first aspect of the present disclosure, there is provided a data processing method, the method including: during the process of a target user remotely controlling a target vehicle, displaying vehicle information of the target vehicle on a display screen; determining a line-of-sight direction when the target user gazes at the display screen; based on the line-of-sight direction, displaying video images with different coding qualities in a target area and a non-target area different from the target area on the display screen; wherein the target area corresponds to the line-of-sight direction, and the coding quality of the video image corresponding to the target area is higher than the coding quality of the video image corresponding to the non-target area.

[0006] According to a second aspect of the present disclosure, there is provided a data processing apparatus, the apparatus including: a display module, configured to display vehicle information of the target vehicle on a display screen during the process of a target user remotely controlling a target vehicle; a determination module, configured to determine a line-of-sight direction when the target user gazes at the display screen; the display module is further configured to, based on the line-of-sight direction, display video images with different coding qualities in a target area and a non-target area different from the target area on the display screen; wherein the target area corresponds to the line-of-sight direction, and the coding quality of the video image corresponding to the target area is higher than the coding quality of the video image corresponding to the non-target area.

[0007] According to a third aspect of the present disclosure, an electronic device is provided. The electronic device includes: a memory and a processor, a computer program is stored on the memory, and when the processor executes the program, the above-described method is implemented.

[0008] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, the above method of the present disclosure is implemented.

[0009] The data processing method, device, electronic device, and storage medium provided by the embodiments of the present disclosure display vehicle information of the target vehicle on a display screen during the process of a target user remotely controlling and driving a target vehicle; determine the line-of-sight direction when the target user gazes at the display screen; based on the line-of-sight direction, display video pictures with different coding qualities in a target area and a non-target area different from the target area on the display screen; wherein, the target area corresponds to the line-of-sight direction, and the coding quality of the video picture corresponding to the target area is higher than that of the video picture corresponding to the non-target area. It is possible to display a picture with a high coding quality in the target area corresponding to the driver's line-of-sight defense, display a picture with a low coding quality in the non-target area, ensure the picture clarity in the driver's attention range, reduce the overall video occupied bandwidth, and improve the efficiency of remote driving. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In the following description of exemplary embodiments with reference to the accompanying drawings, more details, features, and advantages of the present disclosure are disclosed. In the drawings:

[0011] Figure 1 It is a frame diagram of remote cockpit video display bandwidth adjustment provided by an exemplary embodiment of the present disclosure;

[0012] Figure 2 It is a flowchart of a data processing method provided by an exemplary embodiment of the present disclosure;

[0013] Figure 3 It is a schematic diagram of perspective monitoring provided by an exemplary embodiment of the present disclosure;

[0014] Figure 4 It is a schematic diagram of a peak shaving binary Gaussian model provided by an exemplary embodiment of the present disclosure;

[0015] Figure 5 It is a schematic block diagram of functional modules of a data processing device provided by an exemplary embodiment of the present disclosure;

[0016] Figure 6 It is a block diagram of the structure of an electronic device provided by an exemplary embodiment of the present disclosure;

[0017] Figure 7Block diagram of a computer system provided by an exemplary embodiment of the present disclosure. Detailed implementation manners

[0018] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. On the contrary, these embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not used to limit the protection scope of the present disclosure.

[0019] It should be understood that the steps recited in the method embodiments of the present disclosure can be executed in a different order and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this regard.

[0020] As used herein, the term "including" and its variants are open-ended, that is, "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description. It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependence.

[0021] It should be noted that the modification of "one" and "multiple" mentioned in the present disclosure is illustrative rather than restrictive. Those skilled in the art should understand that unless otherwise clearly stated in the context, it should be understood as "one or more".

[0022] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only for illustrative purposes and are not used to limit the scope of these messages or information.

[0023] It can be understood that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, usage scopes, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0024] For example, when receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested by the user will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, an application program, a server, or a storage medium that performs the operations of the present disclosure's technical solution based on the prompt message.

[0025] As an optional but non-limiting implementation manner, the manner of sending a prompt message to the user in response to receiving an active request from the user may be, for example, in the form of a pop-up window, and the prompt message may be presented in text in the pop-up window. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device. It can be understood that the above notification and obtaining user authorization process is only illustrative and does not constitute a limitation on the implementation manner of the present disclosure. Other manners that comply with relevant laws and regulations can also be applied to the implementation manner of the present disclosure.

[0026] With the development of technology, remote driving applications are becoming more and more widespread, such as logistics transportation, mine excavation, etc. A remote driving system generally consists of a vehicle, a remote cockpit, and a network. Multiple cameras are installed around the vehicle body, and the video information collected by the cameras is transmitted to the remote cockpit for display through channels such as 4G or 5G.

[0027] In the related art, when transmitting remote driving videos, if multiple camera images are displayed simultaneously, such as displaying 8 videos, the video bandwidth will be consumed multiplicatively. If multiple vehicles need to be remotely controlled simultaneously, then the video transmission service will occupy most of the total network bandwidth resources, thereby squeezing the network resources of other services such as data monitoring, positioning services, or voice calls, resulting in limited total service capacity and low remote driving efficiency.

[0028] To solve the above problems, the present disclosure proposes a method for processing data in a remote cockpit, and the specific framework is as Figure 1 shown. By capturing the driver's head posture through a camera in the remote cockpit, calculating the position where the line of sight falls on the display screen, thereby dividing the display screen into regions, and then calculating a set of adjustment coefficients for each region of the screen through a peak-clipping bi-Gaussian model, and transmitting it to the vehicle end to adjust the video quality encoding parameters, and finally transmitting the video data with adjusted quality to the cockpit display, so that the picture clarity not only meets the driver's needs but also reduces the bandwidth as a whole.

[0029] The data processing method provided by the embodiments of the present disclosure is as Figure 2 shown, and the method may include the following steps:

[0030] In step S100, during the process of a target user remotely controlling a target vehicle, vehicle information of the target vehicle is displayed on a display screen.

[0031] Among them, the target user is the driver who remotely controls the target vehicle. The target vehicle is equipped with a camera. The vehicle information of the target vehicle includes the surrounding picture information collected by the camera of the target vehicle, the vehicle speed of the target vehicle, etc. The display screen is the display screen of the remote cockpit. During the remote driving process, the target vehicle sends the obtained vehicle information to the display screen, and the driver remotely controls the target vehicle through the picture displayed on the display screen.

[0032] In step S200, determine the line-of-sight direction when the target user is looking at the display screen.

[0033] In a possible implementation manner, a camera is installed at the center of the display screen directly opposite the head of the target user, and the detection of the line-of-sight direction when the target user is looking at the display screen is completed through video image processing technologies such as machine vision or deep learning.

[0034] Exemplarily, a camera 1 can be fixedly installed at the center of the remote cockpit display to collect the head picture of the driver, and technical routes such as head pose and eye tracking are used to determine the line-of-sight direction when the target user is looking at the display screen. Specifically, the pitch angle pitch and yaw angle yaw of the included angle between the midline of the target user's view and the perpendicular to the screen can be determined.

[0035] In step S300, based on the line-of-sight direction, video pictures with different coding qualities are displayed in the target area and the non-target area different from the target area on the display screen respectively.

[0036] Among them, the target area is the driver's viewing area. The target area corresponds to the line-of-sight direction, and the coding quality of the video picture corresponding to the target area is higher than the coding quality of the video picture corresponding to the non-target area.

[0037] In the embodiment, the high or low coding quality can be determined by parameters such as resolution, bit rate or frame rate. For example, in the embodiment, the coding quality of the video picture corresponding to the target area is higher than the coding quality of the video picture corresponding to the non-target area, which can be understood as the resolution corresponding to the target area is higher than the resolution of the video picture corresponding to the non-target area, or the bit rate corresponding to the target area is higher than the bit rate of the video picture corresponding to the non-target area, or the frame rate corresponding to the target area is higher than the frame rate of the video picture corresponding to the non-target area, etc. The embodiment is not limited thereto.

[0038] In the embodiment, the encoding quality of the video picture can also be set to different levels in descending order through parameters such as resolution, bit rate, or frame rate. For example, encoding quality level 1, encoding quality level 2, and encoding quality level 3, etc. Different levels of encoding quality can respectively correspond to different resolutions, bit rates, or frame rates. For example, the resolution of encoding quality level 1 is greater than the resolution of encoding quality level 2, and the resolution of encoding quality level 2 is greater than the resolution of encoding quality level 3; or, the bit rate of encoding quality level 1 is greater than the bit rate of encoding quality level 2, and the bit rate of encoding quality level 2 is greater than the bit rate of encoding quality level 3; or, the frame rate of encoding quality level 1 is greater than the frame rate of encoding quality level 2, and the frame rate of encoding quality level 2 is greater than the frame rate of encoding quality level 3.

[0039] In this way, in the embodiment, the encoding quality of the video picture corresponding to the target area is higher than the encoding quality of the video picture corresponding to the non-target area. Specifically, the encoding quality level of the video picture corresponding to the target area can be higher than the encoding quality level of the video picture corresponding to the non-target area. For example, the encoding quality level of the video picture corresponding to the target area is encoding quality level 1, while the encoding quality level of the video picture corresponding to the non-target area is 2, etc. The embodiment is only an exemplary illustration, and the embodiment is not limited thereto.

[0040] Through the above method, it is possible to display a picture with high encoding quality in the target area corresponding to the driver's line of sight and a picture with low encoding quality in the non-target area, which not only ensures the clarity of the picture in the driver's observation area and guarantees driving safety, but also reduces the data transmission volume in the non-target area, realizes the reduction of the overall bandwidth, reduces the consumption of resource costs, and improves economic benefits.

[0041] To illustrate the present disclosure more clearly, based on the above embodiment, in the above step S300, it includes:

[0042] In step S310, the display screen is divided into multiple sub-regions, and the position of the first sub-region corresponding to the line of sight direction is determined.

[0043] In a possible implementation manner, the display screen can be equally divided into multiple sub-regions with the center of the screen as the origin, and the sub-region where the line-of-sight landing point of the line of sight direction is located is determined.

[0044] Exemplarily, such as Figure 3As shown in the figure, a coordinate system is established on the screen surface, with the origin o at the center of the screen, the screen width W as the horizontal axis, and the height H as the vertical axis. Here, d is the vertical distance from the driver to the display. Assume that the driver's eyes are on the horizontal midline of the screen, that is, the initial horizontal offset is 0, and there is an initial offset h in the vertical direction from the midpoint of the screen. Pitch and yaw are the pitch angle and yaw angle of the viewing midline perpendicular to the screen. Finally, the coordinates of the landing point V(x, y) of the driver's viewing midline on the display are obtained. The entire display area is divided into M*N equal parts. With the center of the screen as the origin, the position of a certain sub-region can be expressed as (m, n), and each sub-region has a corresponding screen coordinate interval. The position P(i, j) of the sub-region where point V is located can be calculated.

[0045] In step S320, based on the position of the first sub-region, a set of encoding quality parameters for the video picture displayed on the display screen is determined.

[0046] Among them, the set of encoding quality parameters includes a first set of encoding quality parameters corresponding to the target region and a second set of encoding quality parameters corresponding to the non-target region. The target region includes the first sub-region.

[0047] In a possible implementation, each sub-region of the display screen corresponds to an initial encoding quality parameter. According to the position of the first sub-region, the encoding quality adjustment parameters for the target region and the non-target region are respectively determined, and the encoding quality parameters are obtained based on the initial encoding quality parameter and the encoding quality adjustment parameter. Among them, the encoding quality parameter includes a bandwidth adjustment coefficient.

[0048] In a possible implementation, the initial bandwidth adjustment coefficients of each sub-region in the target region and the non-target region are obtained. And the bandwidth adjustment coefficients of each sub-region in the target region and the non-target region are respectively determined, and the initial bandwidth adjustment coefficients of each sub-region in the target region and the non-target region are adjusted according to the bandwidth adjustment coefficients to obtain the video encoding quality parameters of each sub-region in the target region and the non-target region.

[0049] Exemplarily, the initial bandwidth adjustment coefficient of each sub-region is B(m, n) = 1, the bandwidth adjustment coefficient of each sub-region is z(m, n), and parameter update is performed as B(m, n)' = B(m, n).*z(m, n), where B(m, n)' is the bandwidth adjustment coefficient of the updated sub-region, that is, the encoding quality parameter.

[0050] In a possible implementation, a set of bandwidth adjustment coefficients for the picture displayed on the display screen can be determined through a clipped bivariate Gaussian model. The clipped bivariate Gaussian model is as follows:

[0051]

[0052]

[0053] Among them, (i, j) is the sub-region corresponding to the perspective landing area, serving as the center of the binary Gaussian model, i.e., the highest point, and the parameters of the peak-clipping binary Gaussian model [σ m , σ n , a, A] can control the size of the target area, where [σ m , σ n controls the length and width of the elliptical peak, a controls the peak steepness, and A controls the peak-clipping area. The generated peak-clipping binary Gaussian model is as shown in Figure 4 . Among them, the vertical axis corresponds to A, the x-axis corresponds to m, and the y-axis corresponds to n. The parameters [σ m , σ n , a, A] are calculated through a mapping function from the vehicle speed, network transmission delay, and expected overall bandwidth compression rate of the target vehicle. Referring to the formula [σ m , σ n , a, A] = f(v, dt, s), where f is the mapping function, and a linear model, polynomial model, or neural network model can be used. The vehicle speed, network transmission delay, and expected overall bandwidth compression rate of the target vehicle are the state parameters of the target vehicle. The network transmission delay is the information transmission network delay between the target vehicle and the display screen. The expected overall bandwidth compression rate can be input manually, such as 0% - 70%. After determining the parameters of the peak-clipping binary Gaussian model, substitute these parameters into the peak-clipping binary Gaussian model formula, and further determine the adjustment coefficient set through the peak-clipping binary Gaussian model.

[0054] In a possible implementation, (m, n) is the sub-region position corresponding to the screen sub-region for which the bandwidth adjustment coefficient is to be calculated. Substitute the positions of each screen sub-region into the Gaussian model respectively to obtain the adjustment coefficients corresponding to each sub-region.

[0055] Exemplarily, substitute the sub-region at position (m, n) into Judge whether the value of t(m, n) is less than A. If this value is less than A, the bandwidth adjustment coefficient of this sub-region is If this value is greater than or equal to A, the bandwidth adjustment coefficient of this sub-region is a preset value. In the embodiments of the present disclosure, this preset value is set to 1. Substitute the positions of the screen sub-regions into the peak-clipping binary Gaussian model in sequence, and finally obtain the coding quality adjustment parameter set Among them, 1 is the coding quality adjustment parameter corresponding to each sub-region in the target area, is the coding quality adjustment parameter for each sub-region in the non-target area.

[0056] In step S330, display the video picture corresponding to the first coding quality parameter set in the target area of the display screen, and display the video picture corresponding to the second coding quality parameter set in the non-target area of the display screen.

[0057] In a possible implementation, before displaying the video picture corresponding to the first set of encoding quality parameters in the target area of the display screen and displaying the video picture corresponding to the second set of encoding quality parameters in the non-target area of the display screen, the remote cockpit terminal first sends the set of encoding quality parameters to the target vehicle. The target vehicle uses the ROI (Region of Interest) Encoding technology, that is, the video encoding technology based on the region of interest, to complete the encoding of each block of the original video data of each camera using the updated adjustment parameter B(m,n)', and obtains the encoded video, and sends the encoded video to the remote cockpit terminal.

[0058] Receive the video picture sent by the target vehicle, where the video picture includes the video picture corresponding to the first set of encoding quality parameters displayed in the target area of the display screen and the video picture corresponding to the second set of encoding quality parameters displayed in the non-target area of the display screen.

[0059] To illustrate the present disclosure more clearly, based on the above embodiments, in the above step S310, it further includes:

[0060] In step S3101, based on the position of the first sub-region, determine the set of encoding quality adjustment parameters of the video picture displayed on the display screen, where the set of encoding quality adjustment parameters includes the first set of encoding quality adjustment parameters corresponding to the target area and the second set of encoding quality adjustment parameters corresponding to the non-target area; or, based on the position of the first sub-region, determine the set of encoding rates of the video picture displayed on the display screen, where the set of encoding rates includes the first set of encoding rates corresponding to the target area and the second set of encoding rates corresponding to the non-target area.

[0061] Among them, the encoding quality adjustment parameter includes a bandwidth adjustment coefficient.

[0062] In a possible implementation, the set of bandwidth adjustment coefficients of the picture displayed on the display screen can be determined by the peak clipping bi-Gaussian model. The specific calculation method can refer to the relevant description in step S330 of the embodiments of the present disclosure, which will not be elaborated here.

[0063] In a possible implementation, the encoding quality parameter of the first sub-region can be determined by the position of the first sub-region, and further, the actual bit rate of the video corresponding to the first sub-region can be obtained according to the encoding quality parameter, so as to obtain the first set of encoding rates corresponding to the target area and the second set of encoding rates corresponding to the non-target area.

[0064] Exemplarily, set the actual bitrate of each sub-region in the target region to the actual bitrate of the first sub-region, and set the actual bitrate of each sub-region in the non-target region to be lower than the actual bitrate of the first sub-region.

[0065] To illustrate the present disclosure more clearly, based on the above embodiments, in the above step S310, it further includes:

[0066] In step S3102, determine the encoding quality parameters corresponding to each sub-region in the target region and the non-target region respectively; wherein, the encoding quality corresponding to each sub-region is inversely correlated with the distance from the position where the first sub-region is located.

[0067] In a possible implementation manner, with the position where the first sub-region is located as the center, the bandwidth adjustment coefficients of each sub-region decrease in turn.

[0068] Exemplarily, the bandwidth adjustment coefficient of the position where the first sub-region is located is 1, the bandwidth adjustment coefficient of the sub-region adjacent to the first sub-region is 0.8, and the bandwidth adjustment coefficient of the sub-region separated from the first sub-region by 1 sub-region is 0.6, decreasing in turn.

[0069] To illustrate the present disclosure more clearly, based on the above embodiments, in the above step S310, it further includes:

[0070] In step S3103, set the encoding quality parameters corresponding to each sub-region in the target region to the first encoding quality parameter.

[0071] Exemplarily, set the bandwidth adjustment coefficients of each sub-region in the target region to 2.

[0072] In step S3104, based on the distance between each sub-region in the non-target region and the position where the first sub-region is located, determine the encoding quality parameters corresponding to each sub-region in the non-target region respectively; wherein, the magnitude of the encoding quality parameters corresponding to each sub-region in the non-target region is inversely correlated with the distance from the position where the first sub-region is located.

[0073] In a possible implementation manner, the smaller the distance between each sub-region in the non-target region and the target position, the larger the corresponding bandwidth adjustment coefficient. Exemplarily, there are 3 sub-regions in the non-target region, namely sub-region 1, sub-region 2, and sub-region 3. The distance magnitudes between the 3 sub-regions and the target position are: sub-region 3 > sub-region 2 > sub-region 1. The bandwidth adjustment coefficient of sub-region 1 can be set to one-fifth of the bandwidth adjustment coefficient of the target region, and the bandwidth adjustment coefficients of sub-region 2 and sub-region 3 can be set to one-sixth and one-seventh of the bandwidth adjustment coefficient of the target region respectively, so as to achieve the sequential decrease of the bandwidth adjustment coefficients of each sub-region in the non-target region.

[0074] In the case of dividing each functional module corresponding to each function, an embodiment of the present disclosure provides a data processing device, which may be a server or a chip applied to a server. Figure 5 It is a schematic block diagram of the functional modules of the data processing device provided by an exemplary embodiment of the present disclosure. As Figure 5 shown, the data processing device includes:

[0075] A display module 201, configured to display vehicle information of a target vehicle on a display screen during the process of the target user remotely controlling the target vehicle;

[0076] A determination module 202, configured to determine the line-of-sight direction when the target user is gazing at the display screen;

[0077] The display module 201 is configured to display video pictures with different coding qualities in a target area and a non-target area different from the target area of the display screen based on the line-of-sight direction; wherein, the target area corresponds to the line-of-sight direction, and the coding quality of the video picture corresponding to the target area is higher than that of the video picture corresponding to the non-target area.

[0078] In a possible implementation manner, the determination module 202 is further configured to divide the display screen into multiple sub-areas, determine the position of the first sub-area corresponding to the line-of-sight direction; and based on the position of the first sub-area, determine a set of coding quality parameter sets of the video picture displayed on the display screen, where the set of coding quality parameter sets includes a first set of coding quality parameters corresponding to the target area and a second set of coding quality parameters corresponding to the non-target area, and the target area includes the first sub-area; the display module 201 is further configured to display a video picture corresponding to the first set of coding quality parameters in the target area of the display screen, and display a video picture corresponding to the second set of coding quality parameters in the non-target area of the display screen.

[0079] In a possible implementation manner, the above device further includes: a sending module, configured to send the set of coding quality parameter sets to the target vehicle;

[0080] The above device further includes: a receiving module, configured to receive video pictures sent by the target vehicle, where the video pictures include a video picture corresponding to the first set of coding quality parameters displayed in the target area of the display screen and a video picture corresponding to the second set of coding quality parameters displayed in the non-target area of the display screen.

[0081] In a possible implementation, the determining module 202 is further configured to determine a set of encoding quality adjustment parameters for the video frame displayed on the display screen based on the position of the first sub-region, where the set of encoding quality adjustment parameters includes a first set of encoding quality adjustment parameters corresponding to the target region and a second set of encoding quality adjustment parameters corresponding to the non-target region; or determine a set of encoding rates for the video frame displayed on the display screen based on the position of the first sub-region, where the set of encoding rates includes a first set of encoding rates corresponding to the target region and a second set of encoding rates corresponding to the non-target region.

[0082] In a possible implementation, the determining module 202 is further configured to determine, with the position of the first sub-region as the center, the encoding quality parameters corresponding to each sub-region in the target region and the non-target region; where the encoding quality corresponding to each sub-region is inversely correlated with the distance from the position of the first sub-region.

[0083] In a possible implementation, the determining module 202 is further configured to set the encoding quality parameters corresponding to each sub-region in the target region to the first encoding quality parameter; and determine the encoding quality parameters corresponding to each sub-region in the non-target region based on the distance between each sub-region in the non-target region and the position of the first sub-region; where the magnitude of the encoding quality parameters corresponding to each sub-region in the non-target region is inversely correlated with the distance from the position of the first sub-region.

[0084] The embodiments of the present disclosure further provide an electronic device, including: at least one processor; a memory for storing instructions executable by the at least one processor; where the at least one processor is configured to execute the instructions to implement the above methods disclosed in the embodiments of the present disclosure.

[0085] Figure 6 FIG. is a schematic structural diagram of an electronic device provided by an exemplary embodiment of the present disclosure. As Figure 6 shown, the electronic device 1800 includes at least one processor 1801 and a memory 1802 coupled to the processor 1801, and the processor 1801 can execute the corresponding steps in the above methods disclosed in the embodiments of the present disclosure.

[0086] The above-mentioned processor 1801 can also be referred to as a central processing unit (CPU). It can be an integrated circuit chip with the ability to process signals. Each step in the above-mentioned methods disclosed in the embodiments of the present disclosure can be completed by the integrated logic circuit in the hardware of the processor 1801 or instructions in the form of software. The above-mentioned processor 1801 can be a general-purpose processor, a digital signal processor (DSP), an ASIC, a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in combination with the embodiments of the present disclosure can be directly implemented by the execution of the hardware decoding processor or completed by the combination of the hardware and software modules in the decoding processor. The software module can be located in the memory 1802, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, and other mature storage media in the art. The processor 1801 reads the information in the memory 1802 and completes the steps of the above-mentioned method in combination with its hardware.

[0087] In addition, when the various operations / processes according to the present disclosure are implemented by software and / or firmware, the program constituting the software can be installed from a storage medium or a network to a computer system having a dedicated hardware structure, such as Figure 7 the computer system 1900 shown. When various programs are installed in the computer system, it can execute various functions, including the functions described above, etc. Figure 7 It is a block diagram of the structure of a computer system provided by an exemplary embodiment of the present disclosure.

[0088] The computer system 1900 is intended to represent various forms of digital electronic computer devices, such as, a laptop computer, a desktop computer, a workbench, a personal digital assistant, a server, a blade server, a mainframe computer, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as, a personal digital processor, a cellular phone, a smart phone, a wearable device, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are only examples and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0089] As Figure 7As shown, computer system 1900 includes a computing unit 1901, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 1902 or a computer program loaded from a storage unit 1908 into a random access memory (RAM) 1903. In the RAM 1903, various programs and data required for the operation of the computer system 1900 can also be stored. The computing unit 1901, the ROM 1902, and the RAM 1903 are connected to each other through a bus 1904. An input / output (I / O) interface 1905 is also connected to the bus 1904.

[0090] Multiple components in the computer system 1900 are connected to the I / O interface 1905, including: an input unit 1906, an output unit 1907, a storage unit 1908, and a communication unit 1909. The input unit 1906 can be any type of device that can input information into the computer system 1900. The input unit 1906 can receive input digital or character information, and generate key signal inputs related to user settings and / or function controls of the electronic device. The output unit 1907 can be any type of device that can present information, and can include but is not limited to a display, a speaker, a video / audio output terminal, a vibrator, and / or a printer. The storage unit 1908 can include but is not limited to a magnetic disk, an optical disk. The communication unit 1909 allows the computer system 1900 to exchange information / data with other devices through a network such as the Internet, and can include but is not limited to a modem, a network card, an infrared communication device, a wireless communication transceiver, and / or a chipset, such as a BluetoothTM device, a WiFi device, a WiMax device, a cellular communication device, and / or the like.

[0091] The computing unit 1901 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 1901 include but are not limited to a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The computing unit 1901 executes the various methods and processes described above. For example, in some embodiments, the above-described methods disclosed in the embodiments of the present disclosure can be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as the storage unit 1908. In some embodiments, part or all of the computer program can be loaded and / or installed onto the electronic device 1900 via the ROM 1902 and / or the communication unit 1909. In some embodiments, the computing unit 1901 can be configured to execute the above-described methods disclosed in the embodiments of the present disclosure in any other appropriate manner (e.g., by means of firmware).

[0092] An embodiment of the present disclosure also provides a computer-readable storage medium. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the above methods disclosed in the embodiments of the present disclosure.

[0093] The computer-readable storage medium in the embodiments of the present disclosure may be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. The above computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specifically, the above computer-readable storage medium may include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disc read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0094] The above computer-readable medium may be included in the above electronic device; or may exist separately without being assembled into the electronic device.

[0095] An embodiment of the present disclosure also provides a computer program product, including a computer program, where the computer program, when executed by a processor, implements the above methods disclosed in the embodiments of the present disclosure.

[0096] In the embodiments of the present disclosure, computer program code for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof. The above programming languages include, but are not limited to, object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, executed as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network (including a local area network (LAN) or a wide area network (WAN)), or may be connected to an external computer.

[0097] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a segment of a program, or a part of code that contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than that marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, as well as combinations of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system that performs the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions.

[0098] The modules, components, or units described in the embodiments of the present disclosure may be implemented in software or in hardware. In some cases, the names of the modules, components, or units do not constitute a limitation on the modules, components, or units themselves.

[0099] The functions described above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0100] The above description is only some embodiments of the present disclosure and an explanation of the applied technical principles. Those skilled in the art should understand that the scope of the disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosure concept. For example, technical solutions formed by mutually replacing the above features with technical features having similar functions (but not limited to) disclosed in the present disclosure.

[0101] Although some specific embodiments of the present disclosure have been described in detail by way of examples, those skilled in the art should understand that the above examples are only for illustration and not for limiting the scope of the present disclosure. Those skilled in the art should understand that the above embodiments may be modified without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. A data processing method, characterized in that: The method comprises: During the process of the target user remotely controlling the driving of the target vehicle, displaying vehicle information of the target vehicle on the display screen; Determining the sight direction of the target user when looking at the display screen; Based on the sight line direction, video images with different encoding qualities are displayed in a target area of ​​the display screen and a non-target area different from the target area, respectively; wherein the target area corresponds to the sight line direction, and the encoding quality of the video image corresponding to the target area is higher than the encoding quality of the video image corresponding to the non-target area.

2. The method according to claim 1, characterized in that The method of displaying video images of different encoding qualities in a target area of ​​a display screen and a non-target area different from the target area based on the sight line direction includes: Dividing the display screen into a plurality of sub-areas, and determining a position of a first sub-area corresponding to the sight line direction; Determine, based on the position of the first sub-region, a set of encoding quality parameters of the video picture displayed on the display screen, wherein the set of encoding quality parameters includes a first encoding quality parameter set corresponding to the target region and a second encoding quality parameter set corresponding to the non-target region, and the target region includes the first sub-region; The video picture corresponding to the first encoding quality parameter set is displayed in the target area of ​​the display screen, and the video picture corresponding to the second encoding quality parameter set is displayed in the non-target area of ​​the display screen.

3. The method according to claim 2, characterized in that Before displaying the video picture corresponding to the first encoding quality parameter set in the target area of ​​the display screen and displaying the video picture corresponding to the second encoding quality parameter set in the non-target area of ​​the display screen, the method further includes: Sending the encoding quality parameter set to the target vehicle; Receive a video picture sent by the target vehicle, wherein the video picture includes a video picture corresponding to the first encoding quality parameter set displayed in a target area of ​​the display screen, and a video picture corresponding to the second encoding quality parameter set displayed in a non-target area of ​​the display screen.

4. The method according to claim 2, characterized in that: The determining, based on the position of the first sub-area, a set of encoding quality parameters of the video picture displayed on the display screen includes: Determine, based on the position of the first sub-area, a set of encoding quality adjustment parameters for the video picture displayed on the display screen, wherein the set of encoding quality adjustment parameters includes a first set of encoding quality adjustment parameters corresponding to the target area and a second set of encoding quality adjustment parameters corresponding to the non-target area; or Based on the position of the first sub-area, a coding rate set of the video picture displayed on the display screen is determined, wherein the coding rate set includes a first coding rate set corresponding to the target area and a second coding rate set corresponding to the non-target area.

5. The method according to claim 2, characterized in that: The determining, based on the position of the first sub-area, a set of encoding quality parameters of the video picture displayed on the display screen includes: Taking the position of the first sub-region as the center, determine the encoding quality parameters corresponding to each sub-region in the target region and the non-target region; wherein the encoding quality corresponding to each sub-region is inversely correlated with the distance between the first sub-region and the position.

6. The method according to claim 2, characterized in that The determining, based on the position of the first sub-area, a set of encoding quality parameters of the video picture displayed on the display screen includes: The encoding quality parameters corresponding to each sub-region in the target region are set to be the first encoding quality parameters; Based on the distances between each sub-region in the non-target region and the positions of the first sub-region, the encoding quality parameters corresponding to each sub-region in the non-target region are determined; wherein the sizes of the encoding quality parameters corresponding to each sub-region in the non-target region are inversely correlated with the distances between each sub-region and the positions of the first sub-region.

7. The method according to claim 4, characterized in that The step of determining a set of encoding quality adjustment parameters of a video picture displayed on the display screen based on the position of the first sub-area includes: Acquire one or more state parameters of the target vehicle, wherein the state parameters include: speed, network delay, and preset bandwidth compression rate; Parameters of a peak clipping binary Gaussian model are determined based on the state parameters, and a first set of encoding quality adjustment parameters corresponding to the target area and a second set of encoding quality adjustment parameters corresponding to the non-target area are determined based on the position of the first sub-area and the peak clipping binary Gaussian model after substituting the parameters.

8. A data processing device, characterized in that: The device comprises: A display module, used to display vehicle information of the target vehicle on a display screen during the process of the target user remotely controlling the target vehicle; A determination module, used to determine the sight direction of the target user when looking at the display screen; The display module is also used to display video images with different encoding qualities in a target area of ​​the display screen and a non-target area different from the target area based on the line of sight direction; wherein the target area corresponds to the line of sight direction, and the encoding quality of the video image corresponding to the target area is higher than the encoding quality of the video image corresponding to the non-target area.

9. An electronic device, characterized in that: include: at least one processor; a memory for storing the at least one processor-executable instruction; The at least one processor is configured to execute the instructions to implement the method according to any one of claims 1 to 6.

10. A computer-readable storage medium, characterized in that: When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the method as claimed in any one of claims 1 to 6.

Images