Task processing method and device and electronic equipment

Abstract

The invention discloses a task processing method and device and electronic equipment, and is applied to the technical field of intelligent cabins and Internet of Vehicles. The task processing method is applied to a vehicle-mounted terminal, and comprises the following steps: acquiring a first image which comprises image content related to a service; generating an image processing task related to the service according to the first image; according to image processing demand information of a first vehicle-mounted intelligent device, the first image is processed to obtain image data, and the first vehicle-mounted intelligent device is a vehicle-mounted intelligent device which provides an image processing task related to the service for the vehicle machine terminal in the at least one vehicle-mounted intelligent device; sending the image data to the first vehicle-mounted intelligent equipment through a data transmission session link between the vehicle terminal and the first vehicle-mounted intelligent equipment; and under the condition that the image processing result sent by the first vehicle-mounted intelligent equipment is received, operation related to the image processing task is executed. The method can solve the problem that the response speed of related services is affected by data processing delay.

Description

TECHNICAL FIELD

[0001] The application belongs to the technical field of intelligent cockpits and Internet of Vehicles, and particularly relates to a task processing method and device and electronic equipment. BACKGROUND

[0002] With the development of automobile intelligence, the intelligent cockpit of an automobile has evolved into a comprehensive platform integrating an in-vehicle infotainment system, an advanced driving assistance system and Internet of Vehicles services. In this way, diversified services such as navigation planning, voice interaction control, real-time vehicle monitoring and multimedia entertainment can be provided for users, thereby improving the overall driving experience of users.

[0003] In the related art, to support the diversified services, the automobile usually deploys multiple types of cameras to collect image data inside and outside the vehicle, and an electronic control unit at the local end of the vehicle is used to centrally process the collected image data. However, since the electronic control unit at the local end of the vehicle needs to prioritize processing high-priority tasks such as vehicle power control and chassis transmission, the image data processing is delayed, thereby affecting the response speed of the related services. SUMMARY

[0004] Embodiments of the application provide a task processing method, device and electronic equipment, which can solve the problem that data processing delay affects the response speed of related services.

[0005] In a first aspect, embodiments of the application provide a task processing method applied to a vehicle terminal, the vehicle terminal being connected with at least one vehicle-mounted intelligent device. The task processing method comprises: acquiring a first image, the first image comprising image content related to a service; generating an image processing task related to the service according to the first image; processing the first image according to image processing requirement information of a first vehicle-mounted intelligent device to obtain image data, the first vehicle-mounted intelligent device being a vehicle-mounted intelligent device in the at least one vehicle-mounted intelligent device that provides the image processing task related to the service to the vehicle terminal; sending the image data to the first vehicle-mounted intelligent device through a data transmission session link between the vehicle terminal and the first vehicle-mounted intelligent device; and performing an operation related to the image processing task in a case where an image processing result sent by the first vehicle-mounted intelligent device is received.

[0006] In some possible implementation manners of embodiments of the application, before the step of sending the image data to the first vehicle-mounted intelligent device through the data transmission session link between the vehicle terminal and the first vehicle-mounted intelligent device, the task processing method further comprises: creating a service interface, the service interface being encapsulated with a model context protocol; broadcasting service instance information of the service to a vehicle local area network through the service interface; and establishing the data transmission session link between the vehicle terminal and the first vehicle-mounted intelligent device through the service interface.

[0007] In some possible implementation manners of the embodiments of the present application, the establishing, by the service interface, of the data transmission session link between the car machine end and the first in-vehicle intelligent device includes: receiving, by the service interface, a data transmission session link establishing request sent by the first in-vehicle intelligent device, the data transmission session link establishing request being sent by the first in-vehicle intelligent device in a case where the first in-vehicle intelligent device detects service instance information of the service in the vehicle local area network; and sending, to the first in-vehicle intelligent device, response information to establish the data transmission session link between the car machine end and the first in-vehicle intelligent device.

[0008] In some possible implementation manners of the embodiments of the present application, before the step of generating the image processing task related to the service according to the first image, the task processing method further includes: obtaining vehicle information of a vehicle in which the car machine end is installed, the vehicle information including at least one of the following: vehicle location information, scene information, and vehicle driving information; filtering, based on the vehicle information, the service matching the vehicle information from the plurality of preset services; and generating the image processing task related to the service according to the first image, including: generating the image processing task related to the service according to the first image and the service.

[0009] In some possible implementation manners of the embodiments of the present application, the first in-vehicle intelligent device runs N service models, N being an integer greater than or equal to 1; and the processing, according to the image processing requirement information of the service related to the service model of the first in-vehicle intelligent device, of the first image to obtain the image data includes: processing, according to the image processing requirement information of the service related to the service model of the N service models run by the first in-vehicle intelligent device, of the first image to obtain the image data. The image processing requirement information of the service model includes at least one of the following: a preset resolution, a preset color space, and a preset frame rate.

[0010] In some possible implementation manners of the embodiments of the present application, the sending of the image data to the first in-vehicle intelligent device includes: performing encoding processing on the image data to obtain encoded image data; and sending the encoded image data to the first in-vehicle intelligent device.

[0011] In a second aspect, the embodiments of the present application provide a task processing method applied to a first in-vehicle intelligent device, the first in-vehicle intelligent device being connected with a car machine end, and the task processing method including: receiving, through a data transmission session link between the first in-vehicle intelligent device and the car machine end, image data sent by the car machine end, the image data being determined by the car machine end based on image processing requirement information of the first in-vehicle intelligent device and a first image; processing the image data to obtain an image processing result; and sending, through the data transmission session link, the image processing result to the car machine end, so that the car machine end performs an operation related to an image processing task related to a service, the service being a service provided by the first in-vehicle intelligent device to the car machine end.

[0012] In some possible implementation manners of the embodiments of the present application, the task processing method further includes: in the case of accessing the vehicle local area network, detecting whether there is service-related broadcast information in the vehicle local area network; in the case of detecting that there is service-related broadcast information in the vehicle local area network, obtaining service instance information corresponding to the broadcast information, the service instance information carrying head unit address information; generating a data transmission session link establishment request according to the head unit address information; and sending the data transmission session link establishment request to the head unit corresponding to the head unit address information, the data transmission session link establishment request being used to request establishment of a data transmission session link with the head unit.

[0013] In a third aspect, the embodiments of the present application provide a task processing apparatus applied to a head unit, the head unit being connected with at least one vehicle intelligent device, and the task processing apparatus comprising: a first obtaining module configured to obtain a first image, the first image comprising image content related to a service; a first generating module configured to generate an image processing task related to the service according to the first image; a first processing module configured to process the first image according to image processing requirement information of a first vehicle intelligent device to obtain image data, the first vehicle intelligent device being a vehicle intelligent device in the at least one vehicle intelligent device that provides the head unit with the image processing task related to the service; a first sending module configured to send the image data to the first vehicle intelligent device through a data transmission session link between the head unit and the first vehicle intelligent device; and a second processing module configured to execute an operation related to the image processing task in the case of receiving an image processing result sent by the first vehicle intelligent device.

[0014] In a fourth aspect, the embodiments of the present application provide a task processing apparatus applied to a first vehicle intelligent device, the first vehicle intelligent device being connected with a head unit, and the task processing apparatus comprising: a first receiving module configured to receive image data sent by the head unit through a data transmission session link between the head unit and the first vehicle intelligent device, the image data being determined by the head unit based on image processing requirement information of the first vehicle intelligent device and a first image, and the service being a service provided by the first vehicle intelligent device to the head unit; a third processing module configured to process the image data to obtain an image processing result; and a second sending module configured to send the image processing result to the head unit through the data transmission session link, so that the head unit executes an operation related to an image processing task related to the service.

[0015] In a fifth aspect, the embodiments of the present application provide an electronic device, which comprises a processor and a memory storing computer program instructions; the processor implements the task processing method according to any one of the first aspect when executing the computer program instructions; or the processor implements the task processing method according to any one of the second aspect when executing the computer program instructions; or the electronic device comprises the task processing apparatus according to the third aspect; or the electronic device comprises the task processing apparatus according to the fourth aspect.

[0016] In a sixth aspect, a computer readable storage medium is provided, and the computer readable storage medium stores computer program instructions. The computer program instructions are executed by a processor to implement the task processing method according to any one of the first aspect; or the computer program instructions are executed by the processor to implement the task processing method according to any one of the second aspect.

[0017] In a seventh aspect, a computer program product is provided, and the computer program product includes computer program or instructions. The computer program or instructions are executed by a processor to implement the task processing method according to any one of the first aspect; or the computer program instructions are executed by the processor to implement the task processing method according to any one of the second aspect.

[0018] The task processing method, the device and the electronic device provided in the embodiments of the present application can generate a targeted image processing task related to a service based on the acquired first image, and the matching of image data and vehicle service is achieved. The first image is processed according to the image processing requirement information of the first in-vehicle intelligent device, so that the image data can be adapted to the processing capacity and business requirement of the first in-vehicle intelligent device, the processing burden of the first in-vehicle intelligent device is reduced, and the image processing efficiency of the first in-vehicle intelligent device is improved. Then, the image data is sent to the first in-vehicle intelligent device through the pre-established special data transmission session link, so that the speed of image data transmission can be effectively guaranteed, and the interruption or failure of the image processing task caused by data transmission delay can be avoided. At the same time, the image processing task is transferred to the first in-vehicle intelligent device for execution, so that the problem that the local data processing delay of the vehicle terminal affects the response speed of the related service can be effectively solved. Finally, the related operation is performed based on the accurate and low-delay image processing result returned by the first in-vehicle intelligent device based on the image data, so that the response speed of the related vehicle service can be improved. BRIEF DESCRIPTION OF DRAWINGS

[0019] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed in the embodiments of the present application will be briefly introduced. Those skilled in the art can obtain other drawings according to these drawings without creating any creative labor.

[0020] Figure 1 A flowchart of a task processing method applied to a vehicle terminal is shown, which is provided by some embodiments of the present application; Figure 2 A flowchart of a method for determining a service in a task processing method is shown, which is provided by some embodiments of the present application; Figure 3 A flowchart of a method for establishing a data transmission session link in a task processing method is shown, which is provided by some embodiments of the present application; Figure 4 A flowchart illustrating a specific implementation of step 1703 provided in some embodiments of this application is shown; Figure 5 A flowchart illustrating a task processing method applied to a first in-vehicle intelligent device according to some embodiments of this application is shown; Figure 6 A flowchart illustrating a specific implementation of step 240 provided in some embodiments of this application is shown; Figure 7 The present application illustrates a schematic diagram of the system architecture of an in-vehicle communication system provided in some embodiments. Figure 8 The following is a flowchart illustrating a task processing method for an in-vehicle communication system provided by some embodiments of this application; Figure 9 The present application provides a schematic diagram of the structure of a task processing device for use in a vehicle-mounted system, according to some embodiments of this application. Figure 10 This application provides a schematic diagram of the structure of a task processing device applied to a first in-vehicle intelligent device, according to some embodiments of the present application. Figure 11 The diagram shows a schematic representation of the structure of an electronic device provided in some embodiments of this application. Detailed Implementation

[0021] The features and exemplary embodiments of various aspects of this application will be described in detail below. To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain this application and not to limit it. For those skilled in the art, this application can be implemented without some of these specific details. The following description of the embodiments is merely to provide a better understanding of this application by illustrating examples.

[0022] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element.

[0023] It should be noted that the acquisition, storage, use, and processing of data in this application embodiment all comply with the relevant provisions of national laws and regulations.

[0024] It should be noted that in the embodiments of this application, certain software, components, models and other existing solutions in the industry may be mentioned. These should be regarded as exemplary and are only intended to illustrate the feasibility of implementing the technical solution of this application. However, it does not mean that the applicant has used or necessarily used the solution.

[0025] To address the problems in the aforementioned related technologies, embodiments of this application provide a task processing method, apparatus, and electronic device. The following description, in conjunction with the appendix... Figure 1 To be continued Figure 8 The task processing method provided in this application will be described in detail through specific embodiments and application scenarios.

[0026] Figure 1 The diagram illustrates a flowchart of a task processing method applied to an in-vehicle infotainment system, provided by some embodiments of this application. For example... Figure 1 As shown, this task processing method is applied to an in-vehicle infotainment system, which can be a vehicle host integrated into the vehicle, serving as a hub for interaction between the vehicle and external smart devices. The in-vehicle infotainment system is connected to at least one in-vehicle smart device, and the task processing method may specifically include steps 110 to 150.

[0027] Step 110: Obtain a first image, which includes image content related to the service; Step 120: Generate an image processing task related to the service based on the first image; Step 130: Process the first image according to the image processing requirements of the first in-vehicle intelligent device to obtain image data, wherein the first in-vehicle intelligent device is at least one in-vehicle intelligent device that provides the image processing task related to the service to the vehicle terminal; Step 140: Send the image data to the first in-vehicle intelligent device through a data transmission session link between the vehicle terminal and the first in-vehicle intelligent device; Step 150: Upon receiving the image processing result sent by the first in-vehicle intelligent device, perform operations related to the image processing task.

[0028] Therefore, by generating targeted, service-related image processing tasks based on the acquired first image, image data is matched with vehicle services. Processing the first image according to the image processing requirements of the first in-vehicle intelligent device ensures that the image data is adapted to the processing capabilities and business needs of the first in-vehicle intelligent device, reducing its processing burden and improving its image processing efficiency. Subsequently, the image data is sent to the first in-vehicle intelligent device through a pre-established dedicated data transmission session link, effectively ensuring the speed of image data transmission and preventing image processing task interruptions or failures due to data transmission delays. Simultaneously, transferring image processing tasks to the first in-vehicle intelligent device for execution effectively solves the problem of local data processing delays on the vehicle's terminal affecting the response speed of related services. Finally, performing related operations based on the accurate, low-latency image processing results returned by the first in-vehicle intelligent device based on the image data improves the response speed of related vehicle services.

[0029] The steps described above are explained in detail below.

[0030] First, regarding step 110, the first image involved in this application embodiment can be an image captured by different types of vehicle-mounted cameras installed in different locations inside and outside the vehicle.

[0031] For example, the vehicle-mounted camera (cabin camera monitoring the driver's status, forward-facing camera monitoring road conditions, and surround-view camera for panoramic images) can be controlled to capture road scenes, in-vehicle scenes, and the surrounding environment of the vehicle, and the captured raw images can be used as the first image; images can also be captured and transmitted to the vehicle's terminal via external devices such as a dashcam or vehicle-mounted action camera.

[0032] Specifically, the services may include, but are not limited to: AI-enhanced sentry service, parking memory and AI car-finding service, and seamless parking payment service. The first image may include at least one of the following images: an image of the vehicle's surrounding environment related to the AI-enhanced sentry service, an image of the vehicle's parking environment related to the parking memory and AI car-finding service, and an image of the parking facilities related to the seamless parking payment service.

[0033] Secondly, regarding step 120, the generation of the image processing task can be automatically triggered by the vehicle-mounted terminal based on the current service.

[0034] For example, if the first image is a road image, then the task related to the Advanced Driver Assistance Systems (ADAS) algorithm is matched; if the first image is a driver image, then the task related to the Driver Monitoring System (DMS) algorithm is matched; and if the first image is a side and rear view of the vehicle, then the task related to the Blind Spot Detection (BSD) algorithm is matched. The DMS is used to determine the driver's driving state by analyzing their facial expressions. If it detects driver distraction, fatigue, or other states, the vehicle's infotainment system will alert the driver to ensure their safety.

[0035] Furthermore, specific image processing tasks can be configured in conjunction with the functions of at least one in-vehicle intelligent device (AIBOX). For example, for road images, ADAS-type image processing tasks such as "extracting lane lines, recognizing traffic signs, and recognizing parking space signs" can be generated; for driver images, DMS-type image processing tasks such as driver status detection can be generated.

[0036] In some embodiments of this application, before performing step 120 above, such as Figure 2 As shown, the above task processing method may further include steps 1601 and 1602.

[0037] Step 1601: Obtain vehicle information of the vehicle with the vehicle terminal installed. The vehicle information includes at least one of the following: vehicle location information, scene information, and vehicle driving information.

[0038] Vehicle location information refers to the vehicle's specific location data in geographic space, which may include, but is not limited to: latitude and longitude coordinates, road name, and region. Scene information refers to the environmental scene characteristics data of the vehicle's current location, which may include, but is not limited to: road type (highway, urban road, rural road), traffic scene (congested road section, intersection, parking lot), environmental scene (rainy day, foggy day, night), and driving scene (overtaking, turning, parking). Vehicle driving information refers to the vehicle's driving parameters during the driving process, which may include, but is not limited to: vehicle speed, driving direction, engine speed, braking status, and turn signal status.

[0039] For example, vehicle location information can be determined by combining the Global Positioning System (GPS) built into the vehicle's infotainment system with the in-vehicle navigation map. Scene information can be obtained by recognizing the scene in the first image using a scene recognition algorithm built into the vehicle's infotainment system. Vehicle driving information can be accessed via the vehicle's CAN bus through the on-board diagnostic system interface on the infotainment system to read vehicle driving information in real time.

[0040] Step 1602: Based on vehicle information, select services that match the vehicle information from multiple preset services.

[0041] The preset services can be a set of vehicle-related services pre-configured in the vehicle's infotainment system, including but not limited to: ADAS driving assistance services, DMS driver monitoring services, BSD blind spot monitoring services, parking space sign recognition services, traffic condition analysis services, vehicle fault warning assistance services, and parking payment services.

[0042] Based on this, step 120 may specifically include generating an image processing task related to the service based on the first image and the service.

[0043] For example, the vehicle-mounted system can compare the extracted vehicle information features with rules in a matching rule base one by one to filter out services that match the vehicle information from a preset pool of services. For instance, the rules in the matching rule base may include, but are not limited to: if the vehicle information includes highways and a speed ≥ 80 km / h, match ADAS driving assistance service; if the vehicle information includes turning and a speed ≤ 40 km / h, match BSD blind spot monitoring service; if the vehicle information includes parking lots and a speed = 0 km / h, match parking space identification service; if the vehicle information includes nighttime and continuous driving for more than 4 hours, match DMS driver monitoring service. Therefore, by filtering and matching vehicle information from multiple sources, it helps generate image processing tasks related to the vehicle's current services, avoiding the indiscriminate generation of image processing tasks, reducing the ineffective computing power consumption of the first in-vehicle intelligent device, and improving the efficiency and accuracy of image processing.

[0044] Furthermore, regarding step 130, the image processing requirement information is the specific image preprocessing requirement submitted by the first in-vehicle intelligent device to the vehicle terminal in order to complete the image processing task.

[0045] In some embodiments of this application, the first in-vehicle intelligent device runs N service models, where N is an integer greater than or equal to 1. Based on this, step 130 may specifically include: processing the first image according to the image processing requirements information of the service models related to the service among the N service models running by the first in-vehicle intelligent device to obtain image data. The image processing requirements information of the service models includes at least one of the following: preset resolution, preset color space, and preset frame rate.

[0046] The service models in this embodiment are algorithm models with specific intelligent processing capabilities built into the AIBOX. Each service model corresponds to at least one specific in-vehicle service scenario, such as an ADAS lane departure warning model, a DMS driver fatigue detection model, and a BSD blind spot obstacle recognition model. It is understood that the N service models running in the first in-vehicle intelligent device can operate independently or collaboratively.

[0047] Preset resolution refers to the image size standard preset by the service model for the image processing task, used to define the input image size required by the service model. For example, the preset resolution of the DMS model in AIBOX can be 1920×1536, and the preset resolution of the BSD model in AIBOX can be 1280×720.

[0048] A preset color space refers to the image color representation format adapted to the service model, used to specify the color encoding format used in image processing. Preset color spaces can include, but are not limited to: RGB for image recognition models, YUV for video stream processing models, grayscale for feature extraction models, and NV12, a general format for model processing. For example, AIBOX's ADAS model can use the YUV color space, and AIBOX's DMS model can use the RGB color space.

[0049] The preset frame rate refers to the number of frames per second required by the service model to process the image stream. For example, the preset frame rate of AIBOX's DMS model is 3fps, and the preset frame rate of AIBOX's DMS model is 2fps.

[0050] For example, after the vehicle-mounted system generates an image processing task, it first determines the service that matches the task and the corresponding service model. Then, the system calls the image processing requirement information of the corresponding service model on the first in-vehicle intelligent device, namely, the preset resolution, preset color space, and preset frame rate. Next, it performs scaling, color space conversion, frame rate adjustment, and other processing on the first image according to the parameters corresponding to these image processing requirement information to generate standardized image data. For example, the number of acquired first images is N, with a resolution of 1950×1536, a UYVY format, and a frame rate of 30fps. The service model related to the service is the DMS fatigue detection model. The first image requirements of the DMS fatigue detection model are: preset resolution of 448×448, preset color space of NV12, and preset frame rate of 3fps. Subsequently, the vehicle-mounted system calls the image scaling algorithm to scale the resolution of the first image with a resolution of 1950×1536 to 448×448; calls the color space conversion algorithm to convert the color space of the first image with a UYVY format to NV12; and calls the frame extraction algorithm to adjust the frame rate of the first image with a frame rate of 30fps to 3fps.

[0051] To address the differentiated needs of the N different service models in AIBOX, customized image requirement information can be adjusted for each model, supporting the parallel processing requirements of multiple service models and adapting to the multi-dimensional intelligent service requirements in in-vehicle scenarios, such as running ADAS and DMS services simultaneously.

[0052] Therefore, by processing the first image based on the parameter requirements of the specific service model, the obtained image data perfectly matches the input standard of the service model, avoiding model inference errors caused by incompatibility in resolution, color space, and frame rate, and ensuring the smooth execution of subsequent image processing tasks of the service model. Furthermore, the in-vehicle system pre-processes the image parameters, eliminating the need for additional image preprocessing operations by the first in-vehicle intelligent device. This allows the computing power of the first in-vehicle intelligent device to be concentrated on algorithm inference, improving the operational efficiency and response speed of the service model.

[0053] Next, in step 140, the data transmission session link refers to a dedicated data transmission channel established between the vehicle terminal and the first in-vehicle intelligent device based on a communication protocol. This data transmission session link is a temporary or long-term session-type connection used for bidirectional transmission of image data, image processing results, and other information between the vehicle terminal and the first in-vehicle intelligent device in this image processing task.

[0054] In some embodiments of this application, before performing step 140, the task processing method further includes a process of establishing a data transmission session link. Based on this, such as... Figure 3 As shown, the above task processing method may further include steps 1701 to 1703.

[0055] Step 1701: Create a service interface, which encapsulates the model context protocol.

[0056] The service interface is a standardized communication interface established between the vehicle's infotainment system and the in-vehicle intelligent device (AIBOX), designed based on the vehicle communication protocol and the Model Context Protocol (MCP). MCP is an open protocol proposed by Anthropic, used to provide a standardized interaction interface between the service model and external tools. The MCP used in this embodiment is a unified service interface protocol customized for in-vehicle image processing scenarios. It encapsulates the context information and communication rules required for service interaction, adapting to the image processing task transmission requirements of AIBOX and ensuring the consistency and compatibility of service interaction.

[0057] Compared to the problems of complex AI capability integration and inconsistent protocols caused by the existence of multiple service interfaces and communication middleware (such as SOA architecture) in vehicle systems, this solution introduces MCP to standardize service interface protocols, which helps to build a modular service ecosystem that can be flexibly combined, thereby effectively reducing the complexity of vehicle system integration.

[0058] Step 1702: Broadcast service instance information of the service to the vehicle local area network through the service interface.

[0059] The in-vehicle local area network (IVN) refers to a dedicated communication network inside the vehicle, which may include in-vehicle Ethernet. It serves as the local network environment for data interaction between the vehicle's infotainment system and in-vehicle intelligent devices (AIBOX), in-vehicle cameras, sensors, and other equipment, characterized by low latency and high reliability. Service instance information refers to feature data characterizing specific instances of image processing services. It is the basis for AIBOX to identify and access target services and may include, but is not limited to: service name, service interface address, vehicle-mounted system identifier, and service availability status.

[0060] Step 1703: Establish a data transmission session link between the vehicle terminal and the first in-vehicle intelligent device through the service interface.

[0061] Among them, the data transmission session link is a dedicated two-way communication link established between the vehicle terminal and the first in-vehicle intelligent device through the service interface based on the model context protocol. It provides a transmission channel for the image data and command interaction of this image processing task, and has session uniqueness and task relevance. It can be released after the task is completed.

[0062] Therefore, by creating a service interface for the encapsulated model context protocol, standardized communication for in-vehicle image processing services is achieved. This ensures that the interaction between the vehicle's infotainment system and the first in-vehicle intelligent device follows unified protocol rules, reducing the risk of communication failures due to protocol incompatibility. Furthermore, by broadcasting service instance information to the in-vehicle local area network through the service interface, the first in-vehicle intelligent device automatically discovers the service without requiring manual configuration of communication parameters, thus improving the intelligence level of the interaction between the vehicle's infotainment system and the first in-vehicle intelligent device.

[0063] In some embodiments of this application, such as Figure 4 As shown, step 1703 can specifically include steps 17031 and 17032.

[0064] Step 17031: Receive a data transmission session connection establishment request sent by the first in-vehicle intelligent device through the service interface. The data transmission session connection establishment request is sent by the first in-vehicle intelligent device after detecting service instance information of the service on the in-vehicle local area network.

[0065] Among them, the data transmission session connection establishment request is a communication request sent by the first in-vehicle intelligent device to the vehicle terminal service interface after detecting matching service instance information in the in-vehicle local area network.

[0066] Step 17032: Send a response message to the first in-vehicle intelligent device to establish a data transmission session link between the vehicle terminal and the first in-vehicle intelligent device.

[0067] The response information refers to the response information sent by the vehicle terminal to the first in-vehicle intelligent device after receiving the request to establish a data transmission session link from the first in-vehicle intelligent device. It can include either a response agreeing to establish a data transmission session link or a response refusing to establish a data transmission session link.

[0068] Therefore, by receiving and responding to requests for establishing data transmission session links through the service interface, bidirectional interactive confirmation of data transmission session link establishment is achieved, enabling the data transmission session link to adapt to the communication capabilities of the vehicle terminal and the first in-vehicle intelligent device, so as to transmit image data and image processing results at high speed and stably.

[0069] In some embodiments of this application, step 140 may specifically include: encoding the image data to obtain encoded image data; and sending the encoded image data to the first vehicle-mounted intelligent device.

[0070] For example, a dedicated image encoding algorithm is used to convert the raw image data processed by the vehicle-mounted system into an encoding format adapted to the decoding capabilities of the first in-vehicle intelligent device and the transmission characteristics of the in-vehicle local area network. Simultaneously, data compression is implemented to reduce transmission bandwidth usage, aiming to improve the transmission efficiency and adaptability of image data. In specific implementations, a hardware encoder (such as an H.264 / H.265 encoder) integrated into the cockpit domain SoC can be used to efficiently compress the pre-processed image data. The size of the encoded image data is significantly reduced. Sending the reduced-size encoded image data to the first in-vehicle intelligent device can reduce the bandwidth usage of the in-vehicle local area network and improve the efficiency of image data transmission.

[0071] Therefore, by encoding image data and compressing it, the size of image data can be significantly reduced, the bandwidth usage of the vehicle local area network can be reduced, and the efficiency of image data transmission can be improved.

[0072] Furthermore, regarding step 150, the image processing result refers to the result obtained by the first in-vehicle intelligent device after further image processing of the image data sent by the vehicle terminal according to the image processing task, such as the image annotation result after target detection and the feature data after image recognition.

[0073] For example, if the image processing task is traffic sign recognition, the vehicle's infotainment system can synchronize the recognition results to the vehicle navigation system, which can then adjust the navigation route or issue driving prompts based on the traffic signs. If the image processing task is driver status detection, the vehicle's infotainment system will issue warning prompts through the car audio system and the central control screen. If the image processing task is parking space sign recognition, the vehicle's infotainment system will send the parking space recognition results to the user's mobile application, enabling remote synchronization of parking space information.

[0074] Figure 5 The illustration shows a flowchart of a task processing method applied to a first in-vehicle intelligent device according to some embodiments of this application. This task processing method is applied to a first in-vehicle intelligent device, which is connected to a vehicle-mounted system, such as... Figure 5 As shown, the task processing method specifically includes steps 210 to 230.

[0075] Step 210: Receive image data sent by the vehicle-mounted terminal via a data transmission session link. The image data is determined by the vehicle-mounted terminal based on the image processing requirement information of the first in-vehicle intelligent device and the first image. Step 220: Process the image data to obtain the image processing result. Step 230: Send the image processing result to the vehicle-mounted terminal via the data transmission session link so that the vehicle-mounted terminal can perform operations related to the image processing task related to the service. The service is the service provided by the first in-vehicle intelligent device to the vehicle-mounted terminal.

[0076] Therefore, by centralizing image processing tasks in the first in-vehicle intelligent device, the hardware performance requirements of the vehicle's infotainment system are reduced, achieving a more rational allocation of computing resources. As a service provider, the first in-vehicle intelligent device can process image data and obtain image processing results, thereby providing diverse image processing services to the vehicle's infotainment system and enhancing its functional expansion capabilities. Furthermore, utilizing the established data transmission session link for bidirectional communication between the first in-vehicle intelligent device and the vehicle's infotainment system avoids the overhead of repeatedly establishing links, improving data transmission efficiency and real-time performance.

[0077] In some embodiments of this application, after receiving the encoded image data sent by the vehicle terminal, the first in-vehicle intelligent device first decodes the encoded image data and inputs the decoded data into a service model related to the service. The service model then processes the decoded data to obtain the image processing result.

[0078] In some embodiments of this application, before performing step 210, the task processing method may further include a process of establishing a data transmission session link. Based on this, such as... Figure 6 As shown, the above task processing method may further include steps 2401 to 2404.

[0079] Step 2401: When connected to the vehicle local area network, detect whether there is any service-related broadcast information in the vehicle local area network.

[0080] For example, after the first in-vehicle intelligent device connects to the in-vehicle local area network, it continuously listens to the information in the in-vehicle local area network and detects whether there is any broadcast information related to the service in the in-vehicle local area network, so as to realize the automatic discovery of the service.

[0081] Step 2402: If broadcast information related to the service is detected in the vehicle local area network, obtain the service instance information corresponding to the broadcast information. The service instance information carries the vehicle terminal address information.

[0082] Step 2403: Generate a data transmission session connection establishment request based on the vehicle terminal address information.

[0083] Step 2404: Send a data transmission session connection establishment request to the vehicle terminal corresponding to the vehicle terminal address information. The data transmission session connection establishment request is used to request the establishment of a data transmission session connection with the vehicle terminal.

[0084] For example, after the vehicle's infotainment system powers on, the built-in Bonjour Manager module calls the Bonjour Server to broadcast service instance information of a service within the vehicle's local area network (LAN) via the Multicast DNS (mDNS) protocol. For instance, the infotainment system announces that the Around View Monitoring (AVM) video stream service is available, with the service identifier _avm._tcp. After the first in-vehicle intelligent device starts up, its Bonjour Client module continuously listens for service types matching the device within the LAN. Once the Bonjour Client module detects the service instance information broadcast by the infotainment system, it notifies the registered observer modules via the Service Notifier, triggering the subsequent connection process. Upon receiving the notification, the observer calls the Session Manager to establish a data transmission session link with the discovered AVM service. After the data transmission session link is established, the first in-vehicle intelligent device can directly receive video stream data from the infotainment system through this link, without requiring manual configuration of network parameters or service addresses. In this way, through the collaboration of the mDNS protocol and the Bonjour framework, automatic service discovery and zero-configuration connection between the vehicle's infotainment system and the first in-vehicle intelligent device are achieved. The first in-vehicle intelligent device can dynamically perceive and access available services, significantly improving service scalability and deployment efficiency, and meeting the plug-and-play functionality requirements of intelligent cockpits.

[0085] Among them, the mDNS protocol refers to a multicast-based DNS protocol that allows devices within a local area network to automatically discover and resolve each other's names without the need for a traditional DNS server.

[0086] Therefore, by using the on-demand configuration of service-related broadcast information based on the first in-vehicle intelligent device for targeted detection, the first in-vehicle intelligent device can focus only on broadcast information related to its own services, avoiding invalid processing of irrelevant broadcasts and ensuring the real-time performance and efficiency of service discovery. Subsequently, by proactively sending a data transmission session connection establishment request determined based on the vehicle terminal address information to the vehicle terminal corresponding to the vehicle terminal address information, it is ensured that the data transmission session connection establishment request can be accurately delivered to the target vehicle terminal, thus ensuring the continuity of data transmission session connection establishment.

[0087] The following section will further explain the above task processing method in conjunction with the vehicle communication system constructed by the vehicle terminal and the first in-vehicle intelligent device.

[0088] like Figure 7As shown in the figure, the vehicle communication system 300 provided in this application embodiment includes a vehicle-mounted terminal 310 and a first vehicle-mounted intelligent device 320. The vehicle-mounted terminal 310 is the hardware carrier of the intelligent cockpit system and is used to execute the instructions of the cockpit domain controller. The first vehicle-mounted intelligent device 320 is used to execute the image processing tasks of the vehicle-mounted terminal. The vehicle-mounted terminal 310 and the first vehicle-mounted intelligent device 320 can establish a communication link through wired or wireless connection. The wired connection can use vehicle Ethernet or data cable, and the wireless connection can use Wi-Fi or Bluetooth connection. The vehicle-mounted terminal and the first vehicle-mounted intelligent device are connected to the same vehicle local area network, forming an efficient and stable data transmission path.

[0089] The vehicle-mounted terminal 310 is used to acquire a first image; generate a service-related image processing task based on the first image; process the first image according to the image processing requirements of the first in-vehicle intelligent device to obtain image data, wherein the first in-vehicle intelligent device is at least one in-vehicle intelligent device that provides the service-related image processing task to the vehicle-mounted terminal; send image data to the first in-vehicle intelligent device through a data transmission session link between the vehicle-mounted terminal and the first in-vehicle intelligent device; and perform operations related to the image processing task upon receiving the image processing result sent by the first in-vehicle intelligent device.

[0090] The first in-vehicle intelligent device 320 is used to receive image data sent by the vehicle terminal through a data transmission session link with the vehicle terminal. The image data is determined by the vehicle terminal based on the image processing requirement information of the first in-vehicle intelligent device and a first image. The device processes the image data to obtain the image processing result. The device sends the image processing result to the vehicle terminal through the data transmission session link so that the vehicle terminal can perform operations related to the image processing task related to the service. The service is the service provided by the first in-vehicle intelligent device to the vehicle terminal.

[0091] Based on such Figure 7 The vehicle communication system 300 shown illustrates the above-mentioned task processing method. In some embodiments of this application, such as... Figure 8 As shown, the above task processing method may include steps 410 to 490.

[0092] Step 410: Start the service on the vehicle's infotainment system.

[0093] Step 420: The vehicle-mounted terminal broadcasts the service instance information corresponding to the service to the vehicle local area network.

[0094] Step 430: When the first in-vehicle intelligent device detects service-related broadcast information in the in-vehicle local area network, it generates a data transmission session connection establishment request based on the vehicle terminal address information carried in the broadcast information.

[0095] Step 440: The first in-vehicle intelligent device sends a data transmission session connection establishment request to the vehicle terminal.

[0096] Step 450: The vehicle terminal sends a response message to the first in-vehicle intelligent device to establish a data transmission session link between the vehicle terminal and the first in-vehicle intelligent device.

[0097] Step 460: The vehicle terminal processes the acquired first image according to the image processing requirements of the first in-vehicle intelligent device to obtain image data.

[0098] Step 470: The vehicle-mounted terminal sends image data to the first in-vehicle intelligent device through a data transmission session link.

[0099] Step 480: The first in-vehicle intelligent device calls the service model related to the service to process the image data and obtain the image processing result.

[0100] Step 490: The first in-vehicle intelligent device sends the image processing results to the vehicle terminal.

[0101] The following section will explain in detail the task processing methods of the vehicle communication system 300 in the scenarios of AI-enhanced sentry service, parking memory and AI vehicle search service, and seamless parking payment service, based on steps 410 to 490 above.

[0102] In scenarios where the service is an AI-enhanced Sentinel (AVM), when the vehicle powers on and initializes or the AIBOX connects to the vehicle's infotainment system, it immediately broadcasts service instance information for the surround-view camera service to the vehicle's local area network (LAN). The AIBOX, by monitoring LAN communication, detects the broadcast information of the surround-view camera service matching its needs, extracts the vehicle's address information from the broadcast information, and generates a data transmission session connection establishment request. The vehicle's infotainment system receives the request and sends a response to the AIBOX, completing the establishment of the data transmission session between the AIBOX and the vehicle's infotainment system, thus achieving automatic discovery and connection of the AVM service. When the user locks the vehicle, the vehicle's infotainment system, based on the processing requirements of the AIBOX's abnormal event detection model, automatically performs image preprocessing and encoding operations on the video streams of the vehicle's surrounding environment acquired by multiple surround-view cameras, converting the video streams into video data that meets the processing requirements of the abnormal event detection model. Subsequently, through the established data transmission session between the AIBOX and the vehicle's infotainment system, the processed video data is efficiently and stably transmitted to the AIBOX. AIBOX uses its built-in abnormal event detection model to analyze the received video data in real time, identify abnormal events such as "strangers pulling car doors" and "vehicle collisions", generate processing results including event type and occurrence time, and then AIBOX feeds back the abnormal event processing results to the vehicle's infotainment system, which in turn pushes alarm information to the car owner's mobile app.

[0103] In scenarios where parking memory and AI-powered car-finding services are provided, after a vehicle enters the parking area, the vehicle's infotainment system automatically activates the parking space sign recognition service and broadcasts service instance information to the vehicle's local area network (LAN). The AIBOX, by monitoring LAN communication, detects the broadcast information for the parking space sign recognition service matching its needs, extracts the vehicle's address information from the broadcast information, and generates a data transmission session connection establishment request. The vehicle's infotainment system receives the request and sends a response to the AIBOX, completing the establishment of the data transmission session between the AIBOX and the vehicle's infotainment system, thus achieving automatic discovery and connection of the parking space sign recognition service. Based on the processing requirements of the AIBOX's parking space sign recognition model, the vehicle's infotainment system continuously captures images of the parking environment (including floor markings, area signs, parking space numbers, etc.) from the camera, automatically performs image preprocessing and encoding operations, and converts the parking environment images into image data that meets the processing requirements of the parking space sign recognition model. Subsequently, through the established data transmission session between the AIBOX and the vehicle's infotainment system, the processed image data is efficiently and stably transmitted to the AIBOX. AIBOX uses a parking space sign recognition model to identify the floor, area, and parking space number in the image, generating parking location information such as "B2 Floor, Area A, No. 028". AIBOX then sends the parking location information back to the vehicle's infotainment system, which in turn pushes the information to the driver's mobile app.

[0104] In scenarios where seamless parking payment services are provided, when a vehicle enters the parking lot exit lane, the vehicle's infotainment system automatically activates the camera service and QR code recognition and payment service, and broadcasts the service instance information for the QR code recognition and payment service. AIBOX, by monitoring the vehicle's local area network communication, detects the broadcast information for the QR code recognition and payment service, extracts the vehicle's address information from the broadcast information, and generates a data transmission session connection establishment request. The vehicle's infotainment system receives the data transmission session connection establishment request and sends a response to AIBOX, completing the establishment of the data transmission session connection between AIBOX and the vehicle's infotainment system, thus achieving automatic discovery and connection of the QR code recognition and payment service. While the vehicle is driving in the parking lot exit lane, the vehicle's infotainment system, according to the requirements of AIBOX's QR code recognition model, focuses on the front-view camera to capture the payment QR code on the walls or payment devices along the route, automatically performing image preprocessing and encoding operations. The video stream is then converted into video data that meets the processing requirements of the abnormal event detection model. Subsequently, through the established data transmission session connection between AIBOX and the vehicle's infotainment system, the processed video data is efficiently and stably transmitted to AIBOX. AIBOX uses its built-in QR code recognition AI model to analyze the image, extract the payment link information from the QR code, and generate a recognition result containing the payment amount and the payee. AIBOX then sends the QR code recognition result and payment link back to the vehicle's infotainment system. After payment is completed, the system pushes the payment result to the owner's mobile app.

[0105] Based on the task processing method 100 provided in the above embodiments, this application also provides specific implementations of the task processing apparatus. Please refer to the following embodiments.

[0106] See Figure 9 The task processing device provided in this application embodiment is applied to the vehicle terminal, which is connected to at least one in-vehicle intelligent device. The task processing device 500 includes a first acquisition module 510, a first generation module 520, a first processing module 530, a first sending module 540, and a second processing module 550.

[0107] The first acquisition module 510 is used to acquire a first image, which includes image content related to the service; the first generation module 520 is used to generate an image processing task related to the service based on the first image; the first processing module 530 is used to process the first image according to the image processing requirements information of the first in-vehicle intelligent device to obtain image data, wherein the first in-vehicle intelligent device is at least one in-vehicle intelligent device that provides image processing tasks related to the service to the vehicle terminal; the first sending module 540 is used to send image data to the first in-vehicle intelligent device through a data transmission session link between the vehicle terminal and the first in-vehicle intelligent device; and the second processing module 550 is used to perform operations related to the image processing task upon receiving the image processing result sent by the first in-vehicle intelligent device.

[0108] Therefore, the first generation module 520 can generate targeted, service-related image processing tasks based on the first image acquired by the first acquisition module 510, achieving matching of image data with vehicle services. The first processing module 530 processes the first image according to the image processing requirements of the first in-vehicle intelligent device, enabling the image data to adapt to the processing capabilities and business needs of the first in-vehicle intelligent device, reducing its processing burden and improving its image processing efficiency. Subsequently, the first sending module 540 sends the image data to the first in-vehicle intelligent device through a pre-established dedicated data transmission session link, effectively ensuring the speed of image data transmission and preventing image processing task interruptions or failures due to data transmission delays. Simultaneously, transferring the image processing task to the first in-vehicle intelligent device effectively solves the problem of local data processing delays on the vehicle terminal affecting the response speed of related services. Finally, the second processing module 550 performs related operations based on the accurate, low-latency image processing results returned by the first in-vehicle intelligent device based on the image data, improving the response speed of related vehicle services.

[0109] In some embodiments of this application, the task processing apparatus 500 further includes a service interface creation module, a broadcast module, and a data transmission session link establishment module.

[0110] The service interface creation module is used to create service interfaces, which encapsulate the model context protocol; the broadcast module is used to broadcast service instance information of the service to the vehicle local area network through the service interface; and the data transmission session link establishment module is used to establish a data transmission session link between the vehicle terminal and the first vehicle intelligent device through the service interface.

[0111] In some embodiments of this application, the data transmission session link establishment module is configured to: receive a data transmission session link establishment request sent by a first in-vehicle intelligent device through a service interface, wherein the data transmission session link establishment request is sent by the first in-vehicle intelligent device when the service instance information of the service is detected in the vehicle local area network; and send response information to the first in-vehicle intelligent device to establish a data transmission session link between the vehicle terminal and the first in-vehicle intelligent device.

[0112] In some embodiments of this application, the task processing device 500 described above further includes a second acquisition module and a filtering module.

[0113] The second acquisition module is used to acquire vehicle information of the vehicle installed on the vehicle terminal. The vehicle information includes at least one of the following: vehicle location information, scene information, and vehicle driving information. The filtering module is used to filter services that match the vehicle information from multiple preset services based on the vehicle information.

[0114] In some embodiments of this application, the first in-vehicle intelligent device runs N service models, where N is an integer greater than or equal to 1; the first processing module is used to process the first image according to the image processing requirement information of the service models related to the service among the N service models running by the first in-vehicle intelligent device, to obtain image data. The image processing requirement information of the service models includes at least one of the following: preset resolution, preset color space, and preset frame rate.

[0115] In some embodiments of this application, the task processing device 500 described above also includes an encoding module.

[0116] The encoding module is used to encode the image data before sending the image data to the first vehicle-mounted intelligent device, so as to obtain the encoded image data.

[0117] The first sending module 540 is specifically used to send encoded image data to the first vehicle-mounted intelligent device.

[0118] The various modules of the task processing device 500 provided in this application embodiment can realize Figures 1 to 4 The functions of each step in the provided task processing method and the corresponding technical effects are described briefly and will not be elaborated here.

[0119] Based on the task processing method 200 provided in the above embodiments, this application also provides specific implementations of the task processing apparatus. Please refer to the following embodiments.

[0120] The task processing device provided in this embodiment is applied to a first in-vehicle intelligent device, which is connected to a vehicle-mounted terminal. See [link to relevant documentation]. Figure 10The task processing device 600 in this embodiment may include a first receiving module 610, a third processing module 620, and a second sending module 630.

[0121] The first receiving module 610 is used to receive image data sent by the vehicle-mounted terminal through a data transmission session link with the vehicle-mounted terminal. The image data is determined by the vehicle-mounted terminal based on the image processing requirement information of the first in-vehicle intelligent device and the first image. The third processing module 620 is used to process the image data to obtain the image processing result. The second sending module 630 is used to send the image processing result to the vehicle-mounted terminal through the data transmission session link so that the vehicle-mounted terminal can perform operations related to the image processing task related to the service. The service is the service provided by the first in-vehicle intelligent device to the vehicle-mounted terminal.

[0122] Therefore, the first receiving module 610 receives image data sent from the vehicle-mounted terminal, the third processing module 620 processes the image data, and then the second sending module 630 sends the image processing result back to the vehicle-mounted terminal. This concentrates the image processing task on the first in-vehicle intelligent device, reducing the hardware performance requirements of the vehicle-mounted terminal and achieving a reasonable allocation of computing resources. As a service provider, the first in-vehicle intelligent device can process the image data and obtain image processing results, thereby providing diverse image processing services to the vehicle-mounted terminal and enhancing its functional expansion capabilities. Furthermore, utilizing the established data transmission session link for bidirectional communication between the first in-vehicle intelligent device and the vehicle-mounted terminal avoids the overhead of repeatedly establishing links, improving data transmission efficiency and real-time performance.

[0123] In some embodiments of this application, the task processing device 600 described above may further include a detection module, a third acquisition module, a second generation module, and a third sending module.

[0124] The system comprises the following modules: a detection module for detecting service-related broadcast information within the vehicle's local area network (LAN); a third acquisition module for acquiring service instance information corresponding to the broadcast information, which carries the vehicle's terminal address information; a second generation module for generating a data transmission session connection establishment request based on the vehicle's terminal address information; and a third sending module for sending the data transmission session connection establishment request to the vehicle's terminal corresponding to the vehicle's terminal address information.

[0125] Figure 11 The diagram shows a hardware structure schematic of an electronic device provided in some embodiments of this application.

[0126] The electronic device may include a processor 701 and a memory 702 storing computer program instructions.

[0127] Specifically, the processor 701 may include a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits that can be configured to implement the embodiments of this application.

[0128] Memory 702 may include mass storage for data or instructions. For example, and not limitingly, memory 702 may include a hard disk drive (HDD), floppy disk drive, flash memory, optical disk, magneto-optical disk, magnetic tape, or Universal Serial Bus (USB) drive, or a combination of two or more of these. Where appropriate, memory 702 may include removable or non-removable (or fixed) media. Where appropriate, memory 702 may be internal or external to the integrated gateway disaster recovery device. In a particular embodiment, memory 702 is non-volatile solid-state memory.

[0129] In a particular embodiment, memory 702 may include read-only memory (ROM), random access memory (RAM), disk storage media device, optical storage media device, flash memory device, electrical, optical, or other physical / tangible memory storage device. Therefore, typically, memory 702 includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the task processing method in the above embodiments according to this application.

[0130] The processor 701 implements any of the task processing methods described in the above embodiments by reading and executing computer program instructions stored in the memory 702.

[0131] In one example, the electronic device may also include a communication interface 703 and a bus 710. For example, Figure 7 As shown, the processor 701, memory 702, and communication interface 703 are connected through bus 710 and complete communication with each other.

[0132] The communication interface 703 is mainly used to realize communication between various modules, devices, units and / or equipment in the embodiments of this application.

[0133] Bus 710 includes hardware, software, or both, that couples components of an electronic device together. For example, and not limitingly, the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an Infinite Bandwidth Interconnect, a Low Pin Count (LPC) bus, a memory bus, a Microchannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local (VLB) bus, or other suitable buses, or combinations of two or more of these. Where appropriate, bus 710 may include one or more buses. Although specific buses are described and illustrated in embodiments of this application, this application contemplates any suitable bus or interconnect.

[0134] The electronic device can execute the task processing method described in the embodiments of this application, thereby achieving a combination Figures 1 to 10 The described task processing methods and apparatus.

[0135] Furthermore, in conjunction with the task processing methods in the above embodiments, this application embodiment can provide a computer-readable storage medium for implementation. This computer-readable storage medium stores computer program instructions; when these computer program instructions are executed by a processor, they implement any of the task processing methods in the above embodiments. Examples of computer-readable storage media include non-transitory computer-readable storage media, such as portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, etc.

[0136] Furthermore, in conjunction with the task processing methods in the above embodiments, this application embodiment can provide a computer program product for implementation. This program product is stored in a storage medium and may specifically include a computer program or instructions. When executed by a processor, the computer program or instructions implement any of the task processing methods in the above embodiments. This program product is executed by at least one processor to implement the various processes of the above task processing method embodiments and achieves the same technical effects; therefore, to avoid repetition, further details are omitted here.

[0137] It should be clarified that this application is not limited to the specific configurations and processes described above and shown in the figures. For the sake of brevity, detailed descriptions of known methods are omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of this application is not limited to the specific steps described and shown. Those skilled in the art can make various changes, modifications, and additions, or change the order of steps, after understanding the spirit of this application.

[0138] The functional blocks shown in the above block diagram can be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, they can be, for example, electronic circuits, application-specific integrated circuits (ASICs), appropriate firmware, plug-ins, function cards, etc. When implemented in software, the elements of this application are programs or code segments used to perform the required tasks. Programs or code segments can be stored on a machine-readable medium or transmitted over a transmission medium or communication link via data signals carried on a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, radio frequency (RF) links, etc. Code segments can be downloaded via computer networks such as the Internet, intranets, etc.

[0139] It should also be noted that the exemplary embodiments mentioned in this application describe methods or systems based on a series of steps or apparatus. However, this application is not limited to the order of the above steps; that is, the steps can be performed in the order mentioned in the embodiments, or in a different order, or several steps can be performed simultaneously.

[0140] The aspects of this disclosure have been described above with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block in the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable task processing apparatus to produce a machine such that these instructions, executable via the processor of the computer or other programmable task processing apparatus, enable the implementation of the function / action specified in one or more blocks of the flowchart illustrations and / or block diagrams. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor, or a field-programmable logic circuit. It is also understood that each block in the block diagrams and / or flowchart illustrations, and combinations of blocks in the block diagrams and / or flowchart illustrations, can also be implemented by special-purpose hardware performing the specified function or action, or can be implemented by a combination of special-purpose hardware and computer instructions.

[0141] The above are merely specific embodiments of this application. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, modules, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here. It should be understood that the protection scope of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the protection scope of this application.

Claims

1. A task processing method, characterized in that, Applied to in-vehicle infotainment systems, the in-vehicle infotainment system is connected to at least one in-vehicle intelligent device, including: Obtain a first image, which includes image content related to the service; Based on the first image, generate an image processing task related to the service; According to the image processing requirements of the first in-vehicle intelligent device, the first image is processed to obtain image data. The first in-vehicle intelligent device is the in-vehicle intelligent device that provides image processing tasks related to the service to the vehicle terminal among the at least one in-vehicle intelligent devices. The image data is sent to the first in-vehicle intelligent device through a data transmission session link between the vehicle terminal and the first in-vehicle intelligent device. Upon receiving the image processing result sent by the first in-vehicle intelligent device, perform operations related to the image processing task.

2. The method according to claim 1, characterized in that, Before sending the image data to the first in-vehicle intelligent device via the data transmission session link between the vehicle-mounted terminal and the first in-vehicle intelligent device, the method further includes: Create a service interface, which encapsulates the model context protocol; The service instance information of the service is broadcast to the vehicle local area network through the service interface. Through the service interface, a data transmission session link is established between the vehicle terminal and the first in-vehicle intelligent device.

3. The method according to claim 2, characterized in that, The step of establishing a data transmission session link between the vehicle-mounted terminal and the first in-vehicle intelligent device through the service interface includes: Through the service interface, a data transmission session connection establishment request sent by the first in-vehicle intelligent device is received. The data transmission session connection establishment request is sent by the first in-vehicle intelligent device when the service instance information of the service is detected in the in-vehicle local area network. Send a response message to the first in-vehicle intelligent device to establish a data transmission session link between the vehicle terminal and the first in-vehicle intelligent device.

4. The method according to claim 1, characterized in that, Before generating the image processing task related to the service based on the first image, the method further includes: Obtain vehicle information of the vehicle on which the vehicle terminal is installed, wherein the vehicle information includes at least one of the following: vehicle location information, scene information, and vehicle driving information; Based on the vehicle information, select services that match the vehicle information from multiple preset services; The step of generating an image processing task related to the service based on the first image includes: Based on the first image and the service, an image processing task related to the service is generated.

5. The method according to any one of claims 1-4, characterized in that, The first in-vehicle intelligent device runs N service models, where N is an integer greater than or equal to 1; The step of processing the first image according to the image processing requirements of the first in-vehicle intelligent device to obtain image data includes: Based on the image processing requirements of the service models related to the service among the N service models running the first in-vehicle intelligent device, the first image is processed to obtain image data; The image processing requirements of the service model include at least one of the following: preset resolution, preset color space, and preset frame rate.

6. The method according to any one of claims 1-4, characterized in that, Sending the image data to the first in-vehicle intelligent device includes: The image data is encoded to obtain encoded image data; The encoded image data is sent to the first in-vehicle intelligent device.

7. A task processing method, characterized in that, Applied to a first in-vehicle intelligent device, the first in-vehicle intelligent device being connected to a vehicle-mounted terminal, including: The system receives image data sent by the vehicle-mounted terminal via a data transmission session link with the vehicle-mounted terminal. The image data is determined by the vehicle-mounted terminal based on the image processing requirements information of the first in-vehicle intelligent device and the first image. The image data is processed to obtain the image processing result; The image processing result is sent to the vehicle-mounted terminal via the data transmission session link, so that the vehicle-mounted terminal can perform operations related to the image processing task related to the service, wherein the service is the service provided by the first in-vehicle intelligent device to the vehicle-mounted terminal.

8. The task processing method according to claim 7, characterized in that, The method further includes: When connected to the vehicle local area network, detect whether there is any broadcast information related to the service in the vehicle local area network; If broadcast information related to the service is detected in the vehicle local area network, the service instance information corresponding to the broadcast information is obtained, and the service instance information carries the vehicle terminal address information. Based on the vehicle terminal address information, a data transmission session connection establishment request is generated; Send the data transmission session connection establishment request to the vehicle terminal corresponding to the vehicle terminal address information. The data transmission session connection establishment request is used to request the establishment of a data transmission session connection with the vehicle terminal.

9. A task processing device, characterized in that, Applied to in-vehicle infotainment systems, the in-vehicle infotainment system is connected to at least one in-vehicle intelligent device, including: The first acquisition module is used to acquire a first image, wherein the first image includes image content related to the service; The first generation module is used to generate service-related image processing tasks based on the first image; The first processing module is used to process the first image according to the image processing requirements information of the first in-vehicle intelligent device to obtain image data. The first in-vehicle intelligent device is the in-vehicle intelligent device that provides image processing tasks related to the service to the vehicle terminal among the at least one in-vehicle intelligent devices. The first sending module is used to send the image data to the first in-vehicle intelligent device through the data transmission session link between the vehicle terminal and the first in-vehicle intelligent device; The second processing module is used to perform operations related to the image processing task upon receiving the image processing result sent by the first in-vehicle intelligent device.

10. A task processing device, characterized in that, Applied to a first in-vehicle intelligent device, the first in-vehicle intelligent device being connected to a vehicle-mounted terminal, including: The first receiving module is used to receive image data sent by the vehicle terminal through a data transmission session link with the vehicle terminal. The image data is determined by the vehicle terminal based on the image processing requirements information of the first in-vehicle intelligent device and a first image. The third processing module is used to process the image data to obtain the image processing result; The second sending module is used to send the image processing result to the vehicle terminal through the data transmission session link, so that the vehicle terminal can perform operations related to the image processing task related to the service, wherein the service is the service provided by the first in-vehicle intelligent device to the vehicle terminal.

11. An electronic device, characterized in that, The electronic device includes: a processor and a memory storing computer program instructions; When the processor executes the computer program instructions, it implements the task processing method as described in any one of claims 1-6; Alternatively, the processor may implement the task processing method as described in any one of claims 7 or 8 when executing the computer program instructions; Alternatively, it may include the task processing apparatus as described in claim 9; Alternatively, it may include the task processing apparatus as described in claim 10.

Images