Chip system and terminal equipment

Abstract

The invention provides a chip system and terminal equipment, and relates to the technical field of terminal equipment. The chip system comprises an AP and an AIGC chip, a content generation model is deployed in the AIGC chip, the AP is configured to send first data to the AIGC chip, and the AIGC chip is configured to execute a corresponding content generation task according to the first data and the content generation model. The invention aims to improve the problems that the privacy is poor, the network needs to be accessed and the delay is high when the content generation task is realized through interaction of the terminal equipment and the remote service equipment.

Description

Technical Field

[0001] The embodiments of the present application relate to the technical field of terminal devices, and in particular to chip systems and terminal devices. Background Art

[0002] Artificial intelligence generated content (AIGC) refers to the process and results of automatically creating or generating various types of content using artificial intelligence technology. These contents can cover various forms such as text, images, audio, and video. At present, the realization of content generation tasks mainly relies on the interaction between terminal devices and remote service devices. However, there are problems such as poor privacy and high latency. Summary of the invention

[0003] The embodiments of the present application provide a chip system and a terminal device for improving the problems of poor privacy, the need to access the network and high latency in implementing content generation tasks that rely on the interaction between the terminal device and the remote service device.

[0004] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions: In a first aspect, an embodiment of the present application provides a chip system, including an application processor (AP) and an artificial intelligence content generation AIGC chip, wherein a content generation model is deployed in the AIGC chip, and the AP is configured to send first data to the AIGC chip, and the AIGC chip is configured to perform corresponding content generation tasks according to the first data and the content generation model.

[0005] The chip system provided in the embodiment of the present application can complete content generation tasks on the terminal device, reduce dependence on remote servers, and thus reduce network requirements. Since data does not need to be frequently uploaded to the cloud for calculation, the user's input data is always processed locally, avoiding the risk of data leakage during transmission and significantly improving privacy. At the same time, the AIGC chip can select and call the corresponding content generation model according to the first data type sent by the AP, so that various content generation tasks can be directly and efficiently executed locally, thereby avoiding the delay caused by remote calculation and data return, and improving task execution efficiency and user experience.

[0006] In an embodiment of the first aspect of the present application, the chip system also includes a switching module and a first chip, the switching module includes a first PCIe interface, a second PCIe interface and a third PCIe interface, the switching module is connected to the AP through the first PCIe interface, the switching module is connected to the AIGC chip through the second PCIe interface, the switching module is connected to the first chip through the third PCIe interface, and the AP is configured to: send the first data and the second data to the switching module, and the switching module is configured to: forward the first data to the AIGC chip, forward the second data to the first chip, or receive the third data sent by the AIGC chip and the fourth data sent by the first chip and send them to the AP.

[0007] The chip system provided in the embodiment of the present application introduces a switching module so that the AIGC chip can be efficiently deployed in the terminal device, and the bandwidth of the PCIe interface can be fully utilized when the PCIe interface on the AP side is limited. The switching module can be connected to the AP, the AIGC chip and the first chip respectively, so as to build an efficient data interaction channel. The AP can manage the content generation task calculation and other computing tasks of the first chip at the same time through the switching module. Therefore, the resources of the existing PCIe interface can be fully utilized, avoiding the introduction of additional PCIe interface overhead due to the independent deployment of the AIGC chip, and improving the hardware resource utilization of the system.

[0008] In an embodiment of the first aspect of the present application, the AP is configured to: obtain the current application scenario of the terminal device, and send a time slice length parameter, a data transmission weight parameter of the third data, and a data transmission weight parameter of the fourth data to the switching module according to the current application scenario, the time slice length parameter is used to characterize the total time of a single data transmission, and the data transmission weight parameter is used to characterize the time proportion of data transmission.

[0009] The chip system provided in the embodiment of the present application can dynamically adjust the priority of the data stream according to the current application scenario of the terminal device, ensuring that content generation tasks and other computing tasks can obtain reasonable resource allocation in different application scenarios, thereby improving the computing performance and response speed of the terminal device.

[0010] In an embodiment of the first aspect of the present application, the AP is specifically configured to: determine a time slice length parameter based on the number of data access requirements for the first chip and the AIGC chip in the current application scenario and the load status of the current application scenario, and the time slice length parameter is negatively correlated with the number of data access requirements for the first chip and the AIGC chip. The higher the load, the smaller the value of the time slice length parameter, and the lower the load, the larger the value of the time slice length parameter.

[0011] In an embodiment of the first aspect of the present application, the AP is specifically configured to: determine the data transmission weight parameter of the third data according to a matching relationship between the current application scenario and the data transmission weight parameter of the preset third data.

[0012] In an embodiment of the first aspect of the present application, the AP is specifically configured to: determine the fourth data transmission weight parameter according to a matching relationship between a current application scenario and a preset fourth data transmission weight parameter.

[0013] In an embodiment of the first aspect of the present application, the switching module includes an arbitrator, which is configured to: determine the time transmission ratio of the third data and the fourth data based on the proportional relationship between the data transmission weight parameter of the third data and the data transmission weight parameter of the fourth data, determine the time when the second PCIe interface receives the third data based on the time slice length parameter and the time transmission ratio of the third data, and determine the time when the third PCIe interface receives the fourth data based on the time slice length parameter and the time transmission ratio of the fourth data.

[0014] The chip system provided in the embodiment of the present application can ensure that high-priority data is transmitted first when transmitting business data, thereby improving the response speed and data transmission efficiency of high-priority data.

[0015] In an embodiment of the first aspect of the present application, the switching module further includes a buffer, and the buffer is configured to: cache the first data, the second data, the third data, and the fourth data.

[0016] In an embodiment of the first aspect of the present application, the AIGC chip and the switching module are integrated on the same chip die.

[0017] The chip system provided in the embodiment of the present application can reduce packaging complexity, make the integration of AIGC chips more flexible, and reduce the manufacturing cost of terminal equipment.

[0018] In a second aspect, the present application provides a terminal device, comprising a chip system according to any one of the first aspects.

[0019] Among them, the technical effects of the second aspect refer to the technical effects of the first aspect and any of its embodiments, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 A schematic diagram of the structure of a terminal device provided in an embodiment of the present application; Figure 2 A schematic diagram of interaction between a terminal device and a remote service device provided in an embodiment of the present application; Figure 3 A schematic diagram of a chip system architecture provided for an embodiment of the present application Figure 1 ; Figure 4 A schematic diagram of a chip system architecture provided for an embodiment of the present application Figure 2 ; Figure 5 A schematic diagram of a chip system architecture provided for an embodiment of the present application Figure 3 ; Figure 6 A schematic diagram of a time slice configuration provided for an embodiment of the present application; Figure 7 A schematic diagram of a chip system architecture provided for an embodiment of the present application Figure 4 ; Figure 8 A schematic diagram of a chip system architecture provided for an embodiment of the present application Figure 5 ; Fig. 9 A schematic diagram of a chip system architecture provided for an embodiment of the present application Figure 6 . DETAILED DESCRIPTION

[0021] The terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification and appended claims of the present application, the singular expressions "one", "a kind of", "above", "the" and "this" are intended to also include, for example, "one or more" such expressions, unless there is an explicit contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one or more than two (including two). The character " / " generally represents that the front and back associated objects are a kind of "or" relationship.

[0022] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments.

[0023] In the following, the terms "first", "second", etc. are used only for convenience of description and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first", "second", etc. may explicitly or implicitly include one or more of the features. In the description of this application, unless otherwise specified, "plurality" means two or more. For example, a plurality of processing units refers to two or more processing units.

[0024] In addition, in the embodiments of the present application, "upper", "lower", "left" and "right" are not limited to being defined relative to the orientation of the components schematically placed in the drawings. It should be understood that these directional terms can be relative concepts, which are used for description and clarification relative to the components, and can change accordingly according to the change in the orientation of the components placed in the drawings. In the drawings, for the sake of clarity, the thickness of the layers and regions is exaggerated, and the size ratio relationship between the parts in the drawings does not reflect the actual size ratio relationship.

[0025] In the embodiments of the present application, unless otherwise clearly specified and limited, the term "connection" should be understood in a broad sense. For example, "connection" can be a fixed connection, a detachable connection, or an integral connection; it can be a direct connection or an indirect connection through an intermediate medium. In addition, the term "electrical connection" can be a direct electrical connection or an indirect electrical connection through an intermediate medium.

[0026] In the embodiments of the present application, the term "module" is generally a functional structure divided according to logic, and the "module" can be implemented by pure hardware, or by a combination of software and hardware. In the embodiments of the present application, "and / or" describes the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, B exists alone, and A and B exist at the same time.

[0027] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0028] At present, when performing content generation tasks, terminal devices first obtain information input by users, which can include information in various forms such as text, voice, image or video. Users submit requirements or instructions through the interactive interface on the terminal device, and the terminal device pre-processes the data and then transmits the request to the remote service device through the network.

[0029] Remote service devices can be located in the cloud or data center, have powerful computing power and storage resources, can run complex AIGC models, and can achieve a variety of content generation tasks such as text generation, image processing, and speech synthesis. After receiving the request sent by the terminal device, the remote service device can call the corresponding model or algorithm according to the request content, perform deep calculation and reasoning, and generate the required content.

[0030] After completing the content generation task, the remote service device will package and compress the data and return it to the terminal device through a secure network channel. The terminal device will then perform necessary post-processing on the returned data, such as formatting, rendering, decoding, etc., and finally display the generated content to the user. This interactive architecture based on cloud services and terminal devices can not only utilize the powerful computing power of remote service devices to process large-scale data and complex algorithms, but also enable terminal devices to achieve high-quality content generation task execution even with limited hardware resources.

[0031] like Figure 1 As shown, an embodiment of the present application provides a terminal device 100, which is an electronic device with wireless communication function. The electronic device can be mobile or fixed. The electronic device can be deployed on land (for example, indoors or outdoors, handheld or vehicle-mounted, etc.), on the water (for example, ships, etc.), or in the air (for example, airplanes, balloons, and satellites, etc.). The electronic device can be called user equipment (UE), access terminal, terminal unit, subscriber unit, terminal station, mobile station (MS), mobile station, terminal agent or terminal device, etc. For example, the electronic device may be a mobile phone, a tablet computer, a laptop computer, a smart bracelet, a smart screen, a smart watch, a virtual reality (VR) device, an augmented reality (AR) device, a terminal in industrial control, a terminal in self-driving, a terminal in remote medical, a terminal in smart grid, a terminal in transportation safety, a terminal in smart city, a terminal in smart home, etc. The embodiments of the present application do not limit the specific type and structure of the electronic device. A possible structure of the electronic device is described below.

[0032] like Figure 1 As shown in Figure A, the terminal device 100 may include a front camera 2931 and a display screen 294. Figure 1 As shown in B, the terminal device 100 may include a back camera 2932. The front camera 2931 and the back camera 2932 are used to capture static images or dynamic videos (collectively referred to as images). The display screen 294 is used to display images or receive user touch operations.

[0033] Figure 2The diagram shows the interaction between the terminal device 100 and the remote service device 200. After obtaining the information input by the user, the terminal device 100 sends the corresponding request information to the remote service device 200. After receiving the request sent by the terminal device 100, the remote service device 200 can call the corresponding model or algorithm according to the request content, perform deep calculation and reasoning, generate the required content and send the processing results to the terminal device 100.

[0034] However, in the above implementation, there are problems such as high network demand, poor privacy and high latency.

[0035] The reason for the high network demand is that there needs to be continuous data interaction between remote service devices and terminal devices, including the sending of task requests, the return of calculation results, and the necessary post-processing data transmission. The frequency and amount of these data transmissions will increase with the complexity of the content generation tasks, thereby placing higher requirements on network bandwidth and stability. Especially in scenarios such as high-definition image generation and large-scale text processing, the amount of data transmission is even greater, further exacerbating the dependence on the network.

[0036] The reason for the poor privacy is that data needs to be transmitted between the terminal device and the remote service device, that is, the user's input information, task requests and some intermediate calculation results may pass through the external server, which poses a risk of data leakage, unauthorized access or abuse.

[0037] The reason for the high delay is that the execution process of the content generation task involves multiple links, including the terminal device sending a request to the remote service device, the remote service device performing calculations and processing, data packaging and compression and transmission back to the terminal device, and the terminal device performing post-processing and final presentation. Any network delay, calculation processing time or data transmission speed limitation in any of these links will cause delays in the execution of the overall task, especially when the remote service device is highly loaded or the network environment is poor, the delay problem is more obvious, affecting the user experience.

[0038] In order to improve the above problems, the present application provides a chip system that can be deployed in the terminal device 100 in the above embodiment. Figure 3The chip system may include an AP 301 and an AIGC chip 302. A content generation model is deployed in the AIGC chip 302. The content generation model deployed in the AIGC chip 302 may include multiple different types for performing different content generation tasks. As an example, a language model for generating text content may be deployed in the AIGC chip 302, and text may be automatically generated according to the input prompt information. A model for generating image content may also be deployed in the AIGC chip 302, which can intelligently control image style, details and other aspects. A model for generating speech synthesis may also be deployed in the AIGC chip 302, which can convert text into high-quality speech output to meet the speech requirements in multimedia interaction scenarios. A model for video generation or editing may also be deployed in the AIGC chip 302, which can complete the generation or dynamic adjustment of video content to meet the requirements of real-time video applications.

[0039] When executing a content generation task, AP 301 first sends first data to AIGC chip 302. The first data may be initial data matching the current content generation task, such as text, voice command, image or video clip, etc. After receiving the first data sent by AP 301, AIGC chip 302 selects and calls the corresponding content generation model deployed internally according to the type of the first data to execute the corresponding content generation task.

[0040] As an example, in a text image generation task, AP 301 can send an instruction information text to AIGC chip 302. After receiving the instruction information text, AIGC chip 302 will call the internal text-to-image generation model to generate corresponding image data according to the text, and transmit the generated image data back to AP 301 for display or editing by the terminal device.

[0041] In the Wensheng speech synthesis task, the AP 301 can send a piece of instruction information text to the AIGC chip 302. After receiving the instruction information text, the AIGC chip 302 will call the internal speech synthesis model to convert the text into corresponding speech data, and return the synthesized speech data to the AP 301, so that the device can play or store it through the speaker.

[0042] In the Vincent video task, AP 301 can send an indication information text to AIGC chip 302. After receiving the indication information text, AIGC chip 302 will call the internal Vincent video model, parse the text into corresponding visual elements, and generate video data that conforms to the text, and finally return the video data to AP 301 so that the terminal device can play or store it.

[0043] Through the above process, the collaborative work between AP 301 and AIGC chip 302 enables the content generation task to be executed efficiently. The various content generation models inside the AIGC chip 302 can be flexibly called according to task requirements to achieve high-quality and diversified content generation capabilities, thereby improving the intelligence level of terminal devices and user experience.

[0044] The chip system provided in the embodiment of the present application can complete content generation tasks on the terminal device, reduce dependence on remote servers, and thus reduce network demand. Since data does not need to be frequently uploaded to the cloud for calculation, the user's input data is always processed locally, avoiding the risk of data leakage during transmission and significantly improving privacy. At the same time, the AIGC chip 302 can select and call the corresponding content generation model according to the first data type sent by AP 301, so that various content generation tasks can be directly and efficiently executed locally, thereby avoiding the delay caused by remote calculation and data return, and improving task execution efficiency and user experience.

[0045] When the AIGC chip 302 is deployed in the terminal device, since the number of PCIE interfaces of the AP 301 is limited, it is necessary to reuse the existing PCIE interfaces whose bandwidth is not fully occupied, and the PCIe channel connecting the first chip to the AP 301 has a large redundancy, so the switching module can be used to expand the connection link between the first chip and the AP 301 to realize the deployment of the AIGC chip 302.

[0046] See also Figure 4 The chip system shown includes not only AP 301 and AIGC chip 302, but also switching module 303 and first chip 304. Switching module 303 includes a first PCIe interface, a second PCIe interface and a third PCIe interface. Switching module 303 is connected to AP 301 through the first PCIe interface, and is connected to AIGC chip 302 through the second PCIe interface. Switching module 303 is connected to first chip 304 through the third PCIe interface.

[0047] As an example, AP 301 can be an SM8750 platform, and the first chip 304 can be a WLAN chip, a Bluetooth chip, or other chips with large PCIe channel redundancy. The SM8750 platform can be connected to the WLAN chip through a set of PCIe Gen3x2 interfaces, and the overall bandwidth of the PCIe Gen3x2 interface is 16Gbps, while the WLAN chip only needs 5.8Gbps bandwidth. Therefore, when the bandwidth utilization of the PCIe interface still has large redundancy, part of the bandwidth can be divided on the same physical channel for the AIGC chip 302 to communicate with the AP 301. In this way, the AIGC chip 302 can share the remaining PCIe bandwidth, thereby avoiding the addition of an additional independent high-speed data bus, reducing the complexity of hardware design, and still providing sufficient bandwidth to support the large data throughput required for AIGC model reasoning.

[0048] Under the above architecture, the first chip 304 and the AIGC chip 302 can perform corresponding tasks at the same time without affecting or interfering with each other. Specifically, the AP 301 can send the first data and the second data to the switching module 303, and the second data can be the service data corresponding to the corresponding task performed by the first chip 304. After receiving the first data and the second data, the switching module 303 can forward the first data to the AIGC chip 302 through the second PCIe interface according to the address identification information in the first data, and forward the second data to the first chip 304 through the third PCIe interface according to the address identification information in the second data.

[0049] After receiving the first data, the AIGC chip 302 performs the corresponding content generation task, and after receiving the second data, the first chip 304 performs the corresponding data processing task. After completing the corresponding data processing tasks, the first chip 304 and the AIGC chip 302 need to send the corresponding data processing results to the AP 301, that is, the AIGC chip 302 needs to send the processing results corresponding to the first data to the AP 301, and the first chip 304 needs to send the processing results corresponding to the second data to the AP 301. Specifically, the AIGC chip 302 needs to send the processing results of the first data (that is, the third data) to the switching module 303, and the first chip 304 needs to send the processing results of the second data (that is, the fourth data) to the switching module 303.

[0050] The chip system provided in the embodiment of the present application enables the AIGC chip 302 to be efficiently deployed in the terminal device by introducing the switching module 303 and the first chip 304, and optimizes resources by using the existing PCIe channel redundancy. The switching module 303 can be connected to the AP 301, the AIGC chip 302 and the first chip 304 respectively, so as to build an efficient data interaction channel. The AP 301 can simultaneously manage the content generation task calculation and other computing tasks of the first chip 304 through the switching module 303. Therefore, the existing PCIe channel resources can be fully utilized, avoiding the introduction of additional PCIe interface overhead due to the independent deployment of the AIGC chip 302, and improving the hardware resource utilization of the system.

[0051] However, when both the first chip 304 and the AIGC chip 302 have data backhaul requirements, since the PCIe interface connecting the first chip 304 and the AIGC chip 302 to the switching module 303 and the PCIe interface connecting the switching module 303 to the AP 301 have the same speed, it is necessary to determine the time length for the switching module 303 to receive the third data and the fourth data.

[0052] In a feasible embodiment of the present application, refer to Figure 3 , AP 301 is configured to: obtain the current application scenario of the terminal device, and send the time slice length parameter and data transmission weight parameter of the third data, as well as the time slice length parameter and data transmission weight parameter of the fourth data to the switching module 303 according to the current application scenario, the time slice length parameter is used to characterize the total time of a single data transmission, and the data transmission weight parameter is used to characterize the time proportion of data transmission.

[0053] When determining the current application scenario of the terminal device, the application scenario can be obtained by monitoring the currently running applications on the terminal device and their foreground activity status. As an example, the application process information of the system can be read to analyze the type of application that is currently active, such as social media, video playback, games or office software, etc., and combined with the user's interactive behavior, such as touch operation, input method, screen brightness adjustment, etc., to further determine the specific application scenario. For example, when it is detected that the user is using video playback software and the screen remains in a horizontal state, it can be determined that the current application scenario is a video viewing scenario; when it is detected that the user is frequently typing and the foreground application is a document editing software, it can be determined that the current application scenario is an office scenario; when high frame rate rendering and high frequency touch operations are detected, and the current application is a game process, it can be determined that the current application scenario is a game scenario.

[0054] After determining the current application scenario of the terminal device, the time slice length parameter, the data transmission weight parameter of the third data, and the data transmission weight parameter of the fourth data may be determined according to the current application scenario.

[0055] The time slice length parameter refers to the total time length used to receive the third data and the fourth data, that is, within a scheduling cycle, the total transmission duration of the third data and the fourth data is constrained by the time slice length parameter, and the data transmission weight parameter determines the time proportion occupied by the third data and the fourth data respectively within the time slice.

[0056] The time slice length parameter is used to characterize the total time of a single data transmission, that is, the maximum duration allowed for data transmission within a scheduling cycle. The time slice length parameter determines the overall execution time of the data transmission task within the time range, and directly affects the data throughput, transmission delay, and utilization of system resources. For example, in bus data scheduling, the time slice length parameter can be set to a fixed time window, such as 5ms, 10ms, etc., indicating the upper limit of the duration of each data transmission cycle. If the time slice length is short, the frequency of data transmission may increase, but the amount of data transmitted each time may be limited; if the time slice length is long, the amount of data transmitted in a single time increases, but the flexibility of scheduling may decrease.

[0057] The data transmission weight parameter is used to characterize the time proportion of data transmission, that is, the proportion of time occupied by data transmission in a time slice period. This parameter is usually used in multi-task scheduling or resource allocation scenarios to determine the priority and bandwidth allocation of different data streams or tasks in the total time slice. For example, in a scheduling cycle with a time slice length of 10ms, if the transmission weight parameter of data stream A is set to 6 and the transmission weight parameter of data stream B is set to 4, the transmission time of data stream A is 6 / (6+4), that is, data stream A occupies 6ms of time for data transmission in this cycle, and the transmission time of data stream B is 4 / (6+4), that is, data stream B occupies 4ms of time for data transmission in this cycle.

[0058] When determining the time slice length parameter, the AP 301 may determine the time slice length parameter according to the load status of the current application scenario and the number of data access requirements for the first chip and the AIGC chip.

[0059] The time slice length parameter is negatively correlated with the number of data access requirements of the first chip and the AIGC chip, and the number of data access requirements refers to the demand status of the current application scenario for the first chip and the AIGC chip. As an example, if the current application scenario has data interaction requirements for both the first chip and the AIGC chip, the value of the time slice length parameter is small, and if the current application scenario only has data interaction requirements for one of the first chip or the AIGC chip, the value of the time slice length parameter is large.

[0060] Furthermore, when the previous application scenario has data interaction requirements for both the first chip and the AIGC chip, the time slice length parameter can be further adjusted according to the load status of the previous application scenario. That is, the load is positively correlated with the value of the time slice length parameter, that is, the higher the load, the smaller the value of the time slice length parameter, and the lower the load, the larger the value of the time slice length parameter. The load can be measured by indicators such as CPU occupancy, memory usage, I / O bandwidth occupancy, network traffic, and GPU computing load. In the game scenario, hardware resources such as CPU and GPU are highly occupied and the load is large, which will shorten the time slice length parameter, that is, reduce the time of a single data transmission cycle, and provide real-time data transmission. Therefore, in the game scenario, the time slice length parameter can be 10ms.

[0061] In the scenario of executing content generation tasks, the content generation tasks have high requirements on the continuous computing power of the system, but their real-time requirements are relatively low. Therefore, when executing content generation tasks, the overall load of the system is relatively low, especially when the content generation tasks mainly rely on the independent processing of the AIGC chip 302, the resources of AP 301 are less occupied, so that the system is at a relatively low load during task execution. In this case, the time slice length parameter will be increased, that is, the time slice of data transmission will be extended, so that data can be transmitted continuously within a longer time window. This adjustment can reduce frequent task switching, improve data throughput efficiency, and reduce the overhead of system resource scheduling. Therefore, in the scenario of executing content generation tasks, the time slice length parameter can be 50ms.

[0062] When determining the data transmission weight parameters of the third data and the fourth data, AP 301 may determine the data transmission weight parameters according to the matching relationship between the current application scenario and the preset data transmission weight parameters. As an example, when the application scenario is a game scenario, the demand for the WLAN chip is high, so a larger weight is assigned to the data sent by the WLAN chip, that is, the data transmission weight of the fourth data is high, and the demand for the AIGC chip 302 is low, so the data transmission weight of the third data is low, to ensure the smoothness and low-latency response of the game. When the application scenario is a scenario for executing a content generation task, the demand for the AIGC chip 302 is high, so a larger weight is assigned to the data sent by the AIGC chip 302, that is, the data transmission weight of the third data is high, and the demand for the WLAN chip is low, so the data transmission weight of the fourth data is low, to ensure that the content generation task can be executed smoothly.

[0063] The matching relationship between the application scenario and the data transmission weight of the third data, as well as the data transmission weight of the application scenario and the fourth data can be stored in the cache 3032 of AP 301 in advance. After the application scenario is determined, the application scenario can be used as a retrieval basis to find the data transmission weight of the third data and the data transmission weight of the fourth data corresponding to the current application scenario.

[0064] After determining the time slice length parameter and the data transmission weight parameter of each data, the time when the second PCIe interface receives the third data and the time when the third PCIe interface receives the fourth data can be determined.

[0065] The time slice length parameters and data transmission weight can be dynamically adjusted according to the scene switching. For example, see Figure 6 When the current application scenario of the terminal device is to watch a video, the time slice length parameter may be 15ms, and the weight ratio of the data sent by the WLAN chip to the data sent by the AIGC chip 302 is 7:3. When the application scenario is switched to a game scenario, the time slice length parameter may be 10ms, and the weight ratio of the data sent by the WLAN chip to the data sent by the AIGC chip 302 is 9:1. When the application scenario is switched to a scenario for executing a content generation task, the time slice length parameter may be 40ms, and the weight ratio of the data sent by the WLAN chip to the data sent by the AIGC chip 302 is 2:8.

[0066] In a feasible embodiment of the present application, continue to refer to Figure 5The switching module 303 includes an arbitrator 3031, and the arbitrator 3031 is configured to: determine the time transmission ratio of the third data and the fourth data according to the proportional relationship between the data transmission weight parameter of the third data and the data transmission weight parameter of the fourth data, determine the time when the second PCIe interface receives the third data according to the time slice length parameter and the time transmission ratio of the third data, and determine the time when the third PCIe interface receives the fourth data according to the time slice length parameter and the time transmission ratio of the fourth data.

[0067] As an example, when the application scenario is a game scenario, the time slice length parameter is 10ms, the data transmission weight parameter of the third data is 1, and the data transmission weight parameter of the fourth data is 9, then the time transmission ratio of the third data and the fourth data is 1:9, so the time for the second PCIe interface to receive the third data can be 1ms, and the time for the third PCIe interface to receive the fourth data can be 9ms. And because the data transmission weight parameters of the four data are higher, the time when the third PCIe interface receives the fourth data is earlier than the time when the second PCIe interface receives the third data. That is, the third PCIe interface receives the fourth data in the first 9ms of a time slice, and the second PCIe interface receives the third data in the last 1ms of a time slice.

[0068] The chip system provided in the embodiment of the present application can ensure that high-priority data is transmitted first when performing business data transmission, thereby ensuring fairness and efficiency among different data streams and improving the system's response speed and data transmission efficiency.

[0069] In a feasible embodiment of the present application, continue to refer to Figure 5 The switching module 303 further includes a buffer 3032 , which can be coupled to the arbiter 3031 , and the buffer 3032 is configured to: buffer the first data, the second data, the third data, and the fourth data.

[0070] The buffer 3032 is used to provide a temporary storage area for storing the first data, the second data, the third data and the fourth data. The main purpose of setting the buffer is to reduce the loss or delay of data during data transmission and improve the data transmission efficiency. Through the buffer 3032, the data sent by the AP 301, the first chip 304 or the AIGC chip 302 can be temporarily stored, thereby avoiding the loss or long waiting time caused by the inability of the receiving end to process the data in time.

[0071] In the above implementation, the AIGC chip 302 and the switching module 303 are independently configured. Although this architecture can provide certain flexibility, there is still room for optimization in terms of chip area, packaging complexity, and data transmission efficiency. For example, see Figure 7,The interaction module includes three external PCIe interfaces, and each PCIe interface includes a corresponding controller and a physical interface.

[0072] In order to further reduce the chip area and packaging cost. In a feasible embodiment of the present application, a chip system is provided, referring to Figure 8 The AIGC module 305 and the switching module 303 in the chip system can be set on an integrated chip 300. The AIGC module 305 has the same function as the aforementioned AIGC chip 302. The integrated chip 300 is connected to the AP 301 through the first PCIe interface and to the first chip 304 through the second PCIe interface. The AIGC module 305 and the switching module 303 are connected through an embedded PCIe interface. The embedded PCIe interface has a low latency feature, so that the AIGC module 305 can quickly receive data from the switching module 303 and efficiently transmit the processed results back to the switching module 303 for further data scheduling and distribution. Setting the AIGC module 305 and the switching module 303 on the integrated chip 300 can reduce the chip packaging cost.

[0073] By integrating the AIGC module 305 and the switching module 303 on the same chip die, the data transmission delay between the AIGC module 305 and the switching module 303 can be effectively reduced, the data throughput rate can be improved, and the power consumption overhead caused by cross-chip communication can be reduced. In addition, at the physical packaging level, this integration method can reduce the number of pins required for packaging, thereby reducing the overall manufacturing cost and packaging difficulty. At the same time, since the switching module 303 and the AIGC module 305 share the same die, data interaction can be carried out through on-chip interconnection without going through an external bus or an additional physical interface, thereby further improving the real-time and stability of data exchange.

[0074] For details, see Fig. 9 Compared with the chip system provided Figure 7In the chip system shown, the AIGC module 305 and the switching module 303 are connected through an embedded PCIe interface. After adopting the embedded PCIe interface, the AIGC module 305 and the switching module 303 do not need to be equipped with multiple physical interfaces, and only the corresponding controllers are retained, thereby significantly reducing the packaging area and making the entire chip system more compact and integrated. In addition, reducing the use of physical interfaces also reduces the power consumption of the chip system. Since the signal transmission of each physical interface is accompanied by a certain amount of power consumption, especially in high-speed signal transmission, this power consumption will be more obvious. By performing data interaction through the embedded PCIe interface, the additional power consumption caused by the simultaneous operation of multiple physical interfaces can be effectively reduced, thereby optimizing the energy efficiency performance of the entire chip system. In addition, reducing the number of physical interfaces can also simplify PCB wiring, reduce production difficulty and cost, and improve signal integrity and data transmission stability.

[0075] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0076] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0077] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0078] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0079] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor to execute all or part of the steps of the method provided in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0080] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A chip system, characterized in that: include: An application processor AP and an artificial intelligence content generation AIGC chip, wherein a content generation model is deployed in the AIGC chip; The AP is configured to: send first data to the AIGC chip; The AIGC chip is configured to: execute a corresponding content generation task according to the first data and the content generation model.

2. The chip system according to claim 1, characterized in that: The chip system also includes a switching module and a first chip, wherein the switching module includes a first PCIe interface, a second PCIe interface, and a third PCIe interface; The switching module is connected to the AP through a first PCIe interface, the switching module is connected to the AIGC chip through a second PCIe interface, and the switching module is connected to the first chip through a third PCIe interface; The AP is configured as: Sending first data and second data to the switching module; The switching module is configured as follows: forwarding the first data to the AIGC chip, and forwarding the second data to the first chip; Or, receive the third data sent by the AIGC chip and the fourth data sent by the first chip and send them to the AP.

3. The chip system according to claim 2, characterized in that: The AP is configured as: Get the current application scenario of the terminal device; According to the current application scenario, a time slice length parameter, a data transmission weight parameter of the third data, and a data transmission weight parameter of the fourth data are sent to the switching module, wherein the time slice length parameter is used to characterize the total time of a single data transmission, and the data transmission weight parameter is used to characterize the time proportion of data transmission.

4. The chip system according to claim 3, characterized in that: The AP is specifically configured as follows: The time slice length parameter is determined according to the number of data access requirements for the first chip and the AIGC chip in the current application scenario and the load status of the current application scenario. The time slice length parameter is negatively correlated with the number of data access requirements for the first chip and the AIGC chip. The higher the load, the smaller the value of the time slice length parameter, and the lower the load, the larger the value of the time slice length parameter.

5. The chip system according to claim 3, characterized in that: The AP is specifically configured as follows: The data transmission weight parameter of the third data is determined according to a matching relationship between the current application scenario and a preset data transmission weight parameter of the third data.

6. The chip system according to claim 3, characterized in that: The AP is specifically configured as follows: The fourth data transmission weight parameter is determined according to a matching relationship between the current application scenario and a preset fourth data transmission weight parameter.

7. The chip system according to claim 2, characterized in that: The switching module includes an arbitrator, which is configured to: Determine a time transmission ratio of the third data and the fourth data according to a proportional relationship between a data transmission weight parameter of the third data and a data transmission weight parameter of the fourth data; Determining the time at which the second PCIe interface receives the third data according to the time slice length parameter and the time transmission ratio of the third data; The time for the third PCIe interface to receive the fourth data is determined according to the time slice length parameter and the time transmission ratio of the fourth data.

8. The chip system according to claim 2, characterized in that: The switching module further includes a buffer, which is configured as follows: The first data, the second data, the third data, and the fourth data are cached.

9. The chip system according to claim 2, characterized in that: The AIGC chip and the switching module are integrated on the same chip die.

10. The chip system according to any one of claims 2 to 9, characterized in that: The first chip includes a WLAN chip.

11. A terminal device, characterized in that: A chip system comprising any one of claims 1-10.

Images