Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Model calling method and system based on HTTP, computer equipment and storage medium

A model and target model technology, applied in the field of artificial intelligence, can solve problems such as low CPU-intensive concurrency performance, poor I/O-intensive high-concurrency effects, etc., to solve CPU-intensive concurrency problems and high concurrency problem, the effect of improving the calculation processing speed

Pending Publication Date: 2020-11-03
PINGAN INT SMART CITY TECH CO LTD
View PDF7 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In view of this, it is necessary to provide an HTTP-based model calling method, system, computer equipment and computer-readable storage medium to solve the traditional model calling CPU calculation-intensive concurrency, low concurrency performance, and I / O-intensive high concurrency effects Poor technical issues

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Model calling method and system based on HTTP, computer equipment and storage medium
  • Model calling method and system based on HTTP, computer equipment and storage medium
  • Model calling method and system based on HTTP, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0051] refer to figure 1 , shows a flow chart of the steps of the method for invoking an HTTP-based model according to an embodiment of the present invention. It can be understood that the flowchart in this method embodiment is not used to limit the sequence of execution steps. An exemplary description is given below taking the computer device 2 as the execution subject. details as follows.

[0052] Step S100, receiving multiple HTTP requests provided by one or more client terminals.

[0053] The computer device 2 can receive HTTP requests sent by one or more client terminals, each client terminal can send multiple HTTP requests, and each HTTP request carries corresponding data to be processed respectively, and the data to be processed can be picture data, Voice data, text data, etc.

[0054] Exemplarily, the step S100 may further include: receiving the multiple HTTP requests asynchronously and in parallel through the HTTP transmission component in the coroutine processing...

Embodiment 2

[0088] Figure 4 It is a schematic diagram of the program modules of Embodiment 2 of the HTTP-based model calling system of the present invention. The HTTP-based model calling system 20 may include or be divided into one or more program modules, one or more program modules are stored in a storage medium, and are executed by one or more processors to complete the present invention, and The above HTTP-based model invocation method can be implemented. The program module referred to in the embodiment of the present invention refers to a series of computer program instruction segments capable of completing specific functions, which is more suitable than the program itself to describe the execution process of the HTTP-based model calling system 20 in the storage medium. The following description will specifically introduce the functions of each program module of the present embodiment:

[0089] The receiving module 200 is configured to receive multiple HTTP requests provided by on...

Embodiment 3

[0100] refer to Figure 5 , is a schematic diagram of the hardware architecture of the computer device according to Embodiment 3 of the present invention. In this embodiment, the computer device 2 is a device capable of automatically performing numerical calculation and / or information processing according to preset or stored instructions. The computer device 2 may be a rack server, a blade server, a tower server or a cabinet server (including an independent server, or a server cluster composed of multiple servers) and the like. As shown in the figure, the computer device 2 at least includes, but is not limited to, a memory 21 , a processor 22 , a network interface 23 , and an HTTP-based model invoking system 20 that can communicate with each other through a system bus.

[0101]In this embodiment, the memory 21 includes at least one type of computer-readable storage medium, and the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a model calling method based on HTTP. The method comprises the following steps: receiving a plurality of HTTP requests provided by one or more client terminals; configuring a plurality of processes for the plurality of HTTP requests; executing the following operations through each process: generating a corresponding processing request according to the corresponding HTTP request, and transmitting the processing request to a corresponding target model, so that the target model feeds back a corresponding processing result based on the corresponding processing request; and receiving the processing result and sending the processing result to a client terminal. According to the embodiment of the invention, the corresponding processes are allocated to theplurality of HTTP requests, and the HTTP requests are processed by calling the corresponding target models, so the calculation processing speed when the HTTP requests are dense and the processing efficiency when the HTTP requests are concurrent are improved.

Description

technical field [0001] The embodiments of the present invention relate to the field of artificial intelligence, and in particular to an HTTP-based model calling method, system, computer equipment, and computer-readable storage medium. Background technique [0002] Model invocation is to process data through artificial intelligence algorithms (such as prediction, evaluation, etc.) and provide application services for artificial intelligence. However, the traditional model call is still in the CPU computing-intensive concurrency problem, I / O-intensive high concurrency problem, and there is no unified model call framework. Therefore, how to solve the problem of CPU-intensive concurrency, I / O-intensive high concurrency and single model call, so as to further improve the concurrency performance of model call for data processing, has become a technical problem that needs to be solved urgently. . Contents of the invention [0003] In view of this, it is necessary to provide an ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/448G06F9/50
CPCG06F9/448G06F9/5027
Inventor 钟贤
Owner PINGAN INT SMART CITY TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com