Intelligent crawler system for carrying out market trend analysis by artificial intelligence

The intelligent crawling system built through artificial intelligence solves the problem of insufficient data collection efficiency and stability in the existing technology, achieves rapid and accurate market trends and competitive information collection, and enhances the competitiveness of enterprises.

CN119829818APending Publication Date: 2025-04-15ALPHA BROTHERS CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311347063.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-10-13
Filing Date
2023-10-18
Publication Date
2025-04-15

AI Technical Summary

Technical Problem

The prior art has limitations in data acquisition efficiency and stability, especially in the case of access rights or technical limitations, which makes it difficult for enterprises to collect accurate market trends and competitive information.

Method used

Using artificial intelligence to build an intelligent crawling system, securely collect information through pre-authenticated terminals, ensuring data accessibility and providing excellent security performance.

Benefits of technology

Improves the speed and accuracy of data collection, helping companies quickly obtain information about market trends and competition, thereby enhancing their competitiveness and avoiding the loss of important data.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119829818A_ABST
    Figure CN119829818A_ABST
Patent Text Reader

Abstract

The invention relates to an intelligent crawler system for analyzing a market trend by utilizing artificial intelligence. One embodiment of the present invention provides a method for providing marketability data analysis information, comprising: receiving user personal information input through a smartphone, extracting image information related to a market from the user personal information, controlling the image information displayed on the smartphone, receiving a signal corresponding to user selection through the smartphone, and displaying the received signal on the smartphone. The invention provides a method for generating marketability data analysis information according to selection and controlling the marketability data analysis information to be displayed through a smart phone.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] This invention relates to marketability data analysis technology based on artificial intelligence. Furthermore, embodiments of this invention relate to an intelligent web crawler system that utilizes artificial intelligence to analyze market trends. [Background Technology]

[0002] In recent years, the internet has become an important tool for businesses to formulate business strategies and identify market trends. However, with a vast amount of information distributed across the internet, collecting and analyzing this information has become an increasingly complex task. In particular, due to the sensitivity and limited accessibility of information, market analysts and business strategists find it difficult to collect accurate and effective data.

[0003] Existing web crawling technologies have limitations in terms of data collection efficiency and stability. Furthermore, due to access restrictions or technical limitations, some information may not be collected. As a result, companies miss out on crucial information for identifying market trends and analyzing competition.

[0004] These technological limitations lead this invention to aim at improving the speed and accuracy of data collection by building intelligent crawling systems using artificial intelligence (AI). Specifically, in situations where data access is difficult, a method for securely collecting information using pre-approved terminals is proposed, ensuring data accessibility and providing excellent performance in terms of security. This enables companies to securely protect sensitive information and quickly and accurately obtain information on market trends. [Summary of the Invention]

[0005] The problem that the invention aims to solve

[0006] The purpose of this invention is to provide an intelligent web crawler system that utilizes artificial intelligence for market trend analysis.

[0007] The limitations of existing data collection technologies make it difficult for businesses to effectively collect and analyze various types of information online. In particular, due to the fragmentation of data and the diversity of question formats, businesses struggle to accurately grasp market trends. Moreover, some information may be impossible or limited to collection due to access restrictions or technical limitations, making it difficult to obtain complete market insights.

[0008] This invention aims to develop an intelligent crawling system that utilizes artificial intelligence (AI) to solve the difficulties of data collection. The system effectively extracts and organizes data from various web pages and online sources, helping businesses quickly obtain accurate market trend and competitive information.

[0009] Specifically, this invention uses pre-authenticated terminals to collect information to overcome data accessibility issues. This ensures accessibility to sensitive information while providing excellent stability in terms of security. Therefore, this invention aims to support effective competition in the market by helping companies enhance their competitiveness and avoid losing important data when formulating business strategies.

[0010] The technical problems to be solved by the present invention are not limited to those described above. Those skilled in the art will be able to clearly understand other technical problems not mentioned in the following description.

[0011] means for solving problems

[0012] This invention proposes an intelligent web crawler system that utilizes artificial intelligence to analyze market trends.

[0013] In addition, embodiments of the present invention provide a method for providing marketability data analysis information, which receives a first piece of information input via a smartphone, extracts market-related analysis information from the first piece of information, controls the display of the analysis information on the smartphone, and receives a signal corresponding to the user's selection on the smartphone. We propose a system that generates marketability data analysis information based on the selection and controls its display via the smartphone.

[0014] Additionally, embodiments of the present invention provide a system for providing marketability data analysis information, (a) a terminal including an input module; a communication module for sending and receiving image and text information with the terminal; (b) a server including an output module, and a control module that controls the communication module and the output module and is based on IoT (Internet of Things) technology and ICT (Information and Communication Technology); including, we propose a system in which image and text information are determined by the control module based on first information obtained from the terminal and are related to marketability data analysis information.

[0015] Invention Effects

[0016] One embodiment of the present invention provides an intelligent web crawler system that uses enhanced artificial intelligence to analyze market trends.

[0017] The effects achievable by this invention are not limited to those described above, and those skilled in the art will clearly understand from the following description other effects not mentioned. [Attached Image Description]

[0018] The above and other aspects, features and advantages of certain preferred embodiments of the present invention will become more apparent from the following description taken in conjunction with the accompanying drawings.

[0019] Figure 1 This is a diagram illustrating a scenario according to an embodiment of the present invention.

[0020] Figure 2 This is a diagram illustrating a system according to an embodiment of the present invention.

[0021] Figure 3 This is a flowchart illustrating a method according to an embodiment of the present invention.

[0022] Figure 4 This is a diagram illustrating a scenario according to an embodiment of the present invention.

[0023] It should be noted that throughout the accompanying drawings, the same reference numerals are used to indicate the same or similar components, features, and structures.

Detailed Implementation Methods

[0024] The embodiments of the present invention will now be described in detail with reference to the accompanying drawings.

[0025] In describing the embodiments, descriptions of technical content known in the art to which this invention pertains and not directly related to this invention will be omitted. This is to more clearly convey the spirit of the invention, rather than obscuring the spirit of the invention by omitting unnecessary explanations.

[0026] For the same reason, some parts are exaggerated, omitted, or shown schematically in the accompanying drawings. Furthermore, the dimensions of each component do not perfectly reflect its actual size. In each drawing, the same or corresponding parts are given the same reference numerals.

[0027] The advantages and features of the invention, as well as methods of implementing them, will become clear from the following detailed description of the embodiments in conjunction with the accompanying drawings. However, the invention is not limited to the embodiments disclosed below and can be implemented in various different forms; these embodiments are provided merely to ensure that the disclosure of the invention is complete and based on common knowledge in the art. The invention is provided to fully inform those who understand its scope, and the invention is defined only by the scope of the claims. Throughout the specification, the same reference numerals refer to the same components.

[0028] At this point, it should be understood that each block of the flowchart, and combinations thereof, can be executed by computer program instructions. Since these computer program instructions can be mounted on the processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, the instructions executed by the processor of the computer or other programmable data processing device are flowchart blocks that create a method for performing the functions described in the flowchart blocks. These computer program instructions can also be stored in computer-usable or computer-readable storage, which can instruct the computer or other programmable data processing device to implement the functions in a specific manner, thereby making the computer-usable or computer-readable storage available in the computer available for the production of an article of manufacture containing instruction means for performing the functions described in the flowchart blocks. The computer program instructions can also be mounted on a computer or other programmable data processing device to perform a series of operational steps on the computer or other programmable data processing device, creating a process executed by the computer, thereby creating instructions for the computer to perform possible data processing devices, and can also provide steps for performing the functions described in the flowchart blocks.

[0029] Additionally, each block can represent a module, segment, or code section containing one or more executable instructions for performing a specified logical function. It should also be noted that in some alternative execution examples, the functions mentioned in the boxes may occur out of order. For example, two boxes shown consecutively may be executed substantially simultaneously, or the boxes may be executed in reverse order depending on their corresponding functions.

[0030] In this embodiment, the term "~unit" refers to a software or hardware component such as an FPGA (Field-Programmable Gate Array) or ASIC (Application-Specific Integrated Circuit), and "~unit" refers to the role that executes them. However, "~part" is not limited to software or hardware. A "~part" can be configured to reside in addressable storage media and can be configured to be reproduced on one or more processors. Thus, for example, "~part" refers to components such as software components, object-oriented software components, class components, task components, processes, functions, attributes, procedures, subroutines, program code segments, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functionality provided within components and "parts" can be combined into a smaller number of components and "parts," or can be further divided into additional components and "parts." Furthermore, components and "parts" can be implemented as a regeneration of one or more CPUs within a device or secure multimedia card.

[0031] The embodiments of the invention will primarily focus on examples of specific systems; however, the key point claimed in this specification is that the scope of this disclosure also extends to other communication systems and services with similar technologies. It can be applied without significantly departing from the foregoing scope, and this will be determined by a person skilled in the art to be possible.

[0032] Figure 1 This is a diagram illustrating a scenario according to an embodiment of the present invention.

[0033] For example, terminal 120 according to an embodiment of the present invention can output image information related to marketability data analysis information.

[0034] The terminal 120 of an embodiment of the present invention can output image information about marketability data analysis information that can be obtained or generated based on IoT technology and / or ICT technology.

[0035] Here, IoT can refer to the Internet of Things.

[0036] The Internet of Things (IoT) can refer to the next generation of technology where all objects in the world are "connected" and communicate with each other through a network. The Fourth Industrial Revolution is about acquiring big data through the IoT, storing it in the cloud, and analyzing and utilizing it through artificial intelligence. The IoT can become intelligent, creating a smart world such as smart cars, smart homes, and smart cities.

[0037] For example, in a world where the internet connects to all sectors, including fully autonomous cars, smart homes, smart buildings, and healthcare services, the internet may become as ubiquitous as air, and a separate internet may not be necessary. However, for the Internet of Things (IoT) to become possible, the internet alone is insufficient. A variety of fundamental technologies, such as sensors, networking, big data, cloud computing, artificial intelligence, and 3D printing, must be combined. In particular, the Fourth Industrial Revolution demonstrates the process of acquiring big data through the IoT, storing it in the cloud, and analyzing and utilizing it through artificial intelligence.

[0038] ICT can also stand for Information and Communication Technology.

[0039] ICT (Information & Communications Technology) is a portmanteau of Information Technology (IT) and Communication Technology (CT), referring to the hardware of information devices and the software technologies needed to operate and manage information. It encompasses the methods of collecting, producing, processing, storing, transmitting, and utilizing information. The shift in the ICT paradigm can be understood from the perspective of the deepening interdependence among the various links in the content (C)-platform (P)-network (N)-device (D) value chain.

[0040] Generally, the C-PN-T (Terminal) value chain has been widely used to explain broadcast platforms, but considering that these are essentially computer devices such as smartphones and tablets, the CPND (Content-Content-Demand) formulation may be more useful in explaining ICT. Looking at the Content (C) segment, it's important to remember that on the internet, the distinction between photos, books, music, videos, etc., no longer makes sense. All these types of content are digitized and provided to users by platform providers, with content holders offering content either through partnerships with platform providers like Google, Apple, and Amazon, or by directly building their own platforms. The platform segment can play a significant role in the CPND value chain.

[0041] Software can be used to accumulate, process, store, and deliver content. This means that ICT companies with software technology are gaining dominance, especially cloud service providers with software technology and cloud infrastructure, who are becoming representative platform providers. In this process, the position of traditional network transmission service providers is likely to be relatively weakened. On the other hand, companies with original content will be able to establish equal relationships with platform providers. The network in the era of digital convergence is the IP network, i.e., the Internet. In traditional networks such as circuit-switched telephone networks, network owners independently provide intelligent services such as user identification, but in the Internet, various service providers such as Akamai provide efficient traffic transmission, security, and various network functions through servers. Clustering is offered in a competitive market.

[0042] These smart network service providers are also platform providers. It's also important for operators with telecommunications networks to directly provide platform services. The device division is always connected to the internet, connecting the software programs inside devices with common operating systems like iOS to the platform to complete services. Apple is a prime example of someone who is both a platform provider and a device provider, and considering the partnerships between Google and Android phone manufacturers, the relationship between the platform and device divisions is becoming increasingly close and interdependent. The level of interdependence is higher than ever before. Alliances between the content and platform divisions, connections between the device and platform divisions, and the blurring of boundaries between the platform and network divisions all likely indicate a deepening of interdependence among CPND divisions.

[0043] Figure 2 This is a diagram illustrating a system according to an embodiment of the present invention.

[0044] refer to Figure 2 The system 100 of the present invention includes a server 110 and a terminal 120. Furthermore, the server 110 of the present invention includes a first control module 111, a first communication module 112, a first input module 113, and / or may include a first output module 114. The terminal 120 of the present invention includes a second control module 121, a second communication module 122, and may include a second input module 123 (not shown).

[0045] Control modules 111 and 121 are the server 110 of the present invention, used to implement the operations / steps / processes according to the embodiments of the present invention, and can directly / indirectly control the terminal 120 of the present invention. Furthermore, control modules 111 and 121 may include at least one processor, and the processor may include at least one central processing unit (CPU) and / or at least one graphics processing device (GPU).

[0046] Communication modules 112 and 122 are the server 110 and / or various data, such as the terminal 120 of the present invention, signals, and can send and receive information. Communication modules 112 and 122 can be wireless communication modules (e.g., cellular communication modules, short-range wireless communication modules, or Global Navigation Satellite System (GNSS) communication modules) or wired communication modules (e.g., local area network (LAN) communication modules), or power line communication modules). Communication modules 112 and 122 can connect to a first network (e.g., a short-range communication network such as Bluetooth, WiFi Direct, or Infrared Data Association (IrDA)) or a second network (e.g., a cellular network, the Internet, or a computer network (e.g., a LAN or WAN)) and can communicate with external electronic devices via a long-range communication network (e.g., a WAN). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips).

[0047] Input modules 113 and 123 are components of the server 110 and / or the terminal 120 of the present invention (e.g., control modules 111, 121, etc.) that need to be used in the server 110 of the present invention, or / or outside the terminal 120 of the present invention (e.g., users (e.g., first user, second user, etc.), administrators of the server 110 of the present invention, etc.). Input modules 113 and 123 are charging devices 1 and 10, installed on the management server 120 and / or the terminal 120 of the present invention. A touchscreen display, touchpad, or button-type recognition module may include a voice recognition sensor, microphone, mouse, or keyboard. Here, the touch-recognition display, touchpad, or button-type recognition module uses the user's body (e.g., pressure-sensitive and / or capacitive methods). Touch by a finger can be recognized.

[0048] Output modules 114 and 124 are signals (e.g., voice signals), information, data, and images generated by the server 110 and / or by the control modules 111 and 121 of the terminal 120 of the present invention, or acquired through the communication modules 112 and 122. They are modules for displaying and / or various objects. For example, output modules 1, 14, and 124 are displays, screens, display units, speakers, and / or light-emitting devices (e.g., LED lights).

[0049] Additionally, the server 110 and / or the terminal 120 of the present invention may further include a storage module, and the server 110 and / or the terminal 120 may store data for operation of the terminal 120, such as basic programs, application programs, and setting information. Furthermore, the storage module may be flash memory, hard disk, micro multimedia card, card memory (e.g., SD or XD memory), magnetic storage, magnetic disk, optical disk, RAM (random access memory), etc. Access memory, SRAM (static random access memory), ROM (read-only memory), PROM (programmable read-only memory), and EEPROM (electrically erasable programmable memory) may include at least one storage medium (read-only memory).

[0050] The storage module serves as the server 110 and / or the first terminal 120 using the invention. It may contain the user's personal information. This personal information may include name, ID (identifier), password, resident registration number, street address, telephone number, mobile telephone number, and / or email address. Additionally, the first control modules 111 and 121 can perform various operations using various programs, content, data, etc., stored in the storage module.

[0051] Figure 3 This is a flowchart illustrating a method according to an embodiment of the present invention.

[0052] refer to Figure 3 The method of this embodiment of the invention is that the first person can execute step 10S210, step 2S220, step 3S230 and / or step 4S240.

[0053] For example, step S210 above is when server 110 receives the first message from terminal 120. It can be characterized as acquiring, receiving, or collecting information.

[0054] For example, the second step S220 may be characterized in that the terminal 120 obtains, receives, or collects second information from the server 110.

[0055] For example, the third step S230 is that when the server 110 and / or the terminal 120 executes the first step, the information and / or the second feature is that information about marketability data analysis information is generated based on the information.

[0056] For example, the fourth step S240 may feature that the server 110 and / or terminal 120 output information about marketability data analysis.

[0057] The method according to an embodiment of the present invention may include only some of S210 to S240 according to one example, and the order of S210 to S240 may be changed according to another example.

[0058] Figure 4 This is a diagram illustrating a scenario according to an embodiment of the present invention.

[0059] For example, according to another embodiment of the present invention, terminal 120 can output text information about marketability data analysis information.

[0060] According to another embodiment of the present invention, terminal 120 uses IoT technology and / or can output text information about marketability data analysis information that can be obtained or generated based on ICT technology.

[0061] Based on artificial intelligence networks, the system 100 and according to embodiments of the present invention are selected or determined. Figure 3 The information used in the method. Additionally, the server 110 of the present invention may include a machine learning module (not shown), which uses machine learning on large amounts of data stored in a database to obtain information according to embodiments of the present invention. Figure 3 The information used in system 100 and the method, etc., can be selected or determined by you. Additionally, the machine learning module uses large amounts of data stored in the database of the server 110 of this invention as input variables to train the artificial intelligence network, specifically using deep learning from the field of machine learning to train an accurate model. Correlation can be derived.

[0062] Furthermore, the machine learning module can compute the weights of multiple inputs in a function through deep learning. In addition, various models such as RNNs (Recurrent Neural Networks), DNNs (Deep Neural Networks), and DRNNs (Dynamically Recurrent Neural Networks) can be used as artificial intelligence network models for this type of learning. In this way, the machine learning module can determine or set the parameters according to embodiments of the present invention. Figure 3 Information used in System 100 and methods.

[0063] One embodiment of the present invention provides a system for providing marketability data analysis information, (a) a terminal including an input module; a communication module for sending and receiving image information and text information with the terminal; (b) a server including an output module, and a control module that controls the communication module and the output module and is based on IoT (Internet of Things) technology and ICT (Information and Communication Technology); including, we propose a system in which the image information and text information are determined by the control module based on first information obtained from the terminal and are related to marketability data analysis information.

[0064] The embodiments of the present invention disclosed in the specification and accompanying drawings are provided merely as specific examples to explain the technical content of the present invention and to facilitate understanding of the invention, and are not intended to limit the scope of the invention. In other words, it will be apparent to those skilled in the art that other modifications based on the technical concept of the present invention can be implemented. Furthermore, the above embodiments can be combined with each other as needed. For example, all embodiments of the present invention can be implemented by combining the system, server, and / or terminal of the present invention.

[0065] Furthermore, the control system, server, and / or terminal methods of the present invention can be implemented in the form of program instructions, which can be executed by various computer devices and recorded on a computer-readable medium.

[0066] Thus, various embodiments of the present invention can be implemented in certain aspects as computer-readable code on a computer-readable recording medium. A computer-readable recording medium is any data storage device capable of storing data readable by a computer system. Examples of computer-readable recording media include read-only memory (ROM), random access memory (RAM), and optical disc read-only memory (CD-ROM), magnetic tape, floppy disk, optical data storage devices, and carrier waves (for transmitting data via the Internet, etc.). The computer-readable recording medium can also be distributed across networked computer systems, allowing the computer-readable code to be stored and executed in a distributed manner. Furthermore, the functional programs, code, and code segments used to implement the various embodiments of the present invention can be readily interpreted by programmers skilled in the art.

[0067] Furthermore, it should be understood that the apparatuses and methods according to various embodiments of the present invention can be implemented in hardware, software, or a combination of hardware and software. Such software can be stored, for example, on volatile or non-volatile storage devices, such as ROM (whether erasable or rewritable), or memory (e.g., RAM), memory chips, devices, or integrated circuits; or, for example, it can be stored on optically or magnetically recordable and machine-readable storage media (e.g., a computer), such as optical discs (CDs), DVDs, magnetic disks, or magnetic tapes. The methods according to various embodiments of the present invention can be implemented by a computer or portable terminal including a control unit and a memory, wherein the memory stores one or more programs including instructions for implementing embodiments of the present invention. Examples of suitable machine-readable storage media are provided.

[0068] Therefore, the present invention includes a program comprising code for implementing the means or methods described in the claims of this specification, and a machine-readable storage medium (e.g., a computer) storing such a program. Furthermore, such a program can be transmitted electronically via any medium, such as communication signals transmitted via wired or wireless connections, and the present invention appropriately includes equivalents thereof.

[0069] The embodiments of the invention disclosed in the specification and drawings are provided merely as specific examples to explain the technical content of the invention and to aid in understanding it, and are not intended to limit the scope of the invention. Furthermore, the above embodiments according to the invention are merely illustrative, and those skilled in the art will understand that various modifications and equivalents of the embodiments are possible. Therefore, the true scope of protection of the invention should be determined by the appended patent claims.

Claims

1. A method for providing marketable data analysis information, wherein: Receive the first message entered via smartphone, Extract market-related analytical information from the first message, Control analysis information displayed on smartphone, A signal corresponding to a selection of the smartphone by the user is received through the smartphone, marketability data analysis information is generated according to the selection, and a display is controlled through the smartphone.