CN104731910A - SYSLOG storage method - Google Patents
SYSLOG storage method Download PDFInfo
- Publication number
- CN104731910A CN104731910A CN201510129489.7A CN201510129489A CN104731910A CN 104731910 A CN104731910 A CN 104731910A CN 201510129489 A CN201510129489 A CN 201510129489A CN 104731910 A CN104731910 A CN 104731910A
- Authority
- CN
- China
- Prior art keywords
- log
- syslog
- storage method
- logs
- software
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/1734—Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Stored Programmes (AREA)
Abstract
本发明公开了一种SYSLOG日志存储方法,该方法是根据应用程序的设置,接收应用程序的呼叫,并将日志生成标准的日志信息,把日志传输到远程的日志服务器上,从而远程存储日志文件。本发明的一种SYSLOG日志存储方法和现有技术相比,解决了日志分析问题,将日志集中化处理,实现全部的数据中心的日志统一化处理,有效的提升运维工作人员的运维效率。
The invention discloses a method for storing SYSLOG logs. According to the setting of the application program, the method receives the call of the application program, generates standard log information from the log, and transmits the log to a remote log server, so as to store the log file remotely. . Compared with the prior art, the SYSLOG log storage method of the present invention solves the log analysis problem, centralizes the log processing, realizes the unified processing of logs in all data centers, and effectively improves the operation and maintenance efficiency of the operation and maintenance staff .
Description
技术领域 technical field
本发明涉及计算机数据处理技术领域,具体地说是一种SYSLOG日志存储方法。 The invention relates to the technical field of computer data processing, in particular to a SYSLOG log storage method.
背景技术 Background technique
当今数据量的急速增长,导致了服务器的数量增加,从而对服务器的运维开发维护人员造成了巨大的压力,特别是对于错误信息的分析处理,运维工作人员需要对分散的大量的数据进行分析处理,工作量很大,导致运维工作人员的劳动强度很大。数据的急速增长,大大影响了运维工作人员的运维效率和错误信息的处理准确性;服务器分布于全国各地并且数量巨大,分析日志问题是目前面临的很重要的问题。 The rapid growth of today's data volume has led to an increase in the number of servers, which has put a huge pressure on the server's operation and maintenance development and maintenance personnel, especially for the analysis and processing of error messages. Analysis and processing require a heavy workload, resulting in a high labor intensity for the operation and maintenance staff. The rapid growth of data has greatly affected the operation and maintenance efficiency of the operation and maintenance staff and the accuracy of error information processing; the servers are distributed all over the country and the number is huge, and the problem of analyzing logs is a very important problem at present.
发明内容 Contents of the invention
本发明的技术任务是提供一种SYSLOG日志存储方法。 The technical task of the invention is to provide a SYSLOG log storage method.
本发明的技术任务是按以下方式实现的,该方法是根据应用程序的设置,接收应用程序的呼叫,并将日志生成标准的日志信息,把日志传输到远程的日志服务器上,从而远程存储日志文件。 The technical task of the present invention is realized in the following manner, the method is to receive the call of the application program according to the setting of the application program, generate standard log information from the log, and transmit the log to a remote log server, thereby storing the log remotely document.
用rsyslog软件把日志传输到远程的日志服务器上。 Use rsyslog software to transfer logs to a remote log server.
所述的rsyslog软件使用tcp协议传输日志。 The rsyslog software described above uses the tcp protocol to transmit logs.
该日志存储方法的步骤如下: The steps of the log storage method are as follows:
步骤1:安装LAMP软件,部署LAMP平台; Step 1: Install LAMP software and deploy the LAMP platform;
步骤2:将LAMP平台初始化; Step 2: Initialize the LAMP platform;
步骤3:然后安装SYSlog和logzilla组件,日志通过web的方式展现; Step 3: Then install the SYSlog and logzilla components, and the logs are displayed through the web;
步骤4:打开浏览器,安装部署web-php组件; Step 4: Open the browser, install and deploy the web-php component;
步骤5:配置部署客户端,通过rsyslog软件的tcp协议传输日志,服务器进行收发存储日志。 Step 5: Configure and deploy the client, transmit logs through the tcp protocol of the rsyslog software, and the server sends, receives, and stores logs.
本发明的一种SYSLOG日志存储方法和现有技术相比,解决了日志分析问题,将日志集中化处理,实现全部的数据中心的日志统一化处理,有效的提升运维工作人员的运维效率。 Compared with the prior art, a SYSLOG log storage method of the present invention solves the log analysis problem, centralizes the log processing, realizes the unified processing of logs in all data centers, and effectively improves the operation and maintenance efficiency of the operation and maintenance staff .
附图说明 Description of drawings
附图1为一种SYSLOG日志存储方法的流程示意框图。 Attached Figure 1 is a schematic block diagram of a SYSLOG log storage method.
具体实施方式 Detailed ways
实施例1: Example 1:
该方法是根据应用程序的设置,接收应用程序的呼叫,并将日志生成标准的日志信息,用rsyslog软件tcp协议把日志传输到远程的日志服务器上,从而远程存储日志文件。 The method is to receive the call of the application program according to the setting of the application program, generate standard log information from the log, and transmit the log to a remote log server by using the rsyslog software tcp protocol, so as to store the log file remotely.
该日志存储方法的步骤如下: The steps of the log storage method are as follows:
步骤1:安装LAMP软件,部署LAMP平台; Step 1: Install LAMP software and deploy the LAMP platform;
步骤2:将LAMP平台初始化; Step 2: Initialize the LAMP platform;
步骤3:然后安装SYSlog和logzilla组件,日志通过web的方式展现; Step 3: Then install the SYSlog and logzilla components, and the logs are displayed through the web;
步骤4:打开浏览器,安装部署web-php组件; Step 4: Open the browser, install and deploy the web-php component;
步骤5:配置部署客户端,通过rsyslog软件的tcp协议传输日志,服务器进行收发存储日志。 Step 5: Configure and deploy the client, transmit logs through the tcp protocol of the rsyslog software, and the server sends, receives, and stores logs.
实施例2: Example 2:
该日志存储方法的步骤如下: The steps of the log storage method are as follows:
步骤1:安装LAMP软件,部署LAMP平台; Step 1: Install LAMP software and deploy the LAMP platform;
步骤2:将LAMP平台初始化;初始化的方法如下: Step 2: Initialize the LAMP platform; the initialization method is as follows:
yum -y install libnet yum -y install libnet
cpan Text::LevenshteinXS cpan Text::LevenshteinXS
cpan -i Digest::SHA1 cpan -i Digest::SHA1
cpan -i Net::MySQL cpan -i Net::MySQL
步骤3:然后安装SYSlog和logzilla组件,日志通过web的方式展现; Step 3: Then install the SYSlog and logzilla components, and the logs are displayed through the web;
步骤4:打开浏览器,安装部署web-php组件; Step 4: Open the browser, install and deploy the web-php component;
步骤5:配置部署客户端,通过rsyslog软件的tcp协议传输日志,服务器进行收发存储日志。 Step 5: Configure and deploy the client, transmit logs through the tcp protocol of the rsyslog software, and the server sends, receives, and stores logs.
名词解释: Glossary:
Log即一种文件的扩展名。 Log is a file extension.
Syslog即系统日志协议,是在一个IP网络中转发系统日志信息的标准,Syslog记录着系统中的任何事件,管理者可以通过查看系统记录随时掌握系统状况。系统日志通过Syslog进程记录系统的有关事件,也可以记录应用程序运作事件。通过适当配置,还可以实现运行Syslog协议的机器之间的通信。通过分析这些网络行为日志,可追踪和掌握与设备和网络有关的情况。 Syslog is the system log protocol, which is a standard for forwarding system log information in an IP network. Syslog records any event in the system, and the administrator can grasp the system status at any time by viewing the system records. The system log records the relevant events of the system through the Syslog process, and can also record the operation events of the application program. With proper configuration, communication between machines running the Syslog protocol can also be achieved. By analyzing these network behavior logs, we can track and grasp the situation related to equipment and network.
syslog-ng为syslog的替代工具,可以完全替代syslog的服务,并且通过定义规则,实现更好的过滤功能。 syslog-ng is an alternative tool of syslog, which can completely replace the service of syslog, and achieve better filtering function by defining rules.
Rsyslog是一个自由软件,GPL的lincesed增强的syslogd。其中,它提供了MySQL和完全可配置的输出格式的支持。rsyslog项目的目标是提供一个更可靠的系统日志守护进程和配置。 Rsyslog is a free software, GPL-lincesed enhanced syslogd. Among other things, it provides support for MySQL and a fully configurable output format. The goal of the rsyslog project is to provide a more reliable syslog daemon and configuration.
TCP是英文Transmission Control Protocol的缩写,翻译成中文为传输控制协议,是一种面向连接的、可靠的、基于字节流的传输层通信协议。 TCP is the abbreviation of Transmission Control Protocol in English. It is translated into Chinese as Transmission Control Protocol. It is a connection-oriented, reliable, byte-stream-based transport layer communication protocol.
Logzilla是一个免费开源的软件,具有可控性、有条理的界面和管理多站点的简化方式。 Logzilla is a free and open source software with controllability, an organized interface and a simplified way of managing multiple sites.
web-php中的php中文名为“超文本预处理器,是一种通用开源脚本语言。 The Chinese name of php in web-php is "hypertext preprocessor", which is a general open source scripting language.
SNMP即简单网络管理协议,是由一组网络管理的标准组成,包含一个应用层协议(application layer protocol)、数据库模型(database schema)和一组资源对象。该协议能够支持网络管理系统,用以监测连接到网络上的设备是否有任何引起管理上关注的情况。 SNMP is the Simple Network Management Protocol, which is composed of a set of network management standards, including an application layer protocol (application layer protocol), a database model (database schema) and a set of resource objects. The protocol supports network management systems to monitor devices connected to the network for any conditions of administrative concern.
LAMP为Linux+Apache+Mysql/MariaDB+Perl/PHP/Python的英文缩写,是一组常用来搭建动态网站或者服务器的开源软件,本身都是各自独立的程序,但是因为常被放在一起使用,拥有了越来越高的兼容度,共同组成了一个强大的Web应用程序平台。 LAMP is the English abbreviation of Linux+Apache+Mysql/MariaDB+Perl/PHP/Python. It is a group of open source software commonly used to build dynamic websites or servers. They are all independent programs, but because they are often used together, With higher and higher compatibility, they together form a powerful web application platform.
通过上面具体实施方式,所述技术领域的技术人员可容易的实现本发明。但是应当理解,本发明并不限于上述的几种具体实施方式。在公开的实施方式的基础上,所述技术领域的技术人员可任意组合不同的技术特征,从而实现不同的技术方案。 Through the above specific implementation manners, those skilled in the technical field can easily realize the present invention. However, it should be understood that the present invention is not limited to the above-mentioned several specific implementation manners. On the basis of the disclosed embodiments, those skilled in the art can arbitrarily combine different technical features, so as to realize different technical solutions.
Claims (4)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510129489.7A CN104731910A (en) | 2015-03-24 | 2015-03-24 | SYSLOG storage method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510129489.7A CN104731910A (en) | 2015-03-24 | 2015-03-24 | SYSLOG storage method |
Publications (1)
Publication Number | Publication Date |
---|---|
CN104731910A true CN104731910A (en) | 2015-06-24 |
Family
ID=53455797
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510129489.7A Pending CN104731910A (en) | 2015-03-24 | 2015-03-24 | SYSLOG storage method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN104731910A (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105868030A (en) * | 2015-12-22 | 2016-08-17 | 乐视移动智能信息技术(北京)有限公司 | Log data communication processing apparatus and method as well as mobile terminal |
CN106656619A (en) * | 2016-12-30 | 2017-05-10 | 郑州云海信息技术有限公司 | Linux log management system and method |
CN107506149A (en) * | 2017-08-29 | 2017-12-22 | 郑州云海信息技术有限公司 | System management memory journal dump method and device |
CN108153653A (en) * | 2018-01-23 | 2018-06-12 | 郑州云海信息技术有限公司 | A kind of BMC blog management methods, system, device and computer storage media |
CN108280017A (en) * | 2018-02-28 | 2018-07-13 | 郑州云海信息技术有限公司 | A kind of System Event Log method for uploading, device, equipment and system |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060288003A1 (en) * | 2005-05-25 | 2006-12-21 | Neeshant Desai | Pattern matching algorithm to determine valid syslog messages |
CN101087210A (en) * | 2007-05-22 | 2007-12-12 | 网御神州科技(北京)有限公司 | High-performance Syslog processing and storage method |
CN103001806A (en) * | 2012-12-18 | 2013-03-27 | 北京华胜天成科技股份有限公司 | Distributed operation and maintenance monitoring system used for information technology (IT) system |
CN103840953A (en) * | 2012-11-21 | 2014-06-04 | 中兴通讯股份有限公司 | Remote log real-time acquisition method and system |
-
2015
- 2015-03-24 CN CN201510129489.7A patent/CN104731910A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060288003A1 (en) * | 2005-05-25 | 2006-12-21 | Neeshant Desai | Pattern matching algorithm to determine valid syslog messages |
CN101087210A (en) * | 2007-05-22 | 2007-12-12 | 网御神州科技(北京)有限公司 | High-performance Syslog processing and storage method |
CN103840953A (en) * | 2012-11-21 | 2014-06-04 | 中兴通讯股份有限公司 | Remote log real-time acquisition method and system |
CN103001806A (en) * | 2012-12-18 | 2013-03-27 | 北京华胜天成科技股份有限公司 | Distributed operation and maintenance monitoring system used for information technology (IT) system |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105868030A (en) * | 2015-12-22 | 2016-08-17 | 乐视移动智能信息技术(北京)有限公司 | Log data communication processing apparatus and method as well as mobile terminal |
CN106656619A (en) * | 2016-12-30 | 2017-05-10 | 郑州云海信息技术有限公司 | Linux log management system and method |
CN107506149A (en) * | 2017-08-29 | 2017-12-22 | 郑州云海信息技术有限公司 | System management memory journal dump method and device |
CN108153653A (en) * | 2018-01-23 | 2018-06-12 | 郑州云海信息技术有限公司 | A kind of BMC blog management methods, system, device and computer storage media |
CN108280017A (en) * | 2018-02-28 | 2018-07-13 | 郑州云海信息技术有限公司 | A kind of System Event Log method for uploading, device, equipment and system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105224351B (en) | Rapid configuration implementation method and rapid configuration server | |
CN106776313B (en) | Method, device and centralized management platform for simulating service | |
CN102571396B (en) | Communication network system and routing inspection subsystem and routing inspection method of communication equipment | |
US8429256B2 (en) | Systems and methods for generating cached representations of host package inventories in remote package repositories | |
US11392873B2 (en) | Systems and methods for simulating orders and workflows in an order entry and management system to test order scenarios | |
CN104731910A (en) | SYSLOG storage method | |
CN107508722B (en) | Service monitoring method and device | |
CN102571420B (en) | Method and system for network element data management | |
US20070016672A1 (en) | Distributed capture and aggregation of dynamic application usage information | |
CN106610836A (en) | Micro-service operation management tool | |
CN103853585B (en) | A kind of implementation method for managing version concentratedly by high in the clouds | |
CN110519077A (en) | Log acquisition system, method, device, server and storage medium | |
TW201312467A (en) | Method and system for distributed application stack deployment | |
CN104391697B (en) | The cloud resource management system and method for application program | |
WO2012094760A1 (en) | Multi-tenant audit awareness in support of cloud environments | |
CN104539053A (en) | Power dispatching automation polling robot and method based on reptile technology | |
CN104639402A (en) | Method for server cluster system network test | |
CN105589791A (en) | Method for application system log monitoring management in cloud computing environment | |
CN109684038B (en) | Docker service container log processing method and device and electronic equipment | |
US20190236683A1 (en) | Transformation and aggregation engine | |
CN104461567A (en) | Method and system for releasing software package | |
WO2022193855A1 (en) | Task state updating method and apparatus, device, and medium | |
CN103414758B (en) | log processing method and device | |
CN105553731A (en) | Automatic inspection method and device | |
CN117194156A (en) | Unified monitoring operation and maintenance management method and system for multi-cloud platform |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WD01 | Invention patent application deemed withdrawn after publication | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20150624 |