[go: up one dir, main page]

CN104731910A - SYSLOG storage method - Google Patents

SYSLOG storage method Download PDF

Info

Publication number
CN104731910A
CN104731910A CN201510129489.7A CN201510129489A CN104731910A CN 104731910 A CN104731910 A CN 104731910A CN 201510129489 A CN201510129489 A CN 201510129489A CN 104731910 A CN104731910 A CN 104731910A
Authority
CN
China
Prior art keywords
log
syslog
storage method
logs
software
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510129489.7A
Other languages
Chinese (zh)
Inventor
刘鹏
孙海峰
王传超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inspur Group Co Ltd
Original Assignee
Inspur Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur Group Co Ltd filed Critical Inspur Group Co Ltd
Priority to CN201510129489.7A priority Critical patent/CN104731910A/en
Publication of CN104731910A publication Critical patent/CN104731910A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/1734Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Stored Programmes (AREA)

Abstract

本发明公开了一种SYSLOG日志存储方法,该方法是根据应用程序的设置,接收应用程序的呼叫,并将日志生成标准的日志信息,把日志传输到远程的日志服务器上,从而远程存储日志文件。本发明的一种SYSLOG日志存储方法和现有技术相比,解决了日志分析问题,将日志集中化处理,实现全部的数据中心的日志统一化处理,有效的提升运维工作人员的运维效率。

The invention discloses a method for storing SYSLOG logs. According to the setting of the application program, the method receives the call of the application program, generates standard log information from the log, and transmits the log to a remote log server, so as to store the log file remotely. . Compared with the prior art, the SYSLOG log storage method of the present invention solves the log analysis problem, centralizes the log processing, realizes the unified processing of logs in all data centers, and effectively improves the operation and maintenance efficiency of the operation and maintenance staff .

Description

一种SYSLOG日志存储方法A SYSLOG log storage method

技术领域 technical field

本发明涉及计算机数据处理技术领域,具体地说是一种SYSLOG日志存储方法。 The invention relates to the technical field of computer data processing, in particular to a SYSLOG log storage method.

背景技术 Background technique

当今数据量的急速增长,导致了服务器的数量增加,从而对服务器的运维开发维护人员造成了巨大的压力,特别是对于错误信息的分析处理,运维工作人员需要对分散的大量的数据进行分析处理,工作量很大,导致运维工作人员的劳动强度很大。数据的急速增长,大大影响了运维工作人员的运维效率和错误信息的处理准确性;服务器分布于全国各地并且数量巨大,分析日志问题是目前面临的很重要的问题。 The rapid growth of today's data volume has led to an increase in the number of servers, which has put a huge pressure on the server's operation and maintenance development and maintenance personnel, especially for the analysis and processing of error messages. Analysis and processing require a heavy workload, resulting in a high labor intensity for the operation and maintenance staff. The rapid growth of data has greatly affected the operation and maintenance efficiency of the operation and maintenance staff and the accuracy of error information processing; the servers are distributed all over the country and the number is huge, and the problem of analyzing logs is a very important problem at present.

发明内容 Contents of the invention

本发明的技术任务是提供一种SYSLOG日志存储方法。 The technical task of the invention is to provide a SYSLOG log storage method.

本发明的技术任务是按以下方式实现的,该方法是根据应用程序的设置,接收应用程序的呼叫,并将日志生成标准的日志信息,把日志传输到远程的日志服务器上,从而远程存储日志文件。 The technical task of the present invention is realized in the following manner, the method is to receive the call of the application program according to the setting of the application program, generate standard log information from the log, and transmit the log to a remote log server, thereby storing the log remotely document.

用rsyslog软件把日志传输到远程的日志服务器上。 Use rsyslog software to transfer logs to a remote log server.

    所述的rsyslog软件使用tcp协议传输日志。 The rsyslog software described above uses the tcp protocol to transmit logs.

该日志存储方法的步骤如下: The steps of the log storage method are as follows:

步骤1:安装LAMP软件,部署LAMP平台; Step 1: Install LAMP software and deploy the LAMP platform;

步骤2:将LAMP平台初始化; Step 2: Initialize the LAMP platform;

步骤3:然后安装SYSlog和logzilla组件,日志通过web的方式展现; Step 3: Then install the SYSlog and logzilla components, and the logs are displayed through the web;

步骤4:打开浏览器,安装部署web-php组件; Step 4: Open the browser, install and deploy the web-php component;

步骤5:配置部署客户端,通过rsyslog软件的tcp协议传输日志,服务器进行收发存储日志。 Step 5: Configure and deploy the client, transmit logs through the tcp protocol of the rsyslog software, and the server sends, receives, and stores logs.

本发明的一种SYSLOG日志存储方法和现有技术相比,解决了日志分析问题,将日志集中化处理,实现全部的数据中心的日志统一化处理,有效的提升运维工作人员的运维效率。 Compared with the prior art, a SYSLOG log storage method of the present invention solves the log analysis problem, centralizes the log processing, realizes the unified processing of logs in all data centers, and effectively improves the operation and maintenance efficiency of the operation and maintenance staff .

附图说明 Description of drawings

    附图1为一种SYSLOG日志存储方法的流程示意框图。 Attached Figure 1 is a schematic block diagram of a SYSLOG log storage method.

具体实施方式 Detailed ways

  实施例1: Example 1:

该方法是根据应用程序的设置,接收应用程序的呼叫,并将日志生成标准的日志信息,用rsyslog软件tcp协议把日志传输到远程的日志服务器上,从而远程存储日志文件。 The method is to receive the call of the application program according to the setting of the application program, generate standard log information from the log, and transmit the log to a remote log server by using the rsyslog software tcp protocol, so as to store the log file remotely.

该日志存储方法的步骤如下: The steps of the log storage method are as follows:

步骤1:安装LAMP软件,部署LAMP平台; Step 1: Install LAMP software and deploy the LAMP platform;

步骤2:将LAMP平台初始化; Step 2: Initialize the LAMP platform;

步骤3:然后安装SYSlog和logzilla组件,日志通过web的方式展现; Step 3: Then install the SYSlog and logzilla components, and the logs are displayed through the web;

步骤4:打开浏览器,安装部署web-php组件; Step 4: Open the browser, install and deploy the web-php component;

步骤5:配置部署客户端,通过rsyslog软件的tcp协议传输日志,服务器进行收发存储日志。 Step 5: Configure and deploy the client, transmit logs through the tcp protocol of the rsyslog software, and the server sends, receives, and stores logs.

实施例2: Example 2:

该日志存储方法的步骤如下: The steps of the log storage method are as follows:

步骤1:安装LAMP软件,部署LAMP平台; Step 1: Install LAMP software and deploy the LAMP platform;

步骤2:将LAMP平台初始化;初始化的方法如下: Step 2: Initialize the LAMP platform; the initialization method is as follows:

yum -y install libnet yum -y install libnet

cpan Text::LevenshteinXS cpan Text::LevenshteinXS

cpan -i Digest::SHA1 cpan -i Digest::SHA1

cpan -i Net::MySQL cpan -i Net::MySQL

步骤3:然后安装SYSlog和logzilla组件,日志通过web的方式展现; Step 3: Then install the SYSlog and logzilla components, and the logs are displayed through the web;

步骤4:打开浏览器,安装部署web-php组件; Step 4: Open the browser, install and deploy the web-php component;

步骤5:配置部署客户端,通过rsyslog软件的tcp协议传输日志,服务器进行收发存储日志。 Step 5: Configure and deploy the client, transmit logs through the tcp protocol of the rsyslog software, and the server sends, receives, and stores logs.

名词解释: Glossary:

 Log即一种文件的扩展名。 Log is a file extension.

Syslog即系统日志协议,是在一个IP网络中转发系统日志信息的标准,Syslog记录着系统中的任何事件,管理者可以通过查看系统记录随时掌握系统状况。系统日志通过Syslog进程记录系统的有关事件,也可以记录应用程序运作事件。通过适当配置,还可以实现运行Syslog协议的机器之间的通信。通过分析这些网络行为日志,可追踪和掌握与设备和网络有关的情况。 Syslog is the system log protocol, which is a standard for forwarding system log information in an IP network. Syslog records any event in the system, and the administrator can grasp the system status at any time by viewing the system records. The system log records the relevant events of the system through the Syslog process, and can also record the operation events of the application program. With proper configuration, communication between machines running the Syslog protocol can also be achieved. By analyzing these network behavior logs, we can track and grasp the situation related to equipment and network.

syslog-ng为syslog的替代工具,可以完全替代syslog的服务,并且通过定义规则,实现更好的过滤功能。 syslog-ng is an alternative tool of syslog, which can completely replace the service of syslog, and achieve better filtering function by defining rules.

Rsyslog是一个自由软件,GPL的lincesed增强的syslogd。其中,它提供了MySQL和完全可配置的输出格式的支持。rsyslog项目的目标是提供一个更可靠的系统日志守护进程和配置。 Rsyslog is a free software, GPL-lincesed enhanced syslogd. Among other things, it provides support for MySQL and a fully configurable output format. The goal of the rsyslog project is to provide a more reliable syslog daemon and configuration.

TCP是英文Transmission Control Protocol的缩写,翻译成中文为传输控制协议,是一种面向连接的、可靠的、基于字节流的传输层通信协议。 TCP is the abbreviation of Transmission Control Protocol in English. It is translated into Chinese as Transmission Control Protocol. It is a connection-oriented, reliable, byte-stream-based transport layer communication protocol.

Logzilla是一个免费开源的软件,具有可控性、有条理的界面和管理多站点的简化方式。 Logzilla is a free and open source software with controllability, an organized interface and a simplified way of managing multiple sites.

web-php中的php中文名为“超文本预处理器,是一种通用开源脚本语言。 The Chinese name of php in web-php is "hypertext preprocessor", which is a general open source scripting language.

SNMP即简单网络管理协议,是由一组网络管理的标准组成,包含一个应用层协议(application layer protocol)、数据库模型(database schema)和一组资源对象。该协议能够支持网络管理系统,用以监测连接到网络上的设备是否有任何引起管理上关注的情况。 SNMP is the Simple Network Management Protocol, which is composed of a set of network management standards, including an application layer protocol (application layer protocol), a database model (database schema) and a set of resource objects. The protocol supports network management systems to monitor devices connected to the network for any conditions of administrative concern.

LAMP为Linux+Apache+Mysql/MariaDB+Perl/PHP/Python的英文缩写,是一组常用来搭建动态网站或者服务器的开源软件,本身都是各自独立的程序,但是因为常被放在一起使用,拥有了越来越高的兼容度,共同组成了一个强大的Web应用程序平台。 LAMP is the English abbreviation of Linux+Apache+Mysql/MariaDB+Perl/PHP/Python. It is a group of open source software commonly used to build dynamic websites or servers. They are all independent programs, but because they are often used together, With higher and higher compatibility, they together form a powerful web application platform.

通过上面具体实施方式,所述技术领域的技术人员可容易的实现本发明。但是应当理解,本发明并不限于上述的几种具体实施方式。在公开的实施方式的基础上,所述技术领域的技术人员可任意组合不同的技术特征,从而实现不同的技术方案。 Through the above specific implementation manners, those skilled in the technical field can easily realize the present invention. However, it should be understood that the present invention is not limited to the above-mentioned several specific implementation manners. On the basis of the disclosed embodiments, those skilled in the art can arbitrarily combine different technical features, so as to realize different technical solutions.

Claims (4)

1.一种SYSLOG日志存储方法,其特征在于,该方法是根据应用程序的设置,接收应用程序的呼叫,并将日志生成标准的日志信息,把日志传输到远程的日志服务器上,从而远程存储日志文件。 1. A SYSLOG log storage method, is characterized in that, the method is according to the setting of application program, receives the calling of application program, and log generation standard log information, log transmission is on the remote log server, thereby remote storage log files. 2.根据权利要求1所述的一种SYSLOG日志存储方法,其特征在于,用rsyslog软件把日志传输到远程的日志服务器上。 2. a kind of SYSLOG log storage method according to claim 1 is characterized in that, log is transmitted on the remote log server with rsyslog software. 3.根据权利要求2所述的一种SYSLOG日志存储方法,其特征在于,所述的rsyslog软件使用tcp协议传输日志。 3. A kind of SYSLOG log storage method according to claim 2, is characterized in that, described rsyslog software uses tcp protocol transmission log. 4.根据权利要求1所述的一种SYSLOG日志存储方法,其特征在于,该日志存储方法的步骤如下: 4. a kind of SYSLOG log storage method according to claim 1, is characterized in that, the step of this log storage method is as follows: 步骤1:安装LAMP软件,部署LAMP平台; Step 1: Install LAMP software and deploy the LAMP platform; 步骤2:将LAMP平台初始化; Step 2: Initialize the LAMP platform; 步骤3:然后安装SYSlog和logzilla组件,日志通过web的方式展现; Step 3: Then install the SYSlog and logzilla components, and the logs are displayed through the web; 步骤4:打开浏览器,安装部署web-php组件; Step 4: Open the browser, install and deploy the web-php component; 步骤5:配置部署客户端,通过rsyslog软件的tcp协议传输日志,服务器进行收发存储日志。 Step 5: Configure and deploy the client, transmit logs through the tcp protocol of the rsyslog software, and the server sends, receives, and stores logs.
CN201510129489.7A 2015-03-24 2015-03-24 SYSLOG storage method Pending CN104731910A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510129489.7A CN104731910A (en) 2015-03-24 2015-03-24 SYSLOG storage method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510129489.7A CN104731910A (en) 2015-03-24 2015-03-24 SYSLOG storage method

Publications (1)

Publication Number Publication Date
CN104731910A true CN104731910A (en) 2015-06-24

Family

ID=53455797

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510129489.7A Pending CN104731910A (en) 2015-03-24 2015-03-24 SYSLOG storage method

Country Status (1)

Country Link
CN (1) CN104731910A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105868030A (en) * 2015-12-22 2016-08-17 乐视移动智能信息技术(北京)有限公司 Log data communication processing apparatus and method as well as mobile terminal
CN106656619A (en) * 2016-12-30 2017-05-10 郑州云海信息技术有限公司 Linux log management system and method
CN107506149A (en) * 2017-08-29 2017-12-22 郑州云海信息技术有限公司 System management memory journal dump method and device
CN108153653A (en) * 2018-01-23 2018-06-12 郑州云海信息技术有限公司 A kind of BMC blog management methods, system, device and computer storage media
CN108280017A (en) * 2018-02-28 2018-07-13 郑州云海信息技术有限公司 A kind of System Event Log method for uploading, device, equipment and system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060288003A1 (en) * 2005-05-25 2006-12-21 Neeshant Desai Pattern matching algorithm to determine valid syslog messages
CN101087210A (en) * 2007-05-22 2007-12-12 网御神州科技(北京)有限公司 High-performance Syslog processing and storage method
CN103001806A (en) * 2012-12-18 2013-03-27 北京华胜天成科技股份有限公司 Distributed operation and maintenance monitoring system used for information technology (IT) system
CN103840953A (en) * 2012-11-21 2014-06-04 中兴通讯股份有限公司 Remote log real-time acquisition method and system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060288003A1 (en) * 2005-05-25 2006-12-21 Neeshant Desai Pattern matching algorithm to determine valid syslog messages
CN101087210A (en) * 2007-05-22 2007-12-12 网御神州科技(北京)有限公司 High-performance Syslog processing and storage method
CN103840953A (en) * 2012-11-21 2014-06-04 中兴通讯股份有限公司 Remote log real-time acquisition method and system
CN103001806A (en) * 2012-12-18 2013-03-27 北京华胜天成科技股份有限公司 Distributed operation and maintenance monitoring system used for information technology (IT) system

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105868030A (en) * 2015-12-22 2016-08-17 乐视移动智能信息技术(北京)有限公司 Log data communication processing apparatus and method as well as mobile terminal
CN106656619A (en) * 2016-12-30 2017-05-10 郑州云海信息技术有限公司 Linux log management system and method
CN107506149A (en) * 2017-08-29 2017-12-22 郑州云海信息技术有限公司 System management memory journal dump method and device
CN108153653A (en) * 2018-01-23 2018-06-12 郑州云海信息技术有限公司 A kind of BMC blog management methods, system, device and computer storage media
CN108280017A (en) * 2018-02-28 2018-07-13 郑州云海信息技术有限公司 A kind of System Event Log method for uploading, device, equipment and system

Similar Documents

Publication Publication Date Title
CN105224351B (en) Rapid configuration implementation method and rapid configuration server
CN106776313B (en) Method, device and centralized management platform for simulating service
CN102571396B (en) Communication network system and routing inspection subsystem and routing inspection method of communication equipment
US8429256B2 (en) Systems and methods for generating cached representations of host package inventories in remote package repositories
US11392873B2 (en) Systems and methods for simulating orders and workflows in an order entry and management system to test order scenarios
CN104731910A (en) SYSLOG storage method
CN107508722B (en) Service monitoring method and device
CN102571420B (en) Method and system for network element data management
US20070016672A1 (en) Distributed capture and aggregation of dynamic application usage information
CN106610836A (en) Micro-service operation management tool
CN103853585B (en) A kind of implementation method for managing version concentratedly by high in the clouds
CN110519077A (en) Log acquisition system, method, device, server and storage medium
TW201312467A (en) Method and system for distributed application stack deployment
CN104391697B (en) The cloud resource management system and method for application program
WO2012094760A1 (en) Multi-tenant audit awareness in support of cloud environments
CN104539053A (en) Power dispatching automation polling robot and method based on reptile technology
CN104639402A (en) Method for server cluster system network test
CN105589791A (en) Method for application system log monitoring management in cloud computing environment
CN109684038B (en) Docker service container log processing method and device and electronic equipment
US20190236683A1 (en) Transformation and aggregation engine
CN104461567A (en) Method and system for releasing software package
WO2022193855A1 (en) Task state updating method and apparatus, device, and medium
CN103414758B (en) log processing method and device
CN105553731A (en) Automatic inspection method and device
CN117194156A (en) Unified monitoring operation and maintenance management method and system for multi-cloud platform

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20150624