provide script/tool to realtime monitoring linux logfile,extract/parse data from it, then write it to mariadb

已完成 已发布的 4 年前 货到付款
已完成 货到付款

freelancer should:

provide script/tool to realtime monitoring linux logfile,extract/parse data from it, then write it to mariadb

script runs on 5 independend linux systems at the same time, single destination mariadb-server

in case sql-server is not reachable, buffer data

resend if server is avail again / buffer data

freelancer must recommend database design

encrypted data transfer (strong encryption / at least TLS1.2 AES-256 or better)

store data in database with exact timestamp (include year)

Example log-lines (no spam):

Sep 6 09:10:19 mx1 postfix/qmgr[5360]: 16264202859: from=<sender@[login to view URL]>, size=148076, nrcpt=1 (queue active)

Sep 6 09:10:19 mx1 postfix/smtp[19044]: 16264202859: to=<info@[login to view URL]>, relay=[login to view URL][0.0.0.0]:25, delay=8.8, delays=8.3/0.02/0.29/0.16, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as AECF51423227)

Expected in database:

timestamp,id,from,to,action

Sep 6 09:10:19,16264202859,sender@[login to view URL],info@[login to view URL],sent

Example log-lines (virus):

Sep 6 09:15:33 mx1 postfix/cleanup[19268]: E4D1E202859: milter-reject: END-OF-MESSAGE from unknown[0.0.0.0]: 5.7.1 virus. (ERR501); from=<badsender@[login to view URL]> to=<sales@[login to view URL]> proto=ESMTP helo=<[login to view URL]>

Expected in database:

timestamp,id,from,to,action

Sep 6 09:15:33,E4D1E202859,badsender@[login to view URL],sales@[login to view URL],virus

Example log-lines (spam):

Sep 6 09:06:26 mx1 postfix/cleanup[16855]: B5EDC202859: milter-reject: END-OF-MESSAGE from [login to view URL] [0.0.0.0]: 5.7.1 spam. (ERR123).; from=<spammer@[login to view URL]> to=<sales@[login to view URL]> proto=ESMTP helo=<[login to view URL]>

Expected in database:

timestamp,id,from,to,action

Sep 6 09:06:26,B5EDC202859,spammer@[login to view URL],sales@[login to view URL],spam

Example log-lines (blocked attachment):

Sep 6 09:25:28 mx1 postfix/cleanup[19589]: 5F7CF202859: milter-reject: END-OF-MESSAGE from [login to view URL][0.0.0.0]: 5.7.1 attachment blocked. (ERR473); from=<sender@[login to view URL]> to=<recipient@[login to view URL]> proto=ESMTP helo=<[login to view URL]>

Expected in database:

timestamp,id,from,to,action

Sep 6 09:25:28,5F7CF202859,sender@[login to view URL],recipient@[login to view URL],attachment

Linux MySQL shell脚本 系统管理

项目ID: #21127320

关于项目

11个方案 远程项目 活跃的4 年前

授予:

shobha1987

Hi, I checked the log format in the log file and also the expected format. I can write the script which extracts logs from the log files and saves to database. I will make it failure safe so in case some error occurs t 更多

€40 EUR 在3天内
(4条评论)
3.0

有11名威客正在参与此工作的竞标,均价€187/小时

antima5

Hi, I can do this using ELK stack , log will save in elasticsearch and that will good for analytics. Please get in touch to discuss it in chat. Thankyou

€250 EUR 在7天内
(49条评论)
5.3
ludwig333

♛ Hello, Sir! ♛ Nice to meet you. I am a full web developer with over 5 years on freelancer.com. Very familiar with Website design, JavaScript, Bootstrap, WordPress, Html5, Smart and Creative frontend design, Responsiv 更多

€140 EUR 在7天内
(19条评论)
5.1
prasantaghorui

This is Prasanta Ghorui, I.S.P. by CIPS, Canada having total work experience of 15 years into Java / J2ee related technologies and also in PL/SQL. I am holding an Master of Computer Application degree from a renowned u 更多

€240 EUR 在7天内
(2条评论)
4.5
ebonk

Hello, I can develop the log parsing program using Python or PHP. I am expert in Python, PHP. I used to develop config and log parsing programs using PHP and Python. Your requirement implicitly require a message queue 更多

€200 EUR 在3天内
(15条评论)
4.9
uzairnaseer920

JUST DO YOUR WORK IN CHEAP RATE. WILL DO LESS THAN BID I hold a degree in Computer Engineering. I minored in Programming with a focus in following skills: Java programming with GUI (JAVA, JAVAFX) Python Programming ( P 更多

€140 EUR 在7天内
(8条评论)
3.4
smartweb4

Hello, I am a senior linux administrator with more than 10 years of experience and I have created hundreds of scripts to automate tasks. I can create a script for your but it will have to be in something else rather t 更多

€250 EUR 在7天内
(3条评论)
2.9
Gery6

Bitte um ein kleines Gespräch bei Interesse. Preis, sowie Ablieferung kann gerne noch verhandelt werden, je nach dem wie dringend dies benötigt wird.

€250 EUR 在3天内
(2条评论)
1.9
himanshubhati98

We are  providing solutions regarding devops and IT Infrasructure and migration . In our organization all member are having  7+ years of collective experience in linux, Jenkins Aws Google cloud, bash/shell script, kube 更多

€250 EUR 在6天内
(0条评论)
0.0