Shulou(Shulou.com)05/31 Report--

This article will explain in detail how to incrementally transmit mysql binlog logs in linux. The content of the article is of high quality, so the editor shares it for you as a reference. I hope you will have a certain understanding of the relevant knowledge after reading this article.

In the actual work, we encountered a problem, MYSQL 5.5.We back up the mysqldump we use, and then transfer the backup to the backup machine every day, but the binlog is not good to transfer mainly to consider several problems:

1. Binlog cannot take the time. What are the rules to pass it on?

2. The transmission of binlog is not all transmitted every time, but needs to be incremental.

3. The last log of binlog is in use and cannot be transmitted.

4. You need to use a prefix for more generality, because the binlog prefix of each database can be specified by yourself.

Such as mysqlbin.000001

So how to solve the above problems? Maybe the shell script can be done, but I choose to do it using C _ Candle + and the LINUX system function opendir readdir lstat

This is the last script I mounted.

#! / bin/sh

TIME_TAG= `date +% Y% m% d`

/ root/ftptool/tool / dbdata/data/ / root/ftptool/ mysql-bin > tool_$ {TIME_TAG} .log

If [$?! = 0]; then

Echo "tool failed"

Exit

Else

Echo "tool sucess!"

Fi

Cat / root/ftptool/ftphead > / root/ftptool/ftp_$ {TIME_TAG} .sh

Cat / root/ftptool/$ {TIME_TAG} > > / root/ftptool/ftp_$ {TIME_TAG} .sh

Cat / root/ftptool/ftptail > > / root/ftptool/ftp_$ {TIME_TAG} .sh

Chmod 755 / root/ftptool/ftp_$ {TIME_TAG} .sh

Sh / root/ftptool/ftp_$ {TIME_TAG} .sh

In fact, ftp_$ {TIME_TAG} .sh comes from three parts

1. Ftphead-- this is very simple. Just write the ip username and password clearly, as follows:

#! / bin/sh

Ftp-I-v-n ftp_$ {TIME_TAG} .sh

Cat ${TIME_TAG} > > ftp_$ {TIME_TAG} .sh

Cat ftptail > > ftp_$ {TIME_TAG} .sh

Generate a full script. And then run it.

In addition, the tool tool will output some information, which, of course, can be closed. I redirected the output to tool_$ {TIME_TAG} .log

You can check the following is a copy:

WARNING:Ftpdir Less Than 1000 Char!

PROCESS:Create Chain Now:

INFO:Current Binog Dir Is: / dbdata/

PROCESS:Checkbin Binlogprefix: mysql-bin

. There are a lot of omissions here

PROCESS:Print chain info

. There are a lot of omissions here

PROCESS:Now Acc Ftpdir:

INFO:Ftp_scirpt fun time:

Wed Jul 13 14:44:13 2016

20160713

INFO:Ftp_scirpt Fun Tmpfile: / root/ftptool/tmp

INFO:Tmpfile Write Mode Succ!

INFO:Ftp_Scirpt Fun Tmp_max_st:0 Max_st_1:2028:

INFO:Scan Put Counter: 163

INFO:Current Max Binlog-1 is:2028

PROCESS:Free Node Is:164

You can clearly see that 163pieces of put script information will be generated. The highest transmission is 2028, and the actual maximum is 2029. I did the-1 operation when coding, in order not to transmit the current binlog.

Because the current binlog is in use

Finally, 164 linked list nodes are released. Colleague, your tmp file directory will also be output, and so will your binglog directory.

Here are all the error codes:

Error 10 open bindbr error

Error 11 argv parameter error

Eroor 12 not find binlog

Error 14 fptdir open error

Error 15 tmp file not found

Error 16 lstat tmp file error

Error 18 tmp file write error

Error 20 binlogdir Must End With /

Error 21 ftpdir Must End With /

Of course, it was successfully put back to 0.

I put the compiled one on Baidu Cloud disk.

Http://pan.baidu.com/s/1i4WuBB3

Here is the full source code

Note that this tool uses LINUX system functions, so it must be a LINUX system or any other system that meets the posix standard that does not contain windows

There is no problem compiling under LINUX. If you have any questions, please contact QQ 22389860.

Click (here) to collapse or open

/ *

> File Name: mbin.h

> Author: gaopeng

> Mail: gaopp_200217@163.com

> Created Time: Tue 02 Aug 2016 05:57:27 PM CST

* * /

# include

# define _ DEG

Using namespace std

Typedef unsigned char uchar

Typedef unsigned long ulong

Typedef unsigned int uint

Typedef unsigned short ushort

Typedef struct data

{

Char* file_name

Char* path_name

Char* full_name

Ulong file_st

Uint nuse

} DATA

Typedef struct f_node

{

Struct f_node * next

DATA* data

} F_NODE

Typedef struct quence

{

Favored Node * first

Favored Node * last

Int items

} QUE

Uint checkbin (const char* file_name,const char* binprefix)

Favored Node * create_que (const char* bindir,const char* binprefix)

QUE* ini_que (void)

Void show (favored Node * const frs_nd)

Void ins_chan (const char* fanciname.const char* pawname.const char* ful_name,QUE * que)

Ulong char_to_num (const char* file_name)

Void time_to_time (char* ltime,char* mytime)

Void ftp_script (const char* ftp_dir,F_NODE* frs_nd)

Int get_max_st (favored Node * const frs_nd)

Ulong readtmp (FILE * fd,const char* tmpdir)

Int myfree (favored Node * const frs_nd)

Uint checkdir (const char* mychar)

Click (here) to collapse or open

/ *

> File Name: main.cpp

> Author: gaopeng

> Mail: gaopp_200217@163.com

> Created Time: Tue 02 Aug 2016 05:58:15 PM CST

* * /

# include

# include

# include

# include

# include

# include

# include "mbin.h"

# include

Using namespace std

Int main (int argc,char * argv [])

{

Favored Node * frs_nd=0

Int freeno = 0

Printf ("% s\ n", "Usage:./tool binlogdir ftpdir binlogprefix")

If (argclast = add

Que- > items++

}

}

Favored Node * create_que (const char* bindir,const char* binprefix)

{

Struct dirent * DirEntry=0

DIR* Dir=0

QUE* myq=0

Uint nob=0; / / check if binlog find

Myq = ini_que ()

Fidelity Node * frs_nd = 0

If (! (Dir = opendir (bindir)

{

Perror ("ERROR (10): Open Binlog Dir Error:")

Exit (10)

}

Else

{

Printf ("INFO:Current Binog Dir Is:% s\ n", bindir)

While (DirEntry = readdir (Dir))

{

If (DirEntry- > d_type = = DT_REG & & checkbin (DirEntry- > dumbname binprefix) = = 1)

{

Nob++

# ifdef _ DEG

Printf ("% s% s\ n", bindir,DirEntry- > d_name)

# endif

Char * tloop = new char [strlen (bindir) + strlen (DirEntry- > d_name) + 5]

Strcat (strcat (tloop,bindir), DirEntry- > d_name); / / bindir like / test/test/test/ last / is must

Ins_chan (DirEntry- > dumbname.bindirpr, tloop.myq)

Delete [] tloop

}

}

Closedir (Dir)

If (nob = = 0)

{

Printf ("WARNING:No Bin Log findings!\ n")

Delete myq

Exit (12)

}

}

Frs_nd = myq- > first

Delete myq

Return frs_nd

}

Uint checkbin (const char* file_name,const char* binprefix)

{

Uint lenprefix = strlen (binprefix); / / exp 5

Uint filelen = strlen (file_name)

Uint i

Uint t

Char tmpfix [strlen (binprefix) + 1]; / / exp strlen (binprefix) + 1 = 6

Memset (tmpfix,0,strlen (binprefix) + 1)

For (iDATA-> full_name,scan_nd- > data- > file_st,scan_nd- > data- > nuse)

Scan_nd = scan_nd- > next

} while (scan_nd- > next)

Printf ("INFO:%s,%s,%s,%lu,%u\ n", scan_nd- > data- > file_name,scan_nd- > data- > path_name,scan_nd- > data- > full_name,scan_nd- > data- > file_st,scan_nd- > data- > nuse)

}

Ulong char_to_num (const char* file_name)

{

Uint len = strlen (file_name)

Uint i

Ulong num=0

Uint chk=0

For (I = (len-1); I > 0 Ting imuri -)

{

If (file_ name [I] > = 48 & & file_ name [I] file_name,ftp)

Fputs ("\ n", ftp)

}

Printf ("INFO:Scan Put Counter:% d\ n", I)

If (I = = 0)

{

Printf ("INFO:Read Max Binlog From Temp is:% lu\ n", tmp_max_st)

Fprintf (tmp, "% lu", tmp_max_st)

Fputs ("\ n", tmp)

}

Else

{

Printf ("INFO:Current Max Binlog-1 is:%lu\ n", max_st_1)

Fprintf (tmp, "% lu", max_st_1)

Fputs ("\ n", tmp)

}

Fclose (ftp)

Fclose (tmp)

}

Int get_max_st (favored Node * const frs_nd)

{

FreshNode * scan_nd = frs_nd

Ulong max_st=0

Do {

If (! scan_nd- > next)

{

Break

}

If (scan_nd- > data- > file_st > max_st)

{

Max_st = scan_nd- > data- > file_st

}

Scan_nd = scan_nd- > next

} while (scan_nd- > next)

If (scan_nd- > data- > file_st > max_st)

{

Max_st = scan_nd- > data- > file_st

}

Return max_st

}

Ulong readtmp (FILE * fd,const char* tmpdir)

{

Struct stat buf

Ulong max_st = 0

If (lstat (tmpdir, & buf)

< 0) { perror("ERROR(16):Lstat Error:"); exit(16); } if(buf.st_size == 0) { max_st = 0; } else { fscanf(fd,"%lu",&max_st); /* if(max_st == 0) { printf("Tmp File Is Bad ?\n"); exit(17); } */ } return max_st; } int myfree(F_NODE* const frs_nd) { F_NODE* scan_nd = frs_nd; F_NODE* cur_nd = 0; int i = 0; do{ cur_nd = scan_nd; if(!scan_nd->

Next)

{

Free (cur_nd- > data- > file_name)

Free (cur_nd- > data- > path_name)

Free (cur_nd- > data- > full_name)

Free (cur_nd- > data)

Free (cur_nd)

ITunes +

Return i

}

Scan_nd = scan_nd- > next

Free (cur_nd- > data- > file_name)

Free (cur_nd- > data- > path_name)

Free (cur_nd- > data- > full_name)

Free (cur_nd- > data)

Free (cur_nd)

ITunes +

} while (scan_nd- > next)

Free (scan_nd- > data- > file_name)

Free (scan_nd- > data- > path_name)

Free (scan_nd- > data- > full_name)

Free (scan_nd- > data)

Free (scan_nd)

ITunes +

Return i

}

Uint checkdir (const char* mychar)

{

Uint len = strlen (mychar)

If (mychar [len-1] = ='/')

{

Return 0

}

Else

{

Return 1

}

}

This is the end of how to transfer mysql binlog logs incrementally in linux. I hope the above content can be helpful to you and learn more knowledge. If you think the article is good, you can share it for more people to see.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.