Shulou(Shulou.com)06/02 Report--

What the editor wants to share with you this time is a detailed explanation of Nginx status monitoring and logs. The article is rich in content, and interested friends can learn about it. I hope you can get something after reading this article.

1. Nginx status monitoring

Nginx provides a built-in status information monitoring page that can be used to monitor the overall access of Nginx, which is implemented by the ngx_http_stub_status_module module.

Use the nginx-V 2 > & 1 | grep-o with-http_stub_status_module command to check whether the current Nginx has status function. If you output ngx_http_stub_status_module, you can add this module at compile time.

By default, status is off, so we need to turn it on and specify uri to access the data.

Server {listen 80; server_name default_server; location / status {stub_status on; allow 114.247.125.227;}}

The allow configuration allows only the specified Ip to access the nginx status function, and there is no restriction if it is removed.

After restarting Nginx, the browser visits http://{IP}/status to view status monitoring information

Active connections: current number of client active connections (including waiting client connections), equivalent to TCP connection status in Established and SYN_ACKaccepts: total number of client connections accepted That is, connections received by the worker process handled: total number of connections processed requests: total number of http requests from the client Reading: number of http requests currently being read (read to http request header) Writing: number of connections currently ready to respond (written to http response header) Waiting: number of idle client requests currently waiting, waiting time is the interval between Reading and Writing

After collecting the Nginx data, it can be monitored by monitoring tools.

2. Log analysis

The default log format configuration for Nginx can be found in / etc/nginx/nginx.conf

Log_format main'$remote_addr-$remote_user [$time_local] "$request"'$status $body_bytes_sent "$http_referer"'"$http_user_agent" $http_x_forwarded_for "$request_time $upstream_response_time'

Printed log instance

39.105.66.117-mp [11/Sep/2019:19:03:01 + 0800] "POST / salesplatform-gateway/users HTTP/1.1" 200575 "-" Apache-HttpClient/4.5.5 (Java/1.8.0_161) "-" 0.040 0.040

39.105.66.117-mp [11/Sep/2019:19:03:08 + 0800] "POST / salesplatform-gateway/users HTTP/1.1" 200575 "-" Apache-HttpClient/4.5.5 (Java/1.8.0_161) "-" 0.008 0.008

$remote_addr: ip address of the client $remote_user: user name used to record the remote client $time_local: used to record access time and time zone $request: url used to record the request and request method $status: response status code $body_bytes_sent: number of bytes of file body content sent to the client $http_referer: you can record the link from which the user accessed $http_user _ agent: browser information used by the user $http_x_forwarded_for: can record client IP Record the ip address of the client through the proxy server $request_time: refers to the time from accepting the first byte of the user's request to sending the response data, that is, $request_time includes the time to receive the client request data, the response time of the back-end program, the time to send the response data to the client $upstream_response_time: the time used to receive the response from the upstream server

Common analysis commands

1. Statistics of UV based on visiting IP

Awk'{print $1} 'paycenteraccess.log | sort-n | uniq | wc-l

2. Query the most frequently visited IP (top 10)

Awk'{print $1}'/ var/log/nginx/access.log | sort-n | uniq-c | sort-rn | head-n 10

3. Check the number of IP visits in a certain period of time (1-8 o'clock)

Awk'$4 > = "[25/Mar/2020:01:00:00" & & $4100) print $0}'| sort-rn

5. View the url visited by the specified ip and the number of visits

Grep "39.105.67.140" / var/log/nginx/access.log | awk'{print $7}'| sort | uniq-c | sort-n-k 1-r

6. Statistics of PV based on visiting URL

Cat / var/log/nginx/access.log | awk'{print $7}'| wc-l

7. Query the most frequently visited URL (top 10)

Awk'{print $7}'/ var/log/nginx/access.log | sort | uniq-c | sort-rn | head-n 10

8. View the most frequently visited URL ([exclude / api/appid]) (top 10)

Grep-v'/ api/appid' / var/log/nginx/access.log | awk'{print $7}'| sort | uniq-c | sort-rn | head-n 10

9. View pages with more than 100 page visits

Cat / var/log/nginx/access.log | cut-d''- f 7 | sort | uniq-c | awk'{if ($1 > 100) print $0}'| less

10. View the most visited page with the last 1000 records

Tail-1000 / var/log/nginx/access.log | awk'{print $7}'| sort | uniq-c | sort-nr | less

11. Count the number of requests per hour and the time point of top10 (accurate to hours)

Awk'{print $4}'/ var/log/nginx/access.log | cut-c 14-15 | sort | uniq-c | sort-nr | head-n 10

12. Count the number of requests per minute and the time point of top10 (accurate to minutes)

Awk'{print $4}'/ var/log/nginx/access.log | cut-c 14-18 | sort | uniq-c | sort-nr | head-n 10

13. Count the number of requests per second and the time point of top10 (accurate to seconds)

Awk'{print $4}'/ var/log/nginx/access.log | cut-c 14-21 | sort | uniq-c | sort-nr | head-n 10

14. Find the log for a specified period of time

Awk'$4 > = "[25/Mar/2020:01:00:00" & & $40.6) {print $4 head 7 print substr ($NF,2,5)}'| print-F'"{print $1 rn 2 minus 3}'| sort-k3-rn | head-10

16. List the time points in which the time of the / api/appid request exceeds 0.6 seconds

Cat / var/log/nginx/access.log | awk'(substr ($NF,2,5) > 0. 6 & & $7 NF,2,5 /\ / api\ / appid/) {print $4 sort 7 NF,2,5 substr ($NF,2,5)}'| awk-F'"'{print $1 camera 2 print 3}'| sort-K3-rn | head-10

17. Obtain the top 10 most time-consuming requests: time, url, time-consuming

Cat / var/log/nginx/access.log | awk'{print $4 magnum 7 awk substr ($NF,2,5)}'| awk-F'"'{print $1 mine2 rn 3}'| sort-K3-rn | head-10 after reading this article on detailed explanation of Nginx status monitoring and logging, if you think the article is well written, you can share it with more people.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.