请叫我awk小(nao)王(can)子(fen)
|
1 2 3 4 5 6 7 8 9 10 |
tail -f /var/log/nginx/access.log|awk '{ if ($9 >= 400) $9="\33[1;31m"$9"\33[0m"; else $9="\33[1;32m"$9"\33[0m"; $1="\33[1;35m"$1"\33[0m"; $7="\33[33m"$7"\33[0m"; $10="\33[1;36m"$10"\33[0m"; print $0; }' |
效果 
不想写python，而且我比较相信awk+uniq+sort的速度
|
1 |
awk -v date="$(date '+\%d/\%b/\%Y')" '($4 ~ date && $9 ~ /200/ ){print $1,$7}' /var/log/nginx/access.log | sort | uniq |awk '{print $2}'|sort|uniq -c|sort -r|head -n 50 |
|
1 2 |
rm /etc/localtime cp /usr/share/zoneinfo/Asia/Shanghai /etc/localtime |
time计时
52M日志，26w条
|
1 2 3 4 5 6 7 8 9 |
awk -v date="$(date '+%d/%b/%Y')" /var/log/nginx/access.log 0.14s user 0.01s system 92% cpu 0.159 total sort 0.00s user 0.00s system 0% cpu 0.156 total uniq -c 0.00s user 0.00s system 0% cpu 0.145 total sort 0.00s user 0.00s system 0% cpu 0.136 total awk '{print $3}' 0.00s user 0.00s system 0% cpu 0.137 total sort 0.00s user 0.00s system 0% cpu 0.125 total uniq -c 0.00s user 0.00s system 0% cpu 0.124 total sort -r 0.00s user 0.00s system 0% cpu 0.114 total head -n 50 0.00s user 0.00s system 0% cpu 0.113 total |
134M日志，加上了两个自定义条件，65w条
|
1 2 3 4 5 6 7 8 |
awk '($9 ~ /200/ && $7 !~ /#/){print $1,$7}' 0.70s user 0.09s system 53% cpu 1.457 total sort 0.03s user 0.01s system 2% cpu 1.530 total uniq -c 0.02s user 0.00s system 1% cpu 1.530 total awk '{print $3}' 0.02s user 0.00s system 1% cpu 1.541 total sort 0.02s user 0.00s system 1% cpu 1.563 total uniq -c 0.01s user 0.00s system 0% cpu 1.569 total sort -r 0.01s user 0.00s system 0% cpu 1.568 total head -n 50 0.00s user 0.00s system 0% cpu 1.567 total |
小站可以考虑
