Skip to content
/ readlog Public

stdin tool to extract information from apache web server logs

Notifications You must be signed in to change notification settings

xwz/readlog

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 

Repository files navigation

readlog - cuts apache log into pieces

Pipe apache logs into readlog to selectively display interesting information.

Example: show the access time as Unix epoch and ip addresses

cat /var/log/apache2/access.log | ./readlog --columns=time,ips

Install

Python 2.5 or later is required. The ApacheReader extension is required and can be compiled and installed by running:

python setup.py install

Command line options

readlog offers 4 command line options:

  • --columns - comma delimited list of column names
  • --params - comma delimited list of query parameter names
  • --date - output date format pattern, default is Unix epoch
  • --format - log format pattern, default is common

The available column names, see http://httpd.apache.org/docs/2.2/logs.html#accesslog for details

  • ips - IP address of the client (remote host)
  • username - userid by HTTP authentication.
  • ident - identity
  • time - time that the request was received
  • tz - timezone
  • method - method used by the client
  • url - requested url
  • path - hierarchical path in the url
  • query - query component in the url
  • fragment - fragment identifier in the url
  • protocol - protocol used by the client
  • status - status code that the server sends back to the client
  • size - size of the object returned to the client
  • referer - the site that the client reports having been referred from
  • user-agent - User-Agent HTTP request header

The names in the --params option can be used to show the corresponding query parameter values.

Example: show the query parameter values with names equal to page and type

cat /var/log/apache2/access.log | ./readlog --params=page,type

The options --params and --columns can be combined.

The --date option defines the date format for the time column. For format patterns see:

http://docs.python.org/library/datetime.html#strftime-and-strptime-behavior

The --format option defines the log input format, in particular, common and combined corresponds to the apache common and combined log formats. A custom input log format is supported by specifying the pattern string as argument.

See http://httpd.apache.org/docs/2.2/logs.html#accesslog for details.

Credits

This package uses the ApacheReader extension from http://github.com/idealisms/apache-log-reader

About

stdin tool to extract information from apache web server logs

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published