Combined Log System Slides

Dave Beckett
Computing Laboratory, University of Kent at Canterbury, CT2 7NF, England
D.J.Beckett@ukc.ac.uk http://www.hensa.ac.uk/parallel/www/djb1.html
Abstract:
Busy Internet archives generate large logs for each access method being used. These raw log files can be difficult to process and to search. This paper describes a system for reading these growing logs, a combined log file format into which they are re-written and a system that automates this building and integration for multiple access methods. Automated summarizing of the information is also provided giving statistics on accesses by user, site, path-name and date/time amongst others.
Keywords:
archives, administration, statistics
Slides:
  1. Combined Log System
  2. Key Features
  3. Overall Design
  4. Combined Log File Format
  5. Main Processing Sequence
  6. Summary files
  7. Summarising - build-sums
  8. Derived summaries - Bytes per day in January 1995
  9. Derived summaries - Bytes per day for 1995
  10. Derived summaries - bytes per hour (October 1991 - April 1995)
  11. Derived summaries - Top 10s
  12. Derived summaries - Top Proxy Hits
  13. Derived summaries - Access Method
  14. Conclusions, Problems and getting the software
  15. Thanks
First Slide Last Slide