Have a suggestion?

Click here to suggest a blog item.

Newsletters Archive

Catch up with DonationCoder by browsing our past newsletters, which collect the most interesting discussions on our site: here.

Editorial Integrity

DonationCoder does not accept paid promotions. We have a strict policy of not accepting gifts of any kind in exchange for placing content in our blogs or newsletters, or on our forum. The content and recommendations you see on our site reflect our genuine personal interests and nothing more.

Latest News

July 2, 2024
Server Migrations Coming

  • Donationcoder server migration is slowly proceeding, expect some hiccups as we get all our ducks in a row..

July 19, 2022
Software Update

Jan 3, 2022
Event Results

May 13, 2020
Software Updates

Mar 24, 2020
Mini Newsletter

Dec 30, 2019
Software Updates

Jan 22, 2020
Software Updates

Jan 12, 2020
Newsletter

Jan 3, 2020
Event Results

Jan 2, 2020
Software Updates

Dec 30, 2019
Software Updates

April 27, 2019
Software Updates

Feb 26, 2019
Software Updates

Feb 23, 2019
Software Updates

Feb 14, 2019
Software Updates

Jan 6, 2019
Event Results

Dec 2, 2018
Software Updates

Nov 13, 2018
Software Releases

July 30, 2018
Software Updates

June 24, 2018
Software Updates

June 6, 2018
Software Updates

Apr 2, 2018
Fundraiser Celebration

Apr 2, 2018
Software Updates

Feb 24, 2018
Software Updates

Jan 14, 2018
Major Site News

Jan 10, 2018
Event Results

Latest Forum Posts
I love screenshot captor.
I have been using it for years. It is dependable and it is very fast and it has so many features. I think it is the best screenshot program out there.

Read more…

Just another Testimony
Just another Testimony image

Our daily Blog

This page spotlights the most interesting posts collected from our forum every day.

You are viewing a specific blog item. Click here to return to the main blog page.

New DonationCoder.com Power Utility for Web Admins: Web Log Filter

Screenshot - 10_21_2006 , 1_51_06 PM.png
My Web Log Filter Tool is now available for download:


This is a super fast web log filter, which works off very simple scripts in order to take huge log files and make smaller ones with only the data you care about in them.

Designed for when your log files are so big that they cause your web log analysis tools to choke.

Features:
  • Designed for speed, can filter 1gb/min
  • Supports lots of conditional operations including regular expressions (or simpler operations for speed)
  • Supports modification during filtering (ie you can anonymize your logs, simplify urls, strip unwanted info)
  • Can redirect info into multiple output files (ie one script to create 10 output logs, 1 for each program you care about tracking)
  • Can parse multiple input files as if they were one big file
  • Can save and load projects for reuse

Examples:
  • You want to examine patterns of people downloading programs on your site, so you make a filter to extract only hits concerning .exe and .zip files.
  • You want to examine referrer patterns, so you create a filter script to discard all hits with blank referrers or referrers from within your own site.
  • You want to anonymize your logs so you can share them, so you create a script to hash randomize all ips and referrers.
  • You want to look at 404 errors and other nonstandard return codes, so you write a script to split a log files into different output files based on the return code.
  • You want to make a script to extract log files for specific pages and files so that you can give different users log files corresponding to their files/pages.

posted by mouser donate to mouser
(permalink) (read 11 comments)


Share on Facebook
submit to reddit