Downloads not updated since Jan 11

gandalf94305 · 2010-01-18 1:09 am

There are three files with IP adresses, PHPBB data and domains for download in the downloads section of www.stopforumspam.com. At least the first two have not been updated since Jan 11, rendering them quite useless.

Are these files supposed to be available up to date (e.g., generated automatically every few hours), or is this just some stale archive snapshot from some point in time. If the latter is the case, stopforumspam.com would be rather useless to me as we cannot send our user registration data through the API for privacy reasons. We depend on checking locally ourselves.

--gandalf.

pedigree · 2010-01-18 5:43 am

Ill check them out, they should be outdating.

Theyre updated once per 24 hours because we prefer people to use the API, its up to date and doesnt mean people hammer a download, thus eating our bandwidth allocation. The ip list is good as an initial cache of information and a fall back incase the api isnt available but shouldnt be relied on for up to date information.

I do however have changes due for the format of the CSV export, where is has ip, lastseen and frequency listed, line by line.

the pnpbb.sql file, was getting out of hand, at 17mb zipped and was downloaded several times per second but a lot of IPs , thus causing a DDoS against us.

The files will be database controlled, only allowing two downloads per 24 hours. The files are updated midnight EST (GMT-05) and take a couple of minutes to generate.

pedigree · 2010-01-18 10:59 am

I think Ive fixed this, the zip files should now be updating properly.

They update at 5 minutes past night EST (GMT-5)

theOZer · 2010-01-20 9:15 am

I'm getting a 404 when I try to download the Domain names.

Concerning the IPs csv zip file, if you're going to have special characters, e.g., . (period), in the field you need to enclose the data in quotes or Excel can NOT import the file as a string; sees it only as a one (1) field input; maybe throw in a CR after each IP wouldn't hurt either.

Nice.

Ciao, theOZer

Last edited by theOZer (2010-01-20 9:22 am)

pedigree · 2010-01-20 10:18 am

/downloads/spamdomains.csv should be .zip, not .csv. Ill fix that shortly.

The problem is, that excel might bork but so might hundreds of forums if I change the format at all.

Im writing a lot of code changes and Ill add the following to the list

- delimited versions of all the files.

There is a new file, that Im testing, that will list all ip,usernames and email addresses, with a lastseen in the last 90 days, in the following format

"field","data","lastseen","frequency"

but its closer to the bottom of my list, than the top.

#1 2010-01-18 1:09 am

Downloads not updated since Jan 11

#2 2010-01-18 5:43 am

Re: Downloads not updated since Jan 11

#3 2010-01-18 10:59 am

Re: Downloads not updated since Jan 11

#4 2010-01-20 9:15 am

Re: Downloads not updated since Jan 11

#5 2010-01-20 10:18 am

Re: Downloads not updated since Jan 11

Board footer