You are not logged in.
- Topics: Active | Unanswered
#1 2007-12-23 11:09 pm
- Russ
- Administrator
- Registered: 2007-11-28
- Posts: 417
Changes, Upgrades, Enhancements
Watch this thread for announcements about stuff I've done to help make things easier and better.
I have a full time job and we're getting ready to sell a house, so my time to devote here is limited. Still, a lot is planned and I get to stuff when I can. Most improvements come from suggestions, so keep those coming.
Tonight I modified the add form to auto populate your API key, provided you are logged into the forum and your email address is the same as your API key you signed up with. I you have multiple API keys it grabs the first one.
Offline
#2 2007-12-25 4:34 am
- mj12
- Member
- Registered: 2007-12-12
- Posts: 11
Re: Changes, Upgrades, Enhancements
Sweet! One less thing my script has to do. Thanks!
Offline
#3 2007-12-25 1:27 pm
- susato
- Member
- Registered: 2007-12-01
- Posts: 18
Re: Changes, Upgrades, Enhancements
Thanks Russ, that really helps with manual adds. That blasted API is nearly impossible to remember.
Just to clarify - shall we submit data for all spambot registration attempts or only for those that make it through email confirmation?
Merry/Happy Christmas to all forum readers today!
What does your computer do in its spare time?
It could be saving lives by helping to study cancer and Alzheimers.
Find out how: visit Team MacOSX in the Folding@Home distributed computing project.
Offline
#4 2007-12-28 9:25 am
- mj12
- Member
- Registered: 2007-12-12
- Posts: 11
Re: Changes, Upgrades, Enhancements
Something that would be nice... on the page that shows the last 20-submissions, add a "Show All" button that will list all the entries submitted, or just those submitted within a user specified range of dates.
Last edited by mj12 (2007-12-28 9:26 am)
Offline
#5 2007-12-31 1:42 pm
- Russ
- Administrator
- Registered: 2007-11-28
- Posts: 417
Re: Changes, Upgrades, Enhancements
That would be nice, I'm adding it to the list...thanks.
Offline
#6 2008-01-07 12:12 pm
- johnnaasdotcom
- Member
- Registered: 2007-12-22
- Posts: 6
Re: Changes, Upgrades, Enhancements
Nice work. I had about 20 that I couldnt submit over my holiday vacation because I have the API key on my home machine, had I looked back at the sight.... :-)
Offline
#7 2008-01-08 1:52 pm
- Russ
- Administrator
- Registered: 2007-11-28
- Posts: 417
Re: Changes, Upgrades, Enhancements
Right, so I've added a "last seen" element to the API XML data. I figured it would be useful for making a determination of threat when evaluating an IP address or whatever. It returns the last time the entry was seen in the database in YYYY-MM-DD HH:MM:SS format, so you could figure out how long ago it was active.
Offline
#8 2008-01-10 1:39 pm
- Russ
- Administrator
- Registered: 2007-11-28
- Posts: 417
Re: Changes, Upgrades, Enhancements
Search results can now be exported as XML or CSV. For instance:
http://www.stopforumspam.com/search?q=% … export=xml
http://www.stopforumspam.com/search?q=% … export=csv
Offline
#9 2008-01-10 2:46 pm
- Russ
- Administrator
- Registered: 2007-11-28
- Posts: 417
Re: Changes, Upgrades, Enhancements
This link: http://www.stopforumspam.com/forum/spammers
will show you all of the entries you have submitted. On the far right of the table, there's a delete button if you need to remove it from the list for some reason.
I've been playing with it and it seems to work, so try it out as needed. It will be linked from the forum header shortly.
Offline
#10 2008-01-10 4:08 pm
- Russ
- Administrator
- Registered: 2007-11-28
- Posts: 417
Re: Changes, Upgrades, Enhancements
I've updated the add page with a sanity check to make sure the email address submitted is not the same email as what's associated with the API key. Too many people would add themselves to the list for some reason and end up on the spammer list!
Offline
#11 2008-01-10 5:06 pm
- susato
- Member
- Registered: 2007-12-01
- Posts: 18
Re: Changes, Upgrades, Enhancements
You could also relabel the boxes to leave no doubt:
Spammer's username:
Spammer's email:
Spammer's IP:
Then no one would enter their own info in the boxes.
Except perhaps an honest spammer...
Nah! Can't remember the last time I saw one of those. ;^)
What does your computer do in its spare time?
It could be saving lives by helping to study cancer and Alzheimers.
Find out how: visit Team MacOSX in the Folding@Home distributed computing project.
Offline
#12 2008-01-17 9:20 pm
- mj12
- Member
- Registered: 2007-12-12
- Posts: 11
Re: Changes, Upgrades, Enhancements
This link: http://www.stopforumspam.com/forum/spammers
will show you all of the entries you have submitted. On the far right of the table, there's a delete button if you need to remove it from the list for some reason.
I've been playing with it and it seems to work, so try it out as needed. It will be linked from the forum header shortly.
SuhWEET, thanks Russ!
Offline
#13 2008-01-17 9:24 pm
- Russ
- Administrator
- Registered: 2007-11-28
- Posts: 417
Re: Changes, Upgrades, Enhancements
Not a very useful update, but I've created an iPhone/iPod touch webclip icon, on the chance someone uses one of these to check the site.
![]()
Offline
#14 2008-03-29 10:36 pm
- Russ
- Administrator
- Registered: 2007-11-28
- Posts: 417
Re: Changes, Upgrades, Enhancements
The Spammer Domains page has been updated to the Spammer Domains and IPs page, which now contains the most frequently found IPs from the list. Also you can download the spammer domains in CSV on the downloads page.
Offline
#15 2009-07-21 10:46 am
- Russ
- Administrator
- Registered: 2007-11-28
- Posts: 417
Re: Changes, Upgrades, Enhancements
Lots of changes/upgrades recently.
- Removal script now available for self-removal from the list
- Data is now available on DNSBL
- APIs page updated with more detailed information
- API post form works better with more detailed error reporting
- Country pages are paginated now
- Geo IP data updated from MaxMind
Offline
#16 2009-07-21 7:33 pm
- Russ
- Administrator
- Registered: 2007-11-28
- Posts: 417
Re: Changes, Upgrades, Enhancements
API Stats are now available
Offline
#17 2009-11-28 6:47 pm
- Russ
- Administrator
- Registered: 2007-11-28
- Posts: 417
Re: Changes, Upgrades, Enhancements
If you noticed the homepage loads a lot faster now, it's because we switched to a Smarty template and caching system (pedigree wrote it). Now the entries are updated once per minute, and the required number of SQL queries to build the page have been reduced from thousands down to just a handful.
Offline
#18 2009-11-28 7:16 pm
- pedigree
- uıɐbɐ ʎɐqǝ ɯoɹɟ pɹɐoqʎǝʞ ɐ buıʎnq ɹǝʌǝu ɯ,ı
- From: Londonderry
- Registered: 2008-04-16
- Posts: 4,445
Re: Changes, Upgrades, Enhancements
I did the php, Russ did the CSS ![]()
Offline
#19 2009-12-07 1:53 pm
- BassNotes
- Member
- From: Costa Mesa, Calif., USA
- Registered: 2009-07-24
- Posts: 13
- Website
Re: Changes, Upgrades, Enhancements
I notice that submitted e-mail addresses with periods inserted to segment the username now also show up in intact form, with the periods removed. Good job! Thanks.
Offline
#20 2009-12-07 2:29 pm
- pedigree
- uıɐbɐ ʎɐqǝ ɯoɹɟ pɹɐoqʎǝʞ ɐ buıʎnq ɹǝʌǝu ɯ,ı
- From: Londonderry
- Registered: 2008-04-16
- Posts: 4,445
Re: Changes, Upgrades, Enhancements
The . removal only works with certain domains, not all domains. As we become aware of other email providers being stupid, then we will add that domain to the strippers and update the database accordingly
Offline
#21 2009-12-08 4:40 pm
- paul
- Member
- Registered: 2009-11-29
- Posts: 27
Re: Changes, Upgrades, Enhancements
What happened... the MySQL password was wrong ?
Anyway, it made me realize that my code needs some work as it crashed my contact page since the returned data was not XML :-(
Offline
#22 2009-12-08 4:57 pm
- pedigree
- uıɐbɐ ʎɐqǝ ɯoɹɟ pɹɐoqʎǝʞ ɐ buıʎnq ɹǝʌǝu ɯ,ı
- From: Londonderry
- Registered: 2008-04-16
- Posts: 4,445
Re: Changes, Upgrades, Enhancements
Someone decided to dos the server with 2700 requests in an hour, thus slowly exhausting the mysql connections available.
You NEED to get the result and verify that its a valid response before processing it.
<response="true"> or <response="false">
Will be the first line.
Ive got code it testing to implement methods to bypass the mysql connections in use so when its tested, then there should be considerly less issues with the database.
Again, I work within the limits of donated server space...
Offline
#23 2010-08-09 7:10 am
- SuperHebbe
- Member
- From: Norway
- Registered: 2010-08-09
- Posts: 1
- Website
Re: Changes, Upgrades, Enhancements
Hi
I don't know how often you update your files in the download section, but if it's not daily, maybe put a "Last updated: xx/xx/xx" behind the files?
Thanks ![]()
Last edited by SuperHebbe (2010-08-09 7:11 am)
Offline
#24 2010-08-09 7:51 am
- pedigree
- uıɐbɐ ʎɐqǝ ɯoɹɟ pɹɐoqʎǝʞ ɐ buıʎnq ɹǝʌǝu ɯ,ı
- From: Londonderry
- Registered: 2008-04-16
- Posts: 4,445
Re: Changes, Upgrades, Enhancements
Consider it done. Ill put this on the new site on the downloads page.
Offline
#25 2010-08-09 8:55 am
- pedigree
- uıɐbɐ ʎɐqǝ ɯoɹɟ pɹɐoqʎǝʞ ɐ buıʎnq ɹǝʌǝu ɯ,ı
- From: Londonderry
- Registered: 2008-04-16
- Posts: 4,445
Re: Changes, Upgrades, Enhancements
This is a copy/paste of the new download page, without all the HTML formatting of course ![]()
Downloads and Contributions
Here are some files generated from our data that may be useful. We hope to add more in the future.
Something you'd like to see here? Ask us.
* All IPs in CSV (one line, comma seperated) - limited to 2 downloads per IP per day
* Just the domains in CSV (from the Spammer Domains page) - limited to 2 downloads per IP per day
IP numbers by Time
These file provide details of all IP numbers logged within the last 1 day, 7 days, 30 days, 90 days and 1 year, in the following format (Excel compatible CSV)
"109.104.183.88","1","2010-03-14 09:30:39"
"109.104.187.89","71","2010-03-27 01:53:34"
"109.104.189.87","8","2009-11-11 07:41:20"
1st column is the IP number, 2nd is the number of times that IP number been reported in the period for which the file was generated, 3rd column is the last seen date/time (EST) for that IP
Updated once per hour
* listed_ipfreq_1.zip - Last 24 hours, limited to 6 downloads per IP per day, last update 09-Aug 09:35 EDT
* listed_ipfreq_7.zip - Last 7 days, limited to 2 downloads per IP per day, last update 09-Aug 09:35 EDT
Updated once per day, midnight EST/EDT
* listed_ipfreq_30.zip - Last 30 days, limited to 2 downloads per IP per day, last update 09-Aug 09:37 EDT
* listed_ipfreq_90.zip - Last 90 days, limited to 2 downloads per IP per day, last update 09-Aug 09:37 EDT
* listed_ipfreq_365.zip - Last 365 days, limited to 2 downloads per IP per day, last update 09-Aug 09:37 EDT
Offline




