map $http_user_agent $bad_bot { "~*" 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~*

Wow! This is one *huge* list. You could’ve charged people just for viewing this post and I’m sure most of us wouldn’t mind forking out some money just to take a peek at this ;)

" 1; "~*

That list is to huge! lol, I tried to find the fake ones but then I looked at the list!

" 1; "~*

Lol, now I get it. There’s 3 *fake* user-agents in the list. Is it…”dumb”, “fuck” & “human”?

" 1; "~*

@Lisa: I hope you don’t mean that I could have charged people to view the blacklist in like a “freakshow” kind of way. Like, “step right up and take a peek at the world’s most hideously long HTAccess Blacklist!” Weird carnival music playing in dark tents and that sort of thing..

" 1; "~*

@ Lisa
" 1; "~*

hm…

" 1; "~*

@Andrew: Nope, those strings address names of “real” user agents, believe it or not.. :)

" 1; "~*

That list is insane!!!

" 1; "~*

I think looking at all of this it harks back to Louis earlier idea of a whitelist;

" 1; "~*

Hi, I think this is fantastic. I have one issue, my server gives a 500 error and the log shows :

" 1; "~*

Well, I got it working, needed to fix a few things and break it over two lines, here are the results, let me know if this will still work as I dont really know htaccess code that well:

" 1; "~*

Hi,

" 1; "~*
  • About Perishable Press
    • " 1; "~*
  • Perishable Press Archives
    • " 1; "~*
  • Contact Perishable Press
    • " 1; "~*
  • Welcome to Dungeon!
    • " 1; "~*
  • Online Dev Tools
    • " 1; "~*
  • Digging Into WordPress (eBook)
    • " 1; "~*
  • .htaccess made easy
    • " 1; "~*
  • Wizard’s SQL Recipes (eBook)
    • " 1; "~*
  • WordPress on shared hosting (video tutorials)
    • " 1; "~*
  • BBQ Pro
    • " 1; "~*
  • Blackhole Pro
    • " 1; "~*
  • USP Pro
    • " 1; "~*
  • Code Snippets
    • " 1; "~*
  • The Tao of WordPress (eBook)
    • " 1; "~*
  • Develop WordPress themes (eBook)
    • " 1; "~* • 75 comments" 1; "~* © 2004–2024 Perishable Press • " 1; "~* " 1; "~* Main Menu" 1; "~* Yes Theme by " 1; "~* Monzilla Media • " 1; "~* 2009/03/30 6:29 am " 1; "~* 2009/03/30 6:35 am " 1; "~* 2009/03/30 6:53 am " 1; "~* 2009/03/30 7:51 am " 1; "~* 2009/03/30 8:56 am " 1; "~* 2009/03/30 9:19 am " 1; "~* 2009/03/30 10:00 am " 1; "~* 2009/03/30 8:30 pm " 1; "~* 2009/03/31 2:25 pm " 1; "~* 2009/04/04 4:14 am " 1; "~* 2009/04/04 3:16 pm " 1; "~* 2009/04/04 7:27 pm " 1; "~* RSS • " 1; "~* Policy • " 1; "~* Sitemap • " 1; "~* John 3:16" 1; "~*
    Around the site
    " 1; "~*
    Favorite projects
    " 1; "~*
    WordPress help
    " 1; "~* Blackhole Pro" 1; "~* eBook: Digging Into WordPress" 1; "~* Wizard’s SQL Recipes for WordPress" 1; "~*
  • Search
    • " 1; "~*
  • Books
    • " 1; "~*
  • Plugins
    • " 1; "~*
  • Twitter
    • " 1; "~*
  • YouTube
    • " 1; "~*
  • LinkedIn
    • " 1; "~*
  • Tumblr
    • " 1; "~*
  • Facebook
    • " 1; "~*
  • Instagram
    • " 1; "~*
  • WordPress
    • " 1; "~* • Post Author " 1; "~*
      " 1; "~* Built w/ shapeSpace • " 1; "~* " 1; "~*
    " 1; "~* " 1; "~* " 1; "~* Wizard’s SQL for WordPress: Over 300+ recipes! Check the " 1; "~* " 1; "~* Digging Into WordPress: Take your WordPress skills to the next level." 1; "~* " 1; "~* Blackhole Pro: Trap bad bots in a virtual black hole." 1; "~* Demo »" 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    Find me on the social medias
    " 1; "~*
    " 1; "~*
    " 1; "~*
    Fall Sale! Code FALL2024 takes 25% OFF our Pro Plugins & Books »
    " 1; "~*
    " 1; "~* " 1; "~* Jeff Starr " 1; "~* Andrew " 1; "~* B. Moore " 1; "~* Donace | The Nexus " 1; "~* Jonathan Ellse " 1; "~* Lisa " 1; "~* eezz " 1; "~*
      " 1; "~*
        " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    Related Posts
    " 1; "~*
    " 1; "~*
    Perishable Press
    " 1; "~*
    Web Dev + WordPress + Security
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~* .children { padding: 0; }" 1; "~* .comment-field label, .comment-field input, .comment-field textarea, .comment .comment-field textarea { display: block; width: 100%; text-align: left; }" 1; "~* .comments-closed img { display: none; }" 1; "~* .form-submit .submit { margin: 0; }" 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
  • more »
    • " 1; "~*
  • more »
    • " 1; "~*
  • CSS
    • " 1; "~*
  • .htaccess
    • " 1; "~*
  • HTML
    • " 1; "~*
  • JavaScript
    • " 1; "~*
  • PHP
    • " 1; "~*
  • Security
    • " 1; "~*
  • SEO
    • " 1; "~*
  • WordPress
    • " 1; "~*
  • apache
    • " 1; "~*
  • blacklist
    • " 1; "~*
  • code
    • " 1; "~*
  • design
    • " 1; "~*
  • hacks
    • " 1; "~*
  • links
    • " 1; "~*
  • markup
    • " 1; "~*
  • mod_rewrite
    • " 1; "~*
  • optimization
    • " 1; "~*
  • plugins
    • " 1; "~*
  • server
    • " 1; "~*
  • spam
    • " 1; "~*
  • tutorials
    • " 1; "~*
  • ux
    • " 1; "~* Here you will find posts about web development, WordPress, security, and more »" 1; "~* Perishable Press is operated by Jeff Starr, a professional web developer and book author with two decades of experience. " 1; "~* Updated " 1; "~* .cancel-reply a { font-size: 11px; font-weight: normal; text-decoration: none; }" 1; "~* .children { list-style: none; }" 1; "~* .comment .avatar { display: block; width: 50px; height: 50px; }" 1; "~* .comment .cancel-reply { display: inline-block; padding: 0 0 0 10px; }" 1; "~* .comment .comment-policy, .cancel-reply { display: none; }" 1; "~* .comment { margin: 20px 0; }" 1; "~* .comment-avatar { float: left; width: 60px; height: 60px; }" 1; "~* .comment-content { float: right; line-height: 1.5; width: calc(100% - 70px); }" 1; "~* .comment-feed { padding: 0 0 0 30px; background-image: url(/wp/wp-content/themes/yes/img/feed.png); background-repeat: no-repeat; background-position: left center; background-size: 20px 20px; }" 1; "~* .comment-field input { box-sizing: border-box; width: 300px; }" 1; "~* .comment-field label { box-sizing: border-box; width: 90px; text-align: right; font-size: 11px; }" 1; "~* .comment-field textarea { box-sizing: border-box; width: calc(100% - 100px); height: 120px; }" 1; "~* .comment-field { margin: 5px 0; }" 1; "~* .comment-info a, .comment-info a:hover { color: #999; text-decoration: none; }" 1; "~* .comment-info { padding: 0 0 0 10px; font-size: 11px; color: #999; }" 1; "~* .comment-moderation { font-style: italic; color: #669966; }" 1; "~* .comment-policy { margin: 0 0 30px 0; }" 1; "~* .comments h2 { line-height: initial; }" 1; "~* .comments pre, .comments blockquote { margin: 20px 0; }" 1; "~* .comments-closed img, .comments-closed span { display: inline-block; margin: 0 3px 0 0; vertical-align: middle; }" 1; "~* .comments-closed span { padding: 3px 0 0 0; }" 1; "~* .comments-closed { margin: 40px 0; text-align: center; }" 1; "~* .comments-list { margin: 40px 0; padding: 0; list-style: none; }" 1; "~* .form-submit .submit { margin: 0 0 0 90px; }" 1; "~* " 1; "~*
    " 1; "~* " 1; "~*
    " 1; "~*
    " 1; "~*
    ♦ Posted by in .htaccess, Security
    " 1; "~*
    " 1; "~*
    Newsletter
    " 1; "~*
    Perishable Press Newsletter
    " 1; "~*
    Thoughts
    " 1; "~*
    Topics
    " 1; "~*
    Welcome
    " 1; "~*
    " 1; "~*
    Get news, updates, deals & tips via email.
    " 1; "~*
    Email kept private. Easy unsubscribe anytime.
    " 1; "~*
    Your email will remain private. Easy unsubscribe anytime.
    " 1; "~*
    I disabled AI in Google search results. It was making me lazy.
    Went out walking today and soaked up some sunshine. It felt good.
    I have an original box/packaging for 2010 iMac if anyone wants it free let me know.
    Always ask AI to cite its sources. Also: “The Web” is not a valid answer.
    All free plugins updated and ready for WP 6.6 dropping next week. Pro plugin updates in the works also complete :)
    99% of video thumbnail/previews are pure cringe. Goofy faces = Clickbait.
    RIP ICQ
    + More thoughts »
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~* The Ultimate User-Agent Blacklist, Featuring Over 1200 Bad Bots | Perishable Press" 1; "~*
    " 1; "~* @media (max-width: 570px) {" 1; "~* }" 1; "~* " 1; "~*
    " 1; "~* " 1; "~* " 1; "~* " 1; "~* " 1; "~*
    About the Author
    Jeff Starr = Creative thinker. Passionate about free and open Web.
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    123…7 •
    " 1; "~*
    ← Next Post
    " 1; "~*
    Previous Post →
    " 1; "~*
    " 1; "~*
    apache blacklist firewall mod_rewrite nG spam tips tricks websites
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    " 1; "~*
    Comments are closed for this post. Something to add? Let me know.
    " 1; "~*
    " 1; "~*
    " 1; "~*

    4G Series: The Ultimate User-Agent Blacklist, Featuring Over 1200 Bad Bots

    " 1; "~*

    75 responses to “4G Series: The Ultimate User-Agent Blacklist, Featuring Over 1200 Bad Bots”

    " 1; "~* " 1; "~* " 1; "~*
  • " 1; "~*
  • " 1; "~*
  • " 1; "~*
  • " 1; "~*
  • " 1; "~*
  • " 1; "~*
  • " 1; "~*
  • " 1; "~*
  • " 1; "~*
  • " 1; "~*
  • " 1; "~*
  • " 1; "~*
      " 1; "~*

      [ Image: Inverted Eclipse ] As discussed in my recent article, Eight Ways to Blacklist with Apache’s mod_rewrite, one method of stopping spammers, scrapers, email harvesters, and malicious bots is to blacklist their associated user agents. Apache enables us to target bad user agents by testing the user-agent string against a predefined blacklist of unwanted visitors. Any bot identifying itself as one of the blacklisted agents is immediately and quietly denied access. While this certainly isn’t the most effective method of securing your site against malicious behavior, it may certainly provide another layer of protection.

      " 1; "~*