●Stories
●Firehose
●All
●Popular
●Polls
●Software
●Thought Leadership
Submit
●
Login
●or
●
Sign up
●Topics:
●Devices
●Build
●Entertainment
●Technology
●Open Source
●Science
●YRO
●Follow us:
●RSS
●Facebook
●LinkedIn
●Twitter
●
Youtube
●
Mastodon
●Bluesky
Slashdot is powered by your submissions, so send in your scoop
Forgot your password?
Close
This discussion has been archived.
No new comments can be posted.
Load All Comments
Full
Abbreviated
Hidden
/Sea
Score:
5
4
3
2
1
0
-1
More
Login
Forgot your password?
Close
Close
Log In/Create an Account
●
All
●
Insightful
●
Informative
●
Interesting
●
Funny
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
bySlashbotAgent ( 6477336 ) writes:
Destroying website? No, that's bullshit.
Destroying website page views by giving the user the data without attribution or even visiting the site? Yea. that's totally happening.
It's not damaging any sites. It's damaging the revenue of a few sites and their pissed. Perhaps rightly so. But the horses have left the barn and the barn has burned down.
byichthius ( 198430 ) writes:
I manager a several small specialist blog/cms type of sites as part of a non-profit, open-source project.
Typically they get a few hundred/thousand hits per day.
Recently they have been hit by AI crawlers. Some sites were getting 500,000 requests per day from 500,000 unique IP addresses with random user-agent strings. The "attacks" last 6-8 weeks.
Most of the connections get dropped by the robot, because they won't wait the 1 or 2 seconds that it takes to generate many of the pages. So most of the CPU goes to creating pages that don't get sent.
Yes, this absolutely destroys websites!
To counter this attack, I now block all robots.
If your UA string says your are a browser, you get a cookie check/captcha.
If it doesn't, you get a 403.
Parent
twitter
facebook
●reshold.
There may be more comments in this discussion. Without JavaScript enabled, you might want to turn on Classic Discussion System in your preferences instead.
Slashdot
●
●
Submit Story
It is much harder to find a job than to keep one.
●FAQ
●Story Archive
●Hall of Fame
●Advertising
●Terms
●Privacy Statement
●About
●Feedback
●Mobile View
●Blog
Do Not Sell or Share My Personal Information
Copyright © 2026 Slashdot Media. All Rights Reserved.
×
Close
Working...
Working...