Get Real! wrote:Sotos wrote:Get Real! wrote:Sotos wrote:Awstats can do shit It even tells you how it "knows" that the visit was made by a bot: It is either a known bot (e.g. Google AdSense) or it is an unknown user agent whose name contains things like "Bot", "Spider", "Crawler" etc.
A bot’s request header is always different to that of a browser.
Giauto oussou gamo to geraton mou…
You are clueless so shut up. I am working now so I will not bother with your crap, but in the evening I will send such requests to your website and you should see them in your stats the next day (because AWstats usually updates every some hours, sometimes up to 24 hours). And I wasn't planning to use a browser, but Postman (https://www.getpostman.com/) and writing a simple nodejs app that makes requests is a matter of minutes also. AWstats is not sophisticated at all, and if anything its effort is to exclude from your "Viewed traffic" stats the bots, and not the other way around.
I don’t care about defending Awstats… with node.js you can easily set up a server to mimic whatever you want.
You don’t need “postman” or anyone else’s help Sotos…
I can demonstrate in node.js with 5 lines of code.
Exactly, which is what I said already. So are those 5 lines of code a "Search Engine"? Clearly not. But you were trying to make the point that every bot you see in your logs is a Search Engine (most aren't) and not only that but that they are as good as Google
So...
Creating a bot that makes http requests: Extremely Easy
Creating a proper Search Engine (e.g. Duck Duck Go): A lot Harder but doable (by people who know how to code)
Creating a Search Engine that can compete with Google: Impossible unless you can invest 100s of millions.