and guess who is the winner ?
It is strange though that all other webcrawlers respect the site policy. Microsoft seems to not take into account the robot.txt file or any other warning. So - they fell into the Bot-Trap and won't have access anymore to any of my systems - except to view the Blacklist page.
I had several IP-Addresses which Whois Entry first part looks like this:
OrgName: Microsoft Corp
OrgID: MSFT
Address: One Microsoft Way
City: Redmond
StateProv: WA
PostalCode: 98052
Country: US
At least - this shows that the Harvester Trap is working ...
|