What's This Google Robot Shit?

1J04

Lost Squirrel
Full Member
Minuteman
  • Aug 7, 2011
    15,344
    33,934
    PNW WA
    I clicked on Members at top of page and seen this. What the hell?


    20181211_152725.jpg
     
    That's how they index the web, dude. Little robot spiders that follow links wherever they go, then they index all the content they come across.
     
    Last edited by a moderator:
    • Like
    Reactions: 1J04
    I honestly had no fricking idea. I thought I was really on to something. Then again, I missed the boat when Microsoft went IPO. :ROFLMAO:

    Dastardly little bastards. Google is fairly polite, but Micro$oft harvests links and context from their browsers. Got into a bit of a pickle one time because the Bing bot would pass valid query strings and headers to an API that generated phone calls to people..... in the middle of the night.
     
    That's just plain mean man. Funny, but mean. :LOL:

    Data Mining. Who'd duh thunk?

    It's also called a "spider." Sites typically want to be found and try to come up on the first page of search results. And crawling websites allows you to type "Maser" and "diaper" and come up with 00Pissy in all his glory:

    maser_diaper_google.png


    It's also how we continually chum snide little tags like "Midget porn rocks," Jimmy, so be somewhat thankful for this double-edged sword.
     
    It's also called a "spider." Sites typically want to be found and try to come up on the first page of search results. And crawling websites allows you to type "Maser" and "diaper" and come up with 00Pissy in all his glory:

    View attachment 6984556

    It's also how we continually chum snide little tags like "Midget porn rocks," Jimmy, so be somewhat thankful for this double-edged sword.

    Tag for posterity......
     
    • Like
    Reactions: Barneybdb and 1J04
    It's also called a "spider." Sites typically want to be found and try to come up on the first page of search results. And crawling websites allows you to type "Maser" and "diaper" and come up with 00Pissy in all his glory:

    View attachment 6984556

    It's also how we continually chum snide little tags like "Midget porn rocks," Jimmy, so be somewhat thankful for this double-edged sword.


    images
     
    I use an extension in the browser called Disconnect. It blocks trackers. If you start a browser session and move from site to site, you can see how many try to follow you everywhere you go. Facebook and Google are the most persistent and prevalent by far. They are clingers.
     
    Those "robots" are what's known as crawlers. Some sites refer to them as spiders. Basically what they are is programs that browse websites and recognize email addresses, home/business addresses, phone numbers, etc. and use that information to sell to advertisers. Lots of content creators on YouTube who are also active on FaceBook or Twitter have been getting bombarded with those crawlers as of late to sell their information to MCNs to get their business.
     
    Boy wonder has trackers and robots mixed up.
    Robots crawl sites and index content. That's how the latest threads show up in Google searches with relevant terms.
    Trackers are loaded when you visit a site and then go to another place, logging your activities. They claim it's all metadata, which means that there is nothing being kept that could be personally linked to you. You're just user X doing this and that, and the information recorded is used to improve ad relevance, etc. They say.
     
    I use uBlock Origin and Duck Duck Go Privacy Essentials, among other things. If a search is really critical, I'll break down and use Google.