Skip to content

Add msnbot for results with "Fetch as bingbot" #191

Open

Description

@cyrilgandon

I am using the Fetch as bingbot feature (https://www.bing.com/webmaster/diagnostics/fetch/bingbot) for testing my pages, and it didn't hit prerender.

After searching what useragent they use, I found this in my logs:

[06/Dec/2019:11:16:50 +0100] "GET / HTTP/1.1" 200 1342 "-" "msnbot/2.0b (+http://search.msn.com/msnbot.htm)"

Maybe we can update all the list of user agent of all the examples/libraries, and add msnbot to the list ?

It may be a bug on their side also. After some research, an article from 2010

Microsoft To Replace MSNBot With BingBot October 1, 2010

Whatever if it is their mistake or not, I guess it will not hurt to add msnbot. I will do that on our nginx config, I let you handle the decision to add it or not to all the repo too :)

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions