Page Optimization Error

[csgosmurfcart]

Hello.
When I try to use 'On Page Grader' on specific site, I get an error message.

"
Page Optimization Error
There was a problem loading this page. Please make sure the page is loading properly and that our user-agent, rogerbot, is not blocked from accessing this page.
"
example : https://www.csgosmurfkart.com

Site's robots.txt settings are good. and I think there's no blocking factor. But On Page Grader cannot crawl the sites.
But campaign crawler is working well on the site. only On Page Grader is not working..

What should I change my server's setting or site's setting for crawling site on my site?
I'm using wordpress on google cloud

Thank you.

[Natalie-Alexis]

Hi - Thanks for posting.

I checked this url against our user-agent and it looks like we are being blocked with a 403 forbidden response when trying to access the page. This isn’t related to your robots.txt allowances, rather a server level block. You will want to work with your hosting admin or web developer to ensure our user-agent “rogerbot” is whitelisted so we can access the site.

We hope that helps to clarify, let us know if you have further questions we can assist with!