If you're creating a post in the SND Dashboard and notice that the website preview isn't appearing after you add a link, it's likely because your site's domain is blocking our scrapers. In order to resolve this, you will need to whitelist the Social News Desk (SND) web scrapers in your CMS / CDN or content firewall configuration.
Here are the steps to help your IT or web team whitelist the scrapers properly.
Identify the SND Scraper User Agents
In order to whitelist the scrapers, you'll need to ensure that the following user agents are allowed:
-
Link Preview Scraper User-Agent:
Social News Desk -
RSS Scraper User-Agent:
Social News Desk RSS Scraper
These user agents are used by our system to access and preview the content when a link is added to a post in the SND Dashboard.
Work with Your IT/Web Team
Your IT team or website developers should be able to add the necessary rules to allow these user agents through. More information in this how-to article on some common places where this whitelist can be applied.
Test Your Configuration
After the IT/web team has applied the changes, it's important to test the configuration:
- Create a new post in the SND Dashboard.
- Add a valid website URL to the post.
- Check if the preview now appears correctly.
If the preview loads as expected, the scraper has been successfully whitelisted.
Troubleshooting
If you’ve followed the above steps and are still experiencing issues, feel free to reach out to SND Support: support@socialnewsdesk.com.
Comments
0 comments
Article is closed for comments.