Welcome to the Q&A Forum

I agree with Stefano, this can be a huge headache.  Since Google implemented the latest iteration of their search algorithms (Panda) there have been serios implications for duplicate content on the web.   You now are penalized for the duplicated content and will lose pangerank.

We always recommend all our clients take immediate action against offending sites.  The first step is contacting the site.  If that bears no results then you should absolutely file DMCA complaints with Google, their hosting provider, and any advertisers on their site.

You should also take steps to prevent the continued scraping of your site.  Another good article for reference:
http://www.blueglass.com/blog/content-scraping-prevention-benefits/

HTACESS is a great start but scraping is a business, and the scrapers have gotten very good at masquerading their theft. That is why there are services, such as ours, that can help protect you against site scraping.

Rami Founder, CEO
www.distil.it

Hi Ryan,

As long as others are benefiting and not bothered I am happy to answer your questions.

When setting up Distil you are able to allocate a specific record (subdomain) or the entire zone (domain) to be delivered through our cloud.  This allows you to segregate what traffic you would like us to serve and what content you would like to handle through other delivery mechanisms.  Distil honors all no cache and cache control directives allowing you to easily customize what content we cache even if we are serving your entire site.  Additioanlly we do not cache any dynamic file types ensuring that fresh content always functions properly. Location based content will continue to function correctly because our service continues to pass the end user's IP through the host headers.

Clients are able to reduce their infrastructure after migrating onto our platform however it is important to note that you cannot downgrade to a $5 shared hosting and expect the same results.  Distil is able to reduce your server load by 50%-70% but the remaining 30%-50% will still be handled by your backend so you need ensure any hosting you use can still handle that.

Our specialty is dealing with bots and all of our security measures surrounding that protection are automated.  Any security concerns outside of that scope will be handled reactively with each individual client.

Our service is constantly adapting to ensure that we provide a holistic solution and we go far beyond the suggestions mentioned above. Distil is set up to adapt intelligently on its own as it uncovers new bots and we also are always adding new algorithms to catch bots.  I do not want to say we are bot proof but we will catch well over 95% of bots and will quickly adapt to catch and stop any new derivates.

Similar to most other cloud or CDN type services Google Analytics will not be impacted at all.

Amazon offers cloud computing where as Distil offers a managed security solution in the cloud.  We utilize several cloud providers, including Amazon, for our infrastructure but what makes Distil unique is the software running on that infrastructure.  Amazon simply provides the computing power, we provide the intelligence to catch and stop malicious bots from scraping your website and ensure your content is protected.

Rami Essaid
www.distil.it

Hi Ryan,

Thanks for catching my typo and your interest.   I am happy to answer your questions publicly and will definitely add your questions to the FAQ section we are currently working on.

The company is at distil.it and yes we are an american company located in San Fran despite the Italian TLD.

We do not host your files permanently on our servers, instead our service is layered on top of a standard host.  We do however cache your content on our edge nodes exactly like a CDN to accelerate your site.  This feature is already included in the pricing model.

With the enterprise plan we will work with clients to responde to specific threats that an organization may face.  This could mean blocking certain countries from accessing your site, blocking certain IP ranges, or dealing with DoS attacks.

Although we can respond to most security concerns, there are still some security threats outside our scope.

Our page optimization and acceleration techniques are recognized by Pagespeed and YSlow and the results are measurable.  With one case study we improved our customer's page load time by 55%.  There are still other optimization tricks that we do not handle such as combining images into CSS sprites, or setting browser caching.

We try to accomodate our customers the best we can. Basic redirects like the one you mention would not be hard and we would happily do this for regular customer within reason.

Pricing for the service is based on bandwidth used and there is no extra cost for storage.For your specific scenario though we may not be a complete solution since our service is not currently optimized for video delivery.

Please feel free to ask any additional questions, we are happy to answer and help!

Rami

Hi All,

To follow up on Ryan's last post "offer an anti-bot copyright protection program ", that is exactly what we have created at Distil.  We are the the first turnkey cloud solution that safeguards your revenue and reputation by protecting your web content from bots, data mining, and other malicious traffic.

I do not mean to shamelessly advertise but it seems relevant to mention our service.  If anyone is interested in testing the solution please feel free to message me and I will be happy to extend a no obligation 30 day trial.

Rami Founder, CEO 
www.distil.it

Hi Ryan,

Thanks for catching my typo and your interest.   I am happy to answer your questions publicly and will definitely add your questions to the FAQ section we are currently working on.

The company is at distil.it and yes we are an american company located in San Fran despite the Italian TLD.

We do not host your files permanently on our servers, instead our service is layered on top of a standard host.  We do however cache your content on our edge nodes exactly like a CDN to accelerate your site.  This feature is already included in the pricing model.

With the enterprise plan we will work with clients to responde to specific threats that an organization may face.  This could mean blocking certain countries from accessing your site, blocking certain IP ranges, or dealing with DoS attacks.

Although we can respond to most security concerns, there are still some security threats outside our scope.

Our page optimization and acceleration techniques are recognized by Pagespeed and YSlow and the results are measurable.  With one case study we improved our customer's page load time by 55%.  There are still other optimization tricks that we do not handle such as combining images into CSS sprites, or setting browser caching.

We try to accomodate our customers the best we can. Basic redirects like the one you mention would not be hard and we would happily do this for regular customer within reason.

Pricing for the service is based on bandwidth used and there is no extra cost for storage.For your specific scenario though we may not be a complete solution since our service is not currently optimized for video delivery.

Please feel free to ask any additional questions, we are happy to answer and help!

Rami

Hi Ryan,

As long as others are benefiting and not bothered I am happy to answer your questions.

When setting up Distil you are able to allocate a specific record (subdomain) or the entire zone (domain) to be delivered through our cloud.  This allows you to segregate what traffic you would like us to serve and what content you would like to handle through other delivery mechanisms.  Distil honors all no cache and cache control directives allowing you to easily customize what content we cache even if we are serving your entire site.  Additioanlly we do not cache any dynamic file types ensuring that fresh content always functions properly. Location based content will continue to function correctly because our service continues to pass the end user's IP through the host headers.

Clients are able to reduce their infrastructure after migrating onto our platform however it is important to note that you cannot downgrade to a $5 shared hosting and expect the same results.  Distil is able to reduce your server load by 50%-70% but the remaining 30%-50% will still be handled by your backend so you need ensure any hosting you use can still handle that.

Our specialty is dealing with bots and all of our security measures surrounding that protection are automated.  Any security concerns outside of that scope will be handled reactively with each individual client.

Our service is constantly adapting to ensure that we provide a holistic solution and we go far beyond the suggestions mentioned above. Distil is set up to adapt intelligently on its own as it uncovers new bots and we also are always adding new algorithms to catch bots.  I do not want to say we are bot proof but we will catch well over 95% of bots and will quickly adapt to catch and stop any new derivates.

Similar to most other cloud or CDN type services Google Analytics will not be impacted at all.

Amazon offers cloud computing where as Distil offers a managed security solution in the cloud.  We utilize several cloud providers, including Amazon, for our infrastructure but what makes Distil unique is the software running on that infrastructure.  Amazon simply provides the computing power, we provide the intelligence to catch and stop malicious bots from scraping your website and ensure your content is protected.

Rami Essaid
www.distil.it