Too much Traffic, Server overloaded

[tunny]

Hello Chevereto,

My Site Wi.to has already over 430'000 Images hosted. But the Problem is, at the moment there will be uploaded lot of Porn.

The daily Traffic is at the Moment over 60 Million Impressions and over 15 Terrabyte Traffic.
Nginx cant handle this much Hits.

Any idea, how i can stop these Porn uploads?
I disabled at the moment Uploading.

 

[Rodolfo]

When your PC run slow you don't change the OS you change the hardware. This is the same thing. If you can't afford that size then just don't.

 

[Neem]

You can enable hotlinking protection for certain sites

http://www.adminempire.com/dealing-with-hotlinked-images/

 

[D.O.A.]

Hello Chevereto,Nginx cant handle this much Hits.

Correction, your server hardware + configuration cannot handle traffic.

nginx is fine ;p

 

[vlaur]

For that amount of trafic i supose you use multi-servers some NFS ... but to serving statics like image the perfect server is G-WAN.

 

[Gunz]

I solved it using some rules on nginx. With version 3.0 i noticed a -90% of porn upload, i think that all porn was uploaded by bot using the API without passing from website.

Here some useful links:
http://nginx.org/en/docs/http/ngx_http_limit_conn_module.html
http://nginx.org/en/docs/http/ngx_http_limit_req_module.html
http://nginx.org/ru/docs/http/ngx_http_core_module.html#limit_rate

 

[Rodolfo]

You can also use CDN and external storage servers. That helps a lot for this.

 

[arsalancfc]

Hello Chevereto,

My Site Wi.to has already over 430'000 Images hosted. But the Problem is, at the moment there will be uploaded lot of Porn.

The daily Traffic is at the Moment over 60 Million Impressions and over 15 Terrabyte Traffic.
Nginx cant handle this much Hits.

Any idea, how i can stop these Porn uploads?
I disabled at the moment Uploading.

from where is your traffic coming?

 

[SirMoo]

I solved it using some rules on nginx. With version 3.0 i noticed a -90% of porn upload, i think that all porn was uploaded by bot using the API without passing from website.

Wouldn't a better solution be to just not give out the public API... Or change it periodically... Seems silly that if the API is being abused that you'd keep it.

 

[vidim]

So is that 60 million real impressions? Shouldn't you be able to monetize that somehow? Like with LiveJasmin or JuicyAds

 

[vlaur]

You need to use multiple servers.
1. Main server just for chevereto app
2. Multiple storage servers, to balance the load.
3. Try to use Incapsula Business plan http://www.incapsula.com/pricing-and-plans.html to block weird bots and crawlers ... is much better than cloudlflare.
4. Hotlink protection for full size of image (if you have just big images), except ".md.png" ".th.png" sure you can find some rules for it. If you do that user will stop embeding full images, and will redirect users to you site to watch it in full format = monetize.