Başta Bing ve sonra Google’ın buton ve yazı boyutları ile oynamasından sonra Yahoo da arayüzünü değiştirdi.
Kendi sitesinde sol üst tarafta Try New Yahoo (Yeni Yahoo’yu Deneyin) başlığı altında sundu. Bakalım Yahoo sevenler beğenecekmi Yahoo ya herhalde ayda en fazla 10 defa giriyorumdur o da  sitelerin istatistiklerini görmek için.

Bu arada az önce arşivime bakarken büyük bir sitenin görüntüsünü kaydetmiştim, sanıyorum bundan yaklaşık 1,2 yıl önceki bir görüntü ve şimdi baktım da çok ezikmiş eskiden halbuki o zamanlar vay be şuna bak derdik, artık merak etmiyorum önümüzdeki yılları internette filan ne olacak diye Hele teknolojiyi, ben teknolojiden hala nefret ediyorum, edicem ve ettiricem ! Yaşasın anti teknoloji Yarın erken kalkıcam şimdilik hoşçakalım efem (uyumıcam sadece konuyu kapatmak için numara yaptım )

Vesselam

Diğer bir metod ise direk Google’ın domainini (alan adını) direk olarak ele geçirip yönetmek için yapılan bir saldırıdır. Bunun ise Google ile aslında hiçbir alakası yoktur diyebilirim, çünkü bu tamamen Google’ın domainini barındırdığı şirketin sistemine bağlıdır. Ama şu son zamanlar Google’ın resmi sitelerinin anasayfası çok hacklendi, bunun Google ile hiçbir alakası yoktur, yöntemi size şöyle açıklayayım;

Ele aldığımız site google.com olsun bu domain nic.com da barınır, bu domainin uzantısına göre değişiklik gösterebilir (Örn: google.com.tr nic.tr) saldıran kişi nic.com a girer ve sitede açık aramaya başlar (buna hiç girmeyeceğim, girsem konu çok dağılır). Bazı şirketler öyle bir sistem yazmışlardır ki uğraşıldıktan sonra gerçektende çok basit yöntemlerle tüm domainleri yönetebilecek yetkiyi kapabilirsiniz. İşte bu yöntemlerden biri ile saldıran kişi nic.com da google.com domain hesabınını yöneten kişinin bilgilerini veritabanından çeker (Bu saldıran kişinin yöntemine göre değişebilir, şifresini sıfırlayabilir, admin bilgilerini direk alabilir vs.). Şimdiye kadar anlattığım yöntemlerin Google ile uzaktan yakından bir alakası yoktur, bu tamamen Google’in domaininin barındırdığı şirketin hatasıdır. Yani aslında nic.com u hackliyor ama nic.com yüzünden masum Google’da arada kaynıyor. Domain yönetim hesabını ele geçirdikten sonra artık koskocaman google.com’un yönetimi hackleyen kişinin elindedir. Tabi bu bahsettiğim yönetim sadece domain yönetimidir, Google sistemine herhangi bir şekilde erişim sağlayamaz. Domain yönetimini ele geçirdikten sonra dns adreslerini değiştirdikten sonra domaini babasının malıymış gibi kullanabilir (ta ki adamlar anlayana kadar dicemde 1 saati geçmez sanırım ).

Evet konuyu toparlayayım şöyle ki ; bu bahsettiğim örnek Google içindir, Yahoo, Microsoft.com filan hacklendiğindede tamamen aynıdır Domainin nasıl hacklendiğini anlarım derseniz; Eğer sitenin anasayfası hacklenmişse domain ele geçirilmiştir.

İşin özü için kısaca bir örnek daha  : ndemir.com domainimi barındırdığım yer olan isimtescil.net hackleniyor ve isimtescil.net te barınan domainim ele geçiriliyor gibi Google vs. de aynen böyledir yani

Evet bir elveda daha diyorum ve herkese sağlıklı,mutlu günler diliyorum. Hoşçakalın.

Vesselam.

1. Klasörlere Erişim

Bir klasöre tüm erişimi engellemek istiyorsanız (mesela program kaynak kodlarınızı barındıran bir klasörünüz olabilir; bu durumda klasöre internetten değil, yalnızca dosya sisteminden erişmeyi isteyebilirsiniz) klasörün içinde .htaccess dosyası oluşturup içine

Kod:
#deny all access

deny from all

yazmanız yeterli. Eğer bu klasöre yalnızca belirlediğiniz ip adresiyle veya ip bloğu tarafından erişilmesini istiyorsanız

Kod:
#deny all access

deny from all

allow from 10.0.0.1 # tek ip adresi

allow from 192.168.0.0/24 # ip bloğu

yazmanız yeterli. Tek bir dosya için erişimi engellemek için ise yazmanız gereken şu:

<Files private.html>

Order allow,deny

Deny from all

</Files>

2. Klasör Listelemek

Bir klasördeki dosyaların listelenmesini istiyorsanız .htaccess dosyasına şunları yazmanız gerekiyor:


Kod:
Options +Indexes +MultiViews +FollowSymlinks

<ifmodule mod_autoindex.c>

IndexOptions FancyIndexing

</ifmodule>

Bunun için sunucunuzda autoindex modülünün yüklü olması gerekiyor. Klasördeki öntanımlı listelemeyi iptal etmek için ise şu satır yeterli:


Kod:
IndexIgnore *

3. Sıkıştırma

Sitenizin bant genişliğini (bandwidth) korumak için bir php özelliği olan veri sıkıştırmayı kullanabilirsiniz. .htaccess dosyasına şunu eklemelisiniz:


Kod:
<ifModule mod_php4.c>

php_value zlib.output_compression 16386

</ifModule>

4. Dosyaları Gizlemek

Belirli dosyalara erişimi engellemek için Files direktifiyle birlikte Regular Expression kullanabilirsiniz. Örnek olarak konfigürasyon dosyalarına, robot.txt’e veya log’lara erişimi engellemek isteyebilirsiniz. Aşağıdaki örnek klasördeki .ht ile başlayan dosyalara erişimi engellemektedir.


Kod:
<Files ~ “^\.ht”>

Order allow,deny

Deny from all

Satisfy All

</Files>

5. Özel HTTP 404 Hata Sayfası

Ziyaretçileriniz “404: Sayfa Bulunamadı” hatasıyla karşılaşacaklarında sizin istediğiniz bir dosyaya yönlenmelerini sağlamak için şu kodu kullanın:


Kod:
ErrorDocument 404 /errors/notfound.html

Bu şekilde diğer hata kodlarını da özelleştirebilirsiniz. Dikkat! Internet Explorer 512 bayttan küçük hata sayfalarıyla karşılaştığında, MSN search gibi bağlantıların bulunduğu kendi hata sayfasını kullanıcıya göstermektedir. Belirttiğiniz hata sayfasının 512B’tan büyük olduğuna emin olun.

6. Hotlinking’i Engellemek

Hotlinking basitçe sizin sitenizdeki bir resmi, videoyu başka bir sitenin göstermesine denir. Bu durumda olan sizin bandwidth’inize olur. Örnek olarak sitenizin dışında kullanılan bazı dosyalara erişimi engelleyip nohotlink.gif adında bir resim dosyası gönderen şu koda bakalım:


Kod:
<IfModule mod_rewrite.c>

RewriteEngine on

RewriteCond %{HTTP_REFERER} !^$

RewriteCond %{HTTP_REFERER} !^http://([-a-z0-9]+\.)?siteniz\.com[NC]

RewriteRule .*\.(zip|mp3|avi|wmv|mpg|mpeg)$ http://www.siteniz.com/img/nohotlink.gif [R,NC,L]

</ifModule>

Kod basitçe siteniz.com dışından çağırılan zip, mp3 ve bazı video dosyaları yerine nohotlink.gif dosyasını gösteriyor. Dikkat! Eğer resim hotlink’lerini engellerseniz site dışından istenen tüm resimleri engelleyeceksiniz. Bu durumda mesela feedburner gibi bir hizmet kullanıyorsanız bu hizmet için kodunuzu değiştirmeniz gerekecektir.

7. Kötü Bot’ları Engellemek

Sitenizi kullanan veya tamamen indirmek isteyen bot’lara karşı .htaccess dosyasını kullanabilirsiniz:


Kod:
<IfModule mod_rewrite.c>

RewriteEngine On

RewriteCond %{HTTP_USER_AGENT} ^BlackWidow [OR]

RewriteCond %{HTTP_USER_AGENT} ^Bot\ mailto:craftbot@yahoo.com [OR]

RewriteCond %{HTTP_USER_AGENT} ^ChinaClaw [OR]

RewriteCond %{HTTP_USER_AGENT} ^Custo [OR]

RewriteCond %{HTTP_USER_AGENT} ^DISCo [OR]

RewriteCond %{HTTP_USER_AGENT} ^Download\ Demon [OR]

RewriteCond %{HTTP_USER_AGENT} ^eCatch [OR]

RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [OR]

RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon [OR]

RewriteCond %{HTTP_USER_AGENT} ^EmailWolf [OR]

RewriteCond %{HTTP_USER_AGENT} ^Express\ WebPictures [OR]

RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [OR]

RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE [OR]

RewriteCond %{HTTP_USER_AGENT} ^FlashGet [OR]

RewriteCond %{HTTP_USER_AGENT} ^GetRight [OR]

RewriteCond %{HTTP_USER_AGENT} ^GetWeb! [OR]

RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla [OR]

RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It [OR]

RewriteCond %{HTTP_USER_AGENT} ^GrabNet [OR]

RewriteCond %{HTTP_USER_AGENT} ^Grafula [OR]

RewriteCond %{HTTP_USER_AGENT} ^HMView [OR]

RewriteCond %{HTTP_USER_AGENT} HTTrack [NC,OR]

RewriteCond %{HTTP_USER_AGENT} ^Image\ Stripper [OR]

RewriteCond %{HTTP_USER_AGENT} ^Image\ Sucker [OR]

RewriteCond %{HTTP_USER_AGENT} Indy\ Library [NC,OR]

RewriteCond %{HTTP_USER_AGENT} ^InterGET [OR]

RewriteCond %{HTTP_USER_AGENT} ^Internet\ Ninja [OR]

RewriteCond %{HTTP_USER_AGENT} ^JetCar [OR]

RewriteCond %{HTTP_USER_AGENT} ^JOC\ Web\ Spider [OR]

RewriteCond %{HTTP_USER_AGENT} ^larbin [OR]

RewriteCond %{HTTP_USER_AGENT} ^LeechFTP [OR]

RewriteCond %{HTTP_USER_AGENT} ^Mass\ Downloader [OR]

RewriteCond %{HTTP_USER_AGENT} ^MIDown\ tool [OR]

RewriteCond %{HTTP_USER_AGENT} ^Mister\ PiX [OR]

RewriteCond %{HTTP_USER_AGENT} ^Navroad [OR]

RewriteCond %{HTTP_USER_AGENT} ^NearSite [OR]

RewriteCond %{HTTP_USER_AGENT} ^NetAnts [OR]

RewriteCond %{HTTP_USER_AGENT} ^NetSpider [OR]

RewriteCond %{HTTP_USER_AGENT} ^Net\ Vampire [OR]

RewriteCond %{HTTP_USER_AGENT} ^NetZIP [OR]

RewriteCond %{HTTP_USER_AGENT} ^Octopus [OR]

RewriteCond %{HTTP_USER_AGENT} ^Offline\ Explorer [OR]

RewriteCond %{HTTP_USER_AGENT} ^Offline\ Navigator [OR]

RewriteCond %{HTTP_USER_AGENT} ^PageGrabber [OR]

RewriteCond %{HTTP_USER_AGENT} ^Papa\ Foto [OR]

RewriteCond %{HTTP_USER_AGENT} ^pavuk [OR]

RewriteCond %{HTTP_USER_AGENT} ^pcBrowser [OR]

RewriteCond %{HTTP_USER_AGENT} ^RealDownload [OR]

RewriteCond %{HTTP_USER_AGENT} ^ReGet [OR]

RewriteCond %{HTTP_USER_AGENT} ^SiteSnagger [OR]

RewriteCond %{HTTP_USER_AGENT} ^SmartDownload [OR]

RewriteCond %{HTTP_USER_AGENT} ^SuperBot [OR]

RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP [OR]

RewriteCond %{HTTP_USER_AGENT} ^Surfbot [OR]

RewriteCond %{HTTP_USER_AGENT} ^tAkeOut [OR]

RewriteCond %{HTTP_USER_AGENT} ^Teleport\ Pro [OR]

RewriteCond %{HTTP_USER_AGENT} ^VoidEYE [OR]

RewriteCond %{HTTP_USER_AGENT} ^Web\ Image\ Collector [OR]

RewriteCond %{HTTP_USER_AGENT} ^Web\ Sucker [OR]

RewriteCond %{HTTP_USER_AGENT} ^WebAuto [OR]

RewriteCond %{HTTP_USER_AGENT} ^WebCopier [OR]

RewriteCond %{HTTP_USER_AGENT} ^WebFetch [OR]

RewriteCond %{HTTP_USER_AGENT} ^WebGo\ IS [OR]

RewriteCond %{HTTP_USER_AGENT} ^WebLeacher [OR]

RewriteCond %{HTTP_USER_AGENT} ^WebReaper [OR]

RewriteCond %{HTTP_USER_AGENT} ^WebSauger [OR]

RewriteCond %{HTTP_USER_AGENT} ^Website\ eXtractor [OR]

RewriteCond %{HTTP_USER_AGENT} ^Website\ Quester [OR]

RewriteCond %{HTTP_USER_AGENT} ^WebStripper [OR]

RewriteCond %{HTTP_USER_AGENT} ^WebWhacker [OR]

RewriteCond %{HTTP_USER_AGENT} ^WebZIP [OR]

RewriteCond %{HTTP_USER_AGENT} ^Wget [OR]

RewriteCond %{HTTP_USER_AGENT} ^Widow [OR]

RewriteCond %{HTTP_USER_AGENT} ^WWWOFFLE [OR]

RewriteCond %{HTTP_USER_AGENT} ^Xaldon\ WebSpider [OR]

RewriteCond %{HTTP_USER_AGENT} ^Zeus

RewriteRule .* – [F]

</ifModule>

8. no-www Desteği

Siz de sitelerde www subdomain’inin kullanılmasına karşıysanız bu kod işinizi görecektir:


Kod:
<IfModule mod_rewrite.c>

Options +FollowSymlinks

RewriteEngine on

RewriteCond %{http_host} ^www\.example\.com[nc]

RewriteRule ^(.*)$ http://example.com/$1 [r=301,nc]

</ifModule>

9. Hangi Dili Kullandığınızı Saklamak

Dosyalarınızın uzantılarını değiştirip .htaccess dosyasına bir kural ekleyerek hangi dili kullandığınızı ziyaretçilerinizden saklayabilirsiniz. Aşağıdaki örnek sayesinde .133t uzantılı dosyalar PHP dosyaları gibi işlenecektir.


Kod:
# Make PHP code look like unknown types

AddType application/x-httpd-php .133t

10. Değişik İpuçları
.htaccess dosyasını olabildiğince küçük tutun. Çünkü her dosya isteğinde sunucu tarafından kontrol edilirler.
.htaccess dosyasını düzenli tutun. Kurallar arttıkça dosyayı anlaması zorlaşacaktır. # kullanarak her bölüme açıklama yazın.
URL’i yeniden tanımladığınız, bir önceki sayfaya yönlenen kurallarda (Nohotlink örneği gibi) [L] özelliğini ekleyin. Bu sunucuya, başka bir kuralı uygulamamasını belirtir.
.htaccess kurallarının alt klasörlerde de geçerli olduğunu, alt klasördeki .htaccess kuralının ise üzerindeki kuralları değiştirebileceğini düşünün.

11. .htpasswd ile Şifre Koruması

İstediğiniz dosya veya klasörlere şifre eklemek için şu adımları takip edin:
Şifrelemek istediğiniz klasörde .htpasswd dosyası oluşturun.
Dosya içeriği kullanıcıadı:şifre tarzındadır. Kullanıcı adı düz metindir. Şifrenin ise şifrelenmiş olması gerekir. Şifrenizi almak için şu adresi kullanabilirsiniz.
Dosyayı kendi bilgisayarınızda oluşturup sunucuya upload ettiyseniz ASCII mode kullandığınızdan emin olun.
Şimdi .htaccess dosyanızı düzenleyin. Kural, düzenlediğiniz dosyanın bulunduğu klasörde ve alt klasörlerinde geçerli olacaktır:


Kod:
AuthUserFile /home/pathto/.htpasswd

AuthType Basic

AuthName “My Secret Folder”
<LIMIT GET POST>

require valid-user

</LIMIT>

Kuralı tek dosya için oluşturmak istiyorsanız kodu direktifi içinde kullanmalısınız.
.htaccess dosyanızın erişilebilir olmadığına emin olun. (bkz. 1. başlık)

12. Öntanımlı Sayfayı Değiştirmek

Öntanımlı sayfa bilgisini aşağıdaki şekilde, sıraya dikkat ederek değiştirebilirsiniz:


Kod:
DirectoryIndex home.html index.htm index.html index.php

English
1) Folders Access Control

You may want to totally disable access in one folder (for example, you have a directory with programming libraries that are included in your main files: in this case only the main files will access these trought the filesystem, but no one from the web should be able to open it). Well, just create an .htaccess file in that folder and put this in it

#deny all access
deny from all

If you’d like to allow access from one specific IP

#deny all access
deny from all
allow from 10.0.0.1

or from a specific IP range (which you enforce with a bit mask)

allow from 192.168.0.0/24

you can also block a specific file from access

<Files private.html>
Order allow,deny
Deny from all
</Files>

./ Back to Index
2) Folder Listing

If you want to make your folders browsable, then you should add this line in .htaccess file

Options +Indexes +MultiViews +FollowSymlinks

And this one if you have the appropriate module installed on your webserver

<ifmodule mod_autoindex.c>
IndexOptions FancyIndexing
</ifmodule>

You may want to prevent folder listing

IndexIgnore *

./ Back to Index
3) Enable Compression

You can enable PHP’s built in data compression to save bandwidth

<ifModule mod_php4.c>
php_value zlib.output_compression 16386
</ifModule>

./ Back to Index
4) Hide your files

To disable access to a particular file you can use a regular expression and the Files directive to deny access to any file beginning with .ht
You can modify it to deny a specific file (like configuration files, robots.txt, log files and whatever you want)

<Files ~ “^\.ht”>
Order allow,deny
Deny from all
Satisfy All
</Files>

./ Back to Index
5) Customized HTTP 404 error page

If you’d like to redirect your visitors every time they catch into an HTTP 404 error, use this code:

ErrorDocument 404 /errors/notfound.html

This redirects the user to /errors/notfound.html whenever a 404 error happen. You can of course redefine also other http errors codes (403, 500… and so on). Read below what I’ve found here!

Tip: Internet Explorer has a lightly-documented “feature” that stops it from serving any custom 404 error page that is less than 512 bytes long. Your visitors will instead be sent to IE’s own 404 page (screenshot), which is generic and suggests they use an MSN search to “look for information on the Internet.” That’s one way to lose visitors! Make sure your custom 404 error page is over this limit — about 10 full lines of text and HTML should be enough.

./ Back to Index
6) Blocking bad referers – No hotlinking

If you want to block some parts of your site from any bad referer:

<IfModule mod_rewrite.c>
RewriteEngine on
RewriteCond %{HTTP_REFERER} example\.com [NC,OR]
RewriteCond %{HTTP_REFERER} otherexample\.com
RewriteRule .* – [F]
</ifModule>

Using rewrite engine, you will deny access to all your site from any visitor incoming from badguy.com or othernastywebsite.com
To prevent bandwidth stealing, you can also block access to particular files (images, zip, avi and so on)

<IfModule mod_rewrite.c>
RewriteEngine on
RewriteCond %{HTTP_REFERER} !^$
RewriteCond %{HTTP_REFERER} !^http://([-a-z0-9]+\.)?example\.com[NC]
RewriteRule .*\.(zip|mp3|avi|wmv|mpg|mpeg)$ http://www.example.com/images/nohotlink.gif [R,NC,L]
</ifModule>

This says: “If the visitor is not coming from mywebsite.net, then redirect all requests for (zip,mp3,avi,wmv,mpg,mpeg) files to a nice image that says “NO HOTLINKING HERE”. Got it? You can redirect to a page, or whatever you want, or you can modify the file extension list to include/exclude other files. CAUTION: when you decide to block image hotlinking, remember that you can potentially block ALL traffic outside your domain scope! For example, if you have a feedburner feed you have to modify the rule to let him get the images … or you feed will look quite nasty!
./ Back to Index
7) Blocking Bad Bots | Fetchers

In some cases you want to block some nasty spiders or site downloaders. Then we have to use mod_rewrite again. Usually bad bots ignore robots.txt directive so you may want to enforce them to a 403 error whenever they try to spider or fetch your website

<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} ^BlackWidow [OR]
RewriteCond %{HTTP_USER_AGENT} ^Bot\ mailto:craftbot@yahoo.com [OR]
RewriteCond %{HTTP_USER_AGENT} ^ChinaClaw [OR]
RewriteCond %{HTTP_USER_AGENT} ^Custo [OR]
RewriteCond %{HTTP_USER_AGENT} ^DISCo [OR]
RewriteCond %{HTTP_USER_AGENT} ^Download\ Demon [OR]
RewriteCond %{HTTP_USER_AGENT} ^eCatch [OR]
RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon [OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailWolf [OR]
RewriteCond %{HTTP_USER_AGENT} ^Express\ WebPictures [OR]
RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [OR]
RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE [OR]
RewriteCond %{HTTP_USER_AGENT} ^FlashGet [OR]
RewriteCond %{HTTP_USER_AGENT} ^GetRight [OR]
RewriteCond %{HTTP_USER_AGENT} ^GetWeb! [OR]
RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla [OR]
RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It [OR]
RewriteCond %{HTTP_USER_AGENT} ^GrabNet [OR]
RewriteCond %{HTTP_USER_AGENT} ^Grafula [OR]
RewriteCond %{HTTP_USER_AGENT} ^HMView [OR]
RewriteCond %{HTTP_USER_AGENT} HTTrack [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Image\ Stripper [OR]
RewriteCond %{HTTP_USER_AGENT} ^Image\ Sucker [OR]
RewriteCond %{HTTP_USER_AGENT} Indy\ Library [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^InterGET [OR]
RewriteCond %{HTTP_USER_AGENT} ^Internet\ Ninja [OR]
RewriteCond %{HTTP_USER_AGENT} ^JetCar [OR]
RewriteCond %{HTTP_USER_AGENT} ^JOC\ Web\ Spider [OR]
RewriteCond %{HTTP_USER_AGENT} ^larbin [OR]
RewriteCond %{HTTP_USER_AGENT} ^LeechFTP [OR]
RewriteCond %{HTTP_USER_AGENT} ^Mass\ Downloader [OR]
RewriteCond %{HTTP_USER_AGENT} ^MIDown\ tool [OR]
RewriteCond %{HTTP_USER_AGENT} ^Mister\ PiX [OR]
RewriteCond %{HTTP_USER_AGENT} ^Navroad [OR]
RewriteCond %{HTTP_USER_AGENT} ^NearSite [OR]
RewriteCond %{HTTP_USER_AGENT} ^NetAnts [OR]
RewriteCond %{HTTP_USER_AGENT} ^NetSpider [OR]
RewriteCond %{HTTP_USER_AGENT} ^Net\ Vampire [OR]
RewriteCond %{HTTP_USER_AGENT} ^NetZIP [OR]
RewriteCond %{HTTP_USER_AGENT} ^Octopus [OR]
RewriteCond %{HTTP_USER_AGENT} ^Offline\ Explorer [OR]
RewriteCond %{HTTP_USER_AGENT} ^Offline\ Navigator [OR]
RewriteCond %{HTTP_USER_AGENT} ^PageGrabber [OR]
RewriteCond %{HTTP_USER_AGENT} ^Papa\ Foto [OR]
RewriteCond %{HTTP_USER_AGENT} ^pavuk [OR]
RewriteCond %{HTTP_USER_AGENT} ^pcBrowser [OR]
RewriteCond %{HTTP_USER_AGENT} ^RealDownload [OR]
RewriteCond %{HTTP_USER_AGENT} ^ReGet [OR]
RewriteCond %{HTTP_USER_AGENT} ^SiteSnagger [OR]
RewriteCond %{HTTP_USER_AGENT} ^SmartDownload [OR]
RewriteCond %{HTTP_USER_AGENT} ^SuperBot [OR]
RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP [OR]
RewriteCond %{HTTP_USER_AGENT} ^Surfbot [OR]
RewriteCond %{HTTP_USER_AGENT} ^tAkeOut [OR]
RewriteCond %{HTTP_USER_AGENT} ^Teleport\ Pro [OR]
RewriteCond %{HTTP_USER_AGENT} ^VoidEYE [OR]
RewriteCond %{HTTP_USER_AGENT} ^Web\ Image\ Collector [OR]
RewriteCond %{HTTP_USER_AGENT} ^Web\ Sucker [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebAuto [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebCopier [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebFetch [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebGo\ IS [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebLeacher [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebReaper [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebSauger [OR]
RewriteCond %{HTTP_USER_AGENT} ^Website\ eXtractor [OR]
RewriteCond %{HTTP_USER_AGENT} ^Website\ Quester [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebStripper [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebWhacker [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebZIP [OR]
RewriteCond %{HTTP_USER_AGENT} ^Wget [OR]
RewriteCond %{HTTP_USER_AGENT} ^Widow [OR]
RewriteCond %{HTTP_USER_AGENT} ^WWWOFFLE [OR]
RewriteCond %{HTTP_USER_AGENT} ^Xaldon\ WebSpider [OR]
RewriteCond %{HTTP_USER_AGENT} ^Zeus
RewriteRule .* – [F]
</ifModule>

(List taken from here)
./ Back to Index
Do not show ‘www’

To do this, you can usea simple rewrite rule

<IfModule mod_rewrite.c>
Options +FollowSymlinks
RewriteEngine on
RewriteCond %{http_host} ^www\.example\.com[nc]
RewriteRule ^(.*)$ http://example.com/$1 [r=301,nc]
</IfModule>

Why removing www? You can read it here.

./ Back to Index
9) Hide scripting language extension

You can improve your security by changing script extensions so your visitors don’t know what scripting language you are using:

# Make PHP code look like unknown types
AddType application/x-httpd-php .133t

This way the .133t files will be parsed as PHP files. You must rename your files with the new extension.
./ Back to Index
10) Various Tips & Tricks
Keep .htaccess small: the file is processed by the webserver at EACH request (performance issues)
Keep your .htaccess organized. Use comments (# lines) and keep it logically consistent. Is very difficult to understand a untidy .htaccess file once it grows in size
When using URL rewriting rules, add the flag [L] to the rules that redirects the users to a last page (like no hotlinking rules and so on). You will tell the server to not process any more the rules (performance issues)
Beware of inheritance: root level .htaccess files are applied also in folders, and any htaccess rule in the folder can override the root rules

./ Back to Index
11) Password Protection with htpasswd

This is useful if you want to add password protection to some pages/folders
Create a .htpasswd file in the folder you want to protect
The file will contain login data in the form username:password. Username is plain text. Password should be encrypted or it won’t work! Use this tool to get your string to add
If you create the file on your local pc, be sure to upload it on the webserver in ASCII mode
Now you can modify your .htaccess file. The authentication will apply to the folder where you place it and its subfolders:

AuthUserFile /home/pathto/.htpasswd
AuthType Basic
AuthName “My Secret Folder”

<LIMIT GET POST>
require valid-user
</LIMIT>

You can protect a single file by placing this into a <Files> directive.
Be sure to protect your .htaccess file from viewing using the 1) tip

./ Back to Index
12) Enabling SSI

Use this instructions to enable SSI parsing

AddType text/html .html
AddType text/html .shtml
AddHandler server-parsed .html
AddHandler server-parsed .shtml

./ Back to Index
13) Changing default page

You can use these instructions to change default page (order is important!)

DirectoryIndex home.html index.htm index.html index.php

./ Back to Index
14) Avoid 500 Error

By passing the charset you avoid the 500 error display

AddDefaultCharset utf-8

./ Back to Index
15) CheckSpelling directive

This directive can be useful to auto-correct simple spelling errors in the URL

<IfModule mod_speling.c>
CheckSpelling On
</IfModule>

./ Back to Index
16) Add MD5 Digest

If you aren’t worried about performance issues, you can add a MD5 hash calculation to attach a MIC (Message Integrity Check) on each request. This is useful to check the integrity of the message.

ContentDigest On

What are the best ways to boost your position in search engines? What keywords should you use on your web-pages? And which tools should you use to improve the quality of backlinks, link popularity and Google Pagerank? We deliver answers. Here is the list of the most useful SEO-tools you might be willing to use, developing and optimizing your next web-site. Our personal choice: 

Alexa

• Alexa-Ranking
  Alexa page-rank-and-rating-results
  

Backlink

• Anchor Text Backlink Checker
  This tool is to check your backlinks and the anchor text used in those backlinks.
• Backlink Analyzer
  Research and analyze websites for link quality. Checks for Indexed Pages, Links to Website, EDU & .GOV Links, Domain Age & Expiration, Google PageRank, Alexa Traffic Rank, DMOZ Listing
• Backlink Anchor Text Analyzer
  This tools help you determine the backlinks of your website and link text used by your backlinks to Link to your website
• Backlink Builder
  Building Quality backlinks is one of the most important factors in Search Engine Optimization…

Domain Popularity, Domain Stats Tools…

• Domain Age Tool
  This tools displays the approximate age of a website on the Internet and allows you to view how the website looked when it first started
• Domain Dossier
  Investigate domains and IP addresses
• Domain Popularity
  This tool shows you all backlinks for the given domain, including up to 10 subpages per backlinking domain, host IP and Google PageRank
• Domain Stats Tool
  This tool helps you get all kind of statistics of your competitor’s domains. The statistics include Alexa Taffic Rank, Age of the domains, Yahoo WebRank, Dmoz listings, count of backlinks and number of pages indexed in Search Engines like Google, Yahoo, Msn etc.
• HTTP / HTTPS Header Check
  This tools allow you to inspect the HTTP headers that the web server returns when requesting a URL. Works with HTTP and HTTPS URLs
• View HTTP Headers
  This little tool lets you view the HTTP headers for a HTTP request
• View HTTP Path
  This little tool lets you view the path/redirects a request takes to get fulfilled

Google Page Rank Checker, Adwords Keyword Tools,Google Banned Tools…

• Advanced Google searches
  Use this tool to search google in many special ways. A useful resource for search engine optimization (especially keyword research) among other things
• Check Google Pagerank
  Now you can check the Google PageRank of any web page without installing the Google toolbar
• Check PageRank by Google data center
  With this tool you can check the PageRank from different data centers
• Free Google Adsense Keywords & YPN Keywords Search Tool
  With the ability to search a growing database of tens of thousands of high-dollar Adsense keywords, Iotaweb allows publishers to find the keywords and key phrases that will allow them to focus their content to monetize their site most effectively.
• Google Adwords Keyword Tool
  Keyword tool from Google that provides Specific and Similar keywords.
• Google Banned Tool
  This tool uses two methods to check to see if a URL you enter is in the Google database. Its a great way to check to see if you have been banned by Google for various reasons….
• Google Keyword Ranking Tool
  Search with list of keywords from differnet Google search sites
• Google Page Rank Checker
  Instantly check the PageRank of any website or web page
• Google Page Rank Checker
  A simple tool that checks and your PageRank so you can display it on your website
• Google Sets
  Automatically create sets of items from a few examples.
• PageRank Authenticity Check
  This tool shows you the PageRank of a given domain. Also the PageRank will be checked of authenticity
• Page Rank Tool
  Our PageRank Tool will query and return the Google PageRank values for submitted URL from various Google datacenters…
• Visual PageRank
  The Visual PageRank – Tool shows all links and there corresponding PageRanks

Keyword Analysis Tool, Keyword Density, Keyword Suggestion Tools…

• McDar Keyword Analysis Tool
  Enter URL and keyword, it will display Pagerank and Back links pages for the Top 10 websites.
• Keyword Density
  This tool shows you how often appears which word in content of given domain
• Keyword Density
  The keyword density tool is useful for helping webmasters and SEOs achieve their optimum keyword density for a set of key terms.
• Keyword Density Checker
  Keyword Density is the percentage of occurrence of your keywords to the text in the rest of your webpage. This tool will crawl the specified URL, extract text as a search engine would, remove common stop words and Analyze the density of the keywords.
• Keyword Difficulty Tool
  The keyword difficulty tool is used to analyze the competitive landscape of a particular search term or phrase, this tool issues a percentage score and provides a detailed analysis of the top ranking sites at Google and Yahoo…
• KwMap.net
  A Keyword Map For the Whole Internet
• Keyword Suggestion Tool
  This keyword suggestion tool will help you with the choosing of the right keywords for your website. You can see which keyword combinations are more popular and also get ideas for more keyword combinations..
• Website Keyword Suggestions
  This tools tries to determine the theme of your website and provides keyword suggestions along with keyword traffic estimates.
• Ontology Finder
  Related Keywords Lookup Tool

Link Popularity Check, Site Link Analyzer, Link Value…

• Deep Link Ratio Tool
  This tool was created to analyze how the deep link ratio of a site affects its rank in search engines. We can use this tool to compare the DLRs for the best ranking sites for a search phrase.
• Link Popularity Check
  Link popularity check is one of the best ways to quantifiably and independently measure your website’s online awareness and overall visibility…
• Link Popularity Checker
  The Link Popularity Checker tells you how many websites are linking to yours…
• LINK VALIDATION SPIDER
  Free Online Broken Link Checker
• Link Price Calculator
  This tools will help you determine the approximate amount you should be paying (or charging) per month for a text link (ad) from each and every page of the specified website
• Link Value
  This tool calculates the link value per month of a given website.
• Reciprocal Link Check
  This tool helps you ensure that your link partners are linking back to your website. It also determines the anchor text used by your link partners to link to your website.
• Site Link Analyzer
  This tool will analyze a given web page and return a table of data containing columns of outbound links and their associated anchor text…
• The Link Reputation Measurement Tool
  Reveals backlinks pointing to your target url along with the following: Link Survey – Link Reputation Score – Text used in links pointing to you – Alexa traffic analysis for the site corresponding to each backlink
• Outbound Links
  This tool shows every outgoing link from the given domain. Separated in external and internal links

Meta Tag Generators

• Meta Tag Generator
  Our Meta Tag Generator will read the page you specify, remove common words from it, and pick the most used words on the page. It will then generate a Meta Keywords tag using the words it has found…
• Meta Tag Generator
  Use this tool to generate a search engine friendly Head Tag for your web site
• Title & Meta Tags Generator
  his code generator will build the title and meta tags for your site to help improve your website’s search engine ranking using our Meta Tag Generator

Miscellaneous Tools

• Directory Submission Manager
  Use this free tool to track your submissions to various web directories….
• Copyscape
  Search for copies of your page on the Web
• Site Analysis including Link Popularity
  This tool generates a complete site analysis e.g. amount of backlinks, indexed sites, Google PageRank and also if your domain is listed in DMOZ and Yahoo directory
• Sitemap Generator
  Create your Google Sitemap Online
• Similar Page Checker
  Search Engines are known to penalize websites that contain Duplicate / Similar content. Your content could be similar to other websites on the Internet, or pages from within your own website could be similar to each other. This tool allows you to determine the percentage of similarity between two pages
• Speedtester
  This tool shows the duration of a given website. This value can be used for showing how long a website take to load and if it is better to optimize the website or change a (slow) ISP.
• mod_rewrite RewriteRule Generator
  Our mod_rewrite RewriteRule generator will take a dynamic url given to it, and generate the correct syntax to place in a .htaccess file to allow the url to be rewritten in a spiderable format
• URL Rewrite (mod_rewrite)
  With this tool you can generate dynamic urls to search engine friendly urls..
• URL Rewriting Tool
  Create Search Engine Friendly URLs
• User Agent Cloaking Detector
  This tool simulates the Googlebot (based on User-Agent) to detect cloaked content
• What is Hosted on that IP
  This little tool lets you view the virtual hosts on a particular IP

Search Engine Position Checker, Spider Simulator, Ranking Report, SERP Tracker

• Google vs Yahoo Graph
  This tool looks at the results from Yahoo and Google, finds the similarities and then gives you a graphical display of what results are in both search engines
• Search Engine Position Checker
  The Search Engine Position Checker tool will automatically query the search engines you specify and check if your URL appears in the first 50 results for your chosen keywords….
• Search Engine Spider Simulator
  With this tool you see all informations a search engine spider receive from a website.
• Marketleap Search Engine Verification Tool
  Our verification tool checks to see if your site is in the top three pages of a search engine result for a specific keyword
• Number of pages indexed
  This tool will generate a report showing how many pages of your website has been indexed by the search engines so far. It supports all major search engines: Google, Yahoo, MSN, Alltheweb, Hotbot and AltaVista.
• Search Engine Ranking Report
  Input key phrase list get Google rankings
• Serps Position
  Use this tool to find out, on which position your domain is ranked for the given keyword and compare the first 100 results by Google, search.MSN and Yahoo.
• SERP Tracker
  The SERP Tracker reports on search engine results and charts performance over time

SEO Analyzer, Scanner

• Free SEO Tools
  SEOToolSet
• Cool SEO Tool!
  This internet marketing tool checks the top 10 sites that rank in Google. After that, it checks to see how those 10 sites rank in Yahoo and in MSN….
• SEO Analyzer
  The SEO Analyzer is a FREE tool that uses a sophisticated algorithm that detects how optimized your web design is for search engines
• SEO Scanner
  An all-in-one advanced SEO analysis, tracking, and reporting tool

Robots.txt Tools

• Robots Txt Generator
  Use this tool to generate a simple robots file for your website…
• Robots.txt syntax checker
  This robots.txt syntax checker checks the contents of a site’s robots.txt…