While Google won't crawl or index the content of pages blocked by robots.txt, we may still index the URLs if we find them on other pages on the web. As a result, the URL of the page and, potentially, other publicly available information such as anchor text in links to the site, or the title from the Open Directory Project (www.dmoz.org), can appear in Google search results.
In order to use a robots.txt file, you'll need to have access to the root of your domain (if you're not sure, check with your web hoster). If you don't have access to the root of a domain, you can restrict access using the robots meta tag.
Robots Meta Tag
To entirely prevent a page's contents from being listed in the Google web index even if other sites link to it, use a noindex meta tag. As long as Googlebot fetches the page, it will see the noindex meta tag and prevent that page from showing up in the web index.
When we see the noindex meta tag on a page, Google will completely drop the page from our search results, even if other pages link to it. Other search engines, however, may interpret this directive differently. As a result, a link to the page can still appear in their search results.
Note that because we have to crawl your page in order to see the noindex meta tag, there's a small chance that Googlebot won't see and respect the noindex meta tag. If your page is still appearing in results, it's probably because we haven't crawled your site since you added the tag. (Also, if you've used your robots.txt file to block this page, we won't be able to see the tag either.)
If the content is currently in our index, we will remove it after the next time we crawl it. To expedite removal, use the URL removal request tool in Google Webmaster Tools.
An effective way of advertising or producing brand exposure through social networks. This technique spreads promotional message throughout the network rapidly by "word of mouth" or by Internet resources like e-mail, blogs or other services.
URL rewriting can be one of the best and quickest ways to improve the usability and search friendliness of your site. It can also be the source of near-unending misery and suffering. Definitely worth playing carefully with it - lots of testing is recommended. With great power comes great responsibility, and all that. There are several other guides on the web already, that may suit your needs better than this one.
Apache URL Rewriting Guide - The best guide around
Before reading on, you may find it helpful to have the mod_rewrite cheat sheet and/or the regular expressions cheat sheet handy. A basic grasp of the concept of regular expressions would also be very helpful.
What is "URL Rewriting"?
Most dynamic sites include variables in their URLs that tell the site what information to show the user. Typically, this gives URLs like the following, telling the relevant script on a site to load product number 7.
The problems with this kind of URL structure are that the URL is not at all memorable. It's difficult to read out over the phone (you'd be surprised how many people pass URLs this way). Search engines and users alike get no useful information about the content of a page from that URL. You can't tell from that URL that that page allows you to buy a Norwegian Blue Parrot (lovely plumage). It's a fairly standard URL - the sort you'd get by default from most CMSes. Compare that to this URL:
http://www.pets.com/products/7/
Clearly a much cleaner and shorter URL. It's much easier to remember, and vastly easier to read out. That said, it doesn't exactly tell anyone what it refers to. But we can do more:
http://www.pets.com/parrots/norwegian-blue/
Now we're getting somewhere. You can tell from the URL, even when it's taken out of context, what you're likely to find on that page. Search engines can split that URL into words (hyphens in URLs are treated as spaces by search engines, whereas underscores are not), and they can use that information to better determine the content of the page. It's an easy URL to remember and to pass to another person.
Unfortunately, the last URL cannot be easily understood by a server without some work on our part. When a request is made for that URL, the server needs to work out how to process that URL so that it knows what to send back to the user. URL rewriting is the technique used to "translate" a URL like the last one into something the server can understand.
Platforms and Tools
Depending on the software your server is running, you may already have access to URL rewriting modules. If not, most hosts will enable or install the relevant modules for you if you ask them very nicely.
Apache is the easiest system to get URL rewriting running on. It usually comes with its own built-in URL rewriting module, mod_rewrite, enabled, and working with mod_rewrite is as simple as uploading correctly formatted and named text files.
IIS, Microsoft's server software, doesn't include URL rewriting capability as standard, but there are add-ons out there that can provide this functionality. ISAPI_Rewrite is the one I recommend working with, as I've so far found it to be the closest to mod_rewrite's functionality. Instructions for installing and configuring ISAPI_Rewrite can be found at the end of this article.
The code that follows is based on URL rewriting using mod_rewrite.
Basic URL Rewriting
To begin with, let's consider a simple example. We have a website, and we have a single PHP script that serves a single page. Its URL is:
http://www.pets.com/pet_care_info_07_07_2008.php
We want to clean up the URL, and our ideal URL would be:
http://www.pets.com/pet-care/
In order for this to work, we need to tell the server to internally redirect all requests for the URL "pet-care" to "pet_care_info_07_07_2008.php". We want this to happen internally, because we don't want the URL in the browser's address bar to change.
To accomplish this, we need to first create a text document called ".htaccess" to contain our rules. It must be named exactly that (not ".htaccess.txt" or "rules.htaccess"). This would be placed in the root directory of the server (the same folder as "pet_care_info_07_07_2008.php" in our example). There may already be an .htaccess file there, in which case we should edit that rather than overwrite it.
The .htaccess file is a configuration file for the server. If there are errors in the file, the server will display an error message (usually with an error code of "500"). If you are transferring the file to the server using FTP, you must make sure it is transferred using the ASCII mode, rather than BINARY. We use this file to perform 2 simple tasks in this instance - first, to tell Apache to turn on the rewrite engine, and second, to tell apache what rewriting rule we want it to use. We need to add the following to the file:
RewriteEngine On # Turn on the rewriting engine RewriteRule ^pet-care/?$ pet_care_info_01_02_2003.php [NC,L] # Handle requests for "pet-care"
A couple of quick items to note - everything following a hash symbol in an .htaccess file is ignored as a comment, and I'd recommend you use comments liberally; and the "RewriteEngine" line should only be used once per .htaccess file (please note that I've not included this line from here onwards in code example).
The "RewriteRule" line is where the magic happens. The line can be broken down into 5 parts:
RewriteRule - Tells Apache that this like refers to a single RewriteRule.
^/pet-care/?$ - The "pattern". The server will check the URL of every request to the site to see if this pattern matches. If it does, then Apache will swap the URL of the request for the "substitution" section that follows.
pet_care_info_01_02_2003.php - The "substitution". If the pattern above matches the request, Apache uses this URL instead of the requested URL.
[NC,L] - "Flags", that tell Apache how to apply the rule. In this case, we're using two flags. "NC", tells Apache that this rule should be case-insensitive, and "L" tells Apache not to process any more rules if this one is used.
# Handle requests for "pet-care" - Comment explaining what the rule does (optional but recommended)
The rule above is a simple method for rewriting a single URL, and is the basis for almost all URL rewriting rules.
The concept of the PPC model was given by Bill Gross the founder of Idealab and Goto.com in 1998. Now Goto.com (Overture) is part of yahoo!. Google started search engine advertising in December 1999. But PPC was only introduced in 2002; until then, advertisements were charged at cost-per-thousand impressions. Yahoo! advertisements have been PPC-based since their introduction in 1998.
What is PPC Model?
Pay per click (PPC), is an Internet advertising model used on websites, in which advertisers pay their host only when their ad is clicked. With search engines, advertisers typically bid on keyword phrases relevant to their target market. Content sites commonly charge a fixed price per click rather than use a bidding system.
Pay Per Click Account Setup
Steps for creating and maintaining a pay per click account is mentioned below:
@Business Analysis
*Challenges
*Goals
@Keyword Research
*Selection
*Biding
@Adwritng
*Head Line
*Body Copy
*Call to Action
@Landing Pages
*Content
*Call to Action
@Launch
@Monitor
*Ad Position
*CTR
*CPC
*Conversions
What is CPA?
Cost Per Action or CPA (sometimes known as Pay Per Action or PPA) is an online advertising pricing model, where the advertiser pays for each specified action (a purchase, a form submission, Lead, Sales, Sign up etc.) linked to the advertisement.
Fraud Clicks
Google started CPA to protect their Ad-word customer from fraud clicks on Ads. Ad-word Conversion Tracking option is available in Ad-word account to track the conversion by applying Code on a Confirmation page (Thank you Page).
The search engine results can be quite different because of the different search algorithms each one uses. It’s important to know what these differences are so you can incorporate them into your optimization strategies.
Here are three important differences between Google and Yahoo’s search engine algorithms:
Age of Domain
Domain Age Google places a much higher emphasis on the age of a domain than Yahoo does. Yahoo does favor older sites as well, but the impact is far less pronounced than Google.
This is why optimizing for multiple search engines is so important. Google should be looked at as a long-term strategy. If your website is relatively new, you will find it is easier to rank higher on Yahoo. To get around Google Sandbox Effect, you can purchase a well aged domain to place your website on, or get a link from an existing one.
Link Quality
Link Quality ImpactGoogle’s algorithm for determining the quality and reputation of web links is far more advanced and accurate than Yahoo’s. Yahoo simply does not place as much effort in screening the quality of links, and as a result suffers from far more spam in the results than Google.
When optimizing for Google, you must understand that the number and quality of incoming links is a huge factor in determining your ranking success. With Yahoo, you can get away with worse quality links, however I don’t recommend this as it would impact your Google rankings.
Meta Tags
Meta TagsYahoo places much more emphasis on the content of meta tags such as meta descriptions and keywords than Google. Above all else the description should be optimized for a reader, not a search engine. Clearly describe the content of your meta tags without keyword stuffing or sounding spammy and you will find much better conversions and click-throughs to your site.
1) Syndicating Articles that Link to Your Sitemap 2) Translating Your Website Into Other Languages 3) ROR Site Map 4) Best Keywords Phrases (that convert) 5) GoogSpy 6) Internal Links Within Content 7) Using Your Log Files for SEO
All Suggested tips will increase your business online.
Google is the dominant player in the search market, with a 65 percent market share in June, according to comScore. Yahoo was second with 19.6 percent, while Microsoft was third with 8.4 percent.
On Wednesday (29, July 2009) Microsoft and Yahoo announced a 10-year search deal to take over Google. This deal will allow Microsoft to access Yahoo's search technology and in return Yahoo will receives a 88% of the search-generated ad revenues from its own sites for the first 5 years of the 10-year deal.
According to search deal Yahoo will use The Bing (New Search Engine by Microsoft) for Search related Services to grab the internet marketing and Yahoo will handle advertise sales by using Microsoft Technology.
Robot.txt is a file that gives instructions to all search engine spiders to index or follow certain page or pages of a website. This file is normally use to disallow the spiders of a search engines from indexing unfinished page of a website during it's development phase. Many webmasters also use this file to avoid spamming. The creation and uses of Robot.txt file are listed below:
Robot.txt Creation:
To all robots out
User-agent: *
Disallow: /
To prevent pages from all crawlers
User-agent: *
Disallow: /page name/
To prevent pages from specific crawler
User-agent: GoogleBot
Disallow: /page name/
To prevent images from specific crawler
User-agent: Googlebot-Image
Disallow: /
To allows all robots
User-agent: *
Disallow:
Finally, some crawlers now support an additional field called "Allow:", most notably, Google.
To disallow all crawlers from your site EXCEPT Google:
User-agent: *
Disallow: /
User-agent: Googlebot
Allow: /
"robots" meta tag
If you want a page indexed but do not want any of the links on the page to be followed, you can use the following instead: < meta name="robots" content="index,nofollow"/>
If you don't want a page indexed but want all links on the page to be followed, you can use the following instead: < meta name="robots" content="noindex,follow"/>
If you want a page indexed and all the links on the page to be followed, you can use the following instead: < meta name="robots" content="index,follow"/>
If you don't want a page indexed and followed, you can use the following instead: < meta name="robots" content="noindex,nofollow"/>
Invite robots to follow all pages < meta name="robots" content="all"/>
Stop robots to follow all pages < meta name="robots" content="none"/>
Dynamic web page physically doesn't exist on server as a static HTML page. Dynamic pages are generated when an user triggers an action through that particular page (generated on the fly). Search Engines aren't good at reading dynamic URL because Search engine usually considers dynamic website as group of never ending links. Now a days many webmasters are suggesting various type of solution for the same. But some important tips are listed below:
@ Create an HTML site map with all text links of your website. @ Try to get deep inbound links from relevant sites to yours. @ Convert your dynamic web pages into static web pages with the help of URL re-writing softwares. @ Just create a static web page linking to all your dynamic web pages and optimized it for search engines.
Social media optimization (SMO) is a set of methods for generating publicity through social media, online communities and community websites. Methods of SMO include adding RSS feeds, adding a "Digg This" button, blogging and incorporating third party community functionalities like Flickr photo slides and galleries or YouTube videos. Social media optimization is a form of search engine marketing.
Look, I don't really think that the mySpaces and Facebooks of the world are that important for the typical small business as they stand today. There may be very practical business reasons for some to actually use these and other, what are called social networks, for business gain, but most people that have jumped on the social network bandwagon have found themselves left with a "is this all there is" kind of feeling.
To those, I say this, the value of the current public social networks for business folks is not what you can get out of them for gain today, but what you can learn by using them for practical gain tomorrow. That's why SpacebookedIn makes sense for you now.
The Facebooks of the world are busy teaching millions and millions of business folks how social networks work, how social networking works, how shared applications can be viral and ever-present. The real payoff in my opinion is that the wave to come after the Facebook bubble bursts is the "personalized business network." Once everyone of your customers and prospects knows how to use what are easily replicatable social networking tools, like building profiles, sharing video and connecting based on mutual interests, your job of building your own social business network around your own very specific community of niche will get a whole lot easier.
Web site optimization is the process of designing your web pages to rank high in the Search Engines. If you really want to boostup your business then optimization of your website is a must.
Meta tags are rarely used by search engines but title tag is the most important tag on our site. So try to put your all target keywords in title tags. Some time anchor tags are also beneficial for ranking purpose.
Quality contents/back links will definetly boost your ranking.But natural links are the best solution for good SERPs. Isn't it?
Link Bait means to create something that naturally attract backlinks for your web page by getting people to talk about it, discussing it on forums, blogging about it, posting it on various social networking sites and linking to it from their sites. Few tips are listed below:
*Write an interesting article
*Test something new that has not been done before
*Be the first to write the latest news in your niche
*Make an interesting picture
*Make a tool that others can put on their sites but that links to you
Nowadays google is giving more importance to the one way natural links. Google also appreciate unique contents. So, we have to follow some ways of natural back links for good SERPs in google.
Most SEOs would agree that Flash is not really SEO friendly (yet). This is because all the content (text) is inside the flash movie and the spiders can't read it or at least usually chooses not to index that content. Supposedly SEs can index some content embedded in Flash but I have not seen any sites banking on this theory successfully.
This script allows for a div section named "flashcontent". Anything placed inside this div will not be shown to the user but your Flash movie will show up as usual. The idea is to place plain text content and/or links inside this div as spider food. An added bonus of using this script is it gets rid of the "white lines" shown around a Flash movie before the "control" is activated in IE by clicking on the Flash object.
In other SEO friendly Flash related news, another designer emailed me a link to fCMSPro which claims to be an SEO friendly Flash based content management system(CMS). I took a look at their product and while it has made some advances in terms of more SEO friendly flash, it also has some serious drawbacks (IMHO).
If you frequent different SEO forums you may have received mixed signals on things like Flash or JavaScript. You may be wondering if it’s safe to use these and if so, what the impact will be. In this article, I attempt to address your concerns over JavaScript.
A brief history of JavaScript
In 1995 Netscape developers realized they needed an easy way to make Java applets more accessible to non-Java programmers and web designers. While it was plagued with problems and errors that were unable to be diagnosed in the early days, the popularity of this simplistic scripting language has hung on and has gotten more popular over time.
Because of its cross-browser compatibility, in that most modern browsers now support JavaScript, and the relative ease of use and implementation, JavaScript has become popular among designers looking for a more dynamic edge for their websites.
So, is JavaScript bad?
In an nutshell, no. If it is used properly, and some basic rules are followed then JavaScript is acceptable.
The biggest flaw with many sites which use JavaScript is that the developer embeds navigation inside of JavaScript menus which render the links invisible to search engine crawlers and therefore the crawler won’t follow those links.
But if you remove the navigation from the JavaScript it then becomes a very powerful scripting tool to help you achieve various effects that HTML can not.
A Google Sitemap is a very simple XML document that lists all the pages in your website, but the Google Sitemaps program is actually much more important than that. In fact, the Sitemaps program provides a little peek inside Google's mind - and it can tell you a lot about what Google thinks of your website!
Why Should You Use Google Sitemaps?...
Until Google Sitemaps was released in the summer of 2005, optimizing a site for Google was a guessing game at best. A website's page might be deleted from the index, and the Webmaster had no idea why. Alternatively, a site's content could be scanned, but because of the peculiarities of the algorithm, the only pages that would rank well might be the "About Us" page, or the company's press releases.
As webmasters we were at the whim of Googlebot, the seemingly arbitrary algorithmic kingmaker that could make or break a website overnight through shifts in search engine positioning. There was no way to communicate with Google about a website - either to understand what was wrong with it, or to tell Google when something had been updated.
That all changed about a year ago when Google released Sitemaps, but the program really became useful in February of 2006 when Google updated it with a couple new tools.
So, what exactly is the Google Sitemaps program, and how can you use it to improve the position of your website? Well, there are essentially two reasons to use Google Sitemaps:
1. Sitemaps provide you with a way to tell Google valuable information about your website.
2. You can use Sitemaps to learn what Google thinks about your website.
What You Can Tell Google About Your Site
Believe it or not, Google is concerned about making sure webmasters have a way of communicating information that is important about their sites. Although Googlebot does a pretty decent job of finding and cataloging web pages, it has very little ability to rate the relative importance of one page versus another. After all, many important pages on the Internet are not properly "optimized", and many of the people who couldn't care less about spending their time on linking campaigns create some of the best content.
Therefore, Google gives you the ability to tell them on a scale of 0.0 to 1.0 how important a given page is relative to all the others. Using this system, you might tell Google that your home page is a 1.0, each of your product sections is a 0.8, and each of your individual product pages is a 0.5. Pages like your company's address and contact information might only rate a 0.2.
You can also tell Google how often your pages are updated and the date that each page was last modified. For example your home page might be updated every day, while a particular product page might only be updated on an annual basis.
What Google Can Tell You About Your Site
Having the ability to tell Google all this information is important, but you don't even need to create a sitemap file in order to enjoy some of the perks of having a Google Sitemaps account.
That's because even without a Sitemap file, you can still learn about any errors that Googlebot has found on your website. As you probably know, your site doesn't have to be "broken" for a robot to have trouble crawling it's pages. Google Sitemaps will tell you about pages it was unable to crawl and links it was unable to follow. Therefore, you can see where these problems are and fix them before your pages get deleted from the index.
Many webmasters spend a lot of time optimizing their home page only. They do this by optimizing onpage factors like H1 tags, title, keyword density, alt tags, etc, and offpage factors like the number and quality of inward links from other sites. That's fine and is something you should definitely do, but you should also take some time to optimize all of your inner web pages as well.
This is because if you can get a good pagerank for all of your inner pages, as well as your home page, it increases the chances of these pages being ranked highly in the search engines for their chosen keywords, and increases the number of visitors you could get.
So how do you achieve this? Well firstly I recommend that all of your main web pages are just one click away from your home page. You should have a well-structured navigation menu on your home page. Each link within the menu should be an anchor text link containing your main keyword(s). For example, let's say you had an inner page about hair loss. Now you may have done keyword research and found the term "hair loss" to be too competitive, so let's say you have decided to optimize your web page for the less competitive term "male hair loss". In this example, your link from the navigation menu should be "male hair loss" rather than "hair loss".
You can dramatically enhance this interlinking structure and boost the pagerank of your inner web pages further by including this navigation menu on all of your inner web pages. This means that all of your main inner web pages are always just one click away and will dramatically boost the number of inward links that each page has. This can be very powerful because with higher pagerank and more links comes higher search engine rankings, but surprisingly is something that many so-called SEO experts fail to recognise.
Another way of achieving this effect if you do not want to include a navigation menu on every page is by including a link tree on every one of your inner pages. These are those links that you often find at the bottom of pages, and are again a very good way of interlinking your web pages. As before, be sure to include your main keyword(s) within each link.
I personally include a left-hand navigation menu on all of my websites, as well as a link tree at the bottom of each web page. This ensures not only that each page of each site has the maximum number of internal inward links, which boosts my pagerank and search engine rankings, but also ensures that the visitors to the site are always just one click away from each main page of the site. This is important if they enter at one of your inner pages, because often they will then want to navigate to the home page.
To conclude, to rank highly in the search engines, you should focus on on-page optimization, and more so off-page optimization. Just as every inward link to your site from another website acts as a vote for your site, and boosts your pagerank and search engine rankings, a link from another page within your site also acts as a vote and will also have a positive effect on your ranking. A good interlinking structure within your site will ensure that every page is fully optimized and has the optimum number of links from your other pages allowing you to rank higher for all of your inner pages as well as your home page.
