Crawling doesn’t Work in Sharepoint

Problem:
Error 1
http://openifs.com
Access is denied. Check that the Default Content Access Account has access to this content, or add a crawl rule to crawl this content. (The item was deleted because it was either not found or the crawler was denied access to it.)

Error 2
sps3://openifs.com
An unrecognized HTTP status was received. Check that the address can be accessed using Internet Explorer.

Reason:
Common reason is that the existing site does not have an extended web application (sharing the same content as the parent web application) on a different zone with NTLM/Windows Integrated authentication.
The search crawler accesses to site content with NTLM account. It will get an Access Denied error when accessing to the form-authentication site.

Therefore, it will need a new web application with the same site content as the form-auth site and with the NTLM authentication enabled. And this can be achieved by using the feature “Extend an existing web application”.

Solution:
(Extend the web application)

Go to Central Administration > Application Management page
Click Create or Extend web application and select Extend an existing web application
Make sure if the web application field shows the one you have set up the form authentication. If not, click on the drop down menu and select the web application in a popup dialog, e.g. SharePoint - 80
Either choose to use the randomly-generated port or assign a port. (The extended web application will be located at this port and share the same content as the original web application)
Select NTLM
Select No for Allow Anonymous option
Choose a zone (e.g. custom)
Click OK
After the web app is extended, the page will be redirected to the central administration page.
To test the site, please access to the extended web application and log on to the site with your search crawl account.


Grant Permission
Please make sure if the search crawl account has access to the new web application. If not, please follow these steps to grant permission
Go to Central Administration > Application Management page
Click on Policy for web application
Click on Add Users

Make sure if the web application field shows the one you have set up the form authentication.
Select the zone that you extended the web application (e.g. custom)
Click Next
Enter the crawl account username to Users field
Check Full Read for the permission
Click Finish To test the site, please access to the extended web application and log on to the site with your search crawl account.