Hide from search engine.

If you have questions about using mojoPortal, you can post them here.

You may want to first review our site administration documentation to see if your question is answered there.

This thread is closed to new posts. You must sign in to post in the forums.
9/14/2011 3:19:24 AM
Gravatar
Total Posts 10

Hide from search engine.

I'm thinking about to use Mojo portal as a company intranet site.

I need to hide the site from search engines is there a way to do that?

9/14/2011 6:41:28 AM
Gravatar
Total Posts 18439

Re: Hide from search engine.

an intranet is a private network so no search bots can crawl your site since they cannot access a private network..

If you make a public facing "intranet" on the public internet network they call that an extranet. Search bots can only crawl and index public facing pages so if you set all of the pages to require users to be in a role, ie uncheck the "All Users" role in View Permissions in page settings and check only a specific role that your users are members of or just check "Authenticated Users" then only authenticated users can access the page therefore no search bot can crawl it.

You can also tell search bots not to crawl using the robots.txt file in the root of the site but that doesn't really prevent them from crawling it, most respectable search bots will obey that but not all of them it is not really a security feature whereas protection by roles will prevent access.

Hope that helps,

Joe

9/14/2011 8:40:56 AM
Gravatar
Total Posts 10

Re: Hide from search engine.

Thanks Joe it did.yes

9/23/2011 2:13:22 PM
Gravatar
Total Posts 49
TRIAD/Next Level Interactive

Re: Hide from search engine.

Joe,

Is there a global setting that allows you to set view permissions for a whole site?

As opposed to checking this setting on every page?

Thanks,
John

9/23/2011 2:48:08 PM
Gravatar
Total Posts 55
mojoPortal Community Expert
Arvixe Web Hosting / mojoPortal Community Liaison Looking for quality mojoPortal hosting? Try Arvixe Check out the MojoPortal Blogs at Arvixe

Re: Hide from search engine.

Hi,

There is a 

<add key="DefaultPageRoles" value="All Users;"/>

in web.config if that's any use to you.

I'd assume it would help for any new pages you're adding but not existing ones?

Spike

9/24/2011 7:26:36 AM
Gravatar
Total Posts 18439

Re: Hide from search engine.

There is nothing to globally set permissions. I believe that web.config setting is used for the default roles of new root level pages (though you can set them as you like at page creation time, the defaults are just what is pre-selected). Then when new child pages are created the default roles for the child page are based on roles from the parent page unless you set them differently. Once a page is created and the roles are established they can only be changed from page settings of the specific page.

I do know that others have been able to batch update page roles from the database but that requires sql knowledge and an understanding of how the roles are stored on the pages as semi colon separated values.

Hope that helps,

Joe

9/24/2011 7:29:20 AM
Gravatar
Total Posts 18439

Re: Hide from search engine.

In follow up we do have an item in our project tracker to implement a way to push role changes from a parent page down through all child pages in order to make it easier to change roles on a lot of pages at once in a site hierarchy. Not sure how soon we will get to that one but we will get to it at some point.

Best,

Joe

9/24/2011 3:54:58 PM
Gravatar
Total Posts 55
mojoPortal Community Expert
Arvixe Web Hosting / mojoPortal Community Liaison Looking for quality mojoPortal hosting? Try Arvixe Check out the MojoPortal Blogs at Arvixe

Re: Hide from search engine.

I wasn't sure whether to mention a direct database update as it could be dangerous.

After backing up my database I did a quick test on a small demo site that appeared to work for me.

First I looked at the AuthorizedRoles field of dbo.mp_Pages to see what I needed to change from (I did this via WebMatrix, but could have used the 'Select top 1000 rows' option in MS SQL SMS)

I tried 2 ways, both using MS SQL Server Management Studio. The simplest was to open the database, right click on dbo.mp_Pages, select edit top 200 rows and then manually change the entries in field AuthorizedRoles. Its easy to slip in a typo but at least you're in control of the changes.

The second was to create the following SQL queries

SELECT *
FROM dbo.mp_Pages
WHERE AuthorizedRoles = 'All Users;'
GO

to check which rows would be affected from my chosen where statement and

SELECT *
FROM dbo.mp_Pages
WHERE AuthorizedRoles <> 'All Users;'

GO

to check rows that would not be affected, then

UPDATE dbo.mp_Pages
SET AuthorizedRoles = 'Authorized Users;'
WHERE AuthorizedRoles = 'All Users;'
GO

to make the changes

My demo site is very small so may not be very representative.

I couldn't say definitively that there would be no side-effects from manipulating the database in this way, or that this is a good way to go, just that it appeared to work for me. And I'd definitely take a backup first - its a potentially dangerous thing to fiddle with the database.

Using the MojoPortal interface may be more long-winded, but its the safest of all options.

Spike

You must sign in to post in the forums. This thread is closed to new posts.