Database Size automatically getting increased

This forum is primarily for reporting issues about Web Accessibility such as difficulty using mojoPortal with a screen reader or other assistive technology.

Post any feedback here related to improving the accessibility or usability of mojoPortal. As stated in our Accessibility documentation, it is an important goal of the project that both the front-end customer experience and the back end administration and content publishing features be accessible to as many people as possible. Ideally, if you post about problems, we will also be glad to have suggestions on how the problems can be fixed but all constructive feedback on these issues is welcome.

This thread is closed to new posts. You must sign in to post in the forums.
10/5/2011 5:46:08 PM
Gravatar
Total Posts 58
"Digg-in yourself to achieve excellence!" Follow #GPsays

Database Size automatically getting increased

Hi Joe,

In one of the website that i have developed with the version 2.3.3.0 was excellent but, the site started facing these problems.

  1. Website's SQL Server 2008 R2 database started incresing in its size upto 10 times. Yes! That was a real shock to  me, where it was around 30MB when i deployed the website and found it to be 325MB after a month's time.
  2. The website started becoming slow, so i allowed the "KeepAlive URL" method and also allowed CSScaching on Server and Client. But still it takes a long time to load than any other websites that have huge data on it.
  3. Since my Webhosting provider(Shared) whom i used it to host a year ago exactly by Nov 2010. He alloted a max of 200MB of database space. but now its keep on increasing and since im busy with other stuffs i dont know where to start, to reduce the DB's size. My Hosting provider for that Client says the Log file for the database is getting increased and it may be due to the new members to the website. But I found there was no new signups, as this is a business website and not a Member specific.

    Is this a bug or am i doing something wrong Joe, Kindly help me. Also everyday like a "Cup of Coffee" tastes better, I keep tasting mojoPortal's versions and building websites or at sometimes if i dont get any client, i simply keep adding new skins that i develop to help me for other projects. I should wholeheartedly thank a ton with a sincere grattitude to you Joe Audette for building this wonderful product that i ever LOVE <3.

Kindly lemme know whether i should upgrade the portal's version or do some tweaks to it. Also I would like to share my website's URL's that i can showcase on mojoPortal's site's list, where you publish. Plz. lemme know about this too. Thank You.

--
Regards
Guruprasad Balaji

10/5/2011 6:31:40 PM
Gravatar
Total Posts 18439

Re: Database Size automatically getting increased

Hi,

That is a strange symptom. I certainly have not heard of it before and have never experienced it in any of my sites

The only ideas I have are:

  1. databases don't automagically recover free space if a table gets lots of data and then later the data is deleted it does not automatically free up the space. You can do some googeling on this to learn more, there are some ways to manually recover the free space in some cases.
  2. given the above, the only tables which I can think of for features included in mojoPortal that might grow and grow under some circumstances would be mp_IndexingQueue and mp_TaskQueue which could get populated with data and then somehow if the task to process and remove those rows doesn't happen it could just build up lots of rows. Maybe also if you are using WebStore the mp_PayPalLog and mp_GoogleCheckoutLog could potentially grow more than expected.
  3. If you have other custom features that create a lot of data, or other apps creating data in the same database
  4. If you have my product In Site Analytics Pro installed and configured to capture data, it is a great deal of data and would grow very quickly. This product can be configured to use a different database than mojoPortal because it does use so much space.
  5. I think you need to look into which tables are very large (lots of rows) and go from there

I would not use AppKeepAlive unless the slowness is caused by lack of traffic, otherwise it doesn't help anything, it just keeps your site from falling asleep, if your site gets continous traffic it is not asleep.

Hope that helps,

Joe

10/5/2011 7:32:48 PM
Gravatar
Total Posts 58
"Digg-in yourself to achieve excellence!" Follow #GPsays

Re: Database Size automatically getting increased

That was a great answer Joe,

Thanks a ton for the great info that i can use it hereon. :-)

I found it to be on most of the mp_{tablename} and not on the custom tables that i'd created. and now how do i delete or optimize to make it small once again? That's now becoming a weird one for me as i dont know how to do that and currently to manage my client's website, i've hired a VPS for database hosting alone from one of my friend handle this strange database growth. If i can rework on the tables, is there any C# script or any DB Tools that i can make use of to Flush the unwanted space that it had created virtually?
Plz. look at the speed of loading of the website[now i've done some minor changes to it by releasing the "CSSCaching on Browser"] and also help me to save from its increasing on size. Thank You in Advance. :-)

--
Regards
Guruprasad Balaji

10/6/2011 8:03:33 AM
Gravatar
Total Posts 18439

Re: Database Size automatically getting increased

I found it to be on most of the mp_{tablename} and not on the custom tables that i'd created.

You found what specifically on what specific tables?

You have the database on a separate VM machine from the web site, does it connect to the VM by a local network or doe sit connect over the internet? Connecting over the internet would be slow.

Is the web site on a VM? How much power does the VM have in terms of processor and memory. You need at least 1 GB of RAM on a VM for a Web Server and ideally at least 2GB or the machine does not have enough head room for running IIS etc and that will make it slow. With a VM with 2GB of RAM you could install SQL Express on the same machine and it "should" run ok, but remember that with a VM the real hardware is shared by multiple VMs and if there are too many of them on the same real hardware they will not perform well.

You will get better performance using inexpensive shared hosting than using an underpowered VM.

I can tell you that this site runs on a dedicated server with a good processor and 2GB of RAM and it is very fast with about 9 different sites running on the same machine and we have both SQL Server and My Sql also running on the same machine. We get a lot of traffic and we could handle a great deal more traffic than we get.

Best,

Joe

10/9/2011 4:32:31 PM
Gravatar
Total Posts 58
"Digg-in yourself to achieve excellence!" Follow #GPsays

Re: Database Size automatically getting increased

Yeah! Thanks for the great info Joe. Sorry for the delayed response. Lemme look into that for sure. Thanks once again. :-)

You must sign in to post in the forums. This thread is closed to new posts.