Announcement

Collapse
No announcement yet.

Constant DB errors

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Marco van Herwaarden
    replied
    There is a very popular hack at vbulletin.org to organize backups.

    Leave a comment:


  • Blairwarlock
    replied
    Originally posted by MarcoH64
    Well that rules that out then.

    Only explanation i can think of then, would be a different codepage during upload, or MyIsam vs. InnoDB
    Not running InnoDB. I agree it's strange. I could understand if it were smaller in size. In any case, the important thing right now is I was able to pinpoint the source of corruption and things are back to some state of normalcy for now.

    Leave a comment:


  • Blairwarlock
    replied
    Morning update:

    That should say it all!

    Thanks for the help guys. I guess in the process of troubleshooting this, going to a newer version of php and mySQL was probably a good thing to do regardless of the fact that it didn't fix the problem. As we found out, sometimes rebooting your computer doesn't always fix the problem

    For the record, my ISP moved to Veritas BackupExec. I can't imagine that Veritas is not compatible with mySQL, but I will need to do some research- perhaps there's an optional module to allow for live DB backups. Important thing now is NO MAS CORRUPCIONO! And yes, I will have to begin scheduling a cron job to perform a daily mysqldump. Thanks again!

    Leave a comment:


  • Marco van Herwaarden
    replied
    Reeko,

    I suggest you open a seperate thread for your problem.

    Try to include as much info as possible, like php/mysql versions, detailed Database errors etc.

    Leave a comment:


  • ReeKo
    replied
    I"m having a ton of these database errors also, been going on for months. I"m brain dead when it comes to PHP and SQL databases, some webmaster I am huh.

    I"M currently running 3.0.1 and feel I need to upgrade but to what version I dont' know.

    Please point me to the location were I can get directions of how to upgrade and the upgrade itself.

    I was told by my hosting location that it's a "proccess" running against the database that is the problem and it's within the VBB Code. I have no idea where to look in the code for the problem?? Are they full of it?? Also if I run a repair on mySQL database it will free up over 600 mb of drive space on my server. WIthin 24 hours that drive space will be full again, I run the repair on mySQL and it's freed up. I do this daily to free up drive space.

    Do you guys - VBulletin - offer hosting??

    I desperatly need help on getting this database error fixed.

    Leave a comment:


  • Marco van Herwaarden
    replied
    Well that rules that out then.

    Only explanation i can think of then, would be a different codepage during upload, or MyIsam vs. InnoDB

    Leave a comment:


  • Blairwarlock
    replied
    Originally posted by MarcoH64
    When compairing the size, are you compairing to another (or old) directory on the same server?

    If not, the actually disk size of a file can depend very much on OS, OS-settings or disk.
    The two folders were on the same disk. I essentially took a dump of my DB, loaded it to a new DB on the same disk and compared the two.

    Leave a comment:


  • George L
    replied
    Originally posted by Blairwarlock
    Update: I did some more troubleshooting and noted the start time of the DB errors over the last week. Seems like errors start between midnight and 2AM every night consistently. This is obviously a time when there's little load on the server with regards to forum users. I did discover that corruption ONLY occurred in the middle of the night..strange. So, what's the first thing anyone would think about that happens each night during off-time? Backups! I called my ISP and sure enough they recently switched over to a new backup platform 2 weeks ago when the corruption began. This new platform seems to NOT be compatible with mySQL open files . Corruption would ONLY occur in 2 tables...post and postindex. We're going to exclude my forum DB tonight to see if we still get corruption. This is good and bad. If in fact this new backup platform is unable to backup mySQL then my nightly backups are worthless and will only be as good as my last weekly dump

    Will keep you updated.
    ah ha yes as suspected... you just will have to cron job or use a backup script run by cron which invokes mysqldump for safely backing up your forums.

    Leave a comment:


  • Blairwarlock
    replied
    Update: I did some more troubleshooting and noted the start time of the DB errors over the last week. Seems like errors start between midnight and 2AM every night consistently. This is obviously a time when there's little load on the server with regards to forum users. I did discover that corruption ONLY occurred in the middle of the night..strange. So, what's the first thing anyone would think about that happens each night during off-time? Backups! I called my ISP and sure enough they recently switched over to a new backup platform 2 weeks ago when the corruption began. This new platform seems to NOT be compatible with mySQL open files . Corruption would ONLY occur in 2 tables...post and postindex. We're going to exclude my forum DB tonight to see if we still get corruption. This is good and bad. If in fact this new backup platform is unable to backup mySQL then my nightly backups are worthless and will only be as good as my last weekly dump

    Will keep you updated.

    Leave a comment:


  • Blairwarlock
    replied
    Originally posted by eva2000
    with tape backup does it just backup the mysql data partition files while mysql is still running ? i.e. copy/transfer the *.myd, *.myi, *.frm ? if so that that's a possible cause of your corruption.

    As to how long it should take it depends on cpu power, disk speed and mysql memory buffer allocations as to how long it's hard to say.

    example 1.4+ GB vB database of mine

    dual AthlonMP 2400+ with 2GB ram and 10k scsi disks, took around 45-55mins to import into empty database

    2x server setup with web and db server both dual P4 3.06ghz Xeon with 3GB ram and raid 5 10k scsi disks took around 16-19mins to import
    Update: more errors ths morning my users are getting VERY upset. i'm really at a loss here. errors this morning are the same 127 as I was getting earlier. any suggestions please??

    Leave a comment:


  • Marco van Herwaarden
    replied
    While the file count is the same, the new load takes up about 30 more MB of disk.
    When compairing the size, are you compairing to another (or old) directory on the same server?

    If not, the actually disk size of a file can depend very much on OS, OS-settings or disk.

    Leave a comment:


  • Blairwarlock
    replied
    Originally posted by eva2000
    with tape backup does it just backup the mysql data partition files while mysql is still running ? i.e. copy/transfer the *.myd, *.myi, *.frm ? if so that that's a possible cause of your corruption.

    As to how long it should take it depends on cpu power, disk speed and mysql memory buffer allocations as to how long it's hard to say.

    example 1.4+ GB vB database of mine

    dual AthlonMP 2400+ with 2GB ram and 10k scsi disks, took around 45-55mins to import into empty database

    2x server setup with web and db server both dual P4 3.06ghz Xeon with 3GB ram and raid 5 10k scsi disks took around 16-19mins to import
    The load was done from a local mysqldump so we did not use tape backup.

    Any ideas on why the size of the new database is greater than the dump it was taken from? Btw, so far so good!

    Leave a comment:


  • George L
    replied
    with tape backup does it just backup the mysql data partition files while mysql is still running ? i.e. copy/transfer the *.myd, *.myi, *.frm ? if so that that's a possible cause of your corruption.

    As to how long it should take it depends on cpu power, disk speed and mysql memory buffer allocations as to how long it's hard to say.

    example 1.4+ GB vB database of mine

    dual AthlonMP 2400+ with 2GB ram and 10k scsi disks, took around 45-55mins to import into empty database

    2x server setup with web and db server both dual P4 3.06ghz Xeon with 3GB ram and raid 5 10k scsi disks took around 16-19mins to import

    Leave a comment:


  • Blairwarlock
    replied
    Originally posted by eva2000
    and run that - doing a backup and restore and fix possible file structure corruptions in database files
    Ok, done. How long should loading an 860MB database take? Took several hours to complete. Perhaps my memory allocation was not optimized. In any case, once it loaded I checked the file count and disk space taken by the actual files/tables. While the file count is the same, the new load takes up about 30 more MB of disk. Interesting...wonder if there was some corruption in the old database that was repaired during the load?

    Leave a comment:


  • Blairwarlock
    replied
    Originally posted by eva2000
    hmm when was last time you backed up your forums ? and how did you back it up ? mysqldump ? or physically moving data files ? corruption could be due to faulty hardware too i.e bad memory modules etc
    Outside of tape backup, forums are manually backed up via mysqldump weekly. I will try your suggestions. Thanks!

    Leave a comment:

widgetinstance 262 (Related Topics) skipped due to lack of content & hide_module_if_empty option.
Working...
X