Doing a second import into an existing board

[cinderelmo]

I'm having trouble with Impex for a vb3 to vb3 import. Previously, I did an import of a phpbb board into my target vb3 forum. Now, I'd like to do a second import into that same vb3 forum, but as you know the script cleans out all the information that has importuserid attached to it.

My vb3 board originally had 5000 users.
My first import from phpbb brought in 1000 users to my vb3 board, taking the total to 6000.
My second import from another vb3 board will bring in an additional 2000 users to my primary vb3 board.
However, after running ImPex, my target (test) forum only has 7000 users.

This is because the original 1000 imported users have been removed during the "cleanup" phase of the import users module. Is there any way around this? Surely someone has imported more than once into the same database?

Thanks!

[Floris]

After each successful import, did you run the SQL to clean out the stored ids that impex makes? If not:

In your target vb install impex and do an import, update counters and run the sql and then update impexconfig and run the second import and then update counters again.


clean up sql post by jerry the impex dev : http://www.vbulletin.com/forum/showp...20&postcount=7

[cinderelmo]

Thanks a lot for the quick reply. I thought I did just what you said, but I'm going to go through it again to verify. Can you tell me which of the counters MUST be updated? For example, do I need to rebuild the search index, or can I just flush it? Or do I even need to touch it?

[Floris]

You imported new forums and threads and posts, the search index won't know those - if you want those to be indexed you need to rebuild search index yes.

After each import you always have to check the usergroup and forum permissions. And update counters. (fix broken user profiles, update usernames, update post count, update user titles, update thread info, update forum info and update search index).

[cinderelmo]

When I run his script (after updating counters) it DELETES all my users who have an importuserid. Thus, I still lose the 1000 users who were in my previous import. Isn't his script designed to allow a user to run an import as a test, then run his script to revert back to the original database so you can test it over and over to see if the import works?

For what its worth, my original import was done several weeks ago and I cannot re-do it. So, perhaps updating counters now (after the fact) isn't helping clear what needs to be cleared?

[Jerry]

The SQL will remove the import id's from the origional import data so the 2nd one will not remove the data if any of the modules are run twice.

[cinderelmo]

The SQL will remove the import id's from the origional import data so the 2nd one will not remove the data if any of the modules are run twice.

Are you sure about that? Can you confirm that the script is not designed to DELETE all users with importuserid <>0. I've run it several times now, and it does not clear the import id's...it simply deletes all the users with importuserid in my target database. The script even describes itself as "-- This will delete everything from the tables that have imported data in them."

Thanks for your time.

[westpointer]

Are you sure about that? Can you confirm that the script is not designed to DELETE all users with importuserid <>0. I've run it several times now, and it does not clear the import id's...it simply deletes all the users with importuserid in my target database. The script even describes itself as "-- This will delete everything from the tables that have imported data in them."

Thanks for your time.

I agree with you. This script seems to be designed for someone who wants to do a trial run on importing and then wants all the imported data deleted.

If you run this on a db that has a prior import, you will DELETE all the data from the prior import.

Is the importuserid field used after an import is successfully accomplished? Can all the importuserid values be reset to zero before importing a second v3 vbulletin forum into the target forum?

[Jerry]

Are you sure about that? Can you confirm that the script is not designed to DELETE all users with importuserid <>0. I've run it several times now, and it does not clear the import id's...it simply deletes all the users with importuserid in my target database. The script even describes itself as "-- This will delete everything from the tables that have imported data in them."

Thanks for your time.

You are right, that is the cleaning database script, i.e. removes all that has been imported.

I have attached the correct script to the same post now.

http://www.vbulletin.com/forum/showthread.php?p=657820#post657820

[westpointer]

Awesome. Can you confirm that after an import is complete, the importuserid serves no function within vBulletin?

[Jerry]

Awesome. Can you confirm that after an import is complete, the importuserid serves no function within vBulletin?

Not at all, it is created for the purpose of the import to allow relevant data to be associated with the user during the import (i.e. the posts).

If there was an external application that used the userid in the old board, that could be pointed to the importuserid, otherwise vBulletin itself makes no call to it at this time.

[cinderelmo]

Just FYI, the new database cleaning script worked very well. There were some options that I had to remove because they were not in my database, but once removed the rest worked great and my vb3 to vb3 import worked as well. I appreciate the help in getting the right script for that!

[simplex]

Not at all, it is created for the purpose of the import to allow relevant data to be associated with the user during the import (i.e. the posts).

If there was an external application that used the userid in the old board, that could be pointed to the importuserid, otherwise vBulletin itself makes no call to it at this time.

Will a simple renaming of some of those importids work, or will I have to add another column before doing a second update?
I ask because I need to figure out which userid (for instance) from source db was mapped where in an easy way, as some custom scripts are relying on those pieces of information.

[Jerry]

Will a simple renaming of some of those importids work, or will I have to add another column before doing a second update?
I ask because I need to figure out which userid (for instance) from source db was mapped where in an easy way, as some custom scripts are relying on those pieces of information.

The userid in the vB database (target) is a vB created one. The importuserid is the one from the source database.

If you have external applications linked to the userid in the source board now the importuserid in vB, point the app at the importuserid will work, though vB wont create importuserids as new members register.

To have more than one importuserid column, you would have to rename it before doing the second import, when impex can't find a column called "importuserid" it will create it, also depending on the system you are importing from it will create an index on importuserid also.