I saved the WOTC Forums before they closed, and need help sorting them out....

[Solauren]

Hello Everyone.

Remember how Wizards of the Coast shut down their Forums in November? Well, they did. Fortunately, they gave some lead-time warning. So, at the beginning of October, just after they announced that, since there wasn't time to sort through all the threads, I started the process that ended up downloaded every D&D/D20 System thread.

This is actually the third time I've done this. (I did this previously in 2005 and then in 2008 just before 4E was out).

I want to put it all online as a lifeboat/archive, but it needs to be sorted out first.

So, I made a program to do it, and I've made it so people can help.

http://www.secretsofthearchmages.net/Threads/SOAM.zip

It's a Microsoft Access Database, so unless you have Microsoft Office Professional, you'll need the viewer.

https://www.microsoft.com/en-us/download/details.aspx?id=4438

The program is simple. After unzipping it, (and installing the viewer if required), you launch the file like you would any other file.

Your first time running the program, you'll be asked for a User Name. This is required for sending results to the FTP server. The filename format is the handle you enter, and the date.

Working in the program is simple. By default, you'll have no work. Select one of the two 'assignment buttons', to give yourself 100 threads to review.

The buttons can either assign work from the entire thread list randomly, or select them from whichever Year/Forum you choose. (i.e Wizards of the Coast, 2008, Magic and Spells)

The choice buttons are along the bottom. The current beta also shows the link/file path you're looking at. Depending on traffic, you might have to wait a few seconds for a thread to load.

The Choices are:
Has Content: There is something mechanical in this thread. i.e Something you could find in a source book.

Questions or Rules Discussion: Meant for threads were people were asking for and explanation on how something worked, discussing custom house rules, or the like.

Ideas: Catch all for anything not mechanically related, but has in game use. This includes people discussing or posting character creation/optimization and the like.

Humor: For things like '1001 funny character' deaths and the like

No Content: For Trolling, complaining, or threads like 'hey, where do I find....' or 'Can someone send me a copy of...'

Upload Results send the files to the FTP server I've set up.

The idea up uploading results is, say Rob does 300 threads this week, and Bob does 200. They send their results to the server. I download them, and combine them into a single file.

You then use the Download Results button to pull those results in, and your copy of the database is update. Now, Bob will never be assigned the 200 he did, or the 300 Rob did, and vice versa.

This will minimize people doing the same work, and will hopefully let this be a coordinated effort.

At 630,520 threads, it would take me years to go through it all. (I figure 23 years at 100 threads per night). But, if 200 people help, and manage 100 threads per night each, this could be done in a little over a month.

Oh, and if you want proof of intent, here is what I squirreled out of just the Magic and Spells Section, and partially from the Monsters Lair Section, from the 2008 download

http://www.secretsofthearchmages.net/Results/Results/Results.htm.

So, please, download and help out?

[Bohandas]

Can this access the 2005 archive you mentioned too?

[Solauren]

Can this access the 2005 archive you mentioned too?


The 2005, 2008, and 2015 downloads are all part of the project.

Also, the Mailing-list lists archives as well (i.e Realms-L, Spelljammer-L, etc, etc)

[Bohandas]

Would the 1001 silly spells and 1001 silly monsters threads go in content or humor?

Also, how big is this archive? Would it be also possible for someone to download the entire archive?

EDIT:
Also, is there a Libre Office equivalent of Microsoft Access?

[Jormengand]

EDIT:
Also, is there a Libre Office equivalent of Microsoft Access?

I don't know that there's a Libreoffice version, but Openoffice on the other hand allows you to handle databases.

[ericgrau]

Props. I was hoping somebody would do this.

[Solauren]

A quick update.

While updating the database copy with my results prior to making this a 'group' project, I found two issues in the code.
First was what was an integer should have been a double.
The other was for larger updates (4000+ results), you get a recordcount error.

Both have been fixed, and the database updated.

Upload any results you have to the server, and redownload the database with the corrected code.

Also, the first results are up. Turns out I've looked over 55,000 + threads in the last 6 years.

I'll address individual questions later this afternoon.

[Bohandas]

I don't know that there's a Libreoffice version, but Openoffice on the other hand allows you to handle databases.

Excellent. I'll try to get on this after easter then.

[Solauren]

I'm working on a F.A.Q (which, ironically, has answers to most of the questions asked so far, and I started it two days ago....)

Bohandas: If there is a full mechanical write up, go into Content.
When in doubt of a category, put it into Content

Ericgrau: Then download and start reading :) And convince your friends to help, and advertise it!


If LibreOffice or OpenOffice doesn't work, the Access Viewer doesn't require you to own MS-Office.
If you don't have a Windows based computer, let me know.

There are no links actually in the database (just a virtual link system I coded in)
If you can't get the database to work, let me know, and I'll tell you how to get to the threads for review, and we can figure out a system for you (and non-windows users).

[Bayar]

I'd offer my hand in marriage if you have the "Forgotten Freedom" threads saved there somewhere. Or a pat on the back or something.

[Solauren]

I'd offer my hand in marriage if you have the "Forgotten Freedom" threads saved there somewhere. Or a pat on the back or something.

Do you remember the subform?

[Bayar]

No, but I do have the defunct links if that would help.

[Solauren]

No, but I do have the defunct links if that would help.

It should. PM away

[Solauren]

I found the threads Bayar sent me, and that gave me an idea.

I'm going to put up a list of all the threads that are part of the project.

if people want to search to see if a thread is there, awesome. (You'll be able to search by title, but not original thread link. However, if you know the thread number, which is part of the link, you'll be able to search by that as well by that as well.)

If you want a copy of the thread, I'll exchange threads for work. (Seems fair to me....)

[Bayar]

I'd be willing to help out after a FAQ is provided since I've had no previous experience working with databases.

[Solauren]

I can explain the entire thing with a single screen shot :)

Expect an update indicating one in a few days (family stuff to do today)

[Solauren]

I lied, it's two screen shots (shrugs).

The FAQ is nearly completed. I'm currently pulling a list of all the Thread Titles/Thread Numbers so people can go 'Hmmm, does he have this old thread....', find out I do, and then decided to help....

Anyway, the screen shots. First shot is the 'first time run/log in screen'. This will only appear once.

http://secretsofthearchmages.net/1stScreenjpg

Simple, and straight forward. Put a name in the Box, and hit 'lets begin'.

And here is the work screen....

http://secretsofthearchmages.net/Work.jpg

That's all you see. The big area with the thank you message is where the threads will be shown, one at a time.

Hopefully, the buttons are self-evidence. You start with no work, so you hit one of the assign work buttons. You'll get 100 threads assigned to you at random. You skim over the first thread, and hit one of the results buttons at the bottom. That will move you to the next thread. Rinse and repeat until done. Once you've done a bunch, you hit 'upload results'. Occasionally, hit download results to update your copy with what others have done to limit duplication of work.

That simple.

[Solauren]

There is now a front page, FAQ, how the program works, and a list of all the threads in the project....

http://www.secretsofthearchmages.net/index.html

[Solauren]

Holiday Weekend Bump....

[Solauren]

Hello

One of the people using the program has noted a problem between 32bit and 64bit (bloody hell it Microsoft....)

He's currently testing out the database with the conflict removed. (a keyword that tells 64bit the code is safe from 32bit, but it's not supported in 32bit but all the documentation I found said it was, sigh...)

Once that's confirmed as working, I'll make the code change in my copy, and there will be a 32bit and 64bit version of the database online for download.

[Bayar]

It's a good thing I didn't try and do anything meaningful a couple of days ago due to some virus problems, as both my computers run on 64bit Windows.

[Bohandas]

Is there any way for me to do a bulk download of all the archived threads?

I'm a bit of a digital pack rat too and would love to have my own local backup archive.

[Solauren]

Is there any way for me to do a bulk download of all the archived threads?

I'm a bit of a digital pack rat too and would love to have my own local backup archive.

As of right now, no. Primarily because I want people to help me sort them out first, then everything online at that point.

'course, if ya helped out, they'd be online quicker.

[Bohandas]

As of right now, no. Primarily because I want people to help me sort them out first, then everything online at that point.

'course, if ya helped out, they'd be online quicker.

Will do. I should have some time tomorrow (provided of course that I don't forget like I forget everything)

[ATHATH]

I just wanted to pop in to say that I'm glad that you're doing this. Well done.

[Bohandas]

Has anyone else been experiencing crashes? Or is it a compatibility issue with LibreOffice?

[Solauren]

Has anyone else been experiencing crashes? Or is it a compatibility issue with LibreOffice?


It's probably LibreOffice. I've heard it and Visual Basic for Applications doesn't get along.

[Bayar]

I have issues with Access. Downloaded the 2010 AND 2007 versions, made sure they are x32 as my new OS, both give runtime errors when trying to open the database.

Edit: Never mind, got the 2010 to finally work.

[Solauren]

Quick update.

I change the website somewhat....
I added Index pages for each Forum and year, and now anyone can see the threads
Meaning you and help out without using MS-Access.

The index.html has the explanation

http://www.secretsofthearchmages.net/index.html

I still need help reviewing them, however.....

[Bohandas]

There was a really long old thread where people were coming up with new abyssal layers, do you know if you have it?

Also, I want to double check, we email results to [email protected] now?

And how to format that? Something like?
Rules on Ascension to Godhood? SOAM-ID19406 ! 3 Question or rules Discussion
or just the numbers?

[Solauren]

There was a really long old thread where people were coming up with new abyssal layers, do you know if you have it?

Also, I want to double check, we email results to [email protected] now?

And how to format that? Something like?
Rules on Ascension to Godhood? SOAM-ID19406 ! 3 Question or rules Discussion
or just the numbers?

Yeah, email them there

Not that I'm really getting any results from anyone (shrugs).

Format is literally ID#, Result # (no text)
1 result per line.

[Fri]

Yeah, email them there

Not that I'm really getting any results from anyone (shrugs).

Format is literally ID#, Result # (no text)
1 result per line.

Sorry to hear that.

despite not being present in that forum at all, I honestly think this is a really good idea, because I know I used to find good stuffs there.

Have you tried to link this to other 3.5 focused forum?

[LooseCannoneer]

I've got some free time tomorrow, I'd be happy to put some time in. Is there any particular order you want the threads organized if there's an overlap?

[Solauren]

Sorry to hear that.

despite not being present in that forum at all, I honestly think this is a really good idea, because I know I used to find good stuffs there.

Have you tried to link this to other 3.5 focused forum?


Not particularly. There shouldn't be any overlap between categories (I deleted duplicates, as they take up space).

As for the advertising this, I put it up on EnWorld too, right in the lifeboat section.

I don't really know any other 3.5 sites.

[Bayar]

I did a couple of threads, but my laptop now refuses to open up the file, crashing as soon as it's done loading it. And my PC is 64bit and that probably won't mesh well.

[Solauren]

I've been considering dumping the entire thing into Microsoft Excel (and therefore any spreadsheet program can read it). With Excel, I can set things up so it's 'click the link, it opens'.

[Bohandas]

Is there any way I could support this with a monetary contribution instead?