Avlis Team cracks the persistance barrier with real-time dat

Avlis Headlines - www.avlis.org

Moderator: Event DM

Post Reply
Orleron
World Advisor, Co-founder
World Advisor, Co-founder
Posts: 15149
Joined: Fri Sep 14, 2001 9:48 pm
Timezone: GMT-5
Contact:

Avlis Team cracks the persistance barrier with real-time dat

Post by Orleron » Mon Jan 20, 2003 2:31 am

Who needs to wait for Bioware? Five days ahead of Bioware?s database connectivity announcement, the Avlis Team went into a secret
closed-beta test. In the months since Neverwinternights (NWN) went gold, the elusive goal of true
persistence has been all but achievable. The beginning of that beta test was to finally push that
effort over the edge.

We are happy to announce to the NWN Community that the Avlis Team has developed a real-time Open
Database Connectivity (ODBC) persistence system which is now undergoing internal-beta testing.
Unlike current systems, which utilize either tokens to hold information or creatively read the
log file and re-compile it into the module, the Avlis Persistence System (APS) and the underlying
NWN Extender (NWNX) read information from a database on the fly and change special local variables
inside NWN in real-time. This revolutionary feat was accomplished by Avlis Team Member Papillon, a
NWN community contributor and resident Avlis Team genius.

In short, the NWNX works by running the NWN server application as a child process and tracking some
special local variables that are set in game. It uses no hakpaks, and the only in-game NWN modification
necessary is the addition of either the scripts for the APS, or your own custom modified SQL
functions. Whenever a script wants to generate a SQL query, it calls our functions and the Extender
pulls the query out of the memory of the NWN server. It then passes it to the database, and writes
the result of the query back into the memory of the server. The database has been tested with Microsoft
Access and MySQL so far. Conceivably, any database with a decent ODBC driver will work. Also, because
of the nature of ODBC logistics, multiple servers can be linked up to one database file to produce
100% reliable cross- server persistence. A variable can be set on one server and checked on another.

The NWNX application takes up nearly 0% CPU usage and it adapts to internal changes in the NWN server
application as they occur. It does not depend on a specific version of the server (1.27 as of this
writing) and thus will work with upcoming releases, too. We have a version for Windows NT/XP and plan
to implement a Linux port of NWNX after the initial release.

Another useful feature of NWNX is the ability to use result sets in a query. This means that for some
queries it is possible to send back more than one piece of information to the NWN server. A good
example of where this would be useful is persistent chests. A normal chest?s contents are wiped out on
server restart. With NWNX, items in the chest can be set as local persistent objects on the chest.
When someone opens the chest, a single open chest query is made and all the objects inside the chest
are returned in the query. Again, this is just one example of what can be done with this program.

This technology opens up many possibilities for persistent worlds in the NWN Community. The number of
possible offshoot ideas are limitless.

Papillon and the Avlis Team will release this software to the community and continue to develop and
improve it. The release will occur after the internal beta-testing is completed. We have many ideas
of our own about what we can do next, now that the possibilities for NWN have just been blown wide open.
"Truth has no form."
--Idries Shah
Duquesne
Squire of Babble
Posts: 26
Joined: Fri Dec 06, 2002 3:55 am
Location: Pennsylvania

Wow

Post by Duquesne » Mon Jan 20, 2003 8:29 pm

I am proud to be a small part of such a ground breaking group. A well deserved BRAVO to the developers! I imagine that many other persistant worlds will want to use this technology when it is released.

- Duquesne
suntzu212
Newbie
Posts: 3
Joined: Tue Jan 21, 2003 2:11 pm

Post by suntzu212 » Tue Jan 21, 2003 2:15 pm

This sounds great. Even with Bio DB functionality right around the corner, it seems they are going to make a completely internal database. That is great but it still leaves the problem that there is no way to get information into the server from the outside world.

The big question I have is: will it work on Linux?
suntzu212
Newbie
Posts: 3
Joined: Tue Jan 21, 2003 2:11 pm

Post by suntzu212 » Tue Jan 21, 2003 4:20 pm

Whoops. I just saw that yuo are planning on doing a linux port. Sounds great. Can't wait to try it out.
Orleron
World Advisor, Co-founder
World Advisor, Co-founder
Posts: 15149
Joined: Fri Sep 14, 2001 9:48 pm
Timezone: GMT-5
Contact:

Post by Orleron » Tue Jan 21, 2003 7:31 pm

Suntzu it DOES solve the problem of getting information from the outside world into the server. Have you read all of our press releases?
"Truth has no form."
--Idries Shah
Vorvodoss

Post by Vorvodoss » Tue Jan 21, 2003 8:55 pm

Suntzu it DOES solve the problem of getting information from the outside world into the server. Have you read all of our press releases?
Um...boss, I think Suntzu was saying that the Bioware DB does not solve the problem of getting info. in from the outside, but OURS does. I might be wrong but...well, no...I don't think I'm wrong. hehe
Orleron
World Advisor, Co-founder
World Advisor, Co-founder
Posts: 15149
Joined: Fri Sep 14, 2001 9:48 pm
Timezone: GMT-5
Contact:

Post by Orleron » Tue Jan 21, 2003 9:29 pm

OH yeah, look at that... guess that's what I get for going through over 100 posts in 5 minutes.... woo
"Truth has no form."
--Idries Shah
Draiden the druid
Squire of Babble
Posts: 44
Joined: Fri Dec 27, 2002 9:45 pm

Congrats on the system

Post by Draiden the druid » Tue Jan 21, 2003 10:25 pm

I too am greatful to be a member of a group that is constantly trying to improve the game play for it's members .In fact all the people around the globe that play the game can benefit from advances such as these. Avlis is a wonderful place to game and I have made some good friends online here and these new additions are going to make it that much more enjoyable, now if you guys could just come up with a way to keep me from dying WAAAAAAY out in the middle of no where...you would really have something :) Thank you again for all of your hard work

Draiden
User avatar
Sili
Sage
Posts: 1816
Joined: Thu Oct 24, 2002 6:24 pm
Location: dallas, tx, GMT -5/-6?!!!
Contact:

Post by Sili » Tue Jan 21, 2003 11:49 pm

Originally posted by Draiden the druid
now if you guys could just come up with a way to keep me from dying WAAAAAAY out in the middle of no where...
Draiden
Don't get killed:D
suntzu212
Newbie
Posts: 3
Joined: Tue Jan 21, 2003 2:11 pm

Post by suntzu212 » Wed Jan 22, 2003 2:44 pm

Yeah, I meant the Bio BD would not allow access to info in the outside world, but yours will. Sorry for being unclear.

I really want this system on my PW, so if you need any help with the linux port or testing on linux, please send an e-mail to soul@soulforge.telmaron.com.
User avatar
Kraag
Newbie
Posts: 2
Joined: Wed Jan 22, 2003 11:24 pm
Location: Guam
Contact:

greetings

Post by Kraag » Wed Jan 22, 2003 11:33 pm

Hello,

A friend of mine posted a link to this on our forums and thought I would check it out.

We run a PW NWN server through Gamehosts.net and have been working on Persistant storage for some time now and have come close but currently we are using a token system.

I just wanted to congradulate you guys on a job well done. If I am out of place posting here my apologies.

Peace.

Spoondog
Timendainum
Newbie
Posts: 5
Joined: Thu Jan 23, 2003 9:42 pm
Location: Midwest, USA
Contact:

Post by Timendainum » Thu Jan 23, 2003 9:47 pm

From what I understnad you guys are in beta testing. I am currenty working on developing my own PW (ha, who isn't these days).

But, I also happen to write RDMS based apps for a living. Yeah I know dang SQL! ;)

Anyways, if you're looking for another beta tester, who will already has an idea of how to use this system, I will put your system through the hoops.

Since I've heard this announcement, I've been making notes on how I intend on using it.

Please let me know if you're interested in another tester.
Orleron
World Advisor, Co-founder
World Advisor, Co-founder
Posts: 15149
Joined: Fri Sep 14, 2001 9:48 pm
Timezone: GMT-5
Contact:

Post by Orleron » Fri Jan 24, 2003 4:33 am

No need, Tim. We're close to release, and you'll have it in your hands sooner than you think.
"Truth has no form."
--Idries Shah
User avatar
Kraag
Newbie
Posts: 2
Joined: Wed Jan 22, 2003 11:24 pm
Location: Guam
Contact:

Post by Kraag » Fri Jan 24, 2003 7:12 am

So will this be available to everyone?

I know our scripting geniuses would love to be able to take a look at it...just wondering.
Orleron
World Advisor, Co-founder
World Advisor, Co-founder
Posts: 15149
Joined: Fri Sep 14, 2001 9:48 pm
Timezone: GMT-5
Contact:

Post by Orleron » Fri Jan 24, 2003 1:08 pm

Executable will be put on NWVault soon. Source code will come out later down the road because there's something Pap wants to do with it first... something about making a standard plugin interface.
"Truth has no form."
--Idries Shah
Timendainum
Newbie
Posts: 5
Joined: Thu Jan 23, 2003 9:42 pm
Location: Midwest, USA
Contact:

Post by Timendainum » Fri Jan 24, 2003 3:37 pm

Originally posted by Orleron
No need, Tim. We're close to release, and you'll have it in your hands sooner than you think.
Great!! Since the announcement this has consumed a good deal of my brain's brandwidth.

Not only am I interested to see what can be done with it, but I am really interested to see how you have implemented it.
Post Reply