"Raw Data Ethics" battle ;)

Discussions of the design and development of in-game content.

Moderator: Team Members

Post Reply
User avatar
John Adams
Retired
Posts: 9684
Joined: Thu Jul 26, 2007 6:27 am
EQ2Emu Server: EQ2Emulator Test Center
Characters: John
Location: Arizona
Contact:

"Raw Data Ethics" battle ;)

Post by John Adams » Thu Sep 08, 2011 7:30 am

I am waging a war within myself over the semantics of "Raw Data", maybe you can help.

Currently, PacketParser will identify a spawn based on various unique properties. Name, class, race, gender, and more recently, individual appearances (eye color, hair type, etc). This makes for a LOT of raw spawns that previously did not exist. Ie., back in 2008 before LE added Appearances comparisons for me, we would parse maybe 30,000 spawns. Now, because each eye shape tweak is considered unique, we will parse over 60,000 spawns - for example.

What I have done with Parser currently was modify it so while it is detecting the uniqueness of a spawn, instead of inserting a NEW spawn for an eye shape tweak, it flags the spawns "randomize eye_type" signed values and saves that to the raw_spawn_info record instead... thus cutting down tremendously on the number of Raw Spawns to -populate.

However, in looking over the new dataset, while it looks exciting and clean, I am now struggling with the original premise of "raw data" in that now, there will never be a source of TRULY raw spawned info to refer to.


So my internal debate, that i bring to you to help me solve (quickly) is, do I really give a shit? This will cut down on Hours, Weeks, maybe even Months of effort to consolidate spawns in our database. Running -populate will put spawns into the dev database already merged, randomized, and ready to pop without any additional effort. Should any data be questionable, we would merely need to re-parse the log that spawn came from using an older parser (or I will add -params to allow it with the current).

I think you all have helped me with my dilemma immensely! Thank you! hahaha... no seriously, if you have any opinions, shout em out before I get too much further into this.

Thanks

User avatar
John Adams
Retired
Posts: 9684
Joined: Thu Jul 26, 2007 6:27 am
EQ2Emu Server: EQ2Emulator Test Center
Characters: John
Location: Arizona
Contact:

Re: "Raw Data Ethics" battle ;)

Post by John Adams » Thu Sep 08, 2011 8:10 am

Examples --

Running Normally, I will get these entries for a Bloodskull Lumberjack:
normal.jpg
Note, of all these UNIQUE spawn IDs, the only difference (besides level) is their appearances (colors, shape of features)


Running with the new -consolidate switch:
consolidate.jpg
Level range is set in RAW data, and a Randomize has been calculated before you even populate your world.


Do you think this is a better way? Please let me know, before I start parsing the whole pile over again ;)
PS: Example of parser console output:
output.jpg
You do not have the required permissions to view the files attached to this post.

User avatar
xinux
Team Member
Posts: 680
Joined: Wed Mar 10, 2010 11:10 am
Location: Destroyer of Servers

Re: "Raw Data Ethics" battle ;)

Post by xinux » Thu Sep 08, 2011 10:12 am

do I really give a shit?
My personal opinion is no running with the consolidate switch to me look's like would save a ton of time and do you really need to populate with all those raw spawns when the randomized value will work just fine.
EQ II - Build=1360 (Orig) - Build=1360 (DoF) - Build=2654 (KoS) - Build=3375 (Classic) - Build=3554 (EoF)
EQ II - Build=4412 (RoK) - Build=5122 (TSO) - Build=6118 (SF) - Build=7628 (DoV) - Build=8295 (Aod)

User avatar
ilythor
Retired
Posts: 436
Joined: Sun Oct 14, 2007 3:44 am
EQ2Emu Server: TessEq2
Location: Australia, mate!
Contact:

Re: "Raw Data Ethics" battle ;)

Post by ilythor » Fri Sep 09, 2011 3:33 am

Randomize all the way!

From a player's perspective, is it possible that we would get 12+ of an identical mob populating an area? (If there are 12 spawns, or a group encounter etc. I am merely asking about appearances)

Nvm, I just realized we're playing an MMO and all the mobs look the same.
"Everytime you pull the trigger in space, you will ruin someone's day, somewhere, and eventually, some time."

User avatar
John Adams
Retired
Posts: 9684
Joined: Thu Jul 26, 2007 6:27 am
EQ2Emu Server: EQ2Emulator Test Center
Characters: John
Location: Arizona
Contact:

Re: "Raw Data Ethics" battle ;)

Post by John Adams » Fri Feb 03, 2012 3:43 pm

There is another ethics battle I have waged with myself, and due to not much interest in how I do things from the rest of you :D I have made a command decision myself.

Previously, I was taking all "common throughout the world" spawns and making then generic, so to speak. Like, a "?" spawn would be spawn_id 100, period. It would appear in any zone, but be called spawn_id 100.

After a fiasco trying to deal with ground spawns that have different results, I've decided saving 1000 DB rows is not really worth the headache of trying to remember "Where the hell did I put that Creature Den (model 2939) anyway? Oh yeah it's a common spawn, at ID 502".

Screw that. We'll see how this looks, and make another decision later if it looks too dirty.

User avatar
Scatman
Retired
Posts: 1688
Joined: Wed Apr 16, 2008 5:44 am
EQ2Emu Server: Scatman's Word
Characters: Scatman
Location: New Jersey

Re: "Raw Data Ethics" battle ;)

Post by Scatman » Fri Feb 03, 2012 4:47 pm

So you're just letting them become whatever ID they are given?

User avatar
John Adams
Retired
Posts: 9684
Joined: Thu Jul 26, 2007 6:27 am
EQ2Emu Server: EQ2Emulator Test Center
Characters: John
Location: Arizona
Contact:

Re: "Raw Data Ethics" battle ;)

Post by John Adams » Fri Feb 03, 2012 7:10 pm

Yes. The way we have it in Milestone 1 is cool, but just too much effort to maintain (imo). I'll take 2nd opinions, if there are any. Pop hasn't begun yet, but working out the final issues with my scripts tonight.

Post Reply

Who is online

Users browsing this forum: No registered users and 0 guests