PacketParser.exe

Topics related to tools created by the Core Team or 3rd-party community members.

Moderator: Team Members

Post Reply
User avatar
John Adams
Retired
Posts: 9684
Joined: Thu Jul 26, 2007 6:27 am
EQ2Emu Server: EQ2Emulator Test Center
Characters: John
Location: Arizona
Contact:

PacketParser.exe

Post by John Adams » Mon Dec 22, 2008 8:07 am

This tool is used to evaluate the captured logs and turn that data into Raw data used to populate your world.

Eventually, this tool will be part of the public SVN, but it is still in development. A current working version is attached to this post. Inside the zip file is a work-in-progress README.txt file, explaining how to set up PacketParser.exe for use.

In general, create a database in MySQL (eg., eq2_rawdata), source in the included SQL "Parser DB.sql", and run the command line "packetparser.exe -spawns -spells -items -quests -factions -collections -achievements {log_file}" to parse your log.


Sample automated batch file:

Code: Select all

for /f "delims=^" %%a in ('dir /b *.log') do call :process "%%a"
PacketParser.exe -populate eq2_test
PAUSE
goto :eof

:process
PacketParser.exe -spawns -spells -items -factions -quests -collections %1%2
This batch file will parse all *.log files in the current directory, then populate your eq2_test database (which is the name of your actual EQ2Emulator server DB). You do not have to use -populate, but it is included in this batch as a full-service example.

Questions? Ask here.
Problems? Post in the Tools Support forum for PacketParser.exe.


[link removed during update]

Magoth78
Posts: 4
Joined: Tue Jul 01, 2008 5:11 am

Re: PacketParser.exe

Post by Magoth78 » Wed Jan 14, 2009 3:22 am

Hello there,

is there any chance to see this tool's sources added into SVN ?
I'd like to learn how it works.

G'day,
Magoth

User avatar
John Adams
Retired
Posts: 9684
Joined: Thu Jul 26, 2007 6:27 am
EQ2Emu Server: EQ2Emulator Test Center
Characters: John
Location: Arizona
Contact:

Re: PacketParser.exe

Post by John Adams » Wed Jan 14, 2009 10:42 am

Sorry, but the PacketParser source is not Open at this time, as it is continually under development. If you wish to contribute to it's development effort, join the EQ2Emulator development team.

Magoth78
Posts: 4
Joined: Tue Jul 01, 2008 5:11 am

Re: PacketParser.exe

Post by Magoth78 » Wed Jan 14, 2009 11:34 am

Thanks for the answer.
It was just about individual learnings as I'm actually working on a tool like this, but it's np.

Mag

unknwon
Posts: 39
Joined: Fri Aug 03, 2007 12:38 pm

Re: PacketParser.exe

Post by unknwon » Wed Jan 14, 2009 11:50 am

i also working on a separate program too and would love to see how the packet collect is working.

Being able to see the packet collectors method of parsing the data, i should be able than to finish my project of getting a separate radar program working for eq2:)

User avatar
John Adams
Retired
Posts: 9684
Joined: Thu Jul 26, 2007 6:27 am
EQ2Emu Server: EQ2Emulator Test Center
Characters: John
Location: Arizona
Contact:

Re: PacketParser.exe

Post by John Adams » Wed Jan 14, 2009 11:53 am

Hah, I'm sorry Magoth78, I am in such a habit of not even looking at who's posting, I didn't see your name. Having your talents on one of our teams would be great for us - but I understand if you don't have time. I can check with the devs to see about the parser source, but it really is a work-in-progress, though it does an amazing job as it is so far.

And Unknwon, the parser and collector are two different programs. The Collector (that gets data from the live game) will likely never be Open Source. The parser is what takes the collected logs and turns it into raw data in your database used to populate your world. They are distinctly different.

unknwon
Posts: 39
Joined: Fri Aug 03, 2007 12:38 pm

Re: PacketParser.exe

Post by unknwon » Wed Jan 14, 2009 11:57 am

sorry it was a miss type on my part, just seeing how the packetParser works would help..

Magoth78
Posts: 4
Joined: Tue Jul 01, 2008 5:11 am

Re: PacketParser.exe

Post by Magoth78 » Wed Jan 14, 2009 12:09 pm

Np John, I understand if the devs don't want to share the parser sources. I will just try to make one by my own as a part on my personnal training.

Mag

User avatar
John Adams
Retired
Posts: 9684
Joined: Thu Jul 26, 2007 6:27 am
EQ2Emu Server: EQ2Emulator Test Center
Characters: John
Location: Arizona
Contact:

Re: PacketParser.exe

Post by John Adams » Thu Jul 02, 2009 11:20 am

My apologies to anyone pulling their hair out about our little parser here... I didn't realize this ZIP file was the distribution point for this tool, and I haven't updated it in 6 mos :shock:

I'll update the archive and submit a new one asap. I removed the old one for now, so give me a day or so to work out a crash and you'll have a new log parser.
John Adams
EQ2Emulator - Project Ghost
"Everything should work now, except the stuff that doesn't" ~Xinux

erde
Posts: 17
Joined: Mon Jun 16, 2008 7:28 am

Re: PacketParser.exe

Post by erde » Thu Jul 02, 2009 11:25 am

John Adams wrote:My apologies to anyone pulling their hair out about our little parser here... I didn't realize this ZIP file was the distribution point for this tool, and I haven't updated it in 6 mos :shock:

I'll update the archive and submit a new one asap. I removed the old one for now, so give me a day or so to work out a crash and you'll have a new log parser.
Thank you, very much!!!

User avatar
John Adams
Retired
Posts: 9684
Joined: Thu Jul 26, 2007 6:27 am
EQ2Emu Server: EQ2Emulator Test Center
Characters: John
Location: Arizona
Contact:

Re: PacketParser.exe

Post by John Adams » Thu Jul 02, 2009 12:15 pm

Being plagued with compiler issues, Zcoretri was kind enough to compile us up a new PacketParser.exe based on the latest dev SVN - so the package above has been updated.

Updated README.txt, the parse-all.bat is now really included (grin), got rid of obsolete structs and replaced them with data version 973 structs, and provided a new Parser DB.sql file.

Someone please test it out, and let us know if it (finally) works.


Special thanks to erde, Faraden, and Sylva1n for reporting the issues and their patience while I sorted them out. :)

Faraden
Posts: 17
Joined: Sun Mar 09, 2008 12:35 pm

Re: PacketParser.exe

Post by Faraden » Thu Jul 02, 2009 1:00 pm

Ah yes super that did the trick! :D

User avatar
John Adams
Retired
Posts: 9684
Joined: Thu Jul 26, 2007 6:27 am
EQ2Emu Server: EQ2Emulator Test Center
Characters: John
Location: Arizona
Contact:

Re: PacketParser.exe

Post by John Adams » Sat Jul 25, 2009 8:40 am

More DB structure changes, so a new PacketParser.exe is being developed and will be released soon. Keep yer shirt on!

Post Reply

Who is online

Users browsing this forum: No registered users and 0 guests