Zones crashing and never shutting down

[John Adams]

Here's a new issue that has appeared recently. Haven't diagnosed what the common problems are, but generally a player is in a zone performing combat, spells, questing, harvesting, the usual play. At some point, the player will freeze (usually after combat) and the zone stops responding for them.

Meanwhile, another player might come along and attempt to enter a different zone, and their game plays like nothing is wrong. Other zones start, stop just like they are supposed to. Meanwhile, the crashed zone is just hung. Anyone attempting to zone INTO the affected zone, gets hung in their client and has to terminate.

This is another of the MANY deadlock issues that lead to NO debugging info to try and see what's going on. If I were 10 people, I would add sufficient log entries to try and track this down. As it is, it might take some time... so this is an alert to players, we're aware of zone lockup issues.


Here's a chuck of the log where it happened, yesterday. Hadn't noticed til today since there's no sign of issue, and it would probably kill the player to come here and actually post something to help us out.

14:08 D Command: Player 'Sphinxgirl' (6234), Command: enablequeuedabilities
14:09 D Player: Sphinxgirl left grid 4294967295 and entered grid 2836440280
14:09 D Login: Looking for Login Appearance Updates...
14:10 D Command: Player 'Sphinxgirl' (6234), Command: hail
14:10 D Command: Player 'Sphinxgirl' (6234), Command: clearallqueuedabilities
14:11 D Command: Player 'Sphinxgirl' (6234), Command: clearallqueuedabilities
14:11 D Command: Player 'Sphinxgirl' (6234), Command: clearallqueuedabilities
14:11 D Command: Handler: 37, COMMAND: 'autoattack'
14:11 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Player 'Sphinxgirl' (6234), Command: clearallqueuedabilities
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:12 D Command: Handler: 37, COMMAND: 'autoattack'
14:12 D Command: Player 'Sphinxgirl' (6234), Command: autoattack
14:17 D Net: AddAuth: 6234 Key: 1312665478
14:18 D Net: AddAuth: 6234 Key: 1312665491
14:18 D Net: AddAuth: 6234 Key: 1312665503
14:18 D Net: AddAuth: 6234 Key: 1312665516
14:18 D Net: AddAuth: 6234 Key: 1312665539
14:19 D Net: AddAuth: 6234 Key: 1312665592
14:24 D Login: Looking for Login Appearance Updates...
14:39 D Login: Looking for Login Appearance Updates...
14:44 D Net: AddAuth: 6234 Key: 1312667080
14:51 D Net: AddAuth: 6238 Key: 1312667495
14:51 D Net: New client from
14:51 D Rules: Rule: R_World:UseBannedIPsTable, Value: 0
14:51 D Net: Adding new client...
14:51 I ZoneAuth: Access Key: 1312667495, Character Name: Sreb, Account ID: 6238
14:51 D Player: Loading character for 'Sreb' (char_id: 31)
14:51 I Zone: Loading new Zone 'GreaterFaydark'
14:51 D World: Classes::GetBaseClass returning base class ID: 11
14:51 D World: Classes::GetSecondaryBaseClass returning secondary class ID: 18
14:51 D Recipes: Loaded 0 recipes for player: Sreb (31)
14:51 D Player: Loading character_details for 'Sreb' (char_id: 31)
14:51 I Spawn: Loaded for zone 'GreaterFaydark':
3354 NPC(s), 515 Object(s), 94 Widget(s)
134 Sign(s), 746 Ground Spawn(s), 0 Spawn Group(s)
0 Spawn Group Association(s), 0 Spawn Group Chance(s)
14:52 D Player: Sending Login Info to new client...
14:52 D Player: Loading Skill Map...
14:52 D Player: Toggling Character ONLINE!

[John Adams]

Scat, from ChangeLog:

==06/28/2009:
LethalEncounter: Disabled crash handled for now.

I will check today, but is this still "disabled"? Because if so, I want it re-enabled if it means things will crash with some info vs just getting hung/stuck. But wanted to run it passed you, since I suspect all this code has changed considerably in 2 years...

[Scatman]

I'm honestly not sure. I don't remember seeing anything about that but that file is so damn big is very likely I missed it.

[John Adams]

Well Scat, unless you are horribly opposed, I am loading the code up with shit-tons of ENTER/EXIT trace-level logging, to see if it's possible to track down some of these issues. My only fear is the performance hit it will take on the server, but really, no one's playing and we NEED to resolve some of these net issues.

Let me know if you hate this plan.

[Scatman]

Please do, I think it'd be great.