Wow Log Parser

racy · 02/28/08, 6:39 PM

I have a project going called Wow Log Parser that is an offline combat log parser for the 2.4 log format. It has the ability to parse most events in the 2.4 log files for example damage, healing and power gains. The presentation is done in tables with details about spells, skills etc. You can also get pie charts that shows the distribution of damage from different sources. There is also a timeline graph that shows DPS, HPS and PPS over time.

The parser focuses on splitting a log into fights vs mobs. The fights can be merged together by selecting them and choosing merge. In each fight the participants are shown and can be selected to show details. Participants can also be merged if the user wants to get total damage, healing etc during a fight.

The ability to export some tables to HTML is also present. It is still in development so not all information can be exported atm.

If you have any feedback it would be appreciated.

Curse:
Wow Log Parser | Curse

Source code and forums:
Wow Log Parser forums

Suran · 02/29/08, 4:28 AM

looks pretty nice imho

but there are some things i'm missing:
in the main view of a fight, were you see participants dps/hps/etc, i miss a column which class the participant is. ok this is minor and/or cosmetic, but it would make it easier to identify the ppl you're raiding with. along with that comes coloring the values

another thing i'd be looking fowrad to is similar to this request: Combat Log Parsing & Analysis
i want some sort of a timeline fpr each individual raidmember, to see, when they did what, some sort of your 'show all events in a list' option, but a bit more graphical and on a per user base

at the end, exporting the html pages to an remote server would be awesome

but already a pretty nice tool, as an alternate option to WWS.
if you'd need some help, i'd happily volounteer as coder, as i had something like that in mind in recent months, as we started using wws and i just don't like it 100%...

so long

Suran of Nozdormu

racy · 02/29/08, 5:14 AM

Automatically finding out what class a player is and also automatically assigning pets to someone is something I want to do, but since it is not present in the log file as far as I know I have to make a database with common spells and abilities so I can find out what class someone is by checking what abilities they use.

About the timeline, some things are probably easy to o and others not so easy. It depends on what kind of timeline you are talking about. I already have the damage, healing and power graphs that is one kind of timeline. Were you thinking about a timeline showing only long cooldowns etc? I think that would be one of those things where you need a database with the events you are interested in, so could take a while to get it right so to speak, but I agree it would be a nifty feature. I'll see what I can do about that one.

The uploading directly to a web server thingy, isnt that kind of unneccessary? Cant you just upload the pages with ftp or whatever your provider uses. It just feels like an overkill feature that is easily solved with other tools.

Polleke · 02/29/08, 7:52 AM

What I currently do is alt tab out of the game, and open the log with notepad++ and use some simple ctrl+f or regex to check things after a wipe.
Now with 2.4 this becomes a whole lot harder because of all the non easy to read hex codes. So what I would like is to have a program running that updates as new information enter WoWCombatlog.txt and provide me once again with an easy searchable log.

I suppose an addon could do this awell, but right now I like the not so cpu intensive approach I have (raiding with athlon xp 1700+ sucks).

Suesse · 02/29/08, 12:54 PM

Sounds like a cool project, Racy. Would it be possible to release the source code? It would be great to have a platform available that would make it easy to quickly write a new analysis code / visualization.

Also, I hope the class balancing act doesn't delay 2.4 too much. Is there anywhere I can get some 2.4 combat logs of full raids with which to test this out?

racy · 02/29/08, 1:03 PM

Originally Posted by Suesse

Sounds like a cool project, Racy. Would it be possible to release the source code? It would be great to have a platform available that would make it easy to quickly write a new analysis code / visualization.

Also, I hope the class balancing act doesn't delay 2.4 too much. Is there anywhere I can get some 2.4 combat logs of full raids with which to test this out?

I found some logs at the WWS forum.
Wow Web Stats • View topic - 2.4 Combat logs samples

About the source code, I will release it when 2.4 comes out most likely, as GPL license. I don't want to release it too early because I want to have comments and a nice stable code base before that.

Kytrarewn · 02/29/08, 1:08 PM

What about automatically relabeling combatlogs? That's my biggest issue with the current WoW combatlog system for PCs. If you could set it to automatically relabel CombatLog.txt to something like 22808WoWlog.txt and send it to a directory of my choosing, I would use this program every day I logged into WoW.

racy · 02/29/08, 1:19 PM

Originally Posted by Kytrarewn

What about automatically relabeling combatlogs? That's my biggest issue with the current WoW combatlog system for PCs. If you could set it to automatically relabel CombatLog.txt to something like 22808WoWlog.txt and send it to a directory of my choosing, I would use this program every day I logged into WoW.

I'm not sure what you mean with this really. Isn't that the job of an addon instead of a separate program like this is.

Kytrarewn · 02/29/08, 1:29 PM

Originally Posted by racy

I'm not sure what you mean with this really. Isn't that the job of an addon instead of a separate program like this is.

No, because it actually entails changing the name of the file after having been parsed. The WoW Combat Logger, and I've searched for the functionality several times, will only output to WoWCombatLog.txt.

If possible, I would find it convenient for your separate program, upon parsing the file, to delete WoWCombatLog.txt and save the raw combat log, with the title formatted for date, in a separate folder (according to the user's preference), as well as the parsed results.

Without parsing or separating the files, you end up with a gigabyte long WoWCombatLog.txt after several months, that can be manually renamed or have sections manually removed to their own file, but, again, having your combatlog parser automatically perform this function would be very convenient.

racy · 02/29/08, 2:16 PM

Originally Posted by Kytrarewn

No, because it actually entails changing the name of the file after having been parsed. The WoW Combat Logger, and I've searched for the functionality several times, will only output to WoWCombatLog.txt.

If possible, I would find it convenient for your separate program, upon parsing the file, to delete WoWCombatLog.txt and save the raw combat log, with the title formatted for date, in a separate folder (according to the user's preference), as well as the parsed results.

Without parsing or separating the files, you end up with a gigabyte long WoWCombatLog.txt after several months, that can be manually renamed or have sections manually removed to their own file, but, again, having your combatlog parser automatically perform this function would be very convenient.

Ahh you mean like a function in the program where you select the WoWCombatlog.txt file and it splits that file into several other files for each day or something like that.

Kytrarewn · 02/29/08, 2:20 PM

Originally Posted by racy

Ahh you mean like a function in the program where you select the WoWCombatlog.txt file and it splits that file into several other files for each day or something like that.

More or less, or at the very least renamed the file to something automatically so that the next "WoWCombatlog.txt" would be fresh.

I know I can do it manually, but an automatic function to do the same would prove useful as I can be forgetful at times.

Suesse · 02/29/08, 2:26 PM

Originally Posted by Kytrarewn

More or less, or at the very least renamed the file to something automatically so that the next "WoWCombatlog.txt" would be fresh.

I see what you're saying. I don't know how others handle this. I was thinking of starting WoW with a simple script that first moved the combat log to something like WoWCombatLog_DATETIMESTAMP.txt, then started up WoW. Then you'd just have to restart WoW each day, if you don't already.

zushiba · 02/29/08, 7:01 PM

You could do this with a batch file, something like

for /f "tokens=2-4 delims=/ " %%i in ('date/t') do (
      (set Dy=%%i)
      (set Mth=%%j)
      (set Yr=%%k)
)


COPY C:\wow\Logs\WoWCombatLog.txt C:\wlog\WoWCombatLog.txt
RENAME C:\wlog\WoWCombatLog.txt "WoWCombatLog_ %Dy%%Mth%%Yr%.txt"
DEL C:\wow\Logs\WoWCombatLog.txt
C:\wow\wow.exe

obviously you will have to change your directories and only run this once per day unless you wanted to add a time variable to the name.

racy · 02/29/08, 8:04 PM

Just added class detection to the parser so that classes are automatically detected. The classes are detected when someone uses specific skills/spells. Not all skills are used for the detection but a few often used ones.

Suesse · 02/29/08, 8:04 PM

Here is one to rename via the time stamp on the file. It will also give you warning if you try this multiple times in one minute.

FOR %%V IN (%1) DO FOR /F "tokens=1-6 delims=/: " %%J IN ("%%~tV") DO IF EXIST %%L%%J%%K_%%M%%N%%O%%~xV (ECHO Cannot rename %%V) ELSE (Rename %%V %%L%%J%%K_%%M%%N%%O%%~xV)

Then call like this: C:\scripts\rename_stamp.bat "C:\Program Files\World of Warcraft\Logs\WoWCombatLog.txt"

Comes from Rename Files to Match Date/Time Stamp - Expert Help by PC Magazine

Paxon-IC · 03/01/08, 10:43 PM

I wrote the following to automatically rar the files up using WinRar if you have that:

@echo
for /F "tokens=1,2 delims= " %%i in ('date /t') do (
     echo %%j
     for /F "tokens=1,2,3 delims=/" %%a in ("%%j") do (set rardate=%%a.%%b.%%c
)
)
set time1=%TIME:~0,2%
set time2=%TIME:~3,2%
set time3=%time1%.%time2%
"C:\Program Files\WinRAR\rar.exe" a "c:\logs\%rardate%-%time3%.rar" @backup.lst -df >log.txt
"C:\Program Files\World of Warcraft\Launcher.exe"

Just use this to launch WoW instead of the default shortcut.

racy · 03/02/08, 8:41 AM

Updated it some again.

1.10.3
Added active DPS, HPS and PPS for participants. This is for the active time they are doing something. Its calculated by removing periods of time longer than 15 seconds when they are not doing any damage, healing or power events.

Changed the regular DPS calculation for merged fights as well. Before the summed duration of the fights was used, now the merged fight is scanned and the active time for the merged fights is calculated in a similar manner to active time for participants.

Also fixed some bugs when looking at the victims own damage, healing etc.

1.10.2
Fixed a bug when calculating average damage. Added a maximum amount column to the tables. Added crit count and percentages to the healing table. Fixed some class detection bugs.

racy · 03/04/08, 6:13 PM

New update, 1.10.4

1.10.4
-------
Added a dispell information dialog. Can view all auras/spells that was dispelled, the time it was dispelled, who dispelled it and from whom it was dispelled. (For example you can use it to check who broke that sheep or who did decursing etc.)

Added a whole bunch of new events to the parser. Spell cast events(start, failed, success). Aura events (Applied, Dispelled, Removed, Stolen, Dispell Failed). Also the party kill event. Of the new events, only the aura dispelled event can be viewed in any constructive way so far with the new dispell dialog.

Some small changes to the HTML output. A fight list sorted on healing done is also displayed now.

racy · 03/09/08, 12:40 PM

I put up a forum for releases, discussions, information, etc on my own server. This is where I will most likely release the source code when I feel it's ready. I will not do that on curse.

Wow Log Parser forums

racy · 03/27/08, 10:53 AM

I have now released the java source code for the project under GPL v2 license, meaning you can use it for your own projects as long as you release the source code and keep the same license (read the GPL v2 license if it's not familiar).

The source code is only released on my own site.
Wow Log Parser forums

racy · 03/29/08, 1:10 PM

New release 1.12.2 for the live 2.4 patch. Fixed a few display bugs and made error detection better so that the program does not crash by loading non supported files. Also changed a few parsing thingies.

I will upload the binary to curse when it works :-P You can download both the binary and source from my own site.
Wow Log Parser forums

racy · 04/06/08, 6:29 PM

Updated it a few times again. Version 1.15 binary and source is available on my website. The curse releases might be a bit behind sometimes but I try to get them up there as well.

racy · 04/10/08, 11:36 AM

Version 1.16.2 is available.

Recent changes from the change log:

Change log
---------------
1.16.2

Fixed some bugs with the new totem detection.
Fixed some bugs with the boss fights feature.

1.16

Added parsing of totems and also added them to the automatic pet detection so they can be assigned to the shaman who summons them.

1.15

Added a new dialog where boss fights can be made. This feature takes the bosses you select and merge the boss fight with all the other fights that occur at the same time. This is done to get all adds etc merged into the boss fight.

1.14

Added more automatic pet parsing so that mage pets, warlock pets, priest pets etc are recognized (only works if the summon event is recorded).
Made some additions to the HTML output, thanks Callithrix.
Added damage shield events.

1.13

Changed some damage, healing and power calculations so that pet events and player events can be calculated separately. Also added that information to the detailed info dialog.
Added mend pet to automatic pet parsing.
Fixed a bug that cleared the fight flags preventing a feature from working correctly.

1.12.5

Changed some colors in the html generation. Also changed how some tables look to avoid having the same information in two places.

1.12.4

Added some automatic pet assigning code for hunter pets in the "pet dialog". If the pet gets "Go for the Throat" or gets fed it is automatically assigned to the correct player.
Added another layer of "crash resistance" in the parsing code.

Kinetic · 04/22/08, 11:56 AM

One of the things that I would love to have the ability to filter by actor and/or target.

For example, I want to see all actions by a certain boss; and it would show a line by line detail of what this boss did to everyone in the raid, sorted by time stamp. I could then filter by target also, and choose (say) our MT, and it would show line by line all the things that the boss did to our MT.

Or I could choose the boss and MT healers as actors, and MT as target...to see why MT died because he didnt get enough heals, or boss got lucky crushing streak.

Or swap it around; I want to check a rogue dps cycle vs Boss, to check if he is running a proper cycle. So I put rogue name as actor and boss name as target.

I recognise the overhead that this may imply; but it would be invaluable to us as a guild (mostly because we dont use spoilers or walk-throughs as a guild policy). However, other guilds (and top tier guilds certainly) would no doubt find this very useful also.

racy · 04/27/08, 6:53 AM

Good idea, I might make one of those functions :-)