Elitist Jerks
Register
Blogs
Forums


Go Back   Elitist Jerks » Public Discussion » Public Discussion

Reply
 
LinkBack Thread Tools
Old 05/08/08, 2:05 AM   #16
webmeister
Von Kaiser
 
Human Mage
 
Blackrock
I've been tossing around a few ideas for this sort of thing recently, since my professional life has so far focused on the research and analysis fields. I definitely think WWS needs some sort of analysis tool that can generate reports rather than just numbers.

A few ideas I've had include:
- a consumables report. Who consistently uses potions/healthstones versus who doesn't. Who dies while their pots/healthstones aren't on cooldown (ie they don't use them). Who uses flasks/elixirs/oils/food buffs etc.
- a "retard" report -- people who consistently take avoidable damage (eg Supremus volcanos, Doomfire, etc).
- a decurse/dispell report. Dispell counts by themselves are fairly meaningless; I want to see who is taking damage from dispellable abilities, organised by who eventually dispelled them. This shows you how quick/attentive your dispellers are (or aren't).

Yes, I'm aware that most of this information can be extracted from WWS with time and patience, but having tools that could automatically do this would be a massive help.

I'd put something like this together myself, but I don't have a lot of programming experience

Interested to hear other people's thoughts.

Offline
Reply With Quote
Old 05/08/08, 2:23 AM   #17
Ellyh
Don Flamenco
 
Ellyh's Avatar
 
Human Priest
 
Hyjal
Webmeister, your ideas sound useful and I could certainly see a value to reports such as these.

That said the kind of cross raid ranking over time reports that the Original Poster is discussing seem to be of very little value and would not be of any use across raids as each raid does things differently so unlike a raw dps # or tanking rotation, things like death numbers / healer are not usable if you don't know the way that a given raid approaches an encounter.

Saraya, I think you may be overcomplicating things. Your idea would require a large number of reliable datapoints before you could draw anything valuable out on an encounter by encounter basis. To get a realistic sample you would need at least 20 minimum valid reports (I.E. Kills or extended attempts) and I cannot think of many bosses that aren't totally on farm with alts subbing in where you would get 20 datapoints before you move on. Additionally most of the things you could draw out from such a report are much more easily addressed if you have reasonably observant players in your raid.

If PoM caused aggro during a Hydross transition, fine, you have a sample point. If this happens consistently, and you can't put the blame on anyone, you can say ok, hey hunters, we're having trouble during this transition, can you try to misdirect onto the tanks?
The easy solution is to find the person who was on the wrong side of the line, which any observant player using an aggro monitor such as grid will know, and yell at them for being on the wrong side of the god damned line at the transition. No complex analyses needed and if they keep doing it they get benched or kicked.

New Zealand Offline
Reply With Quote
Old 05/08/08, 3:10 AM   #18
Northerner
Great Tiger
 
Northerner's Avatar
 
Troll Mage
 
Mal'Ganis
The idea of making a RDPS meter has amused me for a while. The sad thing is not so much that the logic is convoluted (although it is indeed) but that the results would be... well, not conducive to harmony.

Offline
Reply With Quote
Old 05/08/08, 3:11 AM   #19
Saraya
Piston Honda
 
Night Elf Druid
 
Proudmoore
I was mostly trying to respond to the specific examples described in the post above mine. Obviously a phase transition like Hydross is easy as hell to spot, but for more complex fights, its much harder to be able to keep an eye on everyone. And if you had 10 attempts on a boss, each taking even as little as 30 seconds each, I think its still enough to draw data from it. Maybe you could just take the median death time from all the raid and calculate that as the wipe time, and see what's causing all the wipes to happen.

I might also be looking for too much information because in the past I would raid with people who don't admit to doing anything wrong(we're talking dying from spout and denying it even though their corpse is 100 yards away), and its really hard to fix a mistake if you don't know what's going wrong. Seeing subtle stuff like prevented deaths or the ideas webmeister tossed out would help greatly.

Regarding the consumable scan, that'd probably be only suited for short term consumables instead of flasks and elixirs. A elixir/flask scanner would be better served as part of some Addon that scans the raid for missing buffs(maybe it already exists).

If you really wanted to make it intricate, you could also check for trinket/talent cooldowns. Like is this person clicking trinkets during heroism? Did a tank die even though no one had used Nature's Swiftness? This may only be possible if it was drawn from a lengthy raid combat log, although it might point out bad things if people went out to respec between bosses.

Offline
Reply With Quote
Old 05/08/08, 3:44 AM   #20
Medusa
Von Kaiser
 
Medusa's Avatar
 
Tauren Shaman
 
Gorgonnash (EU)
Originally Posted by webmeister View Post
I've been tossing around a few ideas for this sort of thing recently, since my professional life has so far focused on the research and analysis fields. I definitely think WWS needs some sort of analysis tool that can generate reports rather than just numbers.

A few ideas I've had include:
- a consumables report. Who consistently uses potions/healthstones versus who doesn't. Who dies while their pots/healthstones aren't on cooldown (ie they don't use them). Who uses flasks/elixirs/oils/food buffs etc.
- a "retard" report -- people who consistently take avoidable damage (eg Supremus volcanos, Doomfire, etc).
- a decurse/dispell report. Dispell counts by themselves are fairly meaningless; I want to see who is taking damage from dispellable abilities, organised by who eventually dispelled them. This shows you how quick/attentive your dispellers are (or aren't).

Yes, I'm aware that most of this information can be extracted from WWS with time and patience, but having tools that could automatically do this would be a massive help.

I'd put something like this together myself, but I don't have a lot of programming experience

Interested to hear other people's thoughts.
I realy like this ideas. I just remember how many times i just fail to track down whats go wrong or i need realy much time to scroll every single Combat log. Some time before i do it for Archimonde, to track death causes, but it was a long way to track the events. And now we have some problems with the new combat log (not showing death for example).

Most of it i like the -retard report- idea. And it should be trackable. Many Bosses has a lot of possible checks:
MShazzrah - Fatal Attraction tics
RoS - wrong / missed interrupts
Bloodboil - 2 Bloodboil debuffs - or someone forget to move
Teron Gorefiend - last 2 ghosts when Construkts doing damage to Raidmember
and so one

Offline
Reply With Quote
Old 05/08/08, 4:16 AM   #21
terjekv
Von Kaiser
 
Human Warlock
 
Shadowsong (EU)
Originally Posted by Pixen View Post
I guess my question would be, are the tools currently available to analyze raid performance really inadequate? I would think that just through WWS and general observation it'd be pretty apparent who's doing their job and who isn't. Also barriers to change aren't nearly as large in WoW raiding as in your example, the NBA.

I'm sure it'd be nice to have more precise tools, but I don't think the additional information you'd glean would be nearly worth the amount of effort it would take to model something like this.
There *is* information missing though, I miss proper time slicing, modeling of specific traits over time (how did the raids dps look over the course of the fight, how did the different bloodlust groups do during bloodlust and so on) and of course, yes, I'd like to compare this data to previous data to see how people are progressing. I'd also like to know exactly how much that feral druids aura contributed to the group he was in. I'd also like to see what selected sets of people were doing when the tank hit 42 health but lived through it. When did the last heal from each of his designated healers land? And then I'd want the possibility to move to their timeline and see where their time was spent, maybe I'll find that a stupid warlock did something that made him scream out for healing and drew the healers attention.

Finding this information isn't hard given the proper tools. The tools aren't even *that* hard to write. They just require an interface that doesn't think of itself as a glorified damage meter.

Yes, I've been working on something down this path, but no, I don't really have anything to show people unless you wish to see perl stubs. I could use a few proper combat logs though, and, well, I'd also like to see chat logs for the same raids at some point.

Offline
Reply With Quote
Old 05/09/08, 12:56 PM   #22
Yenadar
Piston Honda
 
Dwarf Paladin
 
Stormrage
I am actually willing to tackle a few of these ideas. Specifically the Retard Report, Deaths Averted, and Consumables.

It should be fairly easy to accomplish, especially due to the new combat log data, and especially if more than 1 person is running it, and it is syncronizing through the mod channel. If it is also saved from week to week, you can easily show a 'vs last week' comparison, and '4 week average' or something, and tie it into DBM or BW boss engage and boss death alerts for easy distinction. A bit of finess and you could easily make it similar to WWS, being able to look at the whole night,or individual boss kills/attempts.

Retard Report:
It would require information from each boss of the specific abilities, then watch for damage from them, and start tallying up the damage against players as it occurs. Even abilities that people will take a bit of damage from them, and the retard check is how fast you move away, is simply looking at how much someone took. Even random ones, like Mother. If someone gets it every single time, they will definately be high on the damage, but looking at the average per application is easy to see if the average is acceptably low. Granted, this can also be inferred with awareness and gut-reaction, but other bosses not so much. For example, Archi's doomfires. Damage taken from doomfire isn't quite accurate, but you could 1) uses of pvp trinket during fear (buff gained between fear gained and fear faded), 2) doomfire gained during fear, 3) doomfire gained without fear. Here the mod would look for the application through the high damage first hit (given a range, to account for talent reduction)

Deaths Avoided:
Simple enough. A few mods already do the same math with Ardent Defender saves. +1 to a healer when A) the size of their heal is greater than the amount of health remaining on the target and B) the next incoming hit is larger than the health value the tank was at, and C) that incoming hit was within a set period of time after the saving heal.
Can also show the differences between tanks. A tank with a really high # of saved counts vs a tank without puts into numbers healer gut reaction that "tank A seems to take more damage or is harder to heal". Only should be given to raid leaders, since you don't want healers competing to top this meter.

Consumables:
Really only useful on DPS burn fights like Brutallus, but I know my guild leadership would find use for it, since they already look to WWS the next day to check consumable usage counts. That plus the constant "The cauldron is still up!!! Make it disappear!!! Who doesn't have one yet!!!" Would be able to be quickly solved. (Similar to how Blizzard fixed the age old Raid Warning: "LOOT THE DOG!")

Are any of these as needed as a simple meter or WWS? Probably not. Would they still find use to raid leaders? I think so.

Last edited by Yenadar : 05/09/08 at 1:02 PM.

Offline
Reply With Quote
Old 05/09/08, 2:51 PM   #23
clavicle
Glass Joe
 
Blood Elf Warlock
 
Mal'Ganis
Originally Posted by Yenadar View Post
That plus the constant "The cauldron is still up!!! Make it disappear!!! Who doesn't have one yet!!!" Would be able to be quickly solved.
Well, assuming the entire raid is using oRA2 or CTRA, you can use their item check commands to see who's missing it.

Offline
Reply With Quote
Old 05/11/08, 4:39 AM   #24
Mosely
Glass Joe
 
Dwarf Priest
 
Lightninghoof
I assume you are looking for a way to capitalize on the objective nature of WWS to indicate who is "good" and who is "bad" in your raid. There is only one situation where I could see such information being useful: for a raider to gain leverage when applying to a new guild.

I believe that the only meaningful way to judge a player is in fact subjective, and any statistical approach to quantifying a raider's performance is bound to be flawed. Anyone willing to pay attention can quickly develop a sense for each raider's strengths and weaknesses - no need for an advanced WWS report for that. As a result, I am a firm believer that character references are the best raiding metric. Unfortunately, you will not find those in a WWS parse.

Offline
Reply With Quote
Old 05/11/08, 9:19 AM   #25
Sajukar
King Hippo
 
Sajukar's Avatar
 
-
Troll Mage
 
No WoW Account (EU)
Originally Posted by clavicle View Post
Well, assuming the entire raid is using oRA2 or CTRA, you can use their item check commands to see who's missing it.
Unless, like a large amount of people, they have item checks disabled.

Offline
Reply With Quote
Old 05/11/08, 3:16 PM   #26
Ghando
Bald Bull
 
Ghando's Avatar
 
Tauren Shaman
 
Mal'Ganis
Just the other day I was listening to a sports podcast where the host and his guest were talking about baseball statistics; specifically, which stats are the most creative/important and which stats were going to be the "next big thing." I feel like this thread is much the same way. We've gotten so good at gathering data and WWS reports are so crucial to getting the most out of your guild's performance. On top of this, encounters are tuned so tightly (kudos Blizzard!) that as a top-end guild you can't reasonably get by without these metrics. I really like the idea of generating new statistics/metrics by which you can measure raider performance, and as a healer I think you need to be willing to get creative when putting these metrics together.

I write a humor blog: http://idropthings.blogspot.com

Offline
Reply With Quote
Old 05/11/08, 6:31 PM   #27
Phlis
Don Flamenco
 
Phlis's Avatar
 
Draenei Shaman
 
Magtheridon
A "reaction time" metric could be interesting, just by comparing time stamps.

One easy thing: The amount of time a curse is on a player during archimond.

Something a bit more complicated: A Player dies, looking back at the time stamps, was their a heal being cast on that player? If so, how soon before he died was it being cast? When would it have landed if the player had lived 1 second longer?

Number of Ticks from Consecrates, Blizzards and Flamestrikes on Council.

There are a number of things which require quick reaction from players in individual encounters which could be measured in this way.

Offline
Reply With Quote
Old 05/12/08, 2:16 AM   #28
Ellyh
Don Flamenco
 
Ellyh's Avatar
 
Human Priest
 
Hyjal
Originally Posted by Phlis View Post
A "reaction time" metric could be interesting, just by comparing time stamps.

One easy thing: The amount of time a curse is on a player during archimond.

Something a bit more complicated: A Player dies, looking back at the time stamps, was their a heal being cast on that player? If so, how soon before he died was it being cast? When would it have landed if the player had lived 1 second longer?

Number of Ticks from Consecrates, Blizzards and Flamestrikes on Council.

There are a number of things which require quick reaction from players in individual encounters which could be measured in this way.
I'm not sure how well this metric can be measured by a mod. Does a friendly player get notified of the start of a cast by another player? if not you would require every single person to be running the mod and comparing timestamps would be exceedingly tricky because of latency. Already healers often see a heal land on their screen but then get informed that the target has died because of latency.

Also without a full log of everyone's actions and conditions you cannot determine what is slow healing and what is simply triage and cutting losses. Sometimes the person dieing is simply not high on the priority list. For example on council towards the end you are down to one raid healer due to random deaths and that healer has the choice of saving a rogue on interrupt duty or random hunter 3. I would heal the rogue and hope the hunter can pot or bandage. To really determine how things were going you would need to also analyse the hunter and the rogue to see if there was something they could have done to survive/take less damage. Simply giving the metric that the raid healer took 3 seconds to start casting on the hunter is not of any value in and of itself.

Last edited by Ellyh : 05/12/08 at 5:39 AM.

New Zealand Offline
Reply With Quote
Old 05/12/08, 8:15 AM   #29
Ish
Von Kaiser
 
Blood Elf Warlock
 
Draenor (EU)
Sounds like an awesome idea, problem with recruiting and maintaining a solid raider core is that you cannot always see the small details regarding a raiders performance, a new tool to evaluate your raiders would be most helpfull

Last edited by Ish : 05/12/08 at 8:35 AM.

Offline
Reply With Quote
Old 05/13/08, 9:46 PM   #30
webmeister
Von Kaiser
 
Human Mage
 
Blackrock
In reply to a few people above - the raw numbers and reports are never going to give you the full story. Even WWS can be very misleading.

For example, mage X only shows 2 decurses for an entire Archimonde kill. Maybe nobody near him got cursed, maybe he was letting a nearby druid do all the work. What would be more useful to me in this instance is seeing how good each person is at actually decursing - if people are taking 2-3 ticks of the curse before it's getting removed, clearly that isn't good enough.

The consumables report is something I would also like to see focused on who uses health pots/stones and why. Believe it or not, there are still people in my guild who don't use health consumables even when they're going to die; why, I don't know. But it's still an issue for us, and we're working on Illidan.

If anyone is actually thinking seriously about putting these sorts of things together, send me a PM!

Offline
Reply With Quote
Reply

Go Back   Elitist Jerks » Public Discussion » Public Discussion

Thread Tools

Similar Threads
Thread Thread Starter Forum Replies Last Post
Raiding without a raiding guild. deneba The Dung Heap 4 12/01/07 8:15 PM