GDC Online 2011: Day 2 Live Blog Coverage

Today's GDC Online 2011 coverage kicks off with a live blog of the 'Rapid MMO Content Iteration and Validation with Spatial Analysis in Star Wars: The Old Republic' talk with speaker Georg Zoeller.



For the live blog in full, hit the jump.

Live Blog


  • 1:35: Starting, Introduction

  • 1:38: Georg Zoeller: KOTOR was about 60 hours of content, SWTOR is an astoundingly more than this. Managing this massive volume of content is the focus on this talk.

  • 1:41: I talked two years ago about DA:O, about making a massive title. I had not idea how small that was. A single section of Tatooine has more creatures in it then the entirety of DA:O. A single class will spend between 6-10 hours on Tatooine alone; 15 if you are a completionist. This is only the class content.

  • 1:43: How do you create and manage content on that scope? You need lots of resources, smarter workflow, and smarter tools. The second and third will be what I focus on.

  • 1:46: One testing weekend can generate 100,000 pieces of testing feedback. The different types of feedback we are dealing with are: Testing forums, screenshots, /bugs, context sensitive surveys, chat log, customer service tickets, in-game feedback. This is all the active feedback, a small section of players actually supply. We take this player feedback and filter it through our metrics to determine what actual actions are needed.
  • 1:53: All of these metrics are important when you add the spacial component. Where do players clump up, where do players die, where are the complaints coming from. Using heat maps we can look at planets and see exactly where people are dying but more importantly what class of what level are dying.

  • 1:57: We developed a content tool that we use on SWTOR to analyse any content with x,y, and z data points. We can then quickly share that data within the studio using the tool kit. We can generate heat maps that we can then click on to instantly go to that map and location. For an example, we will look at Tython. First we get player feedback that is useful but not normally clear enough to be useful by itself. We can then jump into the tools to pull up metrics to examine the areas in question (in this case a map on Tython).

  • 2:00: We studied death a great deal. This is why we re-examined the death penalty system. This is why we added the medical probe, to give players that single player feeling of reloading after a tough fight to try again. We found that death penalties are generally negative and unnecessary. After metrics are drawn up, we add content data to compare the metrics to content. The data can tell us things such as, "are the players on level to the monsters they are fighting in general?" We tend to find that many places people are two levels under level. We can then take this information to alter the content to make it more fitting.

  • 2:05: We also track whether the players are playing solo or in group and this helps us to find when players are or aren't grouping and whether the content is too difficult or not. Another example is looking for player feedback when they are confused. We can then look at the chat logs for key phrases such as "How do I.." "How does...", etc. We can see when people ask these questions in chat and what they are asking about to help us find tutorial points or places for clarification. These word clouds can even be placed over a heat map to make it that much easier to see where a player is standing when they ask a question.

  • 2:10: We can also use the chat log for "bug," "broken," "bugged," questnames, etc. This helps us find issues that players don't take the time to do a bug report on. We can use these tools to check performance optimization. We use drawcall metrics from bot driven sampling systems then check this data to tell us how many rendered, active objects are in certain areas that a player's computer will have to generate. We can also do this with terrain and foliage. Knowing instantly where speedtrees are located vs. static trees to see where we might be over using or under using certain assets.

  • 2:15: We can generate all these maps in 3D to let you find metric points without heavy filtering. This works well because the game is in 3D and we can look on multiple levels adding to verticality. Other applications include behavioral analysis. For example, given a perfectly symetrical t-junction, 68% of the players will go right. This is good to know when designing content. We also use fog of war to find what areas people never see. Without fog of war, our testers would pass through entire planets without a single person going to some areas. After adding fog of war our heat maps showed players going to every piece of the map seeing all the content.

  • 2:25: Question: Your metric tool set is extremely complex and impressive. Was this integrated from the beginning or added in later?

    Answer: We didn't have this integreated in the beginning. We found as the game grew it was needed to look at the informaion in a better way. We examined the Hero data and slowly filled in the tool.

  • 2:25: Q: How do you stop or catch leaks?

    A: With all the data tracking we have we can see a single ability used at a single location for every player. If a leaked video shows a player wearing a certain piece of armor or doing donuts on a speeder in a certain zone we can find them very easily.

  • Talk Over

Comments

Page 1 of 2
  • 1
  • 2
  • #17 agentwred
    That is awesome. I wish I could have been at these discussions.
  • #12 Zomeguy
    Interesting stuff. Surprising how much detail they can track.
  • #10 darthwhatwhatwhat
    Seems like nice tools, but with all that information you still need people to take conclusions. I hope their staff is large enough for these kind of things.
  • #8 Dejarik
    KOTOR 60 hours of content?

    I guess Georg spent a lot of time paused during combat considering his next move...
  • #9 Echo2Omega
    If you took the time to engage in the comversations and to all of the side quests and whatnot then 60 hours or so is about right.

    However if you skip everything and just do the bare minimum required to complete the game I am sure you could do it significantly faster....but why would you want to do that?
  • #13 WalterPeck
    Actually I engaged in all convos and consider myself a completionist and it only took my 34 hours of gameplay to finish KOTOR. Each playthrough after that averaged mid 20s (because I knew where to go after that).

    In addition, the whole 200+ hours per class seems to be overestimated as well considering the leveling pace of beta. Yes, yes, I know it's only beta blah blah blah. Hopefully they tweak the speed of leveling for release or people will be at level 50 with 4 days (hard core) and a week or two for the 3-4 hr a day casual.
  • #15 Meglivorn
    I hope not! I don't really understand why the rush for the level cap, instead of enjoying the game itself :(
    I still remember that it took me months to get my first lvl 60 character in wow (and I still play with that for 6 years).
    People now tend to rush through the content, want everything at once and immediately, and than whining about not having anything to do and the content is too small/easy.
  • #16 L'innommable
    Powerlevelers enjoy the game as well. Differently.
    To give a psychological explanation, some feel incomplete and weak as long as they have not reached the level cap.
    Secondly, in old school MMOs, in which the quests consisted in killing ten rats after reading a scrolling text, most consider other departments such as endgame activities funnier.

    Now ToR will address the second, but not the first.

    Food fort thought.
  • #14 MisterBlackJack
    Idk if it takes 8-10 hrs to do the class stories on tatooine and 15 for completionist then 200 hrs per class could be realistic
  • #2 Lanval
    I thought the last answer was very interesting.
  • #3 Drauul
    Sounds like agents in the Matrix to me lol
  • #7 Drauul
    "certain piece of armor" means leather trench coat and armless sunglasses
  • #6 fireyredmystic
    We will find YOU!
  • #4 Kraxis
    Would be cool if they jumped in and first crushed the guy with a mob or two, then called him out on it, before finally banning his ass.

    Charming... yes? http://imgur.com/r6WrI

  • #5 Muskaan
    Big brother is watching you!
  • To post a comment, please login or register a new account.

Most Commented Articles