The Nadu Situation ā€“ Mark Rosewater on Tumblr - eviltoast

The Nadu Situation

This has become a big topic in the community this week, so I wanted to add my thoughts to the discussion. My focus isnā€™t on the banning, but on the behind-the-scenes processes that led to it. Iā€™m Head Designer, so I want to focus on the design elements of the situation.

When we make Magic there are a few things we do to try and make it the best it can be. First, we design in what we call an iterative loop. That is, we make something, we playtest it, we get feedback, we make changes on that feedback, and begin the next iteration of the loop. We try to get as many iterative loops in as we can before the set is locked (aka ā€œno more changesā€).

No matter where we set that line, thereā€™s a last day to make changes. Moving that line earlier doesnā€™t change anything other than giving us less iterative loops to improve things. Also, we make lots and lots of last minute changes. The vast majority of them make the game better. I understand thereā€™s more focus on the times we make a mistake, but it represents a truly small percentage of the changes.

Also, whenever we design a card, we ask ourselves, who is this card for? If weā€™re trying to make game play the best it can be, it helps to understand who will use the card, where they will use it, and what they will do with it. Obviously, in a game as modular as Magic, the players can often zig when we expect them to zag, but in general, this process leads to the best design.

We have two play design teams, one focused on competitive play and one focused on casual play. The competitive play design teams determines which cards they think have a shot at competitive play (remember weā€™re making predictions as where we think the environment might go,we donā€™t definitively know; we need to make an environment complex enough as to entertain tens of millions of players). The casual play design team then looks as the cards that donā€™t play a competitive role to see what casual role they can play.

With that said, let me respond to a few popular lines this week:

ā€œStop designing for Commanderā€ - The nature of competitive formats is that only so many cards can be relevant. As you start making more competitive relevant cards, they displace the weakest of the existing relevant cards. Thatā€™s how a trading card game works. That means that not every card in a set (or even just the rares and mythic rares as the commons and uncommons have a big role making the limited environment work) has a competitive role. As such, we examine how they will play in more casual settings. Thereā€™s no reason not to do that. And when you think of casual settings, you are remiss if you donā€™t consider Commander. Itā€™s the 800-pound gorilla of tabletop play (aka the most played, heavily dominant format). Us considering the casual ramifications of a card that we didnā€™t feel was competitively viable is not what broke the card. Us missing the interaction with a component of the game we consider broken and have stopped doing (0 cost activations), but still lives on in older formats is the cause.

ā€œStop making late changesā€ - Whenever you see an airplane on the news, something bad has happened. It crashed, or caught on fire, or had an emergency landing, or a door fell off. Why do we still make planes? Because planes are pretty useful and whatā€™s being highlighted is the worst element. That focus can lead people to false assumptions. Magic would not be better if we stopped making last changes. A lot more broken things would get through (things we caught and changed), and many more cards just wouldnā€™t be playable. Our process of fixing things up to the last minute does lots and lots of good. Maybe it doesnā€™t get the focus of the screw ups, but it leads to better design.

ā€œEverything needs to get playtestedā€ - My, and my teamā€™s, job is to take a blank piece of paper and make something that doesnā€™t exist exist. Thatā€™s not an easy thing to do. I believe play designā€™s job is even harder. Theyā€™re trying to make a balanced environment with thousands of moving pieces a year in the future. And if weā€™re able to solve it on our end, that means the playerbase will crack it in minute one of playing with it. One minute, by the way, is the time it takes the Magic playerbase to play with a set as much as we can. There are tens of millions of you and a handful of us. There simply isnā€™t time in the day to test everything, so the play design team tests what they think has the highest chance of mattering. They take calculated gambles (based on years of experience) and test the things most likely to cause problems. Will things slip through? Thereā€™s no way they canā€™t. The system is too complex to not miss things.That doesnā€™t mean we donā€™t continually improve our processes to lower the chances of mistakes, but nothing weā€™re going to do can completely eliminate them.

Designing Magic is difficult. Next year is my thirtieth year working on the game, and I think we have the most talented team weā€™ve ever had. Plus, just as we iterate on the designs in a set, we iterate on design processes of making Magic. How we make Magic today is light years different, and I believe better, than how we made Magic when I started. (ā€If I have seen further, itā€™s because I stand on the shoulder of giants.ā€)

One final thing. Iā€™ve always pushed for transparency in Magic design. No one on the planet has written/spoken about it more than me. I truly believe Magic is better as a game because its players have the insight to understand what we, the people making it, are doing. We do ask for one thing in exchange. Please treat the designers who take the time to share with you the behind-the-scenes workings of Magic design with kindness. We are all human beings with feelings. Thereā€™s nothing wrong with feedback, but it can be delivered with common courtesy.

  • Evu@mtgzone.com
    link
    fedilink
    English
    arrow-up
    8
    arrow-down
    1
    Ā·
    2 months ago

    I admire the restraint it took to write calmly about a subject that must be pretty personal for Mark.

    I think Mark is misunderstanding what ā€œstop designing for Commanderā€ means. His response here would be more appropriate if fans were saying ā€œstop balancing for Commanderā€ ā€“ which of course nobody is. I donā€™t know about anyone else, but speaking for myself, when I say ā€œstop designing for Commanderā€ I mean ā€œstop printing undercosted legends with as many abilities as you can jam into a text boxā€. It is okay ā€“ preferable, even ā€“ if one card canā€™t do everything by itself.

    I think Mark is probably right about playtesting, in that no amount of additional resources would be enough to guarantee theyā€™d catch every mistake. But I still donā€™t love the ā€œeh, what can you doā€ attitude. I keep thinking, maybe they could hire a consultant with experience in an industry where rigorous testing is the norm. Thereā€™s got to be room to improve their processes.

    • Andrew@mtgzone.comM
      link
      fedilink
      English
      arrow-up
      6
      Ā·
      2 months ago

      Youā€™re absolutely right and Markā€™s straw man arguments like that are pretty frustrating. I have the same meaning as you when I say stop designing for Commander as Iā€™m sure the vast majority of others do. I donā€™t know if heā€™s being intentionally dishonest or if he just doesnā€™t get it still but it is 100% stop printing overstatted Commander cards that warp eternal formats and these ability soup engines-and-payoffs.

      Re: playtesting I wish they would come out and say what their playtesting process is. How many people are in each group, how long do cards get active testing, etc. Barring those details I kind of disagree that they canā€™t do more and while they definitely cannot catch everything, their process should be sufficient to not let a Nadu get by.

      • LovesThašŸ¦’@mtgjudge.social
        link
        fedilink
        arrow-up
        7
        Ā·
        2 months ago

        @andrew @Evu any process will have changes that occur without testing. Unless the process is willing to miss shipping dates.

        I think the design crime with Nadu was the fear of shipping a bad card after nerfing the card. Not realising the modification was risky is something professionals should know: novel abilities are risky.

        • Spzi@lemm.ee
          link
          fedilink
          English
          arrow-up
          4
          Ā·
          2 months ago

          the design crime with Nadu was the fear of shipping a bad card after nerfing the card.

          Thatā€™s an excellent point. Because, put that way, whatā€™s so bad about shipping a bad card? People will read it once and never look at it again. Like most cards in a set. So what? On the other hand, making it too strong has grave consequences.

          I think the feature creep is caused mostly by greed on both sides; company and players. Company wants to make more money, so needs incentive for players to keep buying. Players want ever stronger cards, and company delivers. Like you canā€™t make the new set weaker than the previous, because of sales.

        • Semjaza@lemmynsfw.com
          link
          fedilink
          arrow-up
          1
          Ā·
          2 months ago

          With Oko, the GU Titan, and now Nadu (and Iā€™m sure Iā€™m missing others) I think theyā€™re should be an earlier end date for buffs so we donā€™t get quite as many it seemed weak after tweaks so we buffed it at the 11th hour and released without proper testing.

    • Spzi@lemm.ee
      link
      fedilink
      English
      arrow-up
      4
      Ā·
      2 months ago

      ā€œstop printing undercosted legends with as many abilities as you can jam into a text boxā€

      So much this. So often I come across a card. Start to read. Nice! Continue reading. Whoa, nice! And then Iā€™m only half through.

      I then like to ask myself if this card would still be nice if it had less/weaker features. And then Iā€™m shaking my head again, going AngryVideoGameNerd ā€œWhat were they thinking!?ā€.

      Examples:

      • [The End]. Exiling any number of copies is strong on itā€™s own, doesnā€™t have to become cheaper at low life.
      • [Ocelot Pride]. Not sure if it needs first strike. It definitely does not need the extra with the Cityā€™s Blessing.

      I feel there are much better examples, but I wanted to stop thinking about it.

      • Evu@mtgzone.com
        link
        fedilink
        English
        arrow-up
        4
        Ā·
        2 months ago

        I feel there are much better examples, but I wanted to stop thinking about it.

        A relatable sentiment.

  • Mike@mtgzone.comM
    link
    fedilink
    arrow-up
    7
    arrow-down
    1
    Ā·
    2 months ago

    I think this is just all a bad take from Mark. I understand his position and that this blog is mostly a defense for WoTCā€™s decisions, but this just misses every one of the complaints for me. Heā€™s basically saying ā€œthis is hard, Iā€™ve been doing this for 30 years, trust usā€ while not addressing the actual complaints.

    To me these are arguments why Maro, Michael Majors, and the entire FIRE team should be let go and new people brought in. Doing this for 30 years and still making these mistakes means that someone else is making the decisions and those decisions are not and wonā€™t be in the best interest of the game.

    • Spzi@lemm.ee
      link
      fedilink
      English
      arrow-up
      6
      Ā·
      2 months ago

      this just misses every one of the complaints for me. Heā€™s basically saying ā€œthis is hard, Iā€™ve been doing this for 30 years, trust usā€

      I donā€™t know what exactly these complaints are, but I also stumbled over this passage. Sure, making magic is hard and you cannot test everything in such a complex system.

      Itā€™s also clear that there has to be a last day for the changes, and thus some changes will be late. Although, I argue, if you keep making changes in the last 5 minutes, that probably hints at your testing period being too short.

      Itā€™s not a given that ā€œwe only have so much timeā€. Itā€™s an economic decision made by management; how much they value testing. They surely try to strike a balance between testing enough and making the most profit. Which is the whole point of this comment.

      Despite him claiming otherwise, of course a different, more qualtiy-focussed approach is possible. For example, one rather extreme version would be ā€œwe only release a set after we found nothing worth changing for 3 consecutive months in testingā€, just to illustrate the range of possibilities. One can move fast and break things, or be very cautios but move slower.

      Though Iā€™d rather have a profit-oriented MTG with too little testing than a bankrupt; or no MTG at all, although thatā€™s probably a false dichotomy.

    • Semjaza@lemmynsfw.com
      link
      fedilink
      arrow-up
      4
      Ā·
      2 months ago

      Unfortunately I donā€™t think that changing all those people will change Hasbroā€™s corporate culture.

      Theyā€™ll milk Magic for all itā€™s worth, Maro tends to spin it as best he can and is a corporate animal but he does love the game. Weā€™ll be worse off when he is replaced by a corporate stooge.