RNTop comment: @RichardMCNgo “People might say that they’re there mainly to have impact or to have fun or various other things. Occasionally that’s meaningfully true (especially for people who didn’t come in through the standard elite university pipeline). But typically their conceptions of impact or fun is inherently bound up in being near concentrations of wealth and prestige, such that they struggle to imagine futures where these come apart. In which case saying they’re pursuing the latter seems more accurate. Certainly when I joined DeepMind and OpenAI I had a very underdeveloped ability to steer away from centers of wealth and prestige, and flinched away from the possibility of my moral reasoning concluding that I should do something weird or self-sacrificing. Because of this I’d feel like a hypocrite saying that other people should do much less wealth/prestige accumulation than me. But if you’ve been at OpenAI or Anthropic even for a year or two, then you’ve accumulated enough that there’s no good reason to avoid thinking creatively about what doing something very new and very interesting might look like. Though in practice such thoughts are hard to have while at those companies, as per the dynamics in my tweet below. So realistically the actual choice is to quit/take a sabbatical to have time to think expansively, or else chug along for a few more years until the nagging feeling that you’re stuck in tunnel vision accumulates enough to feel viscerally bad.”