When tech companies need to understand marketplaces, and tens of millions of dollars are at stake, some of them are turning to a new kind of researcher
When Tom Blake was on the job market in 2012 as an economics Ph.D. student, he assumed he would land at a university or a government research department. But Blake, then studying at the University of California, Davis, accepted an on-site interview from San Jose, Calif.-based eBay. He remembers the moment during the visit when he decided he might be ready to leave academia behind.
"I was with one of the data scientists, and I started asking him questions about who has access to the data and how you get access," Blake says. "He was quite befuddled. I had come from academic research, where data has to be begged for. After some probing, I realized that he had direct access. I realized that I would be totally unfettered in my ability to get to the bottom of any question."
Blake joined eBay Research Labs that year and became part of the small, but growing, band of Ph.D. economists doing economic research in technology companies. One might call them the "techonomists." Some are part of a research staff within a firm and spend all their time on economic research, while others work within a business unit of a firm while doing research as well. Whichever category they fall into, they're in a relatively new type of job: Although economists have long worked in private companies in a handful of traditional roles — like finance, litigation consulting, and economic forecasting — the staff economist carrying out research in a technology firm, and sometimes publishing his or her work, is largely a 21st century development. (Additionally, non-technology firms have been hiring economists, not necessarily Ph.D.s, to mine the firms' large datasets for economic insights.)
Many of the high-profile tech firms of Silicon Valley and elsewhere have techonomists on board; in addition to eBay, the club includes, among others, Airbnb, Amazon.com, Facebook, Google, Microsoft, Netflix, and Pandora. Some of these companies also engage academic economists on a part-time basis to work with their in-house economists. The problems that techonomists are stalking with big data range from marketplace design to digital advertising strategy, from online search behavior to pricing.
Susan Athey of Stanford University, formerly chief economist at Microsoft on a consulting basis, says she is regularly contacted by firms and recruiters who are seeking pointers to possible candidates for such positions. "The flow seems to be increasing," she says.
Mike Bailey, Facebook's economics research manager, agrees. "It definitely seems like it's growing at a fast pace."
The Tech Industry's Allure
Bailey started at Facebook as a research intern in 2011 while he was a Stanford doctoral student. Like eBay's Blake, he too was enamored of the data. "It quickly became clear that working at Facebook would have a lot of advantages over academia," he remembers. "I would be able to continue to work on cutting-edge economics problems, but I would have access to amazing resources — a one-of-a-kind dataset."
For some techonomists, another attraction is the chance to influence the course of a major enterprise. Justin Rao, an economist at Microsoft Research in Redmond, Wash., says, "I've recently had conversations like, 'Justin, do you believe this? Because we'll do it if you do.' Often, we don't have that feeling in academia; you might be falsified in academia via replication, but maybe not. Here, you get put in positions where it will be revealed if you are right or wrong, denoted in tens of millions of dollars."
Blake concurs. "One of the unexpected perks was the actual ability to shape a marketplace," he says. "There's a great deal of satisfaction in it; it's nice to see the rubber meet the road."
He recalls the outcome of research with co-authors on the effectiveness of online search ads. "Academically, it led to publication, which is always nice" — it appeared in Econometrica in early 2015 — "but internally, it led to a lot of direct actions, and the way money is allocated was changed quite dramatically."
Still another plus of working at a tech company, as some see it, is tackling a variety of questions rather than specializing. "I enjoy working on a wide array of problems," Bailey says. "In academia, you are rewarded for building deep expertise in one area, which takes investing years of work into a few projects; that just didn't appeal to me in the end."
Rao explains, "As a professor, you're going to dig into a specific topic and become an expert on that topic. If that's the marathoner approach, I've been asked to become like a middle-distance runner on a lot of topics."
But why would a firm unilaterally share hard-won insights and risk losing a competitive advantage? One reason is that the techonomists see value in having their work vetted by their peers in the academic community. When confidentiality is at a premium, they may pursue that goal by discussing their work with an academic who is affiliated with the company; these academics often have spent time as scholars in residence at the firms and have confidentiality agreements in place. In many cases, however, the desire to obtain additional insights from the academic community in general through broad disclosure of the research outweighs immediate competitive concerns.
Probably the most important reason the firms allow publication, though, is that when they're hiring, the freedom to publish enables them to attract a higher caliber of economist candidates. "It does help with recruiting," says Blake. "And it's important to folks like myself with academic backgrounds because we want to share these really awesome insights that we get out of looking at our data."
As these firms see it, the strongest economics Ph.D.s want to remain part of the discipline's scholarly conversation. That's especially true of Ph.D.s who think they may want a faculty job someday. "If you're recruiting people in the job market and you offer the likelihood of publishing good papers, you're offering someone a lot of career option value," says Rao. (Rao credits Athey, who founded the economics research group at Microsoft in 2007, with instilling that approach within the group.)
Ideas of openness that are espoused by Internet companies can help techonomists make the case for publishing when it raises concerns. "We operate a transparent marketplace," Blake says of eBay. "The notion of 'open and transparent' really resonates with eBay's values, and when we appeal to that to get papers published, that has always gone over very well."
The Techonomist's Path
A decade ago, techonomists didn't have a distinct career path; for the most part, they were senior-level academics whose next move would likely be returning full time to academia. That is changing as more firms start economics groups and as those with groups expand them.
"Smaller companies will contact us and say they're looking for a chief economist and they want to grow a group," says Rao. "Everyone's seeing that, and that makes it easier for us to recruit. We can recruit people who want to be chief economist somewhere one day, and we say, 'Oh, yeah, you can do that. Be with us for five years.'"
Some believe the growth of economics in tech companies is benefiting West Coast economics departments. "It's been great for our students," says Stanford's Athey. "For example, we had students working with Airbnb who wrote novel research papers. Sometimes what happens is a grad student or young faculty member forms a relationship and expands it into a long-term business role that is very symbiotic with their research."
Bailey observes, "I have spoken to a few students and faculty who indicated that one attractive feature of Stanford and Berkeley was proximity to technology firms." Facebook invites local faculty to give talks there and recruits their students, he notes.
And what are the companies looking for when they do? To be sure, the firms may come to the recruiting process with some cut-and-dried criteria in mind — for instance, a background in empirical work in general and, perhaps, in a subfield like industrial organization, in particular. And academic departments and tech companies alike value collegiality.
But the unique setting of a tech firm may lead them to other intangible criteria, as well. "A fundamental part of our job is speaking many languages," says Blake. "We have to be able to communicate with a really diverse set of people — businesspeople with their MBA vernacular, lawyers, finance people, a lot of engineers — to get them to understand what our hypothesis is or what we believe is happening in the market.
"Researchers who want to hole up in their offices and just work on their own thing and push the papers out would be a bad fit," he adds. "But for folks who do want to engage and who enjoy having coffee with engineers and explaining to them why they think they found the coolest new feature, that's somebody who does very well here."