SAN FRANCISCO – Jobs centered on data have been falling into Ana Bertran Ortiz’s lap since she finished her electrical engineering Ph.D. in 2007.
The jobs all come from her command of statistics, making her a beneficiary of the growing demand by U.S. employers for so-called data scientists who can analyze and manipulate the mountains of information generated and stored in the Internet age.
Harvard Business Review last year called this profession the sexiest job of the 21st century.
One measure of demand: Hours billed for work in statistical analysis grew by 522 percent in the first quarter compared with the same period in 2011, according to data compiled for Bloomberg by oDesk Corp., which runs an online service connecting employers with remote freelancers.
Time billed on oDesk for all categories of work in the same time span grew by 135 percent.
In most areas of the modern economy, math and statistics have never been more important, said Susan Athey, an economics professor at the Stanford Graduate School of Business. As firms get more and more data-driven, there become fewer and fewer careers that don’t require those skills.
Bertran Ortiz got her start designing algorithms for a NASA lab to measure sea levels from outer space and orchestrate the landing of the Mars rover.
She’s now working on software that automatically diagnoses glitches in the networks that house the world’s ever-expanding trove of information.
I knew that in electrical engineering, it was very important to understand the randomness of data, Bertran Ortiz said. But I didn’t think it would become so important outside of my field.
Unlike statisticians of a previous generation, data scientists work with information sets so big – far too large and unwieldy to fit into an Excel spreadsheet – that they need to write extensive computer code to extract the right segments.
Often, this data is on a scale that requires multiple servers to even access the numbers. After that, the analysts run calculations to discover the patterns they’re looking for.
The scope of data collection is widening in the private and public sectors, a shift that was highlighted recently with the disclosure of the existence of secret U.S. government programs that collect data on U.S. residents’ telephone calls and foreign nationals’ Internet activity.
The national security industry is among the biggest employers of big-data professionals, according to an analysis from Burning Glass, a job-matching company in Boston.
Douglas Puett runs pattern analyses for Pulse, a news aggregator that was acquired by LinkedIn Corp. in April. Every day, the 25-year-old peers into the mobile application’s logs to track figures, including which news outlets are keeping readers most engaged.
Armed with those numbers, Puett helps Pulse’s product team make decisions such as how to tweak the algorithms that suggest news stories. He also helps design, run and analyze experiments to make sure product changes lead to positive results.
He didn’t even know a job like this existed until he was halfway into his master’s program at Columbia University in New York.
The challenge for employers is that there aren’t enough Douglas Puetts, with the multiplying trove of information likely to further exacerbate the shortage of these analysts.
By 2020, all the digital data created, replicated and consumed in a single year will grow to 40,000 exabytes, or 40 trillion gigabytes, according to a December study by technology research firm IDC. That’s a 300-fold increase from the 130 exabytes in 2005.
It’s so cross-functional and you need multiple skills – you need programming, you need statistics, you need visualization, you need database skills, said Harpinder Singh Madan, co-founder and head of product and marketing at Slice, a startup that helps consumers track and analyze their emailed receipts. The bottom line is that there’s no institution that trains for this.
Businesses are improvising, pulling people from all kinds of backgrounds that require an understanding of statistics. They’re former nuclear physicists, neurosurgeons and marine biologists, many of whom hold doctorates in their previous domains.
There are a lot of people who have experience in statistics, and people need to look outside the traditional places to hire more analysts, said Bertran Ortiz, the electrical engineering Ph.D. who earns more than $100,000 at Virtual Instruments, a San Jose company that monitors the health of data storage networks.
You need some theoretical background, but you also need to be able to apply it in the real world, she said.