Meet Your New Boss, Mr. Algorithm

Comment

Image Credits: Kumar Appaiah (opens in a new window) / Flickr (opens in a new window) under a CC BY-SA 2.0 (opens in a new window) license.

Meet Algo, your new boss. It’s flexible, willing to change work schedules so you can work when you want, and not when you don’t. It’s reasonable, providing you honest feedback without the politics of your last human boss. And Algo will find new projects for you to complete, so you always have something interesting to work on while receiving a paycheck.

The best part is, “Algo” is pretty much here.

We all know the story about algorithms and work the past few years. Service jobs across the country are increasingly being managed with the help of mathematical models of customer demand, revolutionizing everything from taxi driving to food delivery, home cleaning, and laundromats. I have argued that the increased autonomy and flexibility of these jobs means that algorithms are taking over unions as the primary driver of workers’ rights in the 21st century.

But now, startups are starting to move up the corporate ladder, using algorithms to improve and disrupt professions that up until recently have seemed almost completely insulated from the efficiencies of computation.

Two Boston-based startups, HourlyNerd and Quantopian, are using sophisticated algorithms to compete with some of the most-well known firms in consulting and quantitative finance, respectively. As they begin to disrupt these two industries, both hope to expand and democratize their professions to anyone with the talent and desire to work.

If they are successful in their ambitions, we may start to see a world where elite and inaccessible credentials are replaced by performance-based reviews, creating a much more meritocratic workforce than we have today. It will also provide workers with far more flexibility in their daily lives, something that is heavily demanded by today’s workforce. And while flexibility does often come at the cost of job security, this new wave of startups promises to provide great livelihoods to a wider number of people.

Consulting Needs A New Consultant

There is a running joke about consultants: they charge you a lot of money to tell you what you already know. While top management consulting firms may emphasize their unique skillsets and talents to prospective clients, the reality is that the vast majority of consulting work falls into a handful of routine project types like competitive analysis, new market entry, and product pricing that most MBAs are trained in business school to perform.

HourlyNerd is hoping to open up the consulting profession by connecting potential clients through a marketplace to their large number of independent consultants. They have already seen significant traction, with several five-figure projects completed and several larger ones in the works.

The company was founded in January 2013 by Rob Biederman and Pat Petitti, two MBA students from Harvard Business School who thought that the current model of consulting just didn’t make sense in a world of flexible workplaces and democratized marketplaces. Based on their own experiences in management consulting and investment banking, the founders designed a product for companies looking to hire top consulting talent at more wholesale rates than full-service firms provide. The company caught the eye of investors, garnering $4.8 million in capital from the likes of Highland and Greylock earlier this year.

Traditionally, a group of consultants, led by an engagement manager and backed up by a coterie of associates and analysts, decamp to a client’s corporate headquarters for 3–6 months to conduct interviews, collect data, and perform analysis to come up with a solution to a defined business problem. These consulting deals are often worth millions of dollars, preventing all but the richest companies from getting access to top talent. At the same time, the consulting team gets worn out from the grueling weekly travel schedule.

HourlyNerd sees itself as both more responsive and more valuable to companies. The startup guides perspective clients through building a project proposal and selecting talent, using algorithms and previous performance data to find the right match. Unlike consulting firms, which may take weeks or even months to get a team in place, HourlyNerd may be able to connect a company to a consultant in just days, accelerating the business cycle for managers.

On the other side of the marketplace, the company recruits MBAs from top schools, with the hopes of expanding the talent pool as it learns more about the qualities that make for the best consultants. When they first start, new consultants are put on relatively simple projects to gauge their abilities. As they prove themselves to clients, they transition to projects that are more complex.

For consultants, the top benefit of the platform is the flexibility. They can travel the world while earning money a few weeks at a time, or they can work full-time, but only on projects of their choosing. That level of control is unique in the industry, and a key selling point to entrepreneurial business students who otherwise have valuable competing offers to consider.

Using Algorithms In Algorithmic Finance

Quantopian has a simple vision for the future of algorithmic finance: at home, in shorts and a t-shirt. The startup is developing an algorithmic trading platform that will allow quants from anywhere to craft their own investment strategies and potentially strike it rich.

When TechCrunch first discussed the company last year, the startup was still building out its trading platform and algorithm design tools, and ignoring how it was going to make money. Now, with its platform fully formed and flush with a brand new round of capital from Bessemer to the tune of $15 million, the company is preparing for an even more audacious goal: the first democratized hedge fund in the country.

The company, led by CEO John Fawcett, is hoping to eventually open its platform to all investors so that anyone with the right performance track record will be able to manage a part of a central pool of capital – and profit from the returns. That’s a massive change, since today’s hedge fund managers can’t just be excellent quants, but must sell their ideas to prospective limited partners, a rarefied world that is mostly inaccessible to all but bankers on Wall Street.

Quantopian will constantly monitor the strategies of all the algorithmic traders on its platform, identifying those with the best returns with minimal risk. It will then build and adjust its portfolio to carefully select a balanced set of these strategies. Instead of the one-hit wonder that plagues the hedge fund industry today, the startup believes that it can create sustainable growth as it moves from one effective algorithm to another.

The challenges to its model though are legion. As Fawcett explained to me recently, building such an algorithm is extraordinarily difficult, since there are real challenges in balancing how algorithmic traders use their own accounts with how they might trade with others’ capital. There are also complications arising from the diversity of algorithms that might be used on the platform to the risk models available to Quantopian to judge them. These issues are vexing, but not intractable.

Algorithms And The Workplace

It may seem weird that your human boss could be replaced by a computer, but that unfamiliarity is likely to be soothed by the freedom of the work that you will be able to do in the future.

For the first time, independent professionals may have better access to interesting projects than even the best firms in their industry. They will have a global network of opportunities to select from, which not only makes work more interesting, but also brings new challenges that will allow these professionals to develop their careers more rapidly.

Perhaps even more importantly, professionals will be able to cross marketplaces, breaking the categorization that is endemic in these fields. A doctor who wants to do business consulting on the side will be able to do so, improving their practice. Rather than putting workers in boxes, this new wave of startups has the ability to usher in a unique period of creativity for talented people.

And we are likely to see more of these startups.

Zavain Dar, who recently joined Lux Capital as an investor, believes that algorithms are hitting their stride due to a confluence of three factors. First, we finally have the data infrastructure to be able to process lots of data, using technologies like Hadoop. Second, we now have the ability to digitize massive data into unstructured datasets, often stored in the cloud. Finally, we have the ability to analyze this unstructured data in intelligent ways that were impossible just a few years ago.

That’s in part why we are seeing this move up the corporate ladder by startups. Up until now, most talent marketplaces have been based around demand forecast models, in which workers are matched with clients as needed, whether that means getting a vehicle to a certain part of a city or a meal to a home. While certainly not a trivial task, these algorithms are also common enough to be readily implementable.

But what about managing a hedge fund portfolio or identifying the best consultant for a project? Suddenly, there is much more nuance involved, and the algorithms will have to become equally sophisticated.

Dar emphasizes the product feedback loop. “From a venture perspective, it is surprisingly easy to be an entrepreneur and look at a cool dataset and a cool algorithm and have the infrastructure to use it, so that you can go and build a startup. I don’t think that is going to be a long-term company.”

Instead, he emphasizes that entrepreneurs should build products that can use data to make the algorithm better over time. “Everyone knows how Google’s algorithm works, but no one has the same data that Google has to train that algorithm and make it work really well. They have probably the most proprietary and valuable dataset, which is the clickstream data.”

That is perhaps the best point of these sorts of elite talent startups. As more people and projects join them, the quality of their algorithms will increase, creating a positive cycle of improvement.

Yes, There Are Dangers

Of course, there are real concerns as we move away from traditional models of employment to more flexible ones.

Job security is conditioned on performance, but what happens if a client is unhappy and tries to end your career by destroying your credibility? Startups will have to balance the desire of clients wanting past performance data with the need to recognize how talent develops over time, so that an early mistake in a career isn’t deadly to a worker’s future prospects.

Coupled with performance is simply the issue of salary security. If you don’t work, you don’t get paid. That means that parents who would like to take time off to be with their newborn, or a worker who gets sick and needs to take leave will be able to do so, but at a direct financial cost. There are likely ways to mitigate such impacts, but these are real challenges to solve.

Beyond individuals, automation and efficiency have already eliminated entire professions and downsized others. Companies no longer account for their profits using rows of humans crunching numbers, and telephone operators are no longer a typical occurrence when we dial long-distance. Up until now, automation has been far less common in white-collar and elite professions like medicine, law, banking, and consulting.

That is changing, and fast. Ten years ago, the market for lawyers in the United States was healthy, taking in thousands of new legal graduates a year with salaries far more than double the median income in the United States. Now, the market has cratered, with many graduates reporting that the best jobs they can find are paying $12–15 per hour. Dozens of legal startups like RocketLawyer and LegalZoom offer services that used to cost thousands of dollars for just a fraction of that price.

So far, the fate of lawyers hasn’t yet befallen management consultants or bankers. But what happens when work becomes cheaper in these professions as well? Ironically, the great income inequality that we have witnessed over the past 30 years may end up becoming even more acute.

Ultimately, our best bet may be a market that is a combination of the old and the new, perhaps driven by algorithms in the middle helping us match work to workers. Such a hybrid market will allow us to choose between extreme flexibility and no security, or security with limited flexibility. For the first time, we will have a say in the matter, and all we have to do is ask Algo.

More TechCrunch

The Series C funding, which brings its total raise to around $95 million, will go toward mass production of the startup’s inaugural products

AI chip startup DEEPX secures $80M Series C at a $529M valuation 

A dust-up between Evolve Bank & Trust, Mercury and Synapse has led TabaPay to abandon its acquisition plans of troubled banking-as-a-service startup Synapse.

Infighting among fintech players has caused TabaPay to ‘pull out’ from buying bankrupt Synapse

The problem is not the media, but the message.

Apple’s ‘Crush’ ad is disgusting

The Twitter for Android client was “a demo app that Google had created and gave to us,” says Particle co-founder and ex-Twitter employee Sara Beykpour.

Google built some of the first social apps for Android, including Twitter and others

WhatsApp is updating its mobile apps for a fresh and more streamlined look, while also introducing a new “darker dark mode,” the company announced on Thursday. The messaging app says…

WhatsApp’s latest update streamlines navigation and adds a ‘darker dark mode’

Plinky lets you solve the problem of saving and organizing links from anywhere with a focus on simplicity and customization.

Plinky is an app for you to collect and organize links easily

The keynote kicks off at 10 a.m. PT on Tuesday and will offer glimpses into the latest versions of Android, Wear OS and Android TV.

Google I/O 2024: How to watch

For cancer patients, medicines administered in clinical trials can help save or extend lives. But despite thousands of trials in the United States each year, only 3% to 5% of…

Triomics raises $15M Series A to automate cancer clinical trials matching

Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. Sign up here for free — just click TechCrunch Mobility! Tap, tap.…

Tesla drives Luminar lidar sales and Motional pauses robotaxi plans

The newly announced “Public Content Policy” will now join Reddit’s existing privacy policy and content policy to guide how Reddit’s data is being accessed and used by commercial entities and…

Reddit locks down its public data in new content policy, says use now requires a contract

Eva Ho plans to step away from her position as general partner at Fika Ventures, the Los Angeles-based seed firm she co-founded in 2016. Fika told LPs of Ho’s intention…

Fika Ventures co-founder Eva Ho will step back from the firm after its current fund is deployed

In a post on Werner Vogels’ personal blog, he details Distill, an open-source app he built to transcribe and summarize conference calls.

Amazon’s CTO built a meeting-summarizing app for some reason

Paris-based Mistral AI, a startup working on open source large language models — the building block for generative AI services — has been raising money at a $6 billion valuation,…

Sources: Mistral AI raising at a $6B valuation, SoftBank ‘not in’ but DST is

You can expect plenty of AI, but probably not a lot of hardware.

Google I/O 2024: What to expect

Dating apps and other social friend-finders are being put on notice: Dating app giant Bumble is looking to make more acquisitions.

Bumble says it’s looking to M&A to drive growth

When Class founder Michael Chasen was in college, he and a buddy came up with the idea for Blackboard, an online classroom organizational tool. His original company was acquired for…

Blackboard founder transforms Zoom add-on designed for teachers into business tool

Groww, an Indian investment app, has become one of the first startups from the country to shift its domicile back home.

Groww joins the first wave of Indian startups moving domiciles back home from US

Technology giant Dell notified customers on Thursday that it experienced a data breach involving customers’ names and physical addresses. In an email seen by TechCrunch and shared by several people…

Dell discloses data breach of customers’ physical addresses

Featured Article

Fairgen ‘boosts’ survey results using synthetic data and AI-generated responses

The Israeli startup has raised $5.5M for its platform that uses “statistical AI” to generate synthetic data that it says is as good as the real thing.

19 hours ago
Fairgen ‘boosts’ survey results using synthetic data and AI-generated responses

Hydrow, the at-home rowing machine maker, announced Thursday that it has acquired a majority stake in Speede Fitness, the company behind the AI-enabled strength training machine. The rowing startup also…

Rowing startup Hydrow acquires a majority stake in Speede Fitness as their CEO steps down

Call centers are embracing automation. There’s debate as to whether that’s a good thing, but it’s happening — and quite possibly accelerating. According to research firm TechSci Research, the global…

Retell AI lets companies build ‘voice agents’ to answer phone calls

TikTok is starting to automatically label AI-generated content that was made on other platforms, the company announced on Thursday. With this change, if a creator posts content on TikTok that…

TikTok will automatically label AI-generated content created on platforms like DALL·E 3

India’s mobile payments regulator is likely to extend the deadline for imposing market share caps on the popular UPI (unified payments interface) payments rail by one to two years, sources…

India likely to delay UPI market caps in win for PhonePe-Google Pay duopoly

Line Man Wongnai, an on-demand food delivery service in Thailand, is considering an initial public offering on a Thai exchange or the U.S. in 2025.

Thai food delivery app Line Man Wongnai weighs IPO in Thailand, US in 2025

Ever wonder why conversational AI like ChatGPT says “Sorry, I can’t do that” or some other polite refusal? OpenAI is offering a limited look at the reasoning behind its own…

OpenAI offers a peek behind the curtain of its AI’s secret instructions

The federal government agency responsible for granting patents and trademarks is alerting thousands of filers whose private addresses were exposed following a second data spill in as many years. The…

US Patent and Trademark Office confirms another leak of filers’ address data

As part of an investigation into people involved in the pro-independence movement in Catalonia, the Spanish police obtained information from the encrypted services Wire and Proton, which helped the authorities…

Encrypted services Apple, Proton and Wire helped Spanish police identify activist

Match Group, the company that owns several dating apps, including Tinder and Hinge, released its first-quarter earnings report on Tuesday, which shows that Tinder’s paying user base has decreased for…

Match looks to Hinge as Tinder fails

Private social networking is making a comeback. Gratitude Plus, a startup that aims to shift social media in a more positive direction, is expanding its wellness-focused, personal reflections journal to…

Gratitude Plus makes social networking positive, private and personal

With venture totals slipping year-over-year in key markets like the United States, and concern that venture firms themselves are struggling to raise more capital, founders might be worried. After all,…

Can AI help founders fundraise more quickly and easily?