Deep learning software knows that a rose is a rose is a rosa rubiginosa

Next Story

What the NTSB knows about the fatal Tesla crash, so far

We can’t all be botanists, unfortunately, but most of us do have smartphones, and that may be a start. A computer vision system built by Microsoft Research Asia can identify thousands of species of flowers with nothing but a picture.

The Smart Flower Recognition System (Microsoft always did have a way with branding) began serendipitously, with the chance meeting of MSRA’s Yong Rui and botanists from the Chinese Academy of Science at a seminar. Rui’s image analysis work was a perfect match for the botanists, who were trying to figure out how to sort through millions of publicly submitted images of local flowers.

Ah, spring! When a young researcher’s fancy turns to inter-disciplinary collaboration.

The system is built on – what else? – machine learning, specifically a Caffe convolutional neural network trained in 800,000 flower images. Different species of flowers are differentiated enough that, like faces, they can be told apart by running them through a series of filters made to highlight certain features.


Certain curves, certain dark spots, certain proportions – the subtle reasoning of the neural network mirrors our own intuitive recognition of familiar shapes and colors.

“The flower-recognition engine enables domain experts to acquire plant distribution in China in an efficient way. Not only that, this engine can help ordinary people who have a strong interest in flowers to gain more knowledge.”

I asked Rui when the Smart Flower Recognition System will make its way into some kind of web service or app, like so many other experimental machine learning systems. If I hear back, you’ll be the first to know.