Computer & Machine Vision

Our Mobile App

On-device Machine Learning

We developed a bundled mobile app that takes advantage of a number of machine vision technologies. We utilized complex algorithms from tech giants such as Google Vision, IBM Watson and Microsoft to identify individual photos. The team later expanded it to recognize and translate entire scenes. Placing all three algorithms side-by-side provided valuable insight to where each company was approaching the problem from. We learned that Watson is more oriented to nature and medicine while google was better at individual random objects. Microsoft was the most impressive in that it could recognize an entire scene.

One practical application we thought of was to utilize IBM Watson's algorithm to recognize poison ivy (we have an abundance of it behind the office so it was easy to test). The Watson API was exceptional at identifying specific plants and proved to be a valuable tool for creating this app.

The final application we implemented in this bundle was scene translation. We started by utilizing both Microsoft's vision API since our findings concluded that it had (by far) the most efficient and accurate scene recognition. We packaged in Google's translation technology and were able to recognize a scene and translate it into a language of choice within seconds. We created this application because we felt there was a practical use case for real time translation. The ability to mesh two different algorithms together proved infinitely useful for us.