What is Computer Vision?

Article by Rei Morikawa | July 02, 2019

Humans and animals use their eyes to see the world around them; computer vision is the science that aims to give the similar skill to machines. The goal in computer vision is to automate tasks that the human visual system can do, such as image acquisition and image analysis.

For example, in computer science, colors are represented by a HEX numerical value. This is how machines are programmed to understand which pixel combinations correspond to which colors. On the other hand, we humans have an inherent mutual understanding of how to distinguish between different shades of colors.

hexcolor-computervision

The image data for computer vision can come in different forms, such as video sequences, views from multiple cameras at different angles or multidimensional data from a medical scanner.

AI systems that process visual information rely on computer vision. Let’s break down the complex process of how data scientists teach a computer to “see.”

 

Bounding Boxes

In computer vision, the most common way to locate an object within an image is to use bounding boxes. These are imaginary boxes drawn on an image, shape, or text, defined by their x and y coordinates. Human annotators label the contents of bounding boxes, to help a model recognize it as a distinct type of object. The annotators can work with bounding boxes by moving, transforming, rotating, and scaling them. This way, the annotators can make sure that each image has a precise bounding box around it.

computer-vision-bounding-boxes

 

Neural Networks

Neural networks, also called neural nets, are a computer system that functions like the human brain. They create a process that tries to simulate the logical reasoning of human brains, by creating algorithms that are contingent on the outcomes of other surrounding algorithms.

Convolutional neural networks (CNN) are a type of neural network that is used for computer vision. Computers use CNN to break images down into numbers and represent them mathematically. The neural network uses convolution, which is a combination of two functions that produce a third function, to merge multiple sets of information about an image. The computer pools all of that information together to create an accurate representation of  an image. After pooling, the computer describes the image in numerical turns, so that a neural network can make a prediction about the content of that image. This is how autonomous vehicles will be able to tell apart pedestrians, traffic lights, and other cars on the road.

Over time, the neural network will become trained about the accuracy of its predictions. Computers don’t start off knowing how to classify objects, and they require a lot of training data until their predictions are accurate.

Once you’ve trained your model, it can then apply the prediction to end use cases like face recognition to unlock your smartphone, or suggesting a friend to tag on Facebook.

 

Medical Imaging

Recent progress in computer vision allows the hospital industry to make extensive use of medical imaging data to provide better diagnosis, treatment, and prediction of diseases. For example, Medivis built the SurgicalAR platform, a visualization tool that guides surgical navigation, and can decrease complications and improve patient outcomes, while lowering surgical costs. The platform already received approval from the Food and Drug Administration.

 

Autonomous Vehicles

Computer vision is the technology behind imaging for autonomous vehicles in the future. In fact, the automobile industry often refers to computer vision as “perception.” This is because cameras are the primary tools that the vehicles use to perceive their environment and surrounding objects.

 

Face Recognition

Apple recently introduced a face recognition featured called Face ID. Now, instead of typing a password or using your thumbprint, you can unlock your phone just by looking at it. Face ID uses computer vision and machine learning to adapt to changes in your expression and appearance. It can still recognize you if you gain weight, get a haircut, or put on fancy accessories. Even if you wear a scarf or grow a beard, Face ID should still learn to recognize you.

 

Why Lionbridge?

At Lionbridge, we provide custom image training data for your computer vision models. We’ll ensure that annotating image data is quick, cost-effective, and accurate. Our team of 500,000 contributors can quickly tag thousands of images in videos for your computer vision projects.

Interested? Get high-quality data now
The Author
Rei Morikawa

Rei writes content for Lionbridge’s website, blog articles, and social media. Born and raised in Tokyo, but also studied abroad in the US. A huge people person, and passionate about long-distance running, traveling, and discovering new music on Spotify.

Welcome!

Sign up to our newsletter for fresh developments from the world of training data. Lionbridge brings you interviews with industry experts, dataset collections and more.