Image features are, loosely speaking, salient points on the image. Ideally, features should be invariant to image transformations like rotation, translation and scaling. In the context of classification, features of a sample object (image) should not change upon rotation of the image, changing scale (tantamount to resolution change, or magnification) or changing acquisition angle. However, these invariances are not without a limit. Furthermore, features should be insensitive to lighting conditions and color (unless specifically required).
Well known examples of image features include corners, the SIFT, SURF, blobs, edges. Not all of them fulfill the invariances and insensitivity of ideal features. However, depending on the classification task and the expected geometry of the objects, features can be wisely selected. For example, on a PCB board, which embodies well-defined geometrical shapes, corner features might be a good starting point. Harris corners, computes the 2-d eigenvalue of the Hessian of the image (partial derivatives calculated convolving the image with Gaussian kernel) and according to their value determines a “cornerness” metric (see figure below).
Object characterization by a combination of features points and their associated descriptors is also a common practice. Because features like peaks and edges focus on one aspect of the object, whereas SURF and binary features shed light on other aspects, newly examined image, in which the object might appear in arbitrary pose, should be naturally characterized by any possible means. It is then the responsibility of the algorithm developers to make sense of the extracted features value, type and their relationship, in order to tailor a classification process.
Beyond classification, image features are used for object matching. The possibility to reduce the dimensionality of an image or signal into several salient points, which characterize the image, leads to fast object comparison algorithms. Feature-based comparison finds its applications e.g. in searching for image copyright violations in the World Wide Web.
In the past few decades, features as characterization of object have found a permanent place in the computer vision toolbox. However, off the shelf methodologies rarely perform well without pre and post-processing stages. In many features, if not in all of them, parameters need to be tuned to allow intelligent feature selection based on their induced metrics and descriptors. Whether it is for classification purposes, image retrieval, characterization or comparison, features extraction is just one part of the pipeline: an efficient holistic solution needs the work of a computer vision expert. Please refer to our computer vision outsourcing works to learn how RSIP Vision’s expertise is just the right fit for your project.