Algorithm testing is concerned about understanding and comparison of software techniques to capture, process and compare biometric data. Usually, the most important algorithm tests are focused on matching techniques used for comparing biometric data.
Normally, algorithm tests do not involve humans directly. That tests are prepared with a (usually huge) set of offline enrolled data which are compared or processed in a repetitive nature. The results of algorithm tests are a set of statistical metrics computed agregating single results.
Technology testing is concerned to complete software products testing. It refers to end-to-end systems test and are designed to compare several systems under controlled conditions.
The goal of scenario testing is to determine the overall system performance in a prototype or simulated application. Testing is carried out on a complete system in an environment that models a real-world target application of interest. Each tested system will have its own acquisition sensor and so will receive slightly different data. Consequently, care will be required that data collection across all tested systems is in the same environment with the same population. Test results will be repeatable only to the extent that the modeled scenario can be carefully controlled.
Vulnerability Tests goal is analize how the biometric system can be attacked, defeated or how it can fail by its own. There are not acceptable metrics for vunerability but it is accepted that the most susceptible level of a biometric system is the sensor level.
International Biometric Group performs custom Vulnerability and Penetration Testing of biometric devices and systems. IBG evaluates resistance to spoof attacks, replay attacks, communication attacks, and other attempts to defeat or circumvent biometric systems.