 

Comments
J.P.Brown, SuperInduction
The list of techniques that people could be using was wideranging, but the list that I am offering includes some others.
Keeping it simple, my list includes:
Statistics; Probability Scale; Classification; Neural Nets & Clementine
Bruno Delahaye, Others: Techniques using SRM
Vapnik's theory 'Structured Risk Minimisation' (SRM) allows to transform traditionnal algorithms into robust algorithms. For instance KXEN has implemented "Robust Regression" (for regression and classification) i.e SRM applied to polynomial functions.
Krzysztof Cios, hybrid methods
hybrid methods are, for example, methods which are a combination of rule machine learning algorithms and decision tree learning algorithms (like CLIP3 or CN2)