How Machines Learn: Direct Learning vs. Iterative Optimization
Machine learning models generally learn from data in one of two ways: Direct (Analytical) Learning or Iterative Optimization. Understanding these two approaches provides a useful big-picture view of how many machine learning algorithms are related.