Unintended bias is a common occurrence in ML systems. And, as is often the case, a large portion of the reason Delphi's answers can become problematic can be traced back to how it was built.