The issue of absolute certainty about a certain knowledge or fact is traced back to traditional Aristotelian logic. His works are the oldest known official studies of knowledge that were ever found that still share a lot in common with current theory of logic. Basically, there are two basic ways a person can decide if a certain assumption is a fact or it has to remain an assumption - through deductive and inductive reasoning. Speaking about the subject of certainty in knowledge, we will mention deductive reasoning. Then we will move our focus to present-day inductive reasoning that is established on 20th century association.