Hello, welcome to ID3 decision tree algorithm’s overview lecture Suppose that this is a data set that we are going to work on There are three different features in this dataset and one decision class. These are features, and class is the target value target value. there are, as seen, 14 instances and the decision […]

# Tag: entropy

## The Math Behind C4.5 Decision Tree Algorithm

Hello, welcome to C4.5 decision tree algorithm’s overview video. actually, it is very similar to ID3 algorithm. You might remember that we have calculated entropy and information gain for features … in ID3. Here, … We are going to calculate additional metrics. In this way, we can normalize … the calculations of C4.5. This additional […]

## How decision trees algorithm works

Hi, I will explain how the Decision trees algorithm works on supervised classification to create thresholds and how to find the best features for divide How to build a decision tree? Suppose that a set of samples of different patterns, and a decision tree aims to refine into single subsamples, or single pattern subsamples. Suppose […]

## Scientists Claim They Made Time Go Backwards…But Did They?

Time travel to the past is basically impossible without breaking some laws of physics and acquiring plutonium from some Libyans. But time travel to the future is easy, we’re all doing it right now. So why does time go forward and not back? The idea that time only flows in one direction is called the […]

## [Machine Learning] Decision Tree – ID3 algorithm (entropy + Information Gain)

hi, when we build a decision tree we need to select one attribute and split the given data there are several ways to select an attribute and split the data set one of popular algorithm is the ID3 algorithm and the ID3 algorithm uses entropy and information gain concepts what is entropy so the entropy […]

## Information Theory part 13: Data Compression via Huffman Coding

When we represent information, such as an image, digitally, it means we must slice it up into tiny chunks. This allows us to send an image as a sequence of color symbols. And these colors can be represented as unique numbers using some code. Consider the following challenge. Alice and Bob can transmit and receive […]