Python Feature Selection: Remove Multicollinearity from Machine Learning Model in Python

Python Feature Selection: Remove Multicollinearity from Machine Learning Model in Python

Stats Wire

2 года назад

7,544 Просмотров

Ссылки и html тэги не поддерживаются


Комментарии:

@anishdeshpande395
@anishdeshpande395 - 17.10.2023 00:19

Is this method better than variance inflation factor?

Ответить
@baburamchaudhary159
@baburamchaudhary159 - 21.09.2023 22:17

I have been following you for feature selection, covered forward, backward, exhaustive, variance threshold, chi2, etc.
You have not shared the dataset, in them.
for us to follow along you, why don't you share dataset?

Ответить
@naveedullah390
@naveedullah390 - 28.04.2023 14:46

when i enter the code line =====> corrmatrix = X_train.corr()
it gives the error of =========> AttributeError: 'numpy.ndarray' object has no attribute 'corr'

Ответить
@user-ep5mg7kx5n
@user-ep5mg7kx5n - 14.03.2023 18:04

what about a scenario where the order of the columns change? since we're checking for adjacent columns and their correlations to be more than the threshold and then remove the first out of the two in case the threshold is matched or passed, if I change the order of columns, the result received will be different. is that going to a correct list of features as well?

Ответить
@d1pranjal
@d1pranjal - 26.01.2023 11:40

How are diagonal elements being handled in the user defined function correlation(df, threshold) ?

Ответить
@akiwhitesoyo918
@akiwhitesoyo918 - 15.11.2022 16:54

Nice ! Would it be the same if we use PCA to avoid multicollinearity ?

Ответить
@gisflow406
@gisflow406 - 30.10.2022 11:28

This wasn't helpful at all. You just picked one of the correlated variables randomly without additional criteria. Anyways, correlation matrix can't do much. It's much more reliable to use VIF or hierarchical clustering for feature selection.

Ответить
@michaelsagols8295
@michaelsagols8295 - 14.10.2022 12:24

Thank you for the video! very well explained! keep it up!

Ответить
@maskman9630
@maskman9630 - 27.09.2022 11:27

how to find collinearity for categorical features

Ответить
@imontesee
@imontesee - 13.09.2022 08:18

nice video, what about checking from where the high threshold is coming and comparing the correlation with the target column and only dropping the one with the less correlation

Ответить
@oomraden
@oomraden - 26.08.2022 09:54

Hi thanks for the video!
Would'nt that remove all high correlated columns instead of just leaving one column for every relationship?

Ответить
@farahamirah2091
@farahamirah2091 - 14.08.2022 10:53

hi, how to get this dataset?

Ответить
@protapmaitra5049
@protapmaitra5049 - 14.06.2022 08:00

This video was really helpful, thanks a ton.

Ответить
@jorge1869
@jorge1869 - 17.04.2022 13:53

Excellent, thank you very much.

Ответить
@mazharalamsiddiqui6904
@mazharalamsiddiqui6904 - 14.04.2022 19:51

Very nice

Ответить