Text Classification Using BERT & Tensorflow | Deep Learning Tutorial 47 (Tensorflow, Keras & Python)

dude you are awesome

Well Explained ..Thank you for this wonderful explanation 👏

one question: we had 747 data points for each class, so how in confusion materix values are less as 187

when running this code
return bert_encoder(preprocessor)['pooled_output']

I'm getting an error :

TypeError: Exception encountered when calling layer 'keras_layer_7' (type KerasLayer).

pruned(input_ids, input_mask, segment_ids) missing required arguments: input_ids, segment_ids.

Call arguments received by layer 'keras_layer_7' (type KerasLayer):
• inputs={'input_type_ids': 'tf.Tensor(shape=(2, 128), dtype=int32)', 'input_word_ids': 'tf.Tensor(shape=(2, 128), dtype=int32)', 'input_mask': 'tf.Tensor(shape=(2, 128), dtype=int32)'}
• training=None

ModuleNotFoundError: No module named 'tensorflow_text'

Can you do Spoiler Detection with BERT ? I have been trying for some time but I am not able to.

can we use the hidden layers(only CLS) generated from the bert model as a features , to train the tfdistilled bert for binary classification task

Thank you so much for your videos! But i have a doubt since balancing the data in multi label classification doesn't help cause words have similar meanings ,what can be done?

Sir, I need code as Classifier without sequential layers.

very interested

musk melon for Elon musk , hence 0.84 cosine similarity

Thank you so much for this video. This is very helpful for my master's project. Please the model you built in the video, is it a fine-tuning of the last layer of BERT or completely retraining all BERT layers?

HI, thank you for good video. please have talked before about Elmo?

Hello...can you please confirm if removal of stopwords,numbers,stemming etc is required in this case ?

Perfectly Expalined! Thanks a lot.

I am getting No matching distribution found for tensorflow_text==2.12 error while installing tensorflow_text using pip.Could you please help on this.Thank you

Thanks for sharing this nice well explained concept.

if my task is classification with Bert and RNN-specially BiGRU then what output of BERT I need to use ? Pooled or sequential? If I am using Pooled then I am getting error of dimension as rnn requires 3d tensor. Please help with it.

Underrated channel tbh..He needs more recognition. Thanks a lot for supporting us.

helo sir, I want to know one thing for code mixing language like hindi in english letter does Muril BERT understand this hinglish which is english letter wriiten hindi pronounciation

Oh thank god, finally someone who explains well AND covers the topic in enough depth to be useful.

Man, You are a legend!

Great video. I am facing an issue installing tensorflow_hub: cannot import name 'deserialize_keras_object' from partially initialized module 'keras.saving.legacy.serialization' . Any thoughts?

Thank you so much for your videos! You don't know how much you have helped me. I was really scared to dive into transformers but you have made it very easy to understand.

Thank you for explaining Bert model. I am not why the model is taking 2 hours for each epoch, has anyone experienced the same ?

Thanks for this nice tutorial !

Which algorithm we are using for the text classification here? Can anyone tell me please?

wonderful!! but... what if we have 3 or more categories instead of just 2? Thanks a lot

I am little bit confused; each sentence length should be 128 and each word be of 768 dimensions..

I can't find the dataset can someone help me

Thank you so much sir pls where can I find the code?

Thanks for the video, I am getting an error saying failed to covert Numpy array to Tensor.

Can you share the dataset link

Thanks for the great explanation. Really heplful

Thank you very much! You really helped me!

Sir If it is a multi class classification the where should I change the code

I knew Jeff Bezos and banana has a lot in common 🤣 Great video btw

you didnt show how to save a trained model

Thank you sir for your valuable lectures. Can you direct me to one of your content about XLNet Model?

Hi, thanks for the Vid.
Is it possible to make that code run with and AMD GPU ?

Is there a code for NLP Model without labels (i mean Unsupervised ML) ?, i am struggling to find ;)

Very useful video, thanks a lot!

Can you please show how to plot the loss graph?

please do more in-depth stuff on NLP!!

Please help,
How can I input SMOTE for oversampling in this model?

You are awesome, this is first actual slow enough and easy BERT starting video i've seen and suited me very much!

sir what if i have multilabel dataset like 6 labels

Hi sir, Thank you for this amazing video. I have followed your video and used bert model for text classification and the accuracy of my model is very low. Can you help me