Web Scraping with Puppeteer & Node.js: Chrome Automation

I've created a telegram bot and used puppeteer for web scaping. But where do I host it???

What script do I need to type if I want to close the pop up page that appears after clicking submit button? Or go back to previous page?

I have watched full video. Wow so amazing...

Please make more tutorial for the same

Miauuuu

so this is how openai feed their large language models?

I'm getting this error const puppeteer = require('puppeteer')

Nobody heard about curl? No? Ok, bye now…

great way of expalining things.. thanks

As it navigates to new page . We want to get every single text on the new page. How can we achieve that

This is good video. Best teacher. But can we us this technic on server side pages ND can we use this puppeteer to download a whole webpage file? If yes how can we do that?

I am offended by the lack of neighsalot

Hello, with puppeteer u can break captcha?

how do i add this to a WordPress custom post type that can take screenshots of other websites on every post type with its own different name

Really enjoy the way you teach, I did learn something every time I watched, awesome ! Now I can practice, great

This video help me so much 💯 Thank you

This is really good. I started getting into this about a year ago, and coming back to it was a blur. It's all coming back to me now.

What a great kickstarter tutorial. As someone who is using using web scraping to help me refresh my Javascript skills, this is exactly what I need to get a jump out of the gate.

A website has Form - textArea - Button --- > when i typing in textarea manually and click button --> everything is ok form posting textarea value.
But when I change textArea value with javascript like :: textArea.value = 'example value' . On screen textarea value changing successfully.
But form not posting that value which changed through javascript code. Any way to fix this ? Anyone can help me ?

Hello. Your course was the first time I was able to follow along and not hit a snag. This was so much fun. Thank you.

REALLY useful!!! Thank you so much from Buenos Aires, Argentina

Great course!

I start learning puppeteer for a whatsapp project of mine and also some refresher of JS
Since I haven't code that much anymore, but I've to say that this was a very informative tuts.
Good Job!

I'm on minute 6 and my jaw is on the floor already, this is exactly what I needed. Thank you!

Thanks!!!

Wow such a neat and clever code, I just could not resist to subscribe!

simple, clear, amazing ! Thank you for making this video

On Windows you can use the Task Scheduler

Great video! As someone with 0 development experience who wanted to archive many images, this was perfect.

Epic! Would have probably gotten stuck without the Promise.all() thanks! P.S for Windows you can use task scheduler and for more robust npm scheduling I use agenda.

dear you, could you please make a simiar video but in python Puppeteer with cron tab

page.screenshot() throws an error for me saying it is not a function
I am using node.js v17.3.1

35 minutes ran looking like 5 mins...great job explaining! thanks

When I open a URL using puppeteer it loads faster. And it uses so much RAM and CPU (in heavy scraping).
So I decided to programatically call URL using request.js library. Reading responses, saving cookies into variables, calling each link of images or whatever, one-by-one. But it is slow.

Puppeteer loads everthing in that page, things that I dont need. Whereas in manual method, I call only essential links.
Then why puppeteer is fast, and my method is slow?
Theoratically my method should be the fastest, right? Please help.

Very interesting subject and excellent teacher !

Hello, can you help me to make a robot that can see the price difference and show the decentralized exchanges?

your cats meowing in the background made me think mine were in another room 😂

Wow! this is exactly what I was looking for.
Thank you so much.

Amazing amazing tutorial!!!

Amazing video man. Thanks for sharing the knowledge!

Really love the way you teach ❤️

New favorite teacher. I actually have hated using javascript since 1998, but I have a reason to use Puppeteer. Great video!

Excellent brother, very grateful to you 💜💜💜

You are doing a wonderful job by giving Knowledge many thanks

great tutorial! How would you crawl on the website using your "Scraping Text from HTML" part? Can you do a part 2 of this that shows us how to crawl with scraping?

But how to open specific chrome profile using puppeteer?

Very very nicely done!!! 👍👍👍👍