How to load data into PostgreSQL using Python | Your first ETL pipeline | Data Engineering Tutorial
What are the basics you should cover when you build an ETL pipeline?
🎬In this episode I am showing you how an ETL process would look like. We are going to load the data from Task 8 and load it into our local PostgreSQL database.
✨If you are new here:
This is a public and weekly online Python Class which you can attend as well. All you have to do is to join our Discord server if you are interested! Links down below 🙂
==== CLASS STARTS AT 4:30 ====
⏱ Timestamps
0:00 Intro & Agenda
1:00 Recap – How to start web scraping using DEV TOOLS
4:30 Example how my ETL pipeline would look like
9:30 What is a logger?
17:00 Test the database connection
27:25 How to create a database table based on your data
42:00 How to extract the .json data and load into PostgreSQL
========================
If you want to learn how to become a programmer and build automated software, this video is for you. Feel free to drop them in the comments or join our socials!
========================
🙋‍♂️Community Discord:
https://discord.gg/selfdev
https://theselfdev.com
blog.theselfdev.com
pomo.theselfdev.com
📲 Instagram:
https://instagram.com/self.devs
đź“© Connect with me:
Instagram – https://www.instagram.com/long.integer/
Twitch – https://twitch.tv/longlikeshort
Twitter – https://twitter.com/longinteger017
BGM: https://www.youtube.com/watch?v=eCXDM1-dGNY
Subscriber: 1174
#dataengineering #pythontutorial #dataanalysis
đź“šThe FASTEST way to become a Data Engineer:
https://www.youtube.com/watch?v=A513spqCGqA
đź“šKnowing this about DATA will shock you:
https://www.youtube.com/watch?v=o8yIo37R1XA&list=PLnylL1gKkCV5pb2E6Jo591One6wcW9kvy&index=4
đź“šFREE Python Programming Class:
https://www.youtube.com/watch?v=OucYXP931UA&list=PLnylL1gKkCV4ai5aDKH1GoOhtjDh7pWXf
Comments are closed.