Sean MacKenzie Data Engineering

Feeling awesome today as we pass this milestone. Many thanks to my viewers and subscribers for all of your amazing stories and feedback. Also thanks to my supporters on Patreon who have also made such an impact on this channel. I'm looking forward to lots of great new topics as the channel grows. We'll continue our investigation into small, medium, and "big data", how to program applications for desktop and web environments, how to integrate diverse systems and transform data using pipelines, how to do automation, maps, and machine learning projects in Python, how to understand technology choice, how soft skills can impact your career, and many many more. I'm humbled and grateful to be on this journey with you! Let's get to it! #dataengineering #onemillion #datascience #python #vba #msaccess

I follow a process to achieve 3NF (or higher).

Nah, 2NF is good enough for most purposes.

I kinda just build tables for stuff I think should be split out.

I prefer to keep everything in one big table.

Huh? What is normalization?

48 votes

Just passed 5k subscribers. Lots to think about. This week, I want to give special thanks to all of you, my subscribers and viewers on this channel about data engineering. When this all started a few years ago, I didn't really know what to expect. After doing some videos and talking to some of you, I could see that there was a wide range of things I could discuss. I could see that you guys want to cover ALL sizes of data. Lots of tech to choose from. I think that's pretty cool! So, I tailored this content to be a "doorway" for all levels of user to work on small, medium, and big data. The concepts you learn here will help you to bridge between all kinds of data platforms handling data of different sizes. Oh man, and did I discover that MS Access has a dedicated following! Can I get a "hooyah!" from you MS Access data-heads?! You guys are incredible. Coming from the Python arena, we also worked with SQLite as an effective file-based database system. Many of you really responded to topics in server-based relational data too ("medium", I guess lol). These technologies provide the data foundation for most businesses around the world, and where a lot of my experience comes from. Oracle, SQL Server, and other systems tend to run heavily transaction-based systems for business, like ERP systems or MRP in manufacturing. Over the past 48 hours, "How to Add a Row Number to Your SQL Query" has been my top performer. I did that video over a year ago and wasn't sure if anyone would watch it.. ..and nobody did.. until recently! In Big Data, we've been working with Snowflake and Python which has been lots of fun, and is a good introduction and gateway for those of you working with smaller data systems. Many of you have either toyed with Python or are using it seriously, and Snowflake has awesome Python tools that give us all a path to this Big Data technology. We've also been taking a look at artificial intelligence. Just because you're running a smaller system, it doesn't mean you cannot take part in the AI revolution. Integrate AI into your Access database! Use computer vision to identify images! There are a million ways to integrate technologies of different types and make your apps smart. Guys, if you have not done so yet, please make sure to *subscribe* to the channel and like the content you watch if it works for you! This helps me so much in continuing my work. If you choose to subscribe over this holiday season, a thousand thanks! Just take a minute, click subscribe on this page, or find one of my videos later and hit Subscribe. My goal is to help you guys transform yourselves into data masters of all sizes of data. If you're just starting, learn to build a desktop database app to collect data. Learn some simple coding. Then more, and more, until one day you have this awesome toolkit that allows you to do anything you want. Apps. Data wrangling. Data cleaning. Artificial intelligence. Data science. Transactional data systems. You name it. Once you get over the "wall" in your transformation, the sky is the limit. For all of you over this holiday season, good wishes for your peace and prosperity, for you, your families, and loved ones. Have a great holiday! Sean PS: If you're curious, my top 5 for the last 28 days: 1. How to Make a Search Form with Combo Boxes in MS Access https://youtu.be/uq3cgaHF6fc 2. How to Make Interactive Maps with Python https://youtu.be/1-6ndLqsy6M 3. Getting started with the Snowflake Connector for Python https://youtu.be/i2V9HotNgvA 4. How to Add a Row Number to Your SQL Query Using row_number https://youtu.be/HYeZKS9F2b0 5. Access on Azure SQL https://youtu.be/vnlqZcgRLm8 What are you going to master in 2023?

ViewTube

Sean MacKenzie Data Engineering