View
Tube
search
Sign in
Sign up
Subscriptions
Raja's Data Engineering
Databricks | Spark: Learning Series
619,715 views
109 items
Last updated on Apr 1, 2024
public playlist
Raja's Data Engineering
41:34
01. Databricks: Spark Architecture & Internal Working Mechanism
0 views
0
Raja's Data Engineering
12:41
02. Databricks | PySpark: RDD, Dataframe and Dataset
0 views
0
Raja's Data Engineering
16:15
03. Databricks | PySpark: Transformation and Action
0 views
0
Raja's Data Engineering
11:56
04. On-Heap vs Off-Heap| Databricks | Spark | Interview Question | Performance Tuning
0 views
0
Raja's Data Engineering
15:08
05. Databricks | Pyspark: Cluster Deployment
0 views
0
Raja's Data Engineering
17:06
06. Databricks | Pyspark| Spark Reader: Read CSV File
0 views
0
Raja's Data Engineering
14:28
07. Databricks | Pyspark: Filter Condition
0 views
0
Raja's Data Engineering
12:03
08. Databricks | Pyspark: Add, Rename and Drop Columns
0 views
0
Raja's Data Engineering
14:28
09. Databricks | PySpark Join Types
0 views
0
Raja's Data Engineering
28:43
10. Databricks | Pyspark: Utility Commands - DBUtils
0 views
0
Raja's Data Engineering
15:24
11. Databricks | Pyspark: Explode Function
0 views
0
Raja's Data Engineering
13:34
12. Databricks | Pyspark: Case Function (When.Otherwise )
0 views
0
Raja's Data Engineering
10:25
13. Databricks | Pyspark: Union & UnionAll
0 views
0
Raja's Data Engineering
11:33
14. Databricks | Pyspark: Pivot & Unpivot
0 views
0
Raja's Data Engineering
9:35
15. Databricks| Spark | Pyspark | Read Json| Flatten Json
0 views
0
Raja's Data Engineering
7:24
16. Databricks | Spark | Pyspark | Bad Records Handling | Permissive;DropMalformed;FailFast
0 views
0
Raja's Data Engineering
14:43
17. Databricks & Pyspark: Azure Data Lake Storage Integration with Databricks
0 views
0
Raja's Data Engineering
12:08
18. Databricks & Pyspark: Ingest Data from Azure SQL Database
0 views
0
Raja's Data Engineering
17:04
19. Databricks & Pyspark: Real Time ETL Pipeline Azure SQL to ADLS
0 views
0
Raja's Data Engineering
9:32
20. Databricks & Pyspark: Azure Key Vault Integration
0 views
0
Raja's Data Engineering
18:12
21. Databricks| Spark Streaming
0 views
0
Raja's Data Engineering
21:11
22. Databricks| Spark | Performance Optimization | Repartition vs Coalesce
0 views
0
Raja's Data Engineering
18:56
23. Databricks | Spark | Cache vs Persist | Interview Question | Performance Tuning
0 views
0
Raja's Data Engineering
19:42
24. Databricks| Spark | Interview Questions| Catalyst Optimizer
0 views
0
Raja's Data Engineering
13:33
25. Databricks | Spark | Broadcast Variable| Interview Question | Performance Tuning
0 views
0
Raja's Data Engineering
17:14
26. Databricks | Spark | Adaptive Query Execution| Interview Question | Performance Tuning
0 views
0
Raja's Data Engineering
10:05
31. Databricks Pyspark: Handling Null - Part1
0 views
0
Raja's Data Engineering
14:17
32. Databricks| Pyspark| Handling Null Part 2
0 views
0
Raja's Data Engineering
10:08
33. Databricks | Spark | Pyspark | UDF
0 views
0
Raja's Data Engineering
15:03
34. Databricks - Spark: Data Skew Optimization
0 views
0
Raja's Data Engineering
5:52
35. Databricks & Spark: Interview Question - Shuffle Partition
0 views
0
Raja's Data Engineering
6:00
36. Databricks: Autoscaling | Optimized Autoscaling
0 views
0
Raja's Data Engineering
8:14
37. Databricks | Pyspark: Dataframe Checkpoint
0 views
0
Raja's Data Engineering
10:30
38. Databricks | Pyspark | Interview Question | Compression Methods: Snappy vs Gzip
0 views
0
Raja's Data Engineering
10:41
39. Databricks | Spark | Pyspark Functions| Split
0 views
0
Raja's Data Engineering
17:14
40. Databricks | Spark | Pyspark Functions| Arrays_zip
0 views
0
Raja's Data Engineering
5:11
41. Databricks | Spark | Pyspark Functions| Part 2 : Array_Intersect
0 views
0
Raja's Data Engineering
4:48
42. Databricks | Spark | Pyspark Functions| Part 3 : Array_Except
0 views
0
Raja's Data Engineering
4:12
43. Databricks | Spark | Pyspark Functions| Part 4 : Array_Sort
0 views
0
Raja's Data Engineering
7:24
44. Databricks | Spark | Python Functions| Join
0 views
0
Raja's Data Engineering
13:09
45. Databricks | Spark | Pyspark | PartitionBy
0 views
0
Raja's Data Engineering
5:53
46. Databricks | Spark | Pyspark | Number of Records per Partition in Dataframe
0 views
0
Raja's Data Engineering
2:59
47. Databricks | Spark | Pyspark | Null Count of Each Column in Dataframe
0 views
0
Raja's Data Engineering
9:08
48. Databricks - Pyspark: Find Top or Bottom N Rows per Group
0 views
0
Raja's Data Engineering
6:01
49. Databricks & Spark: Interview Question(Scenario Based) - How many spark jobs get created?
0 views
0
Raja's Data Engineering
6:56
50. Databricks | Pyspark: Greatest vs Least vs Max vs Min
0 views
0
Raja's Data Engineering
10:27
51. Databricks | Pyspark | Delta Lake: Introduction to Delta Lake
0 views
0
Raja's Data Engineering
30:13
52. Databricks| Pyspark| Delta Lake Architecture: Internal Working Mechanism
0 views
0
Raja's Data Engineering
7:53
53. Databricks| Pyspark| Delta Lake: Solution Architecture
0 views
0
Raja's Data Engineering
11:56
54. Databricks | Delta Lake| Pyspark: Create Delta Table Using Various Methods
0 views
0
Raja's Data Engineering
11:29
55. Databricks| Pyspark| Delta Lake: Delta Table Instance
0 views
0
Raja's Data Engineering
10:47
56. Databricks| Pyspark | Delta Lake: Different Approaches to Insert Data Into Delta Table
0 views
0
Raja's Data Engineering
8:44
57. Databricks| Pyspark| Delta Lake: Different Approaches to Delete Data from Delta Table
0 views
0
Raja's Data Engineering
7:49
58. Databricks | Pyspark | Delta Lake : Update Delta Table
0 views
0
Raja's Data Engineering
11:30
59. Databricks Pyspark:Slowly Changing Dimension|SCD Type1| Merge using Pyspark and Spark SQL
0 views
0
Raja's Data Engineering
17:12
60. Databricks & Pyspark: Delta Lake Audit Log Table with Operation Metrics
0 views
0
Raja's Data Engineering
20:03
61. Databricks | Pyspark | Delta Lake : Slowly Changing Dimension (SCD Type2)
0 views
0
Raja's Data Engineering
8:47
62. Databricks | Pyspark | Delta Lake: Time Travel
0 views
0
Raja's Data Engineering
7:28
63. Databricks | Pyspark| Delta Lake: Restore Command
0 views
0
Raja's Data Engineering
13:16
64. Databricks | Pyspark | Delta Lake: Optimize Command - File Compaction
0 views
0
Raja's Data Engineering
15:32
65. Databricks | Pyspark | Delta Lake: Vacuum Command
0 views
0
Raja's Data Engineering
14:16
66. Databricks | Pyspark | Delta: Z-Order Command
0 views
0
Raja's Data Engineering
7:53
67. Databricks | Pypark | Delta: Schema Evolution - MergeSchema
0 views
0
Raja's Data Engineering
8:09
68. Databricks | Pyspark | Dataframe InsertInto Delta Table
0 views
0
Raja's Data Engineering
7:02
69. Databricks | Spark | Pyspark | Data Skewness| Interview Question: SPARK_PARTITION_ID
0 views
0
Raja's Data Engineering
10:47
70. Databricks| Pyspark| Input_File_Name: Identify Input File Name of Corrupt Record
0 views
0
Raja's Data Engineering
15:04
71. Databricks | Pyspark | Window Functions: Lead and Lag
0 views
0
Raja's Data Engineering
27:27
72. Databricks | Pyspark | Interview Question: Explain Plan
0 views
0
Raja's Data Engineering
6:45
73. Databricks | Pyspark | UDF to Check if Folder Exists
0 views
0
Raja's Data Engineering
16:46
74. Databricks | Pyspark | Interview Question: Sort-Merge Join (SMJ)
0 views
0
Raja's Data Engineering
22:03
75. Databricks | Pyspark | Performance Optimization - Bucketing
0 views
0
Raja's Data Engineering
8:27
76. Databricks|Pyspark:Interview Question|Scenario Based|Max Over () Get Max value of Duplicate Data
0 views
0
Raja's Data Engineering
8:34
77. Databricks | Pyspark | Create_map(): Convert Dataframe Columns to Dictionary (Map Type)
0 views
0
Raja's Data Engineering
7:47
78. Databricks | Pyspark | Performance Optimization: Delta Cache
0 views
0
Raja's Data Engineering
9:56
79. Databricks | Pyspark | Split Array Elements into Separate Columns
0 views
0
Raja's Data Engineering
12:09
80. Databricks | Pyspark | Tips: Write Dataframe into Single File with Specific File Name
0 views
0
Raja's Data Engineering
8:52
81. Databricks | Pyspark | Workspace Object Access Control
0 views
0
Raja's Data Engineering
19:12
82. Databricks | Pyspark | Databricks Secret Scopes: Azure Key Vault Backed Secrets
0 views
0
Raja's Data Engineering
17:17
83. Databricks | Pyspark | Databricks Workflows: Job Scheduling
0 views
0
Raja's Data Engineering
13:23
84. Databricks | Pyspark | Azure Data Factory + Azure Databricks: Execute Notebook Via ADF
0 views
0
Raja's Data Engineering
10:27
85. Databricks | Pyspark | Notebook Activity in Azure Data Factory with Input Parameter
0 views
0
Raja's Data Engineering
8:35
86. Databricks | Pyspark | Notebook Activity in Azure Data Factory with Output Parameter
0 views
0
Raja's Data Engineering
22:01
87. Databricks | Pyspark | Real Time Project: ETL Pipeline Integrating ADF, ASQL, ADLS, Key Vault
0 views
0
Raja's Data Engineering
13:11
88. Databricks |Pyspark |Notebook Scheduling through Schedule Based Trigger using Azure Data Factory
0 views
0
Raja's Data Engineering
15:35
89. Databricks | Pyspark | Notebook Scheduling through Event Based Trigger using Azure Data Factory
0 views
0
Raja's Data Engineering
10:13
90. Databricks | Pyspark | Interview Question: Read Excel File with Multiple Sheets
0 views
0
Raja's Data Engineering
11:41
91. Databricks | Pyspark | Interview Question |Handlining Duplicate Data: DropDuplicates vs Distinct
0 views
0
Raja's Data Engineering
11:33
92. Databricks | Pyspark | Interview Question | Performance Optimization: Select vs WithColumn
0 views
0
Raja's Data Engineering
15:40
93. Databricks | Pyspark | Interview Question | Schema Definition: Struct Type vs Struct Field
0 views
0
Raja's Data Engineering
13:22
94. Databricks | Pyspark | Interview Question | Schema Definition: Struct Type vs Map Type
0 views
0
Raja's Data Engineering
15:32
95. Databricks | Pyspark | Schema | Different Methods of Schema Definition
0 views
0
Raja's Data Engineering
12:34
96. Databricks | Pyspark | Real Time Scenario | Schema Comparison
0 views
0
Raja's Data Engineering
11:48
97. Databricks | Pyspark | Data Security: Enforcing Column Level Encryption
0 views
0
Raja's Data Engineering
9:09
98. Databricks | Pyspark | Interview Question: Pyspark VS Pandas
0 views
0
Raja's Data Engineering
13:52
99. Databricks | Pyspark | Real Time Use Case: Generate Test Data - Array_Repeat()
0 views
0
Raja's Data Engineering
55:50
100. Databricks | Pyspark | Spark Architecture: Internals of Partition Creation Demystified
0 views
0
Raja's Data Engineering
14:06
106.Databricks|Pyspark|Automation|Real Time Project:DataType Issue When Writing to Azure Synapse/SQL
0 views
0
Raja's Data Engineering
8:37
107. Databricks | Pyspark| Transformation: Subtract vs ExceptAll
0 views
0
Raja's Data Engineering
12:27
108. Databricks | Pyspark| Window Function: First and Last
0 views
0
Raja's Data Engineering
6:31
112. Databricks | Pyspark| Spark Reader: Skip First N Records While Reading CSV File
0 views
0
