ViewTube

ViewTube
Sign inSign upSubscriptions
Filters

Upload date

Type

Duration

Sort by

Features

Reset

53 results

SS UNITECH
10. pyspark performance tuning interview questions and answers | top 5 pyspark performance killers

azure #azuredatabricks #azuredatabrickswithpyspark #azuredataengineer #ssunitech In this video, we dive deep into the most ...

10:24
10. pyspark performance tuning interview questions and answers | top 5 pyspark performance killers

2,194 views

11 months ago

SS UNITECH
5. pyspark performance tuning | partitioning and bucketing in pyspark | partitioning vs bucketing

databricks #azuredatabricks #azure #pysparkperformanceoptimization #pysparkinterviewquestions spark query plan real time ...

10:46
5. pyspark performance tuning | partitioning and bucketing in pyspark | partitioning vs bucketing

1,717 views

1 year ago

BigDatapediaAI
Salting Technique to Handle Skewed data in Apache Spark

Salting Technique to Handle Skewed data in Apache Spark Discussion Forum ----------------------------- Telegram ...

6:09
Salting Technique to Handle Skewed data in Apache Spark

7,145 views

2 years ago

SS UNITECH
6. what is data skew in pyspark | pyspark interview questions & answers | databricks interview q & a

Handle Data Skewness in Apache Spark? #Databricks #PysparkInterviewQuestions #deltalake Azure Databricks #spark #pyspark ...

6:47
6. what is data skew in pyspark | pyspark interview questions & answers | databricks interview q & a

16,973 views

1 year ago

CMU Database Group
A Deep Dive into Spark SQL's Catalyst Optimizer (Cheng Lian + Maryann Xue, DataBricks)

CMU Database Group - Quarantine Tech Talks (2020) Speaker: Cheng Lian + Maryann Xue (DataBricks) A Deep Dive into Spark ...

1:08:50
A Deep Dive into Spark SQL's Catalyst Optimizer (Cheng Lian + Maryann Xue, DataBricks)

6,068 views

5 years ago

SS UNITECH
3. pyspark performance tuning | dynamic partition pruning in apache spark

databricks #azuredatabricks #azure #pysparkperformanceoptimization #pysparkinterviewquestions spark query plan real time ...

8:10
3. pyspark performance tuning | dynamic partition pruning in apache spark

1,021 views

1 year ago

SS UNITECH
1. pyspark performance tuning | spark query plan | pyspark interview questions and answers

In this video, we dive deep into PySpark performance tuning, covering essential techniques to optimize your Spark jobs.

6:16
1. pyspark performance tuning | spark query plan | pyspark interview questions and answers

2,742 views

1 year ago

SS UNITECH
2. pyspark performance tuning | spark query plan practical | wide and narrow transformation

databricks #azuredatabricks #azure #pysparkperformanceoptimization #pysparkinterviewquestions spark query plan real time ...

12:59
2. pyspark performance tuning | spark query plan practical | wide and narrow transformation

1,218 views

1 year ago

SS UNITECH
4. pyspark performance tuning | repartitioning and coalesce in pyspark | repartition vs coalesce

databricks #azuredatabricks #azure #pysparkperformanceoptimization #pysparkinterviewquestions spark query plan real time ...

6:26
4. pyspark performance tuning | repartitioning and coalesce in pyspark | repartition vs coalesce

1,099 views

1 year ago

SS UNITECH
22. union and unionAll in PySpark | unionbyname in pyspark | pyspark tutorial for beginners

Azure Databricks #spark #pyspark #azuredatabricks #azure In this video, I discussed how to use union, unionall and ...

6:52
22. union and unionAll in PySpark | unionbyname in pyspark | pyspark tutorial for beginners

845 views

2 years ago

GKCodeLabs
Reading SparkSession from main arguments | Big Data Day to Day Work | Work as a team

In last video I have discussed about the program where you can develop big data project, and see big data use cases that include ...

23:16
Reading SparkSession from main arguments | Big Data Day to Day Work | Work as a team

1,323 views

5 years ago

Sleep Eat Azure
Run your SparkSQL 4x faster  with Native Execution Engine!!!

... SparkSQL Efficiency Apache Spark Optimization Tips Turbocharge SparkSQL with Native Engine Maximizing SparkSQL Speed ...

5:34
Run your SparkSQL 4x faster with Native Execution Engine!!!

292 views

1 year ago

Surfalytics TV
Spark UI and Query plan review project | Surfalytics

This video provides a practical guide to using Apache Spark, focusing on running Spark locally with Docker and Databricks ...

1:00:34
Spark UI and Query plan review project | Surfalytics

213 views

1 year ago

FOSDEM
Maggy: Asynchronous distributed hyperparameter optimization based on Apache Spark Asynchronous algo…

Maggy: Asynchronous distributed hyperparameter optimization based on Apache Spark Asynchronous algorithms on a ...

25:02
Maggy: Asynchronous distributed hyperparameter optimization based on Apache Spark Asynchronous algo…

628 views

5 years ago

SS UNITECH
12. how partition works internally in PySpark | partition by pyspark interview q & a | #pyspark

how partition works internally in Apache Spark? PySpark interview q & a? Databricks interview question and answers?

7:13
12. how partition works internally in PySpark | partition by pyspark interview q & a | #pyspark

6,159 views

1 year ago

Surfalytics TV
Real Interview Q&A for Senior Data Engineer #1 | Surfalytics

Gain a unique perspective on the technical and problem-solving skills expected of senior data engineers in this very little edited ...

30:26
Real Interview Q&A for Senior Data Engineer #1 | Surfalytics

19,087 views

1 year ago

Master of Machines
PySpark Interview Questions You NEED to Prep For

PySpark Interview Questions You NEED to Prep For Are you preparing for a PySpark interview? Whether you're aiming for a data ...

4:52
PySpark Interview Questions You NEED to Prep For

55 views

1 year ago

SS UNITECH
7. how to define the schema in pyspark | structtype & structfield in pyspark | Pyspark tutorial

In this video, I discussed about how to define the schema and how to create dataframe in pyspark. 1. How to define the schema in ...

7:55
7. how to define the schema in pyspark | structtype & structfield in pyspark | Pyspark tutorial

2,636 views

2 years ago

BigDatapediaAI
Apache Spark Performance Tuning | Resource Allocation with 4 Node Cluster | Hands on Demo

Apache Spark Performance Tuning | Resource Allocation with 4 Node Cluster | Hands on Example Discussion Forum ...

54:37
Apache Spark Performance Tuning | Resource Allocation with 4 Node Cluster | Hands on Demo

1,409 views

4 years ago

Roel Van de Paar
How to optimize inner join query on one large table and one small table? (2 Solutions!!)

How to optimize inner join query on one large table and one small table? Helpful? Please support me on Patreon: ...

3:14
How to optimize inner join query on one large table and one small table? (2 Solutions!!)

130 views

4 years ago

dotconferences
dotScale 2016 - Sean Owen - Scaling Learning on Apache Spark

Filmed at http://2016.dotscale.io on April 25th in Paris. More talks on http://thedotpost.com Scaling up machine learning ...

16:40
dotScale 2016 - Sean Owen - Scaling Learning on Apache Spark

350 views

9 years ago

FOSDEM
Validating Big Data Jobs An exploration with Spark & Airflow (+ friends)

by Holden Karau At: FOSDEM 2019 https://video.fosdem.org/2019/UA2.118/validating_big_data_jobs.webm If you, like close to ...

23:33
Validating Big Data Jobs An exploration with Spark & Airflow (+ friends)

497 views

6 years ago

The ASF
Storage-Partitioned Join for Apache Spark - Chao Sun, Ryan Blue

Thank you to all of of our ApacheCon@Home 2021 sponsors, including: STRATEGIC --------------- Google PLATINUM ...

39:00
Storage-Partitioned Join for Apache Spark - Chao Sun, Ryan Blue

3,280 views

4 years ago

GKCodeLabs
Async Actions in Spark | Session-8 | RDDs Concurrency

Hi Friends As promised, Today our Apache Spark Series from A-Z, begins, and here is the first video, where I have explored the ...

12:27
Async Actions in Spark | Session-8 | RDDs Concurrency

3,160 views

6 years ago

Plain Schwarz
Prashanth Babu – Simplifying upserts and deletes on Delta Lake tables

Data Engineers face many challenges with Data Lakes. GDPR requests, data quality issues, handling large metadata, merges ...

31:14
Prashanth Babu – Simplifying upserts and deletes on Delta Lake tables

182 views

4 years ago