Chevron Left
Volver a Distributed Computing with Spark SQL

Opiniones y comentarios de aprendices correspondientes a Distributed Computing with Spark SQL por parte de Universidad de California, Davis

4.5
estrellas
496 calificaciones

Acerca del Curso

This course is all about big data. It’s for students with SQL experience that want to take the next step on their data journey by learning distributed computing using Apache Spark. Students will gain a thorough understanding of this open-source standard for working with large datasets. Students will gain an understanding of the fundamentals of data analysis using SQL on Spark, setting the foundation for how to combine data with advanced analytics at scale and in production environments. The four modules build on one another and by the end of the course you will understand: the Spark architecture, queries within Spark, common ways to optimize Spark SQL, and how to build reliable data pipelines. The first module introduces Spark and the Databricks environment including how Spark distributes computation and Spark SQL. Module 2 covers the core concepts of Spark such as storage vs. compute, caching, partitions, and troubleshooting performance issues via the Spark UI. It also covers new features in Apache Spark 3.x such as Adaptive Query Execution. The third module focuses on Engineering Data Pipelines including connecting to databases, schemas and data types, file formats, and writing reliable data. The final module covers data lakes, data warehouses, and lakehouses. Students build production grade data pipelines by combining Spark with the open-source project Delta Lake. By the end of this course, students will hone their SQL and distributed computing skills to become more adept at advanced analysis and to set the stage for transitioning to more advanced analytics as Data Scientists....

Principales reseñas

GT

9 de jun. de 2020

I highly recommend this course for anyone in the BI and Data space interested in learning Spark. The course gives an easy to understand to the framework and applicable hands on examples.

KS

13 de may. de 2020

Amazing course that really cuts through the fundamentals of using distributed computing power to analyze and manipulate data. Well organised structure on fundamentals

Filtrar por:

76 - 100 de 124 revisiones para Distributed Computing with Spark SQL

por ANDRES F C

25 de may. de 2020

great

por Elias A C L

15 de may. de 2022

GOOD

por Julio R Y

16 de nov. de 2021

done

por Julio C R F

4 de nov. de 2021

good

por Bryan G G C

24 de oct. de 2021

good

por Erick R M A

28 de nov. de 2021

..

por PIERO D F R

30 de may. de 2022

.

por Justin M

15 de mar. de 2021

I liked how the instructors delivered material; their videos were informative and easy to follow, and they did a good job. The assignments were fine, especially the quizzes. I got a good sense of why distributed computing is useful and how to do it in spark.

I will say that the course material might be too complex for the time allotted. I think the instructors did a good job, but some of the topics were pretty advanced and likely required some knowledge that was beyond the scope of the course. Some of the assignments reflected this. In some of them, I was writing most of the code and could follow what was happening pretty easily. By the last assignment, though, I was pulling code from custom packages that the profs had written and doing regressions using equations that they wrote out for me. I think that was necessary-- going through all of this would have been too time-intensive for this course-- but if I had to write a ML model by myself, I doubt I could do it.

BUT, I definitely understand the models on a conceptual level. In this sense, the course was very successful. While I likely couldn't reproduce a lot of the code, I understand the computer science behind a lot of it. So overall, I think the course was very strong.

por Joanna M

21 de jun. de 2021

Overall a lot of knowledge and an interesting course. I was disappointed that the last part focused more on Machine Learning instead of on databases, data lakes etc. as I feel this would be more relevant to the specialization.

I did not like the assignment as they were not demanding enough. Majority of the code was written for us, it did not require us to analyze the code more to actually understand what we are doing and learn it.

por Kota M

29 de abr. de 2020

Very great introduction to the Spark SQL and databricks environment worked perfectly as a hands-on.

It would be great if the course covers the Spark ML applications. We used sklearn in the course and utilized a trained model by using the user-defined function. I wonder how it compares with the case where we use Sp ark ML for the training as well.

por Carolyn O

7 de feb. de 2021

The course was a struggle. I didn't take calculus or trigonometry. So, the square root means was a bit over my head. It was nice that the machine learning queries were already in the assignments. However, it would have been helpful to explain them better. Then I would be able to understand why they are written a specific way and how to read them.

por Hitesh G

10 de may. de 2020

Positives - Just having SQL knowledge got me to learn how the large data can be processed using SPARKSQL. I had a great time getting hands-on experience for spark SQL notebook.

Negative- I just wish the videos are too paced as there was a lot of information to cover in all the videos.

por Laura M D V

4 de ago. de 2020

It was very helpful to me.

I would improve the assignments' design. Sometimes it felt like something was missing and not very clear, at least not as it is in the real world. And I loved Brooke's way of teaching.

por Sumita P

31 de mar. de 2022

Everything was taught in a way it was easy to understand for a Layman. Practise workbook in Databricks gave lot of hands on experience. Got to learn about new concepts in easy to understand way.

por Colleen G

31 de may. de 2022

This course was more of an introduction to the DataBricks platform but did introduce important concepts of Spark. I would have liked a somewhat longer course that goes into more detail.

por Linlin L

14 de dic. de 2020

This course provides hands-on experience in using Databricks's Spark. I learned a lot. I recommend people with some SQL experience to take this course for efficient programming skills!

por Matthew W

30 de abr. de 2021

It was a quick and challenging overview, but I thought it was well presented as a basic introduction to Apache Spark

por Ashok k

13 de feb. de 2021

Good course. Maybe little more details on how Spark works, Spark architecture would make the story complete

por Виктор И

15 de jun. de 2022

Неплохое введение в распределённые вычисления с помощью Spark. Порой слишком поверхностные объяснения.

por Praneeth P

22 de may. de 2020

A good way to get started with Spark SQL. You might need some knowledge of SQL to get started with.

por Prajnita S

28 de ene. de 2021

There should have been more assignments for practicing. Overall the course was structured good!

por samuel k

30 de may. de 2022

Databricks is a great resource but in this course we only brush the top of SQL.

por Nick C

4 de oct. de 2020

Pretty good. The exercises were good. I would have liked more of them.

por Chong W K

28 de jun. de 2021

Will be better if more practise and examples of Spark SQL is given

por Snorri B A

15 de jul. de 2021

V​ery informative course that increased my knowledge of SQL