Acerca de este Curso
27,900 vistas recientes

100 % en línea

Comienza de inmediato y aprende a tu propio ritmo.

Fechas límite flexibles

Restablece las fechas límite en función de tus horarios.

Nivel avanzado

Aprox. 72 horas para completar

Sugerido: 6 weeks of study, 6-8 hours/week...

Inglés (English)

Subtítulos: Inglés (English), Coreano

Habilidades que obtendrás

GraphsHiveApache HiveApache Spark

100 % en línea

Comienza de inmediato y aprende a tu propio ritmo.

Fechas límite flexibles

Restablece las fechas límite en función de tus horarios.

Nivel avanzado

Aprox. 72 horas para completar

Sugerido: 6 weeks of study, 6-8 hours/week...

Inglés (English)

Subtítulos: Inglés (English), Coreano

Los estudiantes que toman este Course son

  • Data Engineers
  • Data Scientists
  • Data Analysts
  • Technical Solutions Engineers
  • Traders

Programa - Qué aprenderás en este curso

22 minutos para completar

Welcome to the Second Course: Big Data Analysis

8 videos (Total 12 minutos), 1 lectura
8 videos
What is BigData Analysis?1m
Tools For BigData Analysis1m
Graph Data Analysis2m
Meet Alexey Dral2m
Meet Pavel Mezentsev37s
Meet Natalia Pritykovskaya40s
Meet Pavel Klemenkov40s
1 lectura
Slack Channel is the quickest way to get answers to your questions10m
3 horas para completar

Big Data SQL: Hive

15 videos (Total 105 minutos), 3 cuestionarios
15 videos
HTTP Web Service: Access Log Format4m
Business Use Cases: Solution with Hive6m
(optional) SQL: likbez10m
Hive Data Definition Language (DDL)11m
Hive Data Manipulation Language (DML)6m
Hive Analytics: RegexSerDe, Views7m
(optional) Regular Expressions, Likbez9m
Hive Analytics: UDF, UDAF, UDTF7m
Hive Streaming4m
Hive PTF (Window Functions)5m
Hive Optimization: Partitioning, Bucketing and Sampling8m
Hive Map-Side Joins: Plain, Bucket, Sort-Merge5m
Hive Optimization: Data Skew4m
Hive Optimization: Row-Columnar File Formats, Compression8m
3 ejercicios de práctica
Hive: SQL over Hadoop MapReduce20m
Hive Analytics with UDF and Streaming20m
Hive final20m
6 horas para completar

Big Data SQL: Hive (practice week)

3 videos (Total 11 minutos), 4 lecturas, 5 cuestionarios
3 videos
How to Install Docker on Windows 7, 8, 104m
How to submit your first Hadoop assignment3m
4 lecturas
Assignments. General requirements10m
Hive assignment. Intro and instructions10m
Grading System: Instructions and Common Problems10m
Docker Installation Guide10m
2 horas para completar

Spark SQL and Spark Dataframe

14 videos (Total 82 minutos), 2 cuestionarios
14 videos
What is Pandas DataFrame and how to create it4m
How to process a DataFrame as SQL4m
Working with Hive4m
Reading and Writing Files7m
RDD vs. DF vs. SQL3m
Projection and Filtering5m
User Defined Functions8m
Time Processing4m
Window Functions7m
Two-Dimensional Distributions4m
2 ejercicios de práctica
Introducing DataFrame and SQL16m
Spark SQL and Spark Dataframe18m
4 horas para completar

Graph Analysis from Big Data Perspective

13 videos (Total 83 minutos), 5 cuestionarios
13 videos
Graph representation7m
Counting common friends. Part I2m
Counting common friends. Part II10m
Counting common friends. Part III5m
GraphFrames: Introduction6m
Motif Finding: DSL6m
Motif Finding: Counting Mutual Friends6m
Motif Finding: Under The Hood. Part 114m
Motif Finding: Under The Hood. Part 24m
Triangles Count: Introduction3m
Triangles Count: Edge Lists6m
Triangles Count: GraphFrame6m
4 ejercicios de práctica
Graph Representations10m
Motif Finding18m
Triangles Count8m
Graph Analysis from Big Data Perspective20m
26 revisionesChevron Right


comenzó una nueva carrera después de completar estos cursos


consiguió un beneficio tangible en su carrera profesional gracias a este curso

Principales revisiones sobre Big Data Analysis: Hive, Spark SQL, DataFrames and GraphFrames

por SMNov 13th 2018

content of the course is remarkable and the way they explained concepts is very lucid. I just want to give suggestions please give link to the data set they are using for illustrating the concepts.

por SSFeb 3rd 2018

I wish I could give more rating than 5 :). Excellent course. Thanks so much for such an excellent course. All the instructors are great.



Pavel Klemenkov

Chief Data Scientist

Pavel Mezentsev

Senior Data Scientist
PulsePoint inc

Alexey A. Dral

Founder and Chief Executive Officer
BigData Team

Acerca de Yandex

Yandex is a technology company that builds intelligent products and services powered by machine learning. Our goal is to help consumers and businesses better navigate the online and offline world....

Acerca de Programa especializado Big Data for Data Engineers

This specialization is made for people working with data (either small or big). If you are a Data Analyst, Data Scientist, Data Engineer or Data Architect (or you want to become one) — don’t miss the opportunity to expand your knowledge and skills in the field of data engineering and data analysis on the large scale. In four concise courses you will learn the basics of Hadoop, MapReduce, Spark, methods of offline data processing for warehousing, real-time data processing and large-scale machine learning. And Capstone project for you to build and deploy your own Big Data Service (make your portfolio even more competitive). Over the course of the specialization, you will complete progressively harder programming assignments (mostly in Python). Make sure, you have some experience in it. This course will master your skills in designing solutions for common Big Data tasks: - creating batch and real-time data processing pipelines, - doing machine learning at scale, - deploying machine learning models into a production environment — and much more! Join some of best hands-on big data professionals, who know, their job inside-out, to learn the basics, as well as some tricks of the trade, from them. Special thanks to Prof. Mikhail Roytberg (APT dept., MIPT), Oleg Sukhoroslov (PhD, Senior Researcher, IITP RAS), Oleg Ivchenko (APT dept., MIPT), Pavel Akhtyamov (APT dept., MIPT), Vladimir Kuznetsov, Asya Roitberg, Eugene Baulin, Marina Sudarikova....
Big Data for Data Engineers

Preguntas Frecuentes

  • Una vez que te inscribes para obtener un Certificado, tendrás acceso a todos los videos, cuestionarios y tareas de programación (si corresponde). Las tareas calificadas por compañeros solo pueden enviarse y revisarse una vez que haya comenzado tu sesión. Si eliges explorar el curso sin comprarlo, es posible que no puedas acceder a determinadas tareas.

  • Cuando te inscribes en un curso, obtienes acceso a todos los cursos que forman parte del Programa especializado y te darán un Certificado cuando completes el trabajo. Se añadirá tu Certificado electrónico a la página Logros. Desde allí, puedes imprimir tu Certificado o añadirlo a tu perfil de LinkedIn. Si solo quieres leer y visualizar el contenido del curso, puedes auditar el curso sin costo.

¿Tienes más preguntas? Visita el Centro de Ayuda al Alumno.