Question 1

Define Big Data.

Accepted Answer

Big Data refers to vast and complex datasets that traditional data processing applications cannot handle.

Question 2

What is HDFS?

Accepted Answer

HDFS is the Hadoop Distributed File System designed to store very large files across machines in a large cluster.

Question 3

Name two NoSQL databases.

Accepted Answer

Two popular NoSQL databases are MongoDB and Apache Cassandra.

Question 4

What is a NameNode?

Accepted Answer

The NameNode is the master node in HDFS that manages the file system namespace and controls access to files by clients.

Question 5

Define RDD in Spark.

Accepted Answer

RDD (Resilient Distributed Dataset) is the fundamental data structure of Apache Spark.

Question 6

What is the purpose of YARN?

Accepted Answer

YARN (Yet Another Resource Negotiator) is Hadoop's cluster resource management system.

Question 7

State the CAP theorem.

Accepted Answer

The CAP theorem states that a distributed system can only provide two of three guarantees: Consistency, Availability, and Partition tolerance.

Question 8

What is Hive?

Accepted Answer

Apache Hive is a data warehouse software project built on top of Apache Hadoop for providing data query and analysis.

Question 9

Define Clustering in Big Data context.

Accepted Answer

Clustering is an unsupervised machine learning technique used to group similar data points together.

Question 10

What is Pig Latin?

Accepted Answer

Pig Latin is a high-level data flow scripting language used with Apache Pig to analyze large datasets.

Question 11

Explain MapReduce architecture.

Accepted Answer

MapReduce architecture involves a Master node managing jobs and Worker nodes executing Map and Reduce tasks.

Question 12

Differentiate between Relational and NoSQL databases.

Accepted Answer

Relational databases use structured schemas and SQL, while NoSQL databases handle unstructured data with flexible schemas.

Question 13

Discuss HDFS block replication strategy.

Accepted Answer

HDFS replicates each data block multiple times (default 3) across different DataNodes to ensure fault tolerance.

Question 14

Compare Pig Latin with SQL.

Accepted Answer

Pig Latin is a procedural data flow language, whereas SQL is a declarative query language.

Question 15

Explain Spark core components.

Accepted Answer

Spark Core is the underlying execution engine of Apache Spark, providing distributed task dispatching, scheduling, and basic I/O functionalities.

Question 16

Describe the Cassandra data model.

Accepted Answer

Cassandra uses a wide-column store data model optimized for fast writes and highly available distributed storage.

Question 17

How does K-Means clustering work on large datasets?

Accepted Answer

K-Means groups data into K distinct clusters by iteratively updating cluster centroids to minimize the variance within each cluster.

Question 18

Describe Hadoop architecture in detail.

Accepted Answer

Hadoop's architecture consists of HDFS for distributed storage and MapReduce/YARN for distributed processing.

Question 19

Explain YARN architecture and its components.

Accepted Answer

YARN architecture relies on a central ResourceManager, node-level NodeManagers, and per-application ApplicationMasters.

Question 20

Discuss the Apriori algorithm for market basket analysis.

Accepted Answer

The Apriori algorithm is used for mining frequent itemsets and learning association rules over transactional databases.

Question 21

Explain Hive architecture and its data types.

Accepted Answer

Hive provides an SQL-like interface over Hadoop, utilizing components like the Metastore, Driver, and Execution Engine.

Question 22

Detail the Spark architecture and RDD operations.

Accepted Answer

Spark architecture involves a Driver Program, Cluster Manager, and Worker Nodes operating on RDDs via Transformations and Actions.

Big Data Analytics