Skip to content
doubtly
Sign up
Log in to upvote 0 Log in to downvote

What is Big Data Analytics ?

Big Data and Big Data Analytics
Big Data

Big data refers to vast and diverse collections of structured, unstructured, and semi-structured data that grow rapidly over time. Traditional data management systems struggle to handle such large volumes due to their complexity in volume, velocity, and variety.

Applications of Big Data

  • Healthcare: Big data is used to analyze patient data, predict disease outcomes, and improve healthcare services.

  • Finance: Financial institutions use big data to analyze market trends, detect fraud, and make better investment decisions.

  • E-commerce: Big data is employed to analyze customer behavior, improve product recommendations, and optimize marketing strategies.

  • Transportation: Big data is used to analyze traffic patterns, predict congestion, and optimize transportation systems.

  • Energy: Big data is used to analyze energy consumption patterns, predict demand, and optimize energy production and distribution.

  • Social Media: Big data is used to analyze user behavior, detect trends, and improve social media platforms.

  • Manufacturing: Big data is used to analyze production data, detect defects, and optimize manufacturing processes.

  • Media and Entertainment Sector Media and entertainment service providing company like Netflix, Amazon Prime, Spotify do analysis on data collected from their users. Data like what type of video, music users are watching, listening most, how long users are spending on site, etc are collected and analyzed to set the next business strategy.

Big Data Analytics:

Big data analytics involves processing massive amounts of data to uncover hidden patterns, trends, and insights. It helps organizations make informed decisions by transforming raw data into valuable knowledge.

Steps Involved in Big Data Analytics:

  1. Collecting Data: Data is gathered from various sources like social media, sensors, web traffic, and customer feedback.

  2. Cleaning Data: Raw data is processed to remove duplicates, correct errors, and ensure consistency.

  3. Analyzing Data: Advanced tools and techniques are used to discover meaningful patterns and insights from the cleaned data.

Technologies and Tools in Big Data Analytics:

  • Hadoop: An open-source framework that stores and processes large datasets across clusters of commodity hardware. It uses Hadoop Distributed File System (HDFS) for storage and MapReduce for processing.

  • Spark: A fast and general-purpose cluster computing system for big data. It provides in-memory processing capabilities, making it faster than Hadoop for some applications.

  • NoSQL Databases (e.g., MongoDB): These databases are flexible and scalable, ideal for handling unstructured and semi-structured data. They are used for various applications, including real-time data management.

  • Tableau: Data visualization software that transforms data into interactive visualizations and dashboards. It helps users understand complex datasets easily.

  • Python and R: Programming languages used for statistical analysis, data manipulation, and machine learning tasks. They are popular among data scientists for building predictive models and performing data analysis.

  • Machine Learning Frameworks (e.g., TensorFlow): Tools that enable machines to learn from data and make predictions or decisions. They are crucial for tasks like recommendation systems and predictive analytics.

How Hadoop Works:

  • Distribution and Parallel Processing: Hadoop distributes data across a cluster of servers (commodity hardware) and processes it in parallel. This approach improves processing speed and reliability.

  • Components:

    • HDFS (Hadoop Distributed File System): Stores data across multiple machines without relying on centralized storage.
    • MapReduce: Processes large datasets by dividing them into smaller tasks distributed across the cluster.
    • YARN (Yet Another Resource Negotiator): Manages resources and schedules tasks across the Hadoop cluster.

  • Fault Tolerance: Hadoop is designed to handle hardware failures by replicating data across multiple nodes. This ensures data availability and reliability.

AI_11_Ajink. G. 10th Asked Updated bda big data Save WhatsApp Report
Sign in to comment

1 answer

Log in to upvote 0 Log in to downvote

Big Data Analytics is the process of collecting, storing, processing and analysing very large, fast-changing and varied data sets (big data) to find hidden patterns, trends and correlations that support better decisions.

Big data is usually described by the V's:

  • Volume: terabytes to petabytes of data.
  • Velocity: data arrives quickly, often as continuous streams (clicks, sensors, transactions).
  • Variety: structured (tables), semi-structured (JSON, XML, logs) and unstructured (text, images, video).
  • Veracity: uncertainty and noise in data quality.
  • Value: the useful insight that can be extracted.

Traditional RDBMS tools cannot store or process such data efficiently on a single machine, so big data analytics uses distributed storage and parallel processing.

Types of analytics

  1. Descriptive: what happened? (sales reports, dashboards)
  2. Diagnostic: why did it happen? (drill-down, correlation)
  3. Predictive: what is likely to happen? (machine-learning forecasts, churn prediction)
  4. Prescriptive: what should we do? (optimisation, recommendations)

Process: data collection → storage (HDFS, NoSQL such as HBase, Cassandra, MongoDB, data lakes) → processing (Hadoop MapReduce, Apache Spark, stream processing with Kafka/Flink) → analysis (Hive, Pig, Spark MLlib, data mining, ML) → visualisation (Tableau, Power BI).

Applications: healthcare (predicting disease outbreaks), banking (fraud detection), e-commerce (recommendations), transport (traffic prediction), media streaming (personalised content, as Netflix and Spotify do), social media trend analysis, and manufacturing (predictive maintenance).

Challenges: storage and processing cost, data quality, data privacy and security, integration of heterogeneous sources, and shortage of skilled people.

Tutor AI · 23 Oct 2026 AI-verified AI-generated Report
Sign in to comment

Your answer

Log in or create a free account to answer this question.