User Tools

Site Tools


big_data

This is an old revision of the document!


About Big Data

Usually defined by three elements:

  1. Volume
  2. Velocity (speed)
  3. Variety

Proper organization and use of them is as much important as having them.

Organizations

  • Relational Data Model: RDBMS (Relational Database Management System), mainly implemently by SQL (Structured Query Language).
  • Entity-Relationship Data Model (ER): . . . It added additional abstraction to increase the usability of the data. In the model, each item was defined independently of its use. Therefore, developers could create new relationships between data sources without complex programming 1).
  • Data warehouse in 90s
  • Beginning of unstructured data use – BLOBs (Binary Large Objects)
  • Object Database Management System (ODBMS).

The above has shown Structured → Unstructured data. Therefore, building, organizing, integrating, analyzing, and deciding (utilizing the data) become extremely important.

  • COIAA – Capture, Organize, Integrate, Analyze, Act

Capture

  • Setting architectural foundation

 Big Data Architecture

  • Computer-generated or Machine-generated Data
  • Human-generated Data
  • Hybrid Data . . . .
  • Sensor data . . . . RFID tags, Smart meters, medical devices, GPS data, etc.
  • Web log data . . . Google analytics,
  • Point-of-sale data . . . Cashiers' swipes . . . .
  • Financial data
1)
Big Data For Dummies, 2013
big_data.1406098598.txt.gz · Last modified: 2014/07/23 15:56 by hkimscil

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki