Data
- Batch Processing
- Real-Time Processing
- OLTP
- OLAP
- Data Warehouse
- Data Mesh
- ClickHouse
- Apache Kafka
Databases
- MySQL
Data Visualization
Apache Superset: modern data exploration and data visualization platform.
Advantages
- No-code interface for building charts quickly.
- Large Gallery of Visualizations.
- Replace or augment proprietary business intelligence tools.
ETL
- Airbyte
Work
- Data Engineer: Develop & optimize data systems and make data available for analysis.
- Design, Maintain & Optimize Data Systems.
- Data Pipelines: Transform & move data between data systems. Seamless data flow.
- Data high availablity, consistency, Security, Recoverability.
- Acquire datasets that align with business needs.
- Data Analyst: Analyze data in data systems to report & derive insights.
- Reports
- Data Scientist: Perform deeper analysis on data. Develop predective models t osolve more complex data problems.
- Statistical Analysis
- Data Practitioner: Supports the data life cycle by collecting, transforming, and analyzing data, and communicating results in order to inform and guide decision-making.
