---
esco_uri: http://data.europa.eu/esco/skill/e46291c7-52b9-4174-bd59-178884861038
esco_label: "Hadoop"
relation: optional
onet_soc: 15-2051.00
source: model-knowledge
confidence: high
qa_count: 0
generator: gemma3:27b (prompt-designed and spot-checked by Claude)
generated: 2026-07-10
---

# Hadoop — Data Scientist

For a Data Scientist, 'Hadoop' isn’t about being a Hadoop *administrator* – it's about understanding how to leverage its ecosystem for large-scale data processing and analysis. Daily tasks often involve writing Spark jobs (using Python/PySpark or Scala) that read data from HDFS, perform transformations, and output results. You might also use Hive for SQL-like querying of Hadoop datasets, or Pig for more complex data flows. Knowing *when* to use Hadoop is crucial; it's not always the right tool – smaller datasets are often better handled by in-memory solutions.  A good Data Scientist with Hadoop skills can translate analytical problems into scalable data pipelines.

## Weitere Anreicherung

Stage-2 source for future practitioner grounding: arXiv cs.LG/stat.ML (ML preprints).
