AI Data Engineer
Zenteiq.Ai · Bengaluru, India
About the role
Build scalable data pipelines to source, process, and prepare large-scale corpora for training and evaluating foundation models.
Skills
- Python
- Apache Spark
- Ray
- Dask
- Trafilatura
- GCS/GCP
- JSONL
- Parquet
- Arrow
- HTML parsing