Spark Engineer
[Documentation](https://jeffallan.github.io/claude-skills/skills/data-ml/spark-engineer/)
LLM Evaluation
Evaluated by: xiaomi/mimo-v2-flash:free
Last evaluated: May 17, 2026
Prompt Preview
---
name: spark-engineer
description: Use when writing Spark jobs, debugging performance issues, or configuring cluster settings for Apache Spark applications, distributed data processing pipelines, or big data workloads. Invoke to write DataFrame transformations, optimize Spark SQL queries, implement RDD pipelines, tune shuffle operations, configure executor memory, process .parquet files, handle data partitioning, or build structured streaming analytics.
license: MIT
metadata:
author: https:...
Full prompt length: 6538 characters
Tools & Technologies
- python