What ships with the skill
The file inventory comes from the collected source at the recorded commit. Paths and sizes are structural observations, not a measure of quality.
- files
- 6
- Markdown files
- 6
- scripts
- 0
- references
- 5
- Size
- 86.1 KB
- Structural complexity
- Low
File inventory
PathTypeBytes
skills/spark-engineer/references/partitioning-caching.mdReference14.5 KB
skills/spark-engineer/references/performance-tuning.mdReference15.5 KB
skills/spark-engineer/references/rdd-operations.mdReference16 KB
skills/spark-engineer/references/spark-sql-dataframes.mdReference13.5 KB
skills/spark-engineer/references/streaming-patterns.mdReference20 KB
skills/spark-engineer/SKILL.mdInstruction6.6 KB
SKILL.md frontmatter
{
"name": "spark-engineer",
"description": "Use when writing Spark jobs, debugging performance issues, or configuring cluster settings for Apache Spark applications, distributed data processing pipelines, or big data workloads. Invoke to write DataFrame transformations, optimize Spark SQL queries, implement RDD pipelines, tune shuffle operations, configure executor memory, process .parquet files, handle data partitioning, or build structured streaming analytics.",
"license": "MIT",
"metadata": {
"author": "https://github.com/Jeffallan",
"company": "https://synergetic.solutions",
"version": "1.1.0",
"domain": "data-ml",
"triggers": "Apache Spark, PySpark, Spark SQL, distributed computing, big data, DataFrame API, RDD, Spark Streaming, structured streaming, data partitioning, Spark performance, cluster computing, data processing pipeline",
"role": "expert",
"scope": "implementation",
"output-format": "code",
"related-skills": "python-pro, sql-pro, devops-engineer"
}
}