Ingest and transform data files (CSV/JSON/Parquet/Arrow IPC) into Elasticsearch with stream processing and custom transforms.
elastic-elasticsearch-file-ingest/SKILL.md
---
name: elasticsearch-file-ingest
description: >
Ingest and transform data files (CSV/JSON/Parquet/Arrow IPC) into Elasticsearch
with stream processing and custom transforms. Use when loading files or batch importing
data — not for reindexing, general ingest pipeline design, or bulk API patterns.
metadata:
author: elastic
version: 0.2.0
---
# Elasticsearch File Ingest
Stream-based ingestion and transformation of large data files (NDJSON, CSV, Parquet, Arrow IPC) into Elasticsearch.
## Features & Use Cases
- **Stream-based**: Handle large files without running out of memory
- **High throughput**: 50k+ documents/second on commodity hardware
- **Formats**: NDJSON, CSV, Parquet, Arrow IPC
- **Transformations**: Apply custom JavaScript transforms during ingestion (enrich, split, filter)
- **Batch processing**: Ingest multiple files matching a pattern (e.g., `logs/*.json`)
- **Document splitting**: Transform one source document into multiple targets
## Prerequisites… load the full skill through Skill MeIn any connected conversation, say:
Install the Elasticsearch File Ingest skill
If full content is available, it applies in this conversation and stays installed for future sessions.
Not connected yet? It takes about a minute.
Connect your AIOr add it to a project with the CLI
npx @skillme/cli add elastic-elasticsearch-file-ingestMCP endpoint
https://skillme.dev/api/mcpUse it across a team
Pin this skill in a team library and every member's AI loads this exact version until an admin updates it.
How Teams works