ERNIE-Image LoRA Training Tools Compared: OneTrainer vs AI Toolkit vs fal.ai vs RunComfy
Three months after ERNIE-Image's open-source release, the community LoRA training ecosystem is surprisingly mature — but with four competing tools, choosing the right one is the real challenge. OneTrainer runs on just 8GB VRAM, AI Toolkit has Day-0 support, fal.ai requires zero local GPU, and RunComfy does everything in your browser. This comparison helps you find the right path.
ERNIE-Image's strength goes beyond its 8B DiT architecture and out-of-the-box text-to-image quality. The community LoRA training ecosystem that has grown around it in just three months is equally impressive. Since the April 15 open-source release, four mainstream training tools have added support, each with very different approaches and use cases.
Why Train an ERNIE-Image LoRA?
Before comparing tools, the fundamental question: why do you need a LoRA?
While ERNIE-Image's base model produces high-quality images, its knowledge of specific people, styles, or objects is limited. LoRA (Low-Rank Adaptation) lets you teach the model to generate specific content using just 10-50 training images — without modifying the base model at all.
ERNIE-Image LoRA training is especially suited for:
- Character consistency: Same face across different scenes and angles
- Brand identity: Logos, product appearances, and color schemes
- Artistic styles: Specific painting techniques and color palettes
- Product design: From sketches to refined product renders
Tool Overview
| Feature | OneTrainer | Ostris AI Toolkit | fal.ai Trainer | RunComfy |
|---|---|---|---|---|
| Deployment | Local | Local | Cloud API | Cloud Browser |
| Min VRAM | 8GB | 12GB | None needed | None needed |
| Speed | Moderate | Fast (BF16) | Fast (H100) | Fast (Cloud GPU) |
| Cost | Free | Free | $1.2/1000 steps | Subscription |
| Open Source | ✅ | ✅ | ❌ | ❌ |
| Auto-captioning | ❌ (external) | ✅ (Qwen 3VL) | ✅ (built-in) | ✅ (built-in) |
| ERNIE-Image support | Community (Issue #8) | Day-0 official | Official | AI Toolkit based |
| Custom datasets | ✅ | ✅ | ✅ | ✅ |
| Learning curve | Steep | Moderate | Gentle | Gentlest |
OneTrainer: Ultra-Low VRAM Local Option
OneTrainer's ERNIE-Image support comes from community contribution (GitHub Issue #8). Its killer feature: as little as 8GB VRAM.
This means even a GTX 1080 Ti (11GB) or RTX 3060 (12GB) can handle LoRA training.
Typical settings:
- Rank: 16-32
- Optimizer: AdamW
- Precision: FP16
- Steps: 2000-3000
- Learning rate: 1e-4
Best for: Users with entry-level NVIDIA GPUs who want full control over training parameters and don't mind a steeper setup process.
Caveats: Environment setup can take 30-60 minutes. No auto-captioning — you'll need BLIP or WD14 Tagger separately.
Ostris AI Toolkit: The Community Standard for Local Training
AI Toolkit offered Day-0 support for ERNIE-Image from the very first day of release. It has become the most widely used local training tool in the community.
Community-validated settings:
| Parameter | Recommended | Notes |
|---|---|---|
| Rank | 32-128 | Higher = more detail learned, but larger file size and overfitting risk |
| Steps | 3000-4000 | 3000 sufficient for character LoRAs, 4000+ for style LoRAs |
| Precision | BF16 | More stable than FP16, officially recommended for ERNIE-Image |
| Optimizer | AdamW8Bit | More memory efficient, works on 12GB cards |
| Learning rate | 1e-4 | Consistent with SDXL LoRA best practices |
| Preview res | 1024×1024 | Sample images every 500 steps during training |
AI Toolkit's unique advantages:
- Auto-captioning: Integrated Qwen 3VL generates high-quality image descriptions
- Training previews: Sample images auto-generated at configurable intervals
- Multi-model support: Works with FLUX, SDXL, Z-Image, and more
Best for: Users with 12GB+ VRAM GPUs who want the most mature community solution.
fal.ai ERNIE-Image Trainer: Zero GPU Cloud Solution
fal.ai offers fully managed LoRA training as a service. No local GPU, no environment setup — upload your dataset, click train, download the LoRA.
Pricing: $1.2/1000 steps. A typical 3000-step run costs about $3.6.
Workflow:
- Log into fal.ai console
- Select the ERNIE-Image Trainer
- Upload training images (10-30 recommended)
- Set trigger word and parameters
- Start training on H100 GPUs
- Download the LoRA
.safetensorsfile
Best for: Users without local GPUs who need rapid iteration and don't mind pay-per-use pricing.
RunComfy: Zero-Configuration Browser Training
RunComfy wraps AI Toolkit in a cloud-based browser interface. No installation required — everything runs in your browser.
Default configuration:
- Rank: 32
- Precision: BF16 + float8
- Optimizer: AdamW8Bit
- Steps: 3000
- Timestep: Weighted/Balanced
- Preview: Every 500 steps, guidance 4.0, 30 inference steps
These defaults have been validated by the community and work well for most scenarios.
Best for: Users who want zero configuration and a complete browser-based experience.
Dataset Best Practices (Tool-Agnostic)
No matter which tool you choose, dataset quality determines LoRA quality.
Image Count
- Character LoRA: 15-30 images covering front, side, and different expressions
- Style LoRA: 20-40 images representing the style's typical output
- Object LoRA: 10-20 images from different angles and lighting conditions
Image Requirements
- 512×512 or 1024×1024 resolution
- Subject occupies the main area of the frame
- Clean or consistent backgrounds preferred
- Avoid excessive occlusion
Captioning Best Practice
ERNIE-Image's Prompt Enhancer automatically enriches descriptions, but training caption quality still directly affects results:
good: "a portrait of Jane Smith, brown hair, blue eyes, wearing a white shirt, professional headshot"
bad: "a person"
AI Toolkit's Qwen 3VL auto-captioning excels here, producing near-human-quality descriptions.
Post-Training Workflow
Regardless of which tool you use, the output LoRA (.safetensors) goes into ComfyUI's models/loras directory.
Loading ERNIE-Image LoRA in ComfyUI:
- Load the ERNIE-Image model
- Add a LoRA loader node, select your trained LoRA
- Set LoRA weight (typically 0.6-1.0)
- Include your trigger word in the prompt
Decision Guide
| Your Situation | Recommended Tool | Why |
|---|---|---|
| 8-12GB GPU | OneTrainer | Lowest VRAM requirement |
| 12-24GB GPU | AI Toolkit | Most mature community solution |
| No local GPU, pay-per-use | fal.ai Trainer | H100 speed, no setup |
| No local GPU, subscription | RunComfy | One-click browser experience |
| Maximum flexibility | AI Toolkit | Broadest parameter range |
Summary
In just three months, the ERNIE-Image LoRA training ecosystem has grown from zero to four mature tools. OneTrainer serves users with limited VRAM, AI Toolkit is the community mainstream, and fal.ai with RunComfy open the door for users without local GPUs.
Whichever path you choose, the core principle remains: data quality determines LoRA quality. Investing time in curating 20-30 high-quality training images will pay off more than endlessly tweaking training parameters.