Why is DBF data converted to Parquet before analysis?

DBF is a legacy row-based format that is slow for analytical queries. Converting to Parquet, a modern columnar format, allows DuckDB to perform queries up to 100x faster while significantly reducing storage size.

Can I perform SQL joins across different DBF files?

Yes. Once the DBF files are converted to Parquet, the skill provides DuckDB patterns to perform complex SQL joins, such as linking customer masters (ARMST) with transaction records (ARTR).

How does this skill handle Thai characters in legacy files?

The skill utilizes the roonpoo library specifically configured for TIS-620 and CP874 encodings, ensuring that Thai text in legacy DBF files is decoded correctly without corruption.

What libraries are required to use this skill?

This skill relies on roonpoo for DBF reading, pyarrow for Parquet generation, and duckdb for SQL processing. It includes setup instructions using the 'uv' package manager.

DBF Data Analysis & Conversion

Name: DBF Data Analysis & Conversion
Author: ninyawee

byninyawee

0•

Data Science & ML

Analyzes legacy Thai DBF accounting databases by converting them to Parquet for high-performance DuckDB querying.

This skill provides a comprehensive toolkit for modernizing the analysis of legacy Thai accounting systems that rely on DBF (dBase) files. It specializes in handling specific Thai encodings like TIS-620 and CP874 using the roonpoo library, solving the common problem of corrupted text in legacy data. By guiding users through a streamlined workflow—reading DBF files, converting them to the columnar Parquet format, and performing advanced SQL analytics with DuckDB—it transforms slow, fragmented legacy data into a high-performance analytical environment. It is an essential tool for financial auditors, data engineers, and developers working with older enterprise software in the Thai market.

Key Features

01Memory-efficient streaming for processing large legacy databases

02High-performance SQL analytics integration via DuckDB

03Pre-mapped schemas for common Thai accounting tables (ARMST, ARTR, GLTR)

04Efficient DBF to Parquet columnar conversion scripts

050 GitHub stars

06Specialized Thai encoding support (TIS-620/CP874)

Use Cases

01Auditing legacy Thai accounting records from DBF-based ERP systems

02Migrating dBase data to modern data lakes or Parquet-based warehouses

03Running complex SQL joins and aggregations across multiple legacy database files

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add ninyawee/armed-claude dbf-analysis

For use in Claude.ai and ChatGPT

Download Skill