Context
As outlined in the Contributor Roadmap, DuckDB is widely used for analytical pipelines querying partitioned Parquet datasets. Providing a standalone recipe makes it easy for developers to clean and export partitioned datasets.
Task
Add a runnable example script in examples/integrations/duckdb_parquet_export.py showing how to read a partitioned Parquet dataset, clean it using FreshData, and write the cleaned result back out using DuckDB.
Acceptance Criteria
Pointers
New to the codebase? Comment here and we'll help you get set up! You can also check our First Contribution Guide.
Context
As outlined in the Contributor Roadmap, DuckDB is widely used for analytical pipelines querying partitioned Parquet datasets. Providing a standalone recipe makes it easy for developers to clean and export partitioned datasets.
Task
Add a runnable example script in
examples/integrations/duckdb_parquet_export.pyshowing how to read a partitioned Parquet dataset, clean it using FreshData, and write the cleaned result back out using DuckDB.Acceptance Criteria
examples/integrations/duckdb_parquet_export.pywith standalone, executable code.fd.clean(), and exporting back to DuckDB table or Parquet destination.pip install "freshdata-cleaner[duckdb]") in script docstring.examples/README.md.python examples/integrations/duckdb_parquet_export.py.Pointers
examples/integrations/duckdb_workflow.pyexamples/README.mdNew to the codebase? Comment here and we'll help you get set up! You can also check our First Contribution Guide.