csverve

Csverve, pronounced like “swerve” with a “v”, is a package for manipulating tabular data.

• Free software: MIT license

• Documentation: https://csverve.readthedocs.io.

Features

• Take in a regular gzipped CSV file and convert it to csverve format

• Merge gzipped CSZ files

• Concatenate gzipped CSV files (handles large datasets)

• Rewrite a gzipped CSV file (delete headers etc.)

• Annotate - add a column based on provided dictionary

• Write pandas DataFrame to csverve CSV

• Read a csverve CSV

Requirements

Every gzipped CSV file must be accompanied by a meta YAML file. The meta yaml file must have the exact name as the gzipped CSV file, with the addition of a .yaml ending.

csv.gz.yaml must contain:

• column names

• dtypes for each column

• separator

• header (bool) to specify if file has header or not

Example:

columns:
 - dtype: int
   name: prediction_id
 - dtype: str
   name: chromosome_1
 - dtype: str
   name: strand_1
 header: true
 sep: "\t"

Credits

This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.