toad.detector module

Command line tools for detecting csv data

Team: ESC

Examples

python detector.py -i xxx.csv -o report.csv

toad.detector.getTopValues(series, top=5, reverse=False)

Get top/bottom n values

Parameters:

• series (Series) – data series
• top (number) – number of top/bottom n values
• reverse (bool) – it will return bottom n values if True is given

Returns:

Series of top/bottom n values and percentage. [‘value:percent’, None]

Return type:

Series

toad.detector.getDescribe(series, percentiles=[0.25, 0.5, 0.75])

Get describe of series

Parameters:

• series (Series) – data series
• percentiles – the percentiles to include in the output

Returns:

the describe of data include mean, std, min, max and percentiles

Return type:

Series

toad.detector.countBlank(series, blanks=[])

Count number and percentage of blank values in series

Parameters:

• series (Series) – data series
• blanks (list) – list of blank values

Returns:

number of blanks str: the percentage of blank values

Return type:

number

toad.detector.isNumeric(series)

Check if the series’s type is numeric

Parameters:series (Series) – data series Returns:bool

toad.detector.detect(dataframe)

Detect data

Parameters:dataframe (DataFrame) – data that will be detected Returns:report of detecting Return type:DataFrame