File Metadata for data/test-crawler/test-crawler/files/abalone2.csv
Data Details for data/test-crawler/test-crawler/files/abalone2.csv
Last Modified: December 02, 2024 @ 14:10
Size in Bytes: 259,397
File Path: data/test-crawler/test-crawler/files/abalone2.csv
File Source: s3
Quality / Validation Overview:
Locate Data
File Validation
- Schema File "schemas/abalone_schema.json" assigned to "data/test-crawler/test-crawler/files/abalone2.csv"
Data Validation
- The cell "nan" in row at position "2" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "2" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "I" in row at position "3" and field "No Correlation" at position "12" does not conform to a constraint: constraint "enum" is "['A', 'B', 'C']"
- The cell "nan" in row at position "5" and field "Whole weight" at position "6" does not conform to a constraint: constraint "minimum" is "0"
- The cell "nan" in row at position "5" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "5" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "6" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "7" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "8" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "9" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "10" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "11" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "12" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "12" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "13" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "14" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "15" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "16" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "17" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "18" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "19" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "20" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "21" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "22" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "23" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "24" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "25" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "26" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "27" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "28" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "28" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "29" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "30" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "31" and field "Whole weight" at position "6" does not conform to a constraint: constraint "minimum" is "0"
- The cell "nan" in row at position "31" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "31" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "32" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "33" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "34" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "35" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "36" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "36" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "37" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "38" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "39" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "40" and field "Whole weight" at position "6" does not conform to a constraint: constraint "minimum" is "0"
- The cell "nan" in row at position "40" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "40" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "41" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "42" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "43" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "44" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "45" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "46" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "47" and field "Whole weight" at position "6" does not conform to a constraint: constraint "minimum" is "0"
- The cell "nan" in row at position "47" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "47" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "48" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "49" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "50" and field "Whole weight" at position "6" does not conform to a constraint: constraint "minimum" is "0"
- The cell "nan" in row at position "50" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "50" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "51" and field "Whole weight" at position "6" does not conform to a constraint: constraint "minimum" is "0"
- The cell "nan" in row at position "51" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "51" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "52" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "53" and field "Whole weight" at position "6" does not conform to a constraint: constraint "minimum" is "0"
- The cell "nan" in row at position "53" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "53" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "54" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "55" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "56" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "57" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "58" and field "Whole weight" at position "6" does not conform to a constraint: constraint "minimum" is "0"
- The cell "nan" in row at position "58" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "58" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "59" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "60" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "61" and field "Whole weight" at position "6" does not conform to a constraint: constraint "minimum" is "0"
- The cell "nan" in row at position "61" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "61" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "62" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "63" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "64" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "65" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "66" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "67" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "68" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "69" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "70" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "71" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "72" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "73" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "73" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "74" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "75" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "76" and field "Whole weight" at position "6" does not conform to a constraint: constraint "minimum" is "0"
- The cell "nan" in row at position "76" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "76" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "77" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
Data Quality
- Column "No Correlation" is missing > 95% of values
- Column "Is_Large" has only one value
File Overview for data/test-crawler/test-crawler/files/abalone2.csv
Missingness
The missingness plot shows the proportion of missing values for each field in the file. Fields with a high proportion of missing values may be less useful for analysis. This plot may additionally help identify patterns in missingness across fields.
Correlations
Correlations
Field Correlation
Field Correlation
Field Correlation
Field Correlation
Field Correlation
Field Overview for data/test-crawler/test-crawler/files/abalone2.csv
Obs
Sex
Data Type: text
Average Word Length: 6.6
Standard Deviation Word Length: 2.5
Average Sentence Length: 6.6
Standard Deviation Sentence Length: 2.5
Count: 4.2e+03
Unique: 4
Percent Unique: 0.00096
Missing: 0
Percent Missing: 0
Length
Data Type: integer
Count: 4.18e+03
Mean: 0.524
Standard Deviation: 0.12
Minimum: 0
25th Percentile: 0.45
Median: 0.545
75th Percentile: 0.615
Maximum: 0
Missing: 0
Percent Missing: 0
Unique: 134
Percent Unique: 0.0321
Highest Precision: 3
Average Precision: 2.41
Lowest Precision: 1
Diameter
Data Type: integer
Count: 4.18e+03
Mean: 0.408
Standard Deviation: 0.0992
Minimum: 0
25th Percentile: 0.35
Median: 0.425
75th Percentile: 0.48
Maximum: 0
Missing: 0
Percent Missing: 0
Unique: 111
Percent Unique: 0.0266
Highest Precision: 3
Average Precision: 2.4
Lowest Precision: 1
Height
Data Type: integer
Count: 4.18e+03
Mean: 0.14
Standard Deviation: 0.0418
Minimum: 0
25th Percentile: 0.115
Median: 0.14
75th Percentile: 0.165
Maximum: 1
Missing: 0
Percent Missing: 0
Unique: 51
Percent Unique: 0.0122
Highest Precision: 3
Average Precision: 2.44
Lowest Precision: 1
Whole weight
Data Type: integer
Count: 4177
Mean: 0.8302
Standard Deviation: 0.4915
Minimum: 0
25th Percentile: 0.445
Median: 0.8023
75th Percentile: 1.153
Maximum: 2
Missing: 663
Percent Missing: 0.1587
Unique: 2218
Percent Unique: 0.6309
Highest Precision: 4
Average Precision: 2.886
Lowest Precision: 0
Shucked weight
Data Type: integer
Count: 4177
Mean: 0.3594
Standard Deviation: 0.222
Minimum: 0
25th Percentile: 0.186
Median: 0.336
75th Percentile: 0.502
Maximum: 1
Missing: 0
Percent Missing: 0
Unique: 1515
Percent Unique: 0.3627
Highest Precision: 4
Average Precision: 3.429
Lowest Precision: 1
Viscera weight
Data Type: integer
Count: 4177
Mean: 0.1851
Standard Deviation: 0.1098
Minimum: 0
25th Percentile: 0.098
Median: 0.1745
75th Percentile: 0.2595
Maximum: 0
Missing: 1000
Percent Missing: 0.2394
Unique: 850
Percent Unique: 0.2672
Highest Precision: 4
Average Precision: 2.624
Lowest Precision: 0
Shell weight
Data Type: integer
Count: 4177
Mean: 0.2401
Standard Deviation: 0.1412
Minimum: 0
25th Percentile: 0.13
Median: 0.235
75th Percentile: 0.33
Maximum: 1
Missing: 848
Percent Missing: 0.203
Unique: 857
Percent Unique: 0.2571
Highest Precision: 4
Average Precision: 2.295
Lowest Precision: 0