Schema Details
Schema Details for schemas/abalone_schema.json
Last Modified: November 04, 2024 @ 12:20
Size in Bytes: 2,547
File Path: schemas/abalone_schema.json
File Source: local
Quality / Validation Overview:
Locate Data
- Located Schema File: schemas/abalone_schema.json
Raw Schema Data:
{
"fields": [
{
"name": "Obs",
"type": "integer",
"constraints": {
"required": true
}
},
{
"name": "Sex",
"type": "string",
"ontology": "abcd::Sex",
"constraints": {
"required": true,
"enum": [
"Male",
"Female",
"SexUnknown",
"SexNotApplicable",
"MixedSex"
]
}
},
{
"name": "Length",
"type": "number",
"constraints": {
"minimum": 0
}
},
{
"name": "Diameter",
"type": "number",
"constraints": {
"minimum": 0
}
},
{
"name": "Height",
"type": "number",
"constraints": {
"minimum": 0
}
},
{
"name": "Whole weight",
"type": "number",
"constraints": {
"minimum": 0
}
},
{
"name": "Shucked weight",
"type": "number",
"constraints": {
"minimum": 0
}
},
{
"name": "Viscera weight",
"type": "number",
"constraints": {
"minimum": 0
}
},
{
"name": "Shell weight",
"type": "number",
"constraints": {
"minimum": 0
}
},
{
"name": "Rings",
"type": "integer",
"constraints": {
"required": true,
"minimum": 1
}
},
{
"name": "Some Correlation",
"type": "string",
"constraints": {
"required": true,
"enum": [
"A",
"B",
"C"
],
"minLength": 1,
"maxLength": 1
}
},
{
"name": "No Correlation",
"type": "string",
"constraints": {
"required": true,
"enum": [
"A",
"B",
"C"
],
"minLength": 1,
"maxLength": 1
}
},
{
"name": "Is_Large",
"type": "boolean"
}
],
"missingValues": [
"NaN",
"-",
"",
" "
],
"primaryKey": "Obs"
}
Datafile Details
Data Details for data/test-crawler/test-crawler/files/abalone.csv
Last Modified: December 02, 2024 @ 14:10
Size in Bytes: 276,443
File Path: data/test-crawler/test-crawler/files/abalone.csv
File Source: s3
Quality / Validation Overview:
Locate Data
File Validation
- Schema File "schemas/abalone_schema.json" assigned to "data/test-crawler/test-crawler/files/abalone.csv"
Data Validation
- Schema schemas/abalone_schema.json applied to data/test-crawler/test-crawler/files/abalone.csv without error
Data Quality
- data/test-crawler/test-crawler/files/abalone.csv: No Quality Issues Noted
Data Details for data/test-crawler/test-crawler/files/abalone2.csv
Last Modified: December 02, 2024 @ 14:10
Size in Bytes: 259,397
File Path: data/test-crawler/test-crawler/files/abalone2.csv
File Source: s3
Quality / Validation Overview:
Locate Data
File Validation
- Schema File "schemas/abalone_schema.json" assigned to "data/test-crawler/test-crawler/files/abalone2.csv"
Data Validation
- The cell "nan" in row at position "2" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "2" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "I" in row at position "3" and field "No Correlation" at position "12" does not conform to a constraint: constraint "enum" is "['A', 'B', 'C']"
- The cell "nan" in row at position "5" and field "Whole weight" at position "6" does not conform to a constraint: constraint "minimum" is "0"
- The cell "nan" in row at position "5" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "5" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "6" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "7" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "8" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "9" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "10" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "11" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "12" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "12" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "13" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "14" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "15" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "16" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "17" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "18" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "19" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "20" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "21" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "22" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "23" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "24" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "25" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "26" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "27" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "28" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "28" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "29" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "30" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "31" and field "Whole weight" at position "6" does not conform to a constraint: constraint "minimum" is "0"
- The cell "nan" in row at position "31" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "31" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "32" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "33" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "34" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "35" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "36" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "36" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "37" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "38" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "39" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "40" and field "Whole weight" at position "6" does not conform to a constraint: constraint "minimum" is "0"
- The cell "nan" in row at position "40" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "40" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "41" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "42" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "43" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "44" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "45" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "46" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "47" and field "Whole weight" at position "6" does not conform to a constraint: constraint "minimum" is "0"
- The cell "nan" in row at position "47" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "47" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "48" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "49" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "50" and field "Whole weight" at position "6" does not conform to a constraint: constraint "minimum" is "0"
- The cell "nan" in row at position "50" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "50" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "51" and field "Whole weight" at position "6" does not conform to a constraint: constraint "minimum" is "0"
- The cell "nan" in row at position "51" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "51" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "52" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "53" and field "Whole weight" at position "6" does not conform to a constraint: constraint "minimum" is "0"
- The cell "nan" in row at position "53" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "53" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "54" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "55" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "56" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "57" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "58" and field "Whole weight" at position "6" does not conform to a constraint: constraint "minimum" is "0"
- The cell "nan" in row at position "58" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "58" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "59" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "60" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "61" and field "Whole weight" at position "6" does not conform to a constraint: constraint "minimum" is "0"
- The cell "nan" in row at position "61" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "61" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "62" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "63" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "64" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "65" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "66" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "67" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "68" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "69" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "70" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "71" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "72" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "73" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "73" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "74" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "75" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "nan" in row at position "76" and field "Whole weight" at position "6" does not conform to a constraint: constraint "minimum" is "0"
- The cell "nan" in row at position "76" and field "Shell weight" at position "9" does not conform to a constraint: constraint "minimum" is "0"
- The cell "None" in row at position "76" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
- The cell "None" in row at position "77" and field "No Correlation" at position "12" does not conform to a constraint: constraint "required" is "True"
Data Quality
- Column "No Correlation" is missing > 95% of values
- Column "Is_Large" has only one value