Detailed requirement –
Must have –

• Should be hands on in using python/spark, SQL for testing ETL/batch scripts.
• Should be hands on in analyzing and testing data, generating test reports etc.
• Should have experience in using tools such as Athena, jupyter notebooks for querying file based systems.
• Experience in AWS services such as S3, EC2

Good to have –

• exposure in databricks platform, delta tables, unity catalog concepts,
• UI testing
• Knowledge of Machine learning models and their testing their output and performance.